2024-09-12T16:38:34.462 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T16:38:34.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:38:34.569 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685 branch: wip-rgw-meta-handlers description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7902685' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHQWQJanbhTTpeoPAVZb29awoEd0JTgZif1Bo2508vq9AATI1yC4pht1RYd06WSZ4GAJHnJNjn/pevGY/aM1z8E= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJt5h+gP9zPSmgK8IbUyDdqQLs+768H4AlaJNAxynbNpYEvXCAhmV/tvPob+3NVAUHohICHS7cpFfgbAahn2ODw= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T16:38:34.570 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T16:38:34.570 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T16:38:34.570 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T16:38:34.572 INFO:teuthology.task.internal:Checking packages... 2024-09-12T16:38:34.593 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T16:38:34.593 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T16:38:34.593 INFO:teuthology.packaging:ref: None 2024-09-12T16:38:34.593 INFO:teuthology.packaging:tag: None 2024-09-12T16:38:34.593 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T16:38:34.593 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:38:34.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T16:38:34.745 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:38:34.746 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T16:38:34.753 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T16:38:34.753 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T16:38:34.806 INFO:teuthology.task.internal:Saving configuration 2024-09-12T16:38:34.821 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T16:38:34.860 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T16:38:34.884 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:32:51.744018', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIcednCQLsWY6xJr3fwFMkq3h+h1QxFfiLw8Pwjjc0tM'} 2024-09-12T16:38:34.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:32:51.745420', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDELPBpAqyCChgMF+C9gPk0UibABHAiojQSTzNE4SRjp'} 2024-09-12T16:38:34.905 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T16:38:34.911 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-12T16:38:34.911 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-12T16:38:34.911 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T16:38:34.994 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f950ae87ac0>, signals=[15]) 2024-09-12T16:38:34.994 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T16:38:35.045 INFO:teuthology.task.internal:Opening connections... 2024-09-12T16:38:35.046 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-09-12T16:38:35.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:38:35.121 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:38:35.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:38:35.198 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T16:38:35.204 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-09-12T16:38:35.210 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-09-12T16:38:35.210 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-09-12T16:38:35.257 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:38:35.257 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu" 2024-09-12T16:38:35.257 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="22.04" 2024-09-12T16:38:35.257 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:38:35.257 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=jammy 2024-09-12T16:38:35.258 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu 2024-09-12T16:38:35.258 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian 2024-09-12T16:38:35.258 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:38:35.258 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:38:35.258 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:38:35.258 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:38:35.258 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:38:35.259 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-09-12T16:38:35.280 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-09-12T16:38:35.285 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-09-12T16:38:35.286 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-09-12T16:38:35.332 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:38:35.332 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:38:35.333 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:38:35.333 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-09-12T16:38:35.355 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T16:38:35.363 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T16:38:35.443 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T16:38:35.443 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:38:35.446 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:38:35.450 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T16:38:35.486 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T16:38:35.486 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:38:35.495 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:38:35.510 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T16:38:35.575 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T16:38:35.588 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T16:38:35.588 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T16:38:35.588 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:38:35.589 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:38:35.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:38:35.594 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-12T16:38:35.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:38:35.595 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-12T16:38:35.641 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-56-generic 2024-09-12T16:38:35.641 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.15.0-56-generic 2024-09-12T16:38:35.641 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-12T16:38:35.642 INFO:teuthology.orchestra.run.smithi122.stdout:5.15.0-56-generic 2024-09-12T16:38:35.643 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.15.0-56-generic 2024-09-12T16:38:35.643 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get clean 2024-09-12T16:38:35.765 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-12T16:38:35.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-09-12T16:38:35.943 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:38:35.944 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:38:35.944 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:38:35.944 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:38:36.017 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:38:36.045 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:38:36.132 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:38:36.149 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:38:36.185 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:38:36.254 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:38:36.260 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:38:36.265 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:38:36.268 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:38:36.268 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:38:36.269 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:38:36.285 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:38:36.289 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:38:36.289 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:38:36.291 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:38:36.291 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:38:36.291 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:38:36.294 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:38:36.294 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:38:36.299 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:38:36.307 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:38:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:38:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:38:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:38:36.309 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:38:36.312 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:38:36.314 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:38:36.314 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:38:36.320 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:38:36.324 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:38:36.326 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:38:36.326 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:38:36.339 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:38:36.358 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:38:36.358 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:38:36.358 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:38:36.358 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:38:36.362 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:38:36.365 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:38:36.365 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:38:36.365 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:38:36.383 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:38:36.385 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:38:36.385 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:38:36.393 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:38:36.401 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:38:36.402 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:38:36.403 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:38:36.403 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:38:36.428 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:38:36.428 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:38:36.428 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:38:36.428 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:38:36.429 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:38:36.432 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:38:36.433 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:38:36.433 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:38:36.449 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:38:36.450 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:38:36.482 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:38:36.621 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:38:36.814 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:38:36.972 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:38:36.986 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:38:36.987 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:38:36.988 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:38:37.057 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:38:37.072 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:38:37.072 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:38:37.093 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:38:37.123 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:38:37.129 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:38:37.137 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:38:37.137 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:38:37.139 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:38:37.211 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:38:37.212 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:38:37.213 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:38:37.214 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:38:37.215 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:38:37.218 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:38:37.219 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:38:37.300 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:38:37.300 INFO:teuthology.orchestra.run.smithi122.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:38:42.671 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 15.8 MB in 2s (7,424 kB/s) 2024-09-12T16:38:42.815 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 15.8 MB in 2s (7,079 kB/s) 2024-09-12T16:38:44.061 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-12T16:38:44.079 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:38:44.132 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-12T16:38:44.317 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-09-12T16:38:44.317 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-09-12T16:38:44.354 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T16:38:44.371 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:38:44.424 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T16:38:44.485 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:38:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:38:44.485 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:38:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:38:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:38:44.486 INFO:teuthology.orchestra.run.smithi122.stdout: python2.7-minimal 2024-09-12T16:38:44.486 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:38:44.487 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-09-12T16:38:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:38:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:38:44.487 INFO:teuthology.orchestra.run.smithi122.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:38:44.489 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-09-12T16:38:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:38:44.489 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-09-12T16:38:44.489 INFO:teuthology.orchestra.run.smithi122.stdout: thermald 2024-09-12T16:38:44.540 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-09-12T16:38:44.541 INFO:teuthology.orchestra.run.smithi122.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:38:44.541 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:38:44.541 INFO:teuthology.orchestra.run.smithi122.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:38:44.542 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-09-12T16:38:44.542 INFO:teuthology.orchestra.run.smithi122.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:38:44.609 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-12T16:38:44.610 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-12T16:38:44.725 INFO:teuthology.orchestra.run.smithi122.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:38:44.726 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 113 MB of archives. 2024-09-12T16:38:44.726 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:38:44.726 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:38:44.779 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:38:44.779 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:38:44.779 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:38:44.780 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:38:44.780 INFO:teuthology.orchestra.run.smithi151.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:38:44.780 INFO:teuthology.orchestra.run.smithi151.stdout: python2.7-minimal 2024-09-12T16:38:44.780 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:38:44.781 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-12T16:38:44.781 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:38:44.781 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:38:44.781 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:38:44.783 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-12T16:38:44.783 INFO:teuthology.orchestra.run.smithi151.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:38:44.783 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-12T16:38:44.783 INFO:teuthology.orchestra.run.smithi151.stdout: thermald 2024-09-12T16:38:44.846 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-12T16:38:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:38:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:38:44.846 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:38:44.847 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-09-12T16:38:44.848 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:38:45.026 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:38:45.026 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 113 MB of archives. 2024-09-12T16:38:45.026 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:38:45.026 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:38:46.097 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:38:46.442 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:38:46.496 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:38:46.791 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:38:48.660 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:38:48.660 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:38:48.660 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:38:48.957 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:38:48.957 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:38:48.957 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:38:49.006 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:38:49.083 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:38:49.293 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:38:49.374 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:38:49.466 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 113 MB in 5s (25.0 MB/s) 2024-09-12T16:38:49.650 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:38:49.768 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 113 MB in 5s (25.1 MB/s) 2024-09-12T16:38:49.987 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:38:51.686 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:38:51.692 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:38:51.798 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:38:52.043 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:38:52.048 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:38:52.242 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:38:54.217 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:38:54.238 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:38:54.334 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:38:54.803 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:38:54.824 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:38:54.835 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:38:54.853 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:38:54.856 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:38:54.963 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:38:55.405 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:38:55.425 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:38:55.488 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:01.637 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:39:01.748 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:39:02.080 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:39:02.201 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:39:02.521 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:39:02.543 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:39:02.587 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:39:02.641 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:39:02.773 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:39:03.157 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:39:03.285 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:39:03.602 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:39:03.624 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:39:03.663 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:39:08.409 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:39:08.446 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:39:08.476 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:09.948 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:39:09.985 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:39:10.022 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:11.229 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:39:11.363 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:39:12.588 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:39:12.710 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:12.836 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:39:12.965 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:14.017 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:39:14.159 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:39:14.307 INFO:teuthology.orchestra.run.smithi122.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:39:14.307 INFO:teuthology.orchestra.run.smithi122.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:39:14.307 INFO:teuthology.orchestra.run.smithi122.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:39:14.307 INFO:teuthology.orchestra.run.smithi122.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:39:14.450 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:14.517 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:39:14.655 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:14.781 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:39:14.935 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:15.835 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:16.276 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:39:16.277 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:39:16.277 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:39:16.277 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:39:16.420 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:17.212 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:39:17.329 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:39:17.439 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:17.505 INFO:teuthology.orchestra.run.smithi122.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:39:17.505 INFO:teuthology.orchestra.run.smithi122.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:39:18.338 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:39:19.910 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:39:20.058 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:39:20.135 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:39:20.135 INFO:teuthology.orchestra.run.smithi151.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:39:32.161 INFO:teuthology.orchestra.run.smithi122.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:39:32.161 INFO:teuthology.orchestra.run.smithi122.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:39:32.169 INFO:teuthology.orchestra.run.smithi122.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:39:32.192 INFO:teuthology.orchestra.run.smithi122.stdout:Generating grub configuration file ... 2024-09-12T16:39:32.481 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:39:32.510 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:39:32.822 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:39:32.828 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:39:32.899 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:39:32.905 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:39:33.064 INFO:teuthology.orchestra.run.smithi122.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:39:33.064 INFO:teuthology.orchestra.run.smithi122.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:39:33.064 INFO:teuthology.orchestra.run.smithi122.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:39:33.106 INFO:teuthology.orchestra.run.smithi122.stdout:done 2024-09-12T16:39:33.619 DEBUG:teuthology.orchestra.run.smithi122:> dpkg -s linux-image-generic 2024-09-12T16:39:33.638 INFO:teuthology.orchestra.run.smithi122.stdout:Package: linux-image-generic 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Status: install ok installed 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Priority: optional 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Section: kernel 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Installed-Size: 21 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: amd64 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Source: linux-meta 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Version: 5.15.0.119.119 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Recommends: thermald 2024-09-12T16:39:33.639 INFO:teuthology.orchestra.run.smithi122.stdout:Description: Generic Linux kernel image 2024-09-12T16:39:33.640 INFO:teuthology.orchestra.run.smithi122.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:39:33.640 INFO:teuthology.orchestra.run.smithi122.stdout: available. 2024-09-12T16:39:33.640 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:39:33.640 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:39:33.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:39:33.640 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T16:39:33.640 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:39:33.641 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get clean 2024-09-12T16:39:33.827 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-09-12T16:39:33.957 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:39:33.957 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:39:33.965 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:39:33.982 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:39:34.625 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:39:34.625 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:39:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:39:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:Generating grub configuration file ... 2024-09-12T16:39:35.013 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:39:35.043 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:39:35.400 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:39:35.405 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:39:35.441 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-12T16:39:35.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:39:35.475 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:39:35.481 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:39:35.521 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-12T16:39:35.668 INFO:teuthology.orchestra.run.smithi151.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:39:35.668 INFO:teuthology.orchestra.run.smithi151.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:39:35.668 INFO:teuthology.orchestra.run.smithi151.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:39:35.716 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-09-12T16:39:35.728 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-09-12T16:39:35.729 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-09-12T16:39:35.905 INFO:teuthology.orchestra.run.smithi122.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:39:35.905 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:39:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:39:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:39:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:39:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:39:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:39:35.906 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:39:35.944 INFO:teuthology.orchestra.run.smithi122.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:39:35.946 DEBUG:teuthology.orchestra.run.smithi122:> dpkg -s linux-image-generic 2024-09-12T16:39:35.962 INFO:teuthology.orchestra.run.smithi122.stdout:Package: linux-image-generic 2024-09-12T16:39:35.962 INFO:teuthology.orchestra.run.smithi122.stdout:Status: install ok installed 2024-09-12T16:39:35.962 INFO:teuthology.orchestra.run.smithi122.stdout:Priority: optional 2024-09-12T16:39:35.962 INFO:teuthology.orchestra.run.smithi122.stdout:Section: kernel 2024-09-12T16:39:35.962 INFO:teuthology.orchestra.run.smithi122.stdout:Installed-Size: 21 2024-09-12T16:39:35.962 INFO:teuthology.orchestra.run.smithi122.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:39:35.962 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: amd64 2024-09-12T16:39:35.962 INFO:teuthology.orchestra.run.smithi122.stdout:Source: linux-meta 2024-09-12T16:39:35.963 INFO:teuthology.orchestra.run.smithi122.stdout:Version: 5.15.0.119.119 2024-09-12T16:39:35.963 INFO:teuthology.orchestra.run.smithi122.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:39:35.963 INFO:teuthology.orchestra.run.smithi122.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:39:35.963 INFO:teuthology.orchestra.run.smithi122.stdout:Recommends: thermald 2024-09-12T16:39:35.963 INFO:teuthology.orchestra.run.smithi122.stdout:Description: Generic Linux kernel image 2024-09-12T16:39:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:39:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: available. 2024-09-12T16:39:35.963 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-12T16:39:36.009 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.UJbxoxZEQS 2024-09-12T16:39:36.009 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub/grub.cfg /tmp/tmp.UJbxoxZEQS 2024-09-12T16:39:36.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.UJbxoxZEQS 2024-09-12T16:39:36.198 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.UJbxoxZEQS is 10KB 2024-09-12T16:39:36.215 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.UJbxoxZEQS 2024-09-12T16:39:36.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:39:36.233 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-12T16:39:36.259 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.119.119 2024-09-12T16:39:36.260 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:39:36.260 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:39:36.260 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-12T16:39:36.260 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-12T16:39:36.260 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:39:36.260 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-12T16:39:36.260 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:39:36.260 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:39:36.260 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:39:36.260 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-12T16:39:36.260 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:39:36.261 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-12T16:39:36.277 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:39:36.277 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:39:36.277 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:39:36.363 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:39:36.364 DEBUG:teuthology.orchestra.run.smithi122:> sudo update-grub 2024-09-12T16:39:36.386 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-12T16:39:36.644 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:39:36.684 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:39:36.701 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:39:36.718 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:39:37.699 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:39:37.700 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:39:37.708 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-09-12T16:39:37.886 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:39:37.892 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:39:38.082 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T16:39:38.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:39:38.127 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:39:38.132 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:39:38.152 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T16:39:38.175 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:39:38.181 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:39:38.301 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:39:38.301 INFO:teuthology.orchestra.run.smithi122.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:39:38.301 INFO:teuthology.orchestra.run.smithi122.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:39:38.332 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-09-12T16:39:38.341 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-09-12T16:39:38.351 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-12T16:39:38.352 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-12T16:39:38.515 INFO:teuthology.orchestra.run.smithi151.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:39:38.515 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:39:38.516 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:39:38.516 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:39:38.516 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:39:38.516 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:39:38.516 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:39:38.517 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:39:38.557 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:39:38.559 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-12T16:39:38.615 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-12T16:39:38.615 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-12T16:39:38.615 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-12T16:39:38.615 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-12T16:39:38.615 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.119.119 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:39:38.616 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-12T16:39:38.616 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-09-12T16:39:38.660 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.lu5L9mVdaM 2024-09-12T16:39:38.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lu5L9mVdaM 2024-09-12T16:39:38.714 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.lu5L9mVdaM 2024-09-12T16:39:38.825 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.lu5L9mVdaM is 10KB 2024-09-12T16:39:38.838 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.lu5L9mVdaM 2024-09-12T16:39:38.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:39:38.893 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:39:38.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:39:38.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:39:38.969 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:39:38.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo update-grub 2024-09-12T16:39:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:39:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:39:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-09-12T16:39:40.722 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:39:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:39:40.994 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:39:40.999 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:39:41.045 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:39:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:39:41.171 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:39:41.171 INFO:teuthology.orchestra.run.smithi151.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:39:41.172 INFO:teuthology.orchestra.run.smithi151.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:39:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-09-12T16:39:41.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-09-12T16:40:08.369 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T16:40:08.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-12T16:40:08.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:40:11.257 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-12T16:40:11.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T16:40:11.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:40:42.817 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-12T16:40:45.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-12T16:40:51.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-12T16:40:51.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:40:54.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T16:40:54.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:41:10.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-09-12T16:41:13.277 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-12T16:41:22.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-12T16:41:22.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:41:22.661 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-12T16:41:23.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-12T16:41:23.509 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T16:41:23.510 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-12T16:41:23.560 INFO:teuthology.orchestra.run.smithi122.stdout:5.15.0-119-generic 2024-09-12T16:41:23.560 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T16:41:23.560 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:41:23.560 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T16:41:24.561 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T16:41:24.562 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:41:24.723 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-09-12T16:41:24.757 DEBUG:teuthology.parallel:result is None 2024-09-12T16:41:25.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T16:41:25.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:41:25.280 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-12T16:41:40.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T16:41:40.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:41:40.607 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-12T16:41:41.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T16:41:41.240 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-119-generic"... 2024-09-12T16:41:41.240 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-12T16:41:41.287 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-119-generic 2024-09-12T16:41:41.288 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T16:41:41.288 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:41:41.288 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T16:41:42.289 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-12T16:41:42.289 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:41:42.664 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-09-12T16:41:42.701 DEBUG:teuthology.parallel:result is None 2024-09-12T16:41:42.701 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T16:41:42.712 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T16:41:42.713 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:41:42.715 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:41:42.721 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T16:41:42.780 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T16:41:42.803 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T16:41:42.803 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:41:42.806 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:41:42.836 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T16:41:42.841 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T16:41:42.841 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:41:42.867 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:41:42.887 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:41:42.895 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:41:42.897 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:41:42.904 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:41:42.906 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T16:41:42.913 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T16:41:42.914 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:41:42.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:41:42.958 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T16:41:42.974 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T16:41:42.974 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:41:42.997 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:41:43.008 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:41:43.047 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:41:43.096 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:41:43.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:41:43.157 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:41:43.162 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:41:43.212 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:41:43.212 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:41:43.279 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-09-12T16:41:43.282 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-09-12T16:41:43.354 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T16:41:43.361 INFO:teuthology.task.internal:Starting timer... 2024-09-12T16:41:43.362 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T16:41:43.442 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T16:41:43.496 DEBUG:teuthology.task.selinux:Excluding smithi122: OS 'ubuntu' does not support SELinux 2024-09-12T16:41:43.496 DEBUG:teuthology.task.selinux:Excluding smithi151: OS 'ubuntu' does not support SELinux 2024-09-12T16:41:43.496 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T16:41:43.496 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T16:41:43.496 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T16:41:43.496 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T16:41:43.534 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T16:41:43.537 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T16:41:43.641 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T16:41:43.653 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T16:41:43.656 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi122.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T16:49:13.577 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi122.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-09-12T16:49:13.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-12T16:49:13.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:49:13.681 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-12T16:49:13.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-12T16:49:13.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T16:49:13.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:49:13.849 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-12T16:49:13.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-12T16:49:13.933 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T16:49:13.944 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T16:49:13.945 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:49:13.945 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:49:13.948 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:49:13.948 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:49:13.976 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T16:49:13.976 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Command line: ntpd -gq 2024-09-12T16:49:13.976 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: ---------------------------------------------------- 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: corporation. Support and training for ntp-4 are 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: available at https://www.nwtime.org/support 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: ---------------------------------------------------- 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: proto: precision = 0.046 usec (-24) 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: basedate set to 2022-02-04 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: gps base set to 2022-02-06 (week 2196) 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T16:49:13.977 INFO:teuthology.orchestra.run.smithi122.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T16:49:13.978 INFO:teuthology.orchestra.run.smithi122.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T16:49:13.978 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T16:49:13.978 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T16:49:13.978 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T16:49:13.979 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Listen normally on 3 enp3s0f1 172.21.15.122:123 2024-09-12T16:49:13.979 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Listen normally on 4 lo [::1]:123 2024-09-12T16:49:13.979 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d515%5]:123 2024-09-12T16:49:13.979 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:13 ntpd[18500]: Listening on routing socket on fd #22 for interface updates 2024-09-12T16:49:14.000 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T16:49:14.000 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Command line: ntpd -gq 2024-09-12T16:49:14.000 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: ---------------------------------------------------- 2024-09-12T16:49:14.000 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T16:49:14.000 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T16:49:14.001 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: corporation. Support and training for ntp-4 are 2024-09-12T16:49:14.001 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: available at https://www.nwtime.org/support 2024-09-12T16:49:14.001 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: ---------------------------------------------------- 2024-09-12T16:49:14.001 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: proto: precision = 0.056 usec (-24) 2024-09-12T16:49:14.001 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: basedate set to 2022-02-04 2024-09-12T16:49:14.001 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: gps base set to 2022-02-06 (week 2196) 2024-09-12T16:49:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T16:49:14.002 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T16:49:14.002 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T16:49:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T16:49:14.003 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T16:49:14.003 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T16:49:14.003 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T16:49:14.003 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Listen normally on 3 enp3s0f1 172.21.15.151:123 2024-09-12T16:49:14.003 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Listen normally on 4 lo [::1]:123 2024-09-12T16:49:14.004 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f63%5]:123 2024-09-12T16:49:14.004 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:13 ntpd[18487]: Listening on routing socket on fd #22 for interface updates 2024-09-12T16:49:14.977 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:14.977 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:14.977 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:14.977 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:14.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:14.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:14.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:14.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:14.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:14.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:14.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:14.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:14 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:15.000 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:14 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:15.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:14 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:15.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:14 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:15.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:14 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:15.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:14 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:15.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:14 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:15 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:15 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:15 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:15 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:15 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:15 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:16.977 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:16.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:16.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:16 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:17.000 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:17.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:16 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:17.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:17.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:16 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:17.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:16 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:17.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:16 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:18.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:18.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:17 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:18.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.978 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:18.979 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:18.980 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:18.980 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:18 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:19.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:19.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:18 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:18 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:18 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:20.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:20.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:20.003 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:19 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:20.980 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:20.981 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:20.982 INFO:teuthology.orchestra.run.smithi122.stdout:12 Sep 16:49:20 ntpd[18500]: ntpd: time slew -0.000962 s 2024-09-12T16:49:20.982 INFO:teuthology.orchestra.run.smithi122.stdout:ntpd: time slew -0.000962s 2024-09-12T16:49:20.982 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T16:49:20.982 INFO:teuthology.orchestra.run.smithi122.stderr:12 Sep 16:49:20 ntpd[18500]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T16:49:21.000 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:21.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:21.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:49:21.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:20 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:49:21.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:49:21.001 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:20 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:49:21.001 INFO:teuthology.orchestra.run.smithi151.stdout:12 Sep 16:49:20 ntpd[18487]: ntpd: time slew -0.000356 s 2024-09-12T16:49:21.001 INFO:teuthology.orchestra.run.smithi151.stdout:ntpd: time slew -0.000356s 2024-09-12T16:49:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:20 ntpd[18487]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T16:49:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:12 Sep 16:49:20 ntpd[18487]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T16:49:21.024 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T16:49:21.024 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-09-12T16:49:21.024 INFO:teuthology.orchestra.run.smithi122.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:49:21.024 INFO:teuthology.orchestra.run.smithi122.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:49:21.024 INFO:teuthology.orchestra.run.smithi122.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:49:21.025 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:49:21.100 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T16:49:21.100 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-12T16:49:21.100 INFO:teuthology.orchestra.run.smithi151.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:49:21.101 INFO:teuthology.orchestra.run.smithi151.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:49:21.101 INFO:teuthology.orchestra.run.smithi151.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:49:21.101 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:49:21.102 INFO:teuthology.run_tasks:Running task install... 2024-09-12T16:49:21.110 DEBUG:teuthology.task.install:project ceph 2024-09-12T16:49:21.110 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T16:49:21.110 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T16:49:21.110 INFO:teuthology.task.install:Using flavor: default 2024-09-12T16:49:21.116 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T16:49:21.116 INFO:teuthology.task.install:extra packages: [] 2024-09-12T16:49:21.116 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-key list | grep Ceph 2024-09-12T16:49:21.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-key list | grep Ceph 2024-09-12T16:49:21.179 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T16:49:21.205 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T16:49:21.207 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T16:49:21.207 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T16:49:21.209 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T16:49:21.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:49:21.236 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T16:49:21.236 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T16:49:21.236 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T16:49:21.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:49:21.363 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T16:49:21.364 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:49:21.399 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T16:49:21.420 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:49:21.495 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:49:21.495 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T16:49:21.510 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-09-12T16:49:21.535 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:49:21.535 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T16:49:21.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-12T16:49:21.723 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:49:21.742 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T16:49:21.764 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T16:49:21.777 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T16:49:21.787 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T16:49:21.798 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T16:49:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T16:49:21.820 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:49:21.820 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:49:21.820 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T16:49:21.841 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T16:49:21.847 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:49:21.849 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T16:49:21.869 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T16:49:21.892 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:49:21.926 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:49:21.974 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:49:22.006 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:49:22.150 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 28.6 kB in 0s (68.7 kB/s) 2024-09-12T16:49:22.184 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 28.6 kB in 0s (59.5 kB/s) 2024-09-12T16:49:23.162 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T16:49:23.181 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:49:23.187 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-12T16:49:23.204 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:49:23.247 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-12T16:49:23.266 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-09-12T16:49:23.448 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-12T16:49:23.448 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-12T16:49:23.484 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-09-12T16:49:23.485 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-09-12T16:49:23.654 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:49:23.654 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:49:23.654 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:49:23.654 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:49:23.655 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:49:23.655 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:49:23.655 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:49:23.656 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-12T16:49:23.656 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T16:49:23.656 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T16:49:23.656 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T16:49:23.656 INFO:teuthology.orchestra.run.smithi151.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T16:49:23.658 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T16:49:23.658 INFO:teuthology.orchestra.run.smithi151.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T16:49:23.658 INFO:teuthology.orchestra.run.smithi151.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T16:49:23.658 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T16:49:23.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T16:49:23.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T16:49:23.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T16:49:23.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T16:49:23.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T16:49:23.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T16:49:23.662 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet zip 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-12T16:49:23.663 INFO:teuthology.orchestra.run.smithi151.stdout: btrfs-tools 2024-09-12T16:49:23.681 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:49:23.681 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:49:23.681 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:49:23.681 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:49:23.681 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:49:23.682 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:49:23.682 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:49:23.682 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-09-12T16:49:23.683 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T16:49:23.683 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T16:49:23.683 INFO:teuthology.orchestra.run.smithi122.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T16:49:23.683 INFO:teuthology.orchestra.run.smithi122.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T16:49:23.684 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T16:49:23.684 INFO:teuthology.orchestra.run.smithi122.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T16:49:23.684 INFO:teuthology.orchestra.run.smithi122.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T16:49:23.684 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T16:49:23.684 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T16:49:23.684 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T16:49:23.685 INFO:teuthology.orchestra.run.smithi122.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet zip 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T16:49:23.686 INFO:teuthology.orchestra.run.smithi122.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T16:49:23.687 INFO:teuthology.orchestra.run.smithi122.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T16:49:23.687 INFO:teuthology.orchestra.run.smithi122.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T16:49:23.687 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-09-12T16:49:23.687 INFO:teuthology.orchestra.run.smithi122.stdout: btrfs-tools 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T16:49:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T16:49:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T16:49:23.765 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T16:49:23.765 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T16:49:23.765 INFO:teuthology.orchestra.run.smithi151.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T16:49:23.790 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-09-12T16:49:23.790 INFO:teuthology.orchestra.run.smithi122.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T16:49:23.790 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T16:49:23.790 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T16:49:23.790 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T16:49:23.790 INFO:teuthology.orchestra.run.smithi122.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T16:49:23.790 INFO:teuthology.orchestra.run.smithi122.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T16:49:23.790 INFO:teuthology.orchestra.run.smithi122.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T16:49:23.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T16:49:23.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T16:49:23.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T16:49:23.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T16:49:23.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T16:49:23.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T16:49:23.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T16:49:23.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T16:49:23.792 INFO:teuthology.orchestra.run.smithi122.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T16:49:23.822 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T16:49:23.822 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 243 MB of archives. 2024-09-12T16:49:23.822 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T16:49:23.822 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T16:49:23.850 INFO:teuthology.orchestra.run.smithi122.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T16:49:23.851 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 243 MB of archives. 2024-09-12T16:49:23.851 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T16:49:23.851 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T16:49:23.903 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T16:49:23.910 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T16:49:23.913 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T16:49:23.930 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T16:49:23.933 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T16:49:23.937 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T16:49:23.943 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T16:49:23.960 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T16:49:23.992 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T16:49:23.998 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T16:49:24.011 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T16:49:24.017 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T16:49:24.018 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T16:49:24.019 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T16:49:24.021 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T16:49:24.022 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T16:49:24.024 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T16:49:24.026 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T16:49:24.027 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T16:49:24.028 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T16:49:24.029 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T16:49:24.033 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T16:49:24.037 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T16:49:24.037 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T16:49:24.038 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T16:49:24.045 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T16:49:24.046 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T16:49:24.048 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T16:49:24.048 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T16:49:24.049 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T16:49:24.050 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T16:49:24.050 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T16:49:24.051 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T16:49:24.052 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T16:49:24.052 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T16:49:24.052 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T16:49:24.053 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T16:49:24.053 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T16:49:24.053 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T16:49:24.056 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T16:49:24.063 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T16:49:24.070 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T16:49:24.071 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T16:49:24.071 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T16:49:24.072 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T16:49:24.073 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T16:49:24.073 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T16:49:24.074 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T16:49:24.075 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T16:49:24.075 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T16:49:24.076 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T16:49:24.076 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T16:49:24.076 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T16:49:24.077 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T16:49:24.078 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T16:49:24.079 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T16:49:24.079 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T16:49:24.081 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T16:49:24.089 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T16:49:24.089 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T16:49:24.095 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T16:49:24.096 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T16:49:24.096 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T16:49:24.100 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T16:49:24.101 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T16:49:24.102 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T16:49:24.102 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T16:49:24.103 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T16:49:24.104 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T16:49:24.104 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T16:49:24.109 INFO:teuthology.orchestra.run.smithi151.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T16:49:24.110 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T16:49:24.110 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T16:49:24.110 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T16:49:24.110 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T16:49:24.110 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T16:49:24.110 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T16:49:24.112 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T16:49:24.115 INFO:teuthology.orchestra.run.smithi151.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T16:49:24.117 INFO:teuthology.orchestra.run.smithi151.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T16:49:24.127 INFO:teuthology.orchestra.run.smithi151.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T16:49:24.127 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T16:49:24.127 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T16:49:24.128 INFO:teuthology.orchestra.run.smithi151.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T16:49:24.128 INFO:teuthology.orchestra.run.smithi151.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T16:49:24.128 INFO:teuthology.orchestra.run.smithi151.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T16:49:24.141 INFO:teuthology.orchestra.run.smithi151.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T16:49:24.143 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T16:49:24.143 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T16:49:24.144 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T16:49:24.144 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T16:49:24.144 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T16:49:24.145 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T16:49:24.146 INFO:teuthology.orchestra.run.smithi122.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T16:49:24.148 INFO:teuthology.orchestra.run.smithi122.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T16:49:24.151 INFO:teuthology.orchestra.run.smithi122.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T16:49:24.155 INFO:teuthology.orchestra.run.smithi122.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T16:49:24.156 INFO:teuthology.orchestra.run.smithi122.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T16:49:24.172 INFO:teuthology.orchestra.run.smithi122.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T16:49:24.172 INFO:teuthology.orchestra.run.smithi122.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T16:49:24.173 INFO:teuthology.orchestra.run.smithi122.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T16:49:24.176 INFO:teuthology.orchestra.run.smithi122.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T16:49:24.184 INFO:teuthology.orchestra.run.smithi151.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T16:49:24.184 INFO:teuthology.orchestra.run.smithi151.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T16:49:24.185 INFO:teuthology.orchestra.run.smithi151.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T16:49:24.185 INFO:teuthology.orchestra.run.smithi151.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T16:49:24.210 INFO:teuthology.orchestra.run.smithi151.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T16:49:24.211 INFO:teuthology.orchestra.run.smithi151.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T16:49:24.222 INFO:teuthology.orchestra.run.smithi122.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T16:49:24.223 INFO:teuthology.orchestra.run.smithi151.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T16:49:24.227 INFO:teuthology.orchestra.run.smithi151.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T16:49:24.228 INFO:teuthology.orchestra.run.smithi122.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T16:49:24.229 INFO:teuthology.orchestra.run.smithi151.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T16:49:24.230 INFO:teuthology.orchestra.run.smithi122.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T16:49:24.230 INFO:teuthology.orchestra.run.smithi151.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T16:49:24.230 INFO:teuthology.orchestra.run.smithi151.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T16:49:24.231 INFO:teuthology.orchestra.run.smithi122.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T16:49:24.231 INFO:teuthology.orchestra.run.smithi122.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T16:49:24.231 INFO:teuthology.orchestra.run.smithi151.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T16:49:24.232 INFO:teuthology.orchestra.run.smithi122.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T16:49:24.235 INFO:teuthology.orchestra.run.smithi151.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T16:49:24.237 INFO:teuthology.orchestra.run.smithi151.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T16:49:24.246 INFO:teuthology.orchestra.run.smithi151.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T16:49:24.246 INFO:teuthology.orchestra.run.smithi151.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T16:49:24.247 INFO:teuthology.orchestra.run.smithi151.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T16:49:24.247 INFO:teuthology.orchestra.run.smithi151.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T16:49:24.247 INFO:teuthology.orchestra.run.smithi151.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T16:49:24.247 INFO:teuthology.orchestra.run.smithi151.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T16:49:24.247 INFO:teuthology.orchestra.run.smithi151.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T16:49:24.249 INFO:teuthology.orchestra.run.smithi122.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T16:49:24.251 INFO:teuthology.orchestra.run.smithi122.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T16:49:24.251 INFO:teuthology.orchestra.run.smithi122.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T16:49:24.257 INFO:teuthology.orchestra.run.smithi151.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T16:49:24.257 INFO:teuthology.orchestra.run.smithi151.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T16:49:24.259 INFO:teuthology.orchestra.run.smithi151.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T16:49:24.262 INFO:teuthology.orchestra.run.smithi122.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T16:49:24.265 INFO:teuthology.orchestra.run.smithi122.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T16:49:24.265 INFO:teuthology.orchestra.run.smithi122.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T16:49:24.266 INFO:teuthology.orchestra.run.smithi122.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T16:49:24.266 INFO:teuthology.orchestra.run.smithi122.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T16:49:24.267 INFO:teuthology.orchestra.run.smithi122.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T16:49:24.267 INFO:teuthology.orchestra.run.smithi122.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T16:49:24.269 INFO:teuthology.orchestra.run.smithi122.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T16:49:24.271 INFO:teuthology.orchestra.run.smithi122.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T16:49:24.272 INFO:teuthology.orchestra.run.smithi151.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T16:49:24.273 INFO:teuthology.orchestra.run.smithi151.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T16:49:24.274 INFO:teuthology.orchestra.run.smithi151.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T16:49:24.274 INFO:teuthology.orchestra.run.smithi122.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T16:49:24.276 INFO:teuthology.orchestra.run.smithi122.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T16:49:24.277 INFO:teuthology.orchestra.run.smithi151.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T16:49:24.280 INFO:teuthology.orchestra.run.smithi151.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T16:49:24.281 INFO:teuthology.orchestra.run.smithi151.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T16:49:24.281 INFO:teuthology.orchestra.run.smithi151.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T16:49:24.283 INFO:teuthology.orchestra.run.smithi122.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T16:49:24.283 INFO:teuthology.orchestra.run.smithi122.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T16:49:24.284 INFO:teuthology.orchestra.run.smithi122.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T16:49:24.286 INFO:teuthology.orchestra.run.smithi122.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T16:49:24.290 INFO:teuthology.orchestra.run.smithi151.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T16:49:24.291 INFO:teuthology.orchestra.run.smithi151.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T16:49:24.293 INFO:teuthology.orchestra.run.smithi151.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T16:49:24.300 INFO:teuthology.orchestra.run.smithi122.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T16:49:24.301 INFO:teuthology.orchestra.run.smithi122.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T16:49:24.301 INFO:teuthology.orchestra.run.smithi122.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T16:49:24.305 INFO:teuthology.orchestra.run.smithi122.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T16:49:24.306 INFO:teuthology.orchestra.run.smithi151.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T16:49:24.307 INFO:teuthology.orchestra.run.smithi122.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T16:49:24.307 INFO:teuthology.orchestra.run.smithi151.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T16:49:24.308 INFO:teuthology.orchestra.run.smithi151.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T16:49:24.308 INFO:teuthology.orchestra.run.smithi122.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T16:49:24.308 INFO:teuthology.orchestra.run.smithi122.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T16:49:24.309 INFO:teuthology.orchestra.run.smithi151.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T16:49:24.310 INFO:teuthology.orchestra.run.smithi151.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T16:49:24.316 INFO:teuthology.orchestra.run.smithi151.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T16:49:24.316 INFO:teuthology.orchestra.run.smithi151.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T16:49:24.316 INFO:teuthology.orchestra.run.smithi122.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T16:49:24.317 INFO:teuthology.orchestra.run.smithi122.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T16:49:24.320 INFO:teuthology.orchestra.run.smithi122.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T16:49:24.324 INFO:teuthology.orchestra.run.smithi151.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T16:49:24.326 INFO:teuthology.orchestra.run.smithi151.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T16:49:24.327 INFO:teuthology.orchestra.run.smithi151.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T16:49:24.334 INFO:teuthology.orchestra.run.smithi122.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T16:49:24.335 INFO:teuthology.orchestra.run.smithi122.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T16:49:24.335 INFO:teuthology.orchestra.run.smithi122.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T16:49:24.336 INFO:teuthology.orchestra.run.smithi122.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T16:49:24.336 INFO:teuthology.orchestra.run.smithi122.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T16:49:24.343 INFO:teuthology.orchestra.run.smithi122.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T16:49:24.343 INFO:teuthology.orchestra.run.smithi122.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T16:49:24.351 INFO:teuthology.orchestra.run.smithi122.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T16:49:24.353 INFO:teuthology.orchestra.run.smithi122.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T16:49:24.353 INFO:teuthology.orchestra.run.smithi122.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T16:49:24.504 INFO:teuthology.orchestra.run.smithi151.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T16:49:24.506 INFO:teuthology.orchestra.run.smithi151.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T16:49:24.515 INFO:teuthology.orchestra.run.smithi151.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T16:49:24.552 INFO:teuthology.orchestra.run.smithi122.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T16:49:24.554 INFO:teuthology.orchestra.run.smithi122.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T16:49:24.562 INFO:teuthology.orchestra.run.smithi122.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T16:49:25.655 INFO:teuthology.orchestra.run.smithi151.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T16:49:25.783 INFO:teuthology.orchestra.run.smithi122.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T16:49:25.787 INFO:teuthology.orchestra.run.smithi151.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T16:49:25.793 INFO:teuthology.orchestra.run.smithi151.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T16:49:25.796 INFO:teuthology.orchestra.run.smithi151.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T16:49:25.852 INFO:teuthology.orchestra.run.smithi151.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T16:49:25.886 INFO:teuthology.orchestra.run.smithi122.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T16:49:25.912 INFO:teuthology.orchestra.run.smithi122.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T16:49:25.931 INFO:teuthology.orchestra.run.smithi122.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T16:49:26.001 INFO:teuthology.orchestra.run.smithi122.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T16:49:26.167 INFO:teuthology.orchestra.run.smithi151.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T16:49:26.297 INFO:teuthology.orchestra.run.smithi122.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T16:49:27.236 INFO:teuthology.orchestra.run.smithi151.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T16:49:27.236 INFO:teuthology.orchestra.run.smithi151.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T16:49:27.254 INFO:teuthology.orchestra.run.smithi151.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T16:49:27.303 INFO:teuthology.orchestra.run.smithi151.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T16:49:27.318 INFO:teuthology.orchestra.run.smithi151.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T16:49:27.319 INFO:teuthology.orchestra.run.smithi151.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T16:49:27.669 INFO:teuthology.orchestra.run.smithi122.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T16:49:27.669 INFO:teuthology.orchestra.run.smithi122.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T16:49:27.686 INFO:teuthology.orchestra.run.smithi122.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T16:49:27.743 INFO:teuthology.orchestra.run.smithi122.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T16:49:27.811 INFO:teuthology.orchestra.run.smithi122.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T16:49:27.814 INFO:teuthology.orchestra.run.smithi122.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T16:49:29.459 INFO:teuthology.orchestra.run.smithi151.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T16:49:29.620 INFO:teuthology.orchestra.run.smithi151.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T16:49:29.621 INFO:teuthology.orchestra.run.smithi151.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T16:49:30.373 INFO:teuthology.orchestra.run.smithi122.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T16:49:30.618 INFO:teuthology.orchestra.run.smithi122.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T16:49:30.618 INFO:teuthology.orchestra.run.smithi122.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T16:49:31.334 INFO:teuthology.orchestra.run.smithi151.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T16:49:31.337 INFO:teuthology.orchestra.run.smithi151.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T16:49:31.338 INFO:teuthology.orchestra.run.smithi151.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T16:49:31.795 INFO:teuthology.orchestra.run.smithi151.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T16:49:32.049 INFO:teuthology.orchestra.run.smithi122.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T16:49:32.052 INFO:teuthology.orchestra.run.smithi122.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T16:49:32.053 INFO:teuthology.orchestra.run.smithi122.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T16:49:32.366 INFO:teuthology.orchestra.run.smithi122.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T16:49:32.378 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 243 MB in 8s (30.3 MB/s) 2024-09-12T16:49:32.510 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T16:49:32.609 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T16:49:32.615 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T16:49:32.701 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T16:49:32.943 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 243 MB in 9s (28.4 MB/s) 2024-09-12T16:49:33.021 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T16:49:33.048 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T16:49:33.088 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T16:49:33.105 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T16:49:33.206 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T16:49:33.211 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T16:49:33.296 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T16:49:33.400 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T16:49:33.426 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T16:49:33.469 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T16:49:33.633 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T16:49:33.659 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T16:49:33.700 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T16:49:33.913 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T16:49:33.939 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:49:33.978 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T16:49:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:49:34.004 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T16:49:34.044 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T16:49:34.367 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T16:49:34.393 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:49:34.433 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:49:34.482 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T16:49:34.509 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:49:34.557 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:49:34.770 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T16:49:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:49:34.837 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:49:34.927 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T16:49:34.954 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:49:35.149 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:49:35.224 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T16:49:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T16:49:35.282 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T16:49:35.573 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T16:49:35.599 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:49:35.602 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librados2. 2024-09-12T16:49:35.629 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:35.639 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:49:35.669 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:35.993 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T16:49:36.019 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T16:49:36.059 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T16:49:36.123 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librbd1. 2024-09-12T16:49:36.149 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:36.189 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:36.354 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librados2. 2024-09-12T16:49:36.380 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:36.421 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:36.634 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T16:49:36.661 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:36.701 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:36.874 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librbd1. 2024-09-12T16:49:36.900 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:36.941 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:37.146 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rados. 2024-09-12T16:49:37.172 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:37.212 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:37.377 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T16:49:37.403 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:37.444 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:37.549 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T16:49:37.574 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:49:37.616 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:37.705 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rados. 2024-09-12T16:49:37.720 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:37.763 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:37.861 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T16:49:37.887 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:37.919 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:38.092 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T16:49:38.118 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:49:38.158 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:38.214 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T16:49:38.240 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:49:38.280 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:38.394 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T16:49:38.421 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:38.461 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:38.584 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T16:49:38.611 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T16:49:38.651 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T16:49:38.747 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T16:49:38.774 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:49:38.805 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:38.971 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T16:49:39.003 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T16:49:39.038 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T16:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T16:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T16:49:39.184 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T16:49:39.299 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T16:49:39.315 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:39.357 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:39.504 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T16:49:39.530 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T16:49:39.570 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T16:49:39.679 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T16:49:39.705 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T16:49:39.744 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T16:49:39.823 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T16:49:39.838 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:39.881 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:40.023 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T16:49:40.049 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T16:49:40.089 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T16:49:40.185 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T16:49:40.212 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T16:49:40.252 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T16:49:40.437 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T16:49:40.450 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T16:49:40.493 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T16:49:40.522 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T16:49:40.548 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T16:49:40.588 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T16:49:40.797 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua5.1. 2024-09-12T16:49:40.823 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T16:49:40.863 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T16:49:40.891 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T16:49:40.907 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T16:49:40.949 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T16:49:41.159 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-any. 2024-09-12T16:49:41.174 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T16:49:41.217 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T16:49:41.229 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua5.1. 2024-09-12T16:49:41.244 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T16:49:41.278 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T16:49:41.445 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package zip. 2024-09-12T16:49:41.460 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T16:49:41.495 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T16:49:41.590 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-any. 2024-09-12T16:49:41.616 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T16:49:41.656 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T16:49:41.799 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package unzip. 2024-09-12T16:49:41.826 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T16:49:41.870 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T16:49:41.926 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package zip. 2024-09-12T16:49:41.953 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T16:49:41.993 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T16:49:42.263 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package unzip. 2024-09-12T16:49:42.290 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T16:49:42.321 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T16:49:42.349 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package luarocks. 2024-09-12T16:49:42.375 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T16:49:42.462 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T16:49:42.719 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package luarocks. 2024-09-12T16:49:42.746 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T16:49:42.786 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T16:49:42.847 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librgw2. 2024-09-12T16:49:42.873 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:42.922 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:43.154 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librgw2. 2024-09-12T16:49:43.341 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:43.341 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:43.508 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T16:49:43.524 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:43.566 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:43.739 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T16:49:43.754 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:43.797 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:43.914 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T16:49:43.938 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T16:49:43.979 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T16:49:44.125 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T16:49:44.152 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T16:49:44.192 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T16:49:44.282 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T16:49:44.308 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:44.349 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:44.453 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T16:49:44.477 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:44.512 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:44.745 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-common. 2024-09-12T16:49:44.771 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:44.811 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:44.907 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-common. 2024-09-12T16:49:45.089 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:45.089 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:46.284 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-base. 2024-09-12T16:49:46.310 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:46.360 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:46.463 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-base. 2024-09-12T16:49:46.490 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:46.539 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:46.948 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T16:49:46.979 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T16:49:47.016 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T16:49:47.077 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T16:49:47.092 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T16:49:47.127 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T16:49:47.260 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T16:49:47.286 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T16:49:47.318 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T16:49:47.413 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T16:49:47.440 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T16:49:47.479 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T16:49:47.622 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T16:49:47.648 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T16:49:47.688 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T16:49:47.802 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T16:49:47.826 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T16:49:47.866 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T16:49:48.010 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T16:49:48.035 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T16:49:48.075 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T16:49:48.153 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T16:49:48.180 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T16:49:48.219 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T16:49:48.345 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T16:49:48.361 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T16:49:48.395 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T16:49:48.489 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T16:49:48.504 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T16:49:48.572 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T16:49:48.683 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T16:49:48.709 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T16:49:48.749 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T16:49:48.876 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T16:49:48.902 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T16:49:48.942 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T16:49:49.061 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-portend. 2024-09-12T16:49:49.088 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T16:49:49.127 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T16:49:49.220 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-portend. 2024-09-12T16:49:49.236 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T16:49:49.270 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T16:49:49.389 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T16:49:49.405 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T16:49:49.439 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T16:49:49.540 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T16:49:49.567 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T16:49:49.607 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T16:49:49.742 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T16:49:49.769 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T16:49:49.809 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T16:49:49.919 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T16:49:49.946 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T16:49:49.985 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T16:49:50.172 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T16:49:50.199 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T16:49:50.239 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T16:49:50.314 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T16:49:50.341 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T16:49:50.381 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T16:49:50.551 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T16:49:50.577 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T16:49:50.617 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T16:49:50.693 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T16:49:50.719 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T16:49:50.759 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T16:49:50.913 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T16:49:50.939 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T16:49:50.979 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T16:49:51.079 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T16:49:51.106 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T16:49:51.146 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T16:49:51.291 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-mako. 2024-09-12T16:49:51.317 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T16:49:51.358 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T16:49:51.432 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-mako. 2024-09-12T16:49:51.459 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T16:49:51.499 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T16:49:51.672 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T16:49:51.699 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T16:49:51.767 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T16:49:52.067 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T16:49:52.080 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T16:49:52.117 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T16:49:52.136 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T16:49:52.163 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T16:49:52.203 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T16:49:52.395 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webob. 2024-09-12T16:49:52.422 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T16:49:52.462 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T16:49:52.481 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T16:49:52.507 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T16:49:52.548 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T16:49:52.801 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webob. 2024-09-12T16:49:52.827 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T16:49:52.867 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T16:49:52.991 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T16:49:53.017 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T16:49:53.060 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T16:49:53.196 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T16:49:53.222 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T16:49:53.265 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T16:49:53.369 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T16:49:53.396 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T16:49:53.436 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T16:49:53.574 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T16:49:53.600 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T16:49:53.640 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T16:49:53.723 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-paste. 2024-09-12T16:49:53.738 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T16:49:53.773 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T16:49:53.944 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-paste. 2024-09-12T16:49:53.970 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T16:49:54.019 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T16:49:54.093 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T16:49:54.109 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T16:49:54.151 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T16:49:54.331 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T16:49:54.346 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T16:49:54.389 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T16:49:54.422 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T16:49:54.437 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T16:49:54.472 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T16:49:54.692 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T16:49:54.718 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T16:49:54.758 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T16:49:54.759 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T16:49:54.785 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T16:49:54.825 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T16:49:55.021 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T16:49:55.047 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T16:49:55.079 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T16:49:55.137 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T16:49:55.164 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T16:49:55.204 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T16:49:55.416 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T16:49:55.442 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T16:49:55.482 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T16:49:55.552 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T16:49:55.578 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T16:49:55.635 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T16:49:55.854 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T16:49:55.881 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T16:49:55.921 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T16:49:55.947 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-idna. 2024-09-12T16:49:55.973 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T16:49:56.005 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T16:49:56.241 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-idna. 2024-09-12T16:49:56.267 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T16:49:56.307 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T16:49:56.308 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T16:49:56.335 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T16:49:56.375 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T16:49:56.577 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T16:49:56.603 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T16:49:56.635 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T16:49:56.696 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests. 2024-09-12T16:49:56.722 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T16:49:56.762 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T16:49:56.914 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests. 2024-09-12T16:49:56.941 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T16:49:56.972 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T16:49:57.967 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T16:49:57.993 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T16:49:58.033 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T16:49:58.101 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T16:49:58.124 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T16:49:58.167 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T16:49:58.329 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T16:49:58.355 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:49:58.395 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:58.471 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T16:49:58.487 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:49:58.554 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:58.751 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T16:49:58.766 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:58.801 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:58.909 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T16:49:58.936 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:58.968 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:59.096 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T16:49:59.123 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T16:49:59.163 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T16:49:59.279 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T16:49:59.306 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T16:49:59.346 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T16:49:59.500 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T16:49:59.527 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T16:49:59.566 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T16:49:59.649 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T16:49:59.676 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T16:49:59.715 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T16:49:59.862 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T16:49:59.877 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:49:59.911 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:49:59.994 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T16:50:00.021 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:00.060 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:00.316 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T16:50:00.342 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:00.382 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:00.406 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T16:50:00.433 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:00.464 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:00.995 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T16:50:01.021 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:01.061 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:01.093 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T16:50:01.119 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:01.159 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:02.116 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph. 2024-09-12T16:50:02.142 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:02.182 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:02.222 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph. 2024-09-12T16:50:02.248 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:02.288 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:02.502 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T16:50:02.528 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:02.549 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T16:50:02.568 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:02.576 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:02.608 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:02.922 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T16:50:02.949 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:02.989 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:02.994 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T16:50:03.021 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:03.061 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:03.448 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephadm. 2024-09-12T16:50:03.475 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:03.514 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:03.551 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephadm. 2024-09-12T16:50:03.577 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:03.617 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:03.776 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T16:50:03.802 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T16:50:03.834 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T16:50:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T16:50:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T16:50:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T16:50:04.145 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T16:50:04.161 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T16:50:04.196 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T16:50:04.291 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T16:50:04.307 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T16:50:04.350 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T16:50:05.126 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-babel. 2024-09-12T16:50:05.154 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T16:50:05.226 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T16:50:05.363 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-babel. 2024-09-12T16:50:05.391 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T16:50:05.430 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T16:50:05.554 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T16:50:05.581 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T16:50:05.621 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T16:50:05.742 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T16:50:05.758 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T16:50:05.800 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T16:50:05.966 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T16:50:05.992 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:06.032 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:06.146 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T16:50:06.173 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:06.212 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:06.378 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T16:50:06.404 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T16:50:06.444 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T16:50:06.534 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T16:50:06.586 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T16:50:06.600 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T16:50:06.748 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-routes. 2024-09-12T16:50:06.774 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T16:50:06.814 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T16:50:06.886 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-routes. 2024-09-12T16:50:06.914 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T16:50:06.953 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T16:50:07.151 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T16:50:07.178 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:07.217 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T16:50:07.351 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:07.390 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:09.933 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T16:50:09.950 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T16:50:09.991 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T16:50:10.340 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T16:50:10.371 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T16:50:10.415 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T16:50:10.429 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T16:50:10.456 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T16:50:10.486 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T16:50:10.858 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T16:50:10.878 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T16:50:10.885 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T16:50:10.906 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T16:50:10.923 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T16:50:10.969 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T16:50:11.227 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T16:50:11.254 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T16:50:11.323 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T16:50:11.351 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T16:50:11.352 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T16:50:11.390 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T16:50:11.677 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T16:50:11.704 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T16:50:11.743 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T16:50:12.386 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T16:50:12.414 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:12.420 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T16:50:12.449 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:12.531 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:12.573 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:13.460 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T16:50:13.487 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T16:50:13.526 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T16:50:13.780 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T16:50:13.795 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T16:50:13.795 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T16:50:13.823 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T16:50:13.838 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T16:50:13.861 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T16:50:14.150 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T16:50:14.173 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T16:50:14.177 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T16:50:14.201 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T16:50:14.216 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T16:50:14.240 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T16:50:14.520 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T16:50:14.547 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T16:50:14.569 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T16:50:14.586 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T16:50:14.597 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T16:50:14.636 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T16:50:14.907 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T16:50:14.935 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T16:50:14.939 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T16:50:14.967 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T16:50:14.974 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T16:50:14.997 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T16:50:15.277 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T16:50:15.305 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T16:50:15.318 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T16:50:15.344 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T16:50:15.346 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T16:50:15.385 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T16:50:15.639 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T16:50:15.655 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T16:50:15.689 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T16:50:15.706 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T16:50:15.734 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T16:50:15.772 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T16:50:15.992 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T16:50:16.020 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T16:50:16.059 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T16:50:16.068 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T16:50:16.095 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T16:50:16.134 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T16:50:16.446 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T16:50:16.474 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T16:50:16.513 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T16:50:16.765 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T16:50:16.791 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:16.832 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:17.110 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T16:50:17.126 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T16:50:17.161 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T16:50:17.168 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T16:50:17.178 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:17.211 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:17.505 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T16:50:17.531 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T16:50:17.533 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T16:50:17.559 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T16:50:17.571 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T16:50:17.597 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T16:50:17.833 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package jq. 2024-09-12T16:50:17.860 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T16:50:17.899 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T16:50:17.943 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T16:50:17.971 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T16:50:18.010 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T16:50:18.144 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package socat. 2024-09-12T16:50:18.160 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T16:50:18.193 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T16:50:18.246 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package jq. 2024-09-12T16:50:18.274 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T16:50:18.313 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T16:50:18.472 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T16:50:18.497 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T16:50:18.539 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T16:50:18.566 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package socat. 2024-09-12T16:50:18.582 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T16:50:18.650 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T16:50:18.918 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-test. 2024-09-12T16:50:18.934 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:18.953 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T16:50:18.969 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T16:50:18.977 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:19.011 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T16:50:19.384 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-test. 2024-09-12T16:50:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:19.442 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:21.275 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T16:50:21.303 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:21.342 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:21.637 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T16:50:21.666 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:21.688 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T16:50:21.703 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:21.705 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:50:21.738 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:22.010 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T16:50:22.023 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T16:50:22.026 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:22.051 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T16:50:22.068 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:22.123 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T16:50:22.389 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T16:50:22.416 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T16:50:22.436 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T16:50:22.464 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T16:50:22.473 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T16:50:22.503 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T16:50:22.802 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T16:50:22.818 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T16:50:22.861 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T16:50:22.864 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T16:50:22.893 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T16:50:22.931 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T16:50:23.199 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T16:50:23.227 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T16:50:23.345 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package pkg-config. 2024-09-12T16:50:23.373 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T16:50:23.374 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T16:50:23.411 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T16:50:23.672 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T16:50:23.688 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T16:50:23.730 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T16:50:23.797 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pkg-config. 2024-09-12T16:50:23.825 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T16:50:23.863 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T16:50:24.167 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T16:50:24.195 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T16:50:24.234 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T16:50:24.342 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T16:50:24.358 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T16:50:24.400 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T16:50:24.478 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T16:50:24.494 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T16:50:24.528 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T16:50:24.796 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T16:50:24.823 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T16:50:24.824 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T16:50:24.851 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T16:50:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T16:50:24.889 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T16:50:25.141 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T16:50:25.169 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T16:50:25.207 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T16:50:25.209 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T16:50:25.237 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T16:50:25.275 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T16:50:25.528 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T16:50:25.556 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T16:50:25.587 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-py. 2024-09-12T16:50:25.594 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T16:50:25.603 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T16:50:25.637 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T16:50:25.906 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T16:50:25.934 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T16:50:25.965 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T16:50:25.973 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T16:50:25.993 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T16:50:26.031 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T16:50:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-py. 2024-09-12T16:50:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T16:50:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T16:50:26.494 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T16:50:26.522 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T16:50:26.561 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T16:50:26.756 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T16:50:26.772 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T16:50:26.805 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T16:50:26.871 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-toml. 2024-09-12T16:50:26.899 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T16:50:26.938 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T16:50:27.207 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T16:50:27.235 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T16:50:27.269 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T16:50:27.282 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T16:50:27.297 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T16:50:27.335 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T16:50:27.621 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T16:50:27.647 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-toml. 2024-09-12T16:50:27.647 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T16:50:27.675 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T16:50:27.685 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T16:50:27.713 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T16:50:27.921 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T16:50:27.937 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T16:50:27.971 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T16:50:28.017 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T16:50:28.045 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T16:50:28.075 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T16:50:28.412 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T16:50:28.433 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T16:50:28.471 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T16:50:28.593 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package radosgw. 2024-09-12T16:50:28.620 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:28.659 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:28.749 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T16:50:28.765 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T16:50:28.801 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T16:50:29.530 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package radosgw. 2024-09-12T16:50:29.536 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T16:50:29.552 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:29.558 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:29.594 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:29.596 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:29.891 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T16:50:30.150 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T16:50:30.267 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T16:50:30.531 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T16:50:30.532 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T16:50:30.561 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:50:30.591 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:30.836 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T16:50:30.862 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T16:50:31.112 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T16:50:31.221 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T16:50:31.264 INFO:teuthology.orchestra.run.smithi122.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T16:50:31.335 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:31.459 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T16:50:31.794 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T16:50:31.852 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user cephadm....done 2024-09-12T16:50:32.009 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T16:50:32.203 INFO:teuthology.orchestra.run.smithi151.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T16:50:32.319 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T16:50:32.507 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:32.553 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T16:50:32.679 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T16:50:32.929 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T16:50:32.998 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user cephadm....done 2024-09-12T16:50:33.121 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T16:50:33.189 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T16:50:33.298 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T16:50:33.373 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T16:50:33.600 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T16:50:33.615 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T16:50:33.741 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T16:50:33.944 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T16:50:34.018 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T16:50:34.195 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T16:50:34.269 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T16:50:34.378 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T16:50:34.463 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T16:50:34.706 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T16:50:34.772 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T16:50:34.957 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T16:50:35.115 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T16:50:35.216 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T16:50:35.366 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T16:50:35.467 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:35.642 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T16:50:35.727 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T16:50:35.853 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T16:50:35.918 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T16:50:35.979 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T16:50:36.105 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T16:50:36.153 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T16:50:36.364 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T16:50:36.404 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T16:50:36.654 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:36.740 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T16:50:36.769 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T16:50:36.834 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T16:50:36.914 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T16:50:36.960 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T16:50:37.040 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T16:50:37.166 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T16:50:37.292 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T16:50:37.319 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T16:50:37.445 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T16:50:37.551 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T16:50:37.721 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T16:50:37.949 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T16:50:37.981 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T16:50:37.999 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T16:50:38.079 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T16:50:38.205 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T16:50:38.290 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T16:50:38.425 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T16:50:38.564 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T16:50:38.690 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T16:50:38.958 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T16:50:39.102 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T16:50:39.234 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T16:50:39.354 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T16:50:39.479 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T16:50:39.561 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T16:50:39.605 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T16:50:39.686 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T16:50:39.939 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T16:50:40.330 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T16:50:40.340 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T16:50:40.592 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T16:50:40.597 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T16:50:40.723 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T16:50:40.849 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T16:50:40.959 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T16:50:41.158 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T16:50:41.244 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T16:50:41.551 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T16:50:41.587 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T16:50:41.794 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T16:50:41.838 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T16:50:41.964 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:42.163 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T16:50:42.257 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T16:50:42.438 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T16:50:42.567 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T16:50:42.781 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T16:50:43.032 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T16:50:43.158 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T16:50:43.730 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T16:50:43.761 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T16:50:44.132 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:50:44.275 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T16:50:44.526 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T16:50:44.627 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T16:50:44.745 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T16:50:44.933 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T16:50:45.038 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T16:50:45.192 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:50:45.297 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T16:50:45.335 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T16:50:45.565 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:50:45.594 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T16:50:45.693 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T16:50:45.720 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T16:50:45.846 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T16:50:45.984 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T16:50:46.139 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T16:50:46.227 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T16:50:46.398 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T16:50:46.486 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T16:50:46.641 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:50:46.745 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T16:50:46.767 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T16:50:46.997 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T16:50:47.060 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T16:50:47.256 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T16:50:47.311 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T16:50:47.357 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T16:50:47.562 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T16:50:47.625 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T16:50:47.751 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T16:50:47.805 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T16:50:48.039 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T16:50:48.043 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T16:50:48.307 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T16:50:48.353 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T16:50:48.433 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T16:50:48.604 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T16:50:48.725 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T16:50:48.747 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T16:50:48.835 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T16:50:48.873 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T16:50:48.961 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T16:50:49.102 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T16:50:49.199 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T16:50:49.317 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T16:50:49.404 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T16:50:49.646 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T16:50:49.702 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T16:50:49.748 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T16:50:49.961 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T16:50:50.004 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T16:50:50.087 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T16:50:50.212 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T16:50:50.338 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:50:50.450 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T16:50:50.456 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T16:50:50.576 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T16:50:50.757 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T16:50:50.961 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T16:50:51.050 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T16:50:51.220 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T16:50:51.318 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T16:50:51.346 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T16:50:51.419 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T16:50:51.589 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:50:51.670 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T16:50:51.698 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T16:50:51.937 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T16:50:52.015 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T16:50:52.299 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T16:50:52.308 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T16:50:52.593 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T16:50:52.684 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T16:50:52.702 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T16:50:52.944 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T16:50:52.961 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T16:50:53.248 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T16:50:53.271 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T16:50:53.397 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:53.498 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:53.599 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T16:50:53.608 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T16:50:53.936 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:53.975 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T16:50:54.062 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:54.188 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T16:50:54.260 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T16:50:54.473 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:54.596 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T16:50:54.598 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:54.722 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:54.725 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:54.848 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:54.927 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T16:50:54.928 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T16:50:54.991 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T16:50:55.327 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:55.426 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:55.436 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:55.537 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T16:50:55.552 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:55.678 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:55.805 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T16:50:55.822 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:55.948 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:56.074 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:56.292 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T16:50:56.292 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T16:50:56.783 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:56.909 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:57.033 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:57.044 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:57.150 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:57.152 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T16:50:57.260 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:57.361 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:57.487 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:58.036 INFO:teuthology.orchestra.run.smithi122.stdout:Adding group ceph....done 2024-09-12T16:50:58.331 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:58.381 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user ceph....done 2024-09-12T16:50:58.457 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:58.547 INFO:teuthology.orchestra.run.smithi122.stdout:Setting system user ceph properties....done 2024-09-12T16:50:58.555 INFO:teuthology.orchestra.run.smithi122.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T16:50:58.575 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:58.688 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T16:50:58.692 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:58.802 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:58.993 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T16:50:59.310 INFO:teuthology.orchestra.run.smithi151.stdout:Adding group ceph....done 2024-09-12T16:50:59.488 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:59.614 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:50:59.670 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user ceph....done 2024-09-12T16:50:59.839 INFO:teuthology.orchestra.run.smithi151.stdout:Setting system user ceph properties....done 2024-09-12T16:50:59.851 INFO:teuthology.orchestra.run.smithi151.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T16:50:59.987 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T16:51:00.066 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:51:00.066 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:51:00.316 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T16:51:00.499 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:00.802 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:00.839 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T16:51:00.953 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:01.284 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:01.424 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:51:01.425 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:51:01.518 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T16:51:01.519 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T16:51:01.871 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:01.986 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:02.218 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T16:51:02.229 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T16:51:02.229 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T16:51:02.687 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:02.715 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:02.930 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T16:51:02.930 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T16:51:02.956 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T16:51:02.956 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T16:51:03.389 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:03.425 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:03.515 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:03.634 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T16:51:03.634 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T16:51:03.657 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:03.853 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T16:51:03.854 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T16:51:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:04.300 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:04.403 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T16:51:04.403 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T16:51:04.469 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:04.595 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:04.746 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:04.911 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:05.037 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:05.091 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T16:51:05.188 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:05.199 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T16:51:05.369 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T16:51:05.401 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T16:51:05.401 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T16:51:05.889 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:06.040 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:06.166 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:06.309 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:51:06.453 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T16:51:06.637 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T16:51:06.738 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T16:51:06.890 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T16:51:07.085 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T16:51:07.090 DEBUG:teuthology.parallel:result is None 2024-09-12T16:51:07.948 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T16:51:08.578 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T16:51:08.582 DEBUG:teuthology.parallel:result is None 2024-09-12T16:51:08.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:51:08.723 DEBUG:teuthology.orchestra.run.smithi122:> dpkg-query -W -f '${Version}' ceph 2024-09-12T16:51:08.742 INFO:teuthology.orchestra.run.smithi122.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:51:08.743 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:51:08.743 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T16:51:08.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:51:08.883 DEBUG:teuthology.orchestra.run.smithi151:> dpkg-query -W -f '${Version}' ceph 2024-09-12T16:51:08.902 INFO:teuthology.orchestra.run.smithi151.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:51:08.902 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:51:08.902 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T16:51:08.904 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T16:51:08.904 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:08.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:51:08.919 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:08.919 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:51:08.958 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T16:51:08.958 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:08.959 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:51:08.974 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:51:09.034 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:09.035 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:51:09.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:51:09.101 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T16:51:09.101 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:09.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:51:09.115 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:51:09.170 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:09.170 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:51:09.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:51:09.238 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T16:51:09.239 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:09.239 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:51:09.252 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:51:09.306 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:09.306 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:51:09.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:51:09.373 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T16:51:09.461 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T16:51:09.462 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-09-12T16:51:09.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-09-12T16:51:09.477 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T16:51:09.477 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:51:09.521 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:51:09.534 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T16:51:09.534 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:51:09.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:51:09.602 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T16:51:09.602 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T16:51:09.602 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7902685', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHQWQJanbhTTpeoPAVZb29awoEd0JTgZif1Bo2508vq9AATI1yC4pht1RYd06WSZ4GAJHnJNjn/pevGY/aM1z8E=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJt5h+gP9zPSmgK8IbUyDdqQLs+768H4AlaJNAxynbNpYEvXCAhmV/tvPob+3NVAUHohICHS7cpFfgbAahn2ODw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T16:51:09.603 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:51:09.632 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:51:09.638 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:51:09.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:51:09.695 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:09.695 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T16:51:09.739 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T16:51:09.740 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-09-12T16:51:09.787 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T16:51:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:51:09.788 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-12T16:51:09.788 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:51:09.788 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-12 16:45:43.644286660 +0000 2024-09-12T16:51:09.788 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-12 16:45:43.640286694 +0000 2024-09-12T16:51:09.788 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-12 16:45:43.640286694 +0000 2024-09-12T16:51:09.788 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-12T16:51:09.789 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T16:51:09.841 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-12T16:51:09.841 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-12T16:51:09.842 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000335095 s, 1.5 MB/s 2024-09-12T16:51:09.843 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T16:51:09.893 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-09-12T16:51:09.943 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T16:51:09.943 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:51:09.944 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-09-12T16:51:09.944 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:51:09.944 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-12 16:45:44.396279943 +0000 2024-09-12T16:51:09.944 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-12 16:45:44.152282122 +0000 2024-09-12T16:51:09.944 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-12 16:45:44.152282122 +0000 2024-09-12T16:51:09.944 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-12T16:51:09.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T16:51:09.997 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-12T16:51:09.998 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-12T16:51:09.998 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000444514 s, 1.2 MB/s 2024-09-12T16:51:09.999 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T16:51:10.049 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-09-12T16:51:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T16:51:10.095 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:51:10.095 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-09-12T16:51:10.095 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:51:10.095 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-12 16:45:44.928275191 +0000 2024-09-12T16:51:10.096 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-12 16:45:44.648277692 +0000 2024-09-12T16:51:10.096 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-12 16:45:44.648277692 +0000 2024-09-12T16:51:10.096 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-12T16:51:10.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T16:51:10.154 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-12T16:51:10.154 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-12T16:51:10.154 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000328923 s, 1.6 MB/s 2024-09-12T16:51:10.155 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T16:51:10.210 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-09-12T16:51:10.263 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T16:51:10.263 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:51:10.263 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-09-12T16:51:10.263 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:51:10.264 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-12 16:45:45.428270725 +0000 2024-09-12T16:51:10.264 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-12 16:45:45.184272904 +0000 2024-09-12T16:51:10.264 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-12 16:45:45.184272904 +0000 2024-09-12T16:51:10.264 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-09-12T16:51:10.264 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T16:51:10.318 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-12T16:51:10.318 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-12T16:51:10.318 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000336683 s, 1.5 MB/s 2024-09-12T16:51:10.319 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T16:51:10.368 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T16:51:10.369 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:10.369 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T16:51:10.374 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T16:51:10.375 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-09-12T16:51:10.423 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T16:51:10.423 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:51:10.423 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-09-12T16:51:10.423 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:51:10.424 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-12 16:45:43.610062810 +0000 2024-09-12T16:51:10.424 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-12 16:45:43.370064954 +0000 2024-09-12T16:51:10.424 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-12 16:45:43.370064954 +0000 2024-09-12T16:51:10.424 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-12T16:51:10.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T16:51:10.477 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-12T16:51:10.477 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-12T16:51:10.477 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000388727 s, 1.3 MB/s 2024-09-12T16:51:10.478 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T16:51:10.528 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-09-12T16:51:10.574 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T16:51:10.574 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:51:10.574 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-12T16:51:10.575 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:51:10.575 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-12 16:45:44.094058487 +0000 2024-09-12T16:51:10.575 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-12 16:45:43.838060773 +0000 2024-09-12T16:51:10.575 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-12 16:45:43.838060773 +0000 2024-09-12T16:51:10.575 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-12T16:51:10.575 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T16:51:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-12T16:51:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-12T16:51:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000343211 s, 1.5 MB/s 2024-09-12T16:51:10.634 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T16:51:10.684 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-09-12T16:51:10.730 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T16:51:10.730 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:51:10.730 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-09-12T16:51:10.731 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:51:10.731 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-12 16:45:44.566054271 +0000 2024-09-12T16:51:10.731 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-12 16:45:44.338056308 +0000 2024-09-12T16:51:10.731 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-12 16:45:44.338056308 +0000 2024-09-12T16:51:10.731 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-12T16:51:10.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T16:51:10.784 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-12T16:51:10.785 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-12T16:51:10.785 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.0003386 s, 1.5 MB/s 2024-09-12T16:51:10.786 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T16:51:10.836 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-09-12T16:51:10.882 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T16:51:10.882 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:51:10.882 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-12T16:51:10.882 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:51:10.883 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-12 16:45:45.054049912 +0000 2024-09-12T16:51:10.883 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-12 16:45:44.810052092 +0000 2024-09-12T16:51:10.883 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-12 16:45:44.810052092 +0000 2024-09-12T16:51:10.883 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-12T16:51:10.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T16:51:10.937 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-12T16:51:10.938 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-12T16:51:10.938 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000380634 s, 1.3 MB/s 2024-09-12T16:51:10.939 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T16:51:10.987 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T16:51:10.988 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-12T16:51:10.988 INFO:tasks.ceph:Generating config... 2024-09-12T16:51:10.989 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T16:51:10.989 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-12T16:51:10.989 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T16:51:10.989 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T16:51:10.990 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T16:51:10.990 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T16:51:10.991 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T16:51:10.991 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T16:51:10.991 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T16:51:10.991 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T16:51:10.991 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T16:51:10.991 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T16:51:10.991 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T16:51:10.991 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T16:51:10.991 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T16:51:10.991 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T16:51:10.991 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T16:51:10.991 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T16:51:10.992 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T16:51:10.992 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T16:51:11.026 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T16:51:11.044 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T16:51:11.121 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:51:11.175 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.122')] 2024-09-12T16:51:11.175 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.122'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-12T16:51:11.176 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:11.176 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T16:51:11.226 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.122 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:11.307 INFO:teuthology.orchestra.run.smithi122.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:51:11.307 INFO:teuthology.orchestra.run.smithi122.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:51:11.309 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:11.309 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: generated fsid 5046056a-17be-43b6-80d1-88da5e3ce49b 2024-09-12T16:51:11.309 INFO:teuthology.orchestra.run.smithi122.stdout:setting min_mon_release = quincy 2024-09-12T16:51:11.310 INFO:teuthology.orchestra.run.smithi122.stdout:epoch 0 2024-09-12T16:51:11.310 INFO:teuthology.orchestra.run.smithi122.stdout:fsid 5046056a-17be-43b6-80d1-88da5e3ce49b 2024-09-12T16:51:11.310 INFO:teuthology.orchestra.run.smithi122.stdout:last_changed 2024-09-12T16:51:11.307925+0000 2024-09-12T16:51:11.310 INFO:teuthology.orchestra.run.smithi122.stdout:created 2024-09-12T16:51:11.307925+0000 2024-09-12T16:51:11.310 INFO:teuthology.orchestra.run.smithi122.stdout:min_mon_release 17 (quincy) 2024-09-12T16:51:11.311 INFO:teuthology.orchestra.run.smithi122.stdout:election_strategy: 1 2024-09-12T16:51:11.311 INFO:teuthology.orchestra.run.smithi122.stdout:0: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.a 2024-09-12T16:51:11.311 INFO:teuthology.orchestra.run.smithi122.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-12T16:51:11.312 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T16:51:11.357 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5046056a-17be-43b6-80d1-88da5e3ce49b... 2024-09-12T16:51:11.358 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:51:11.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:51:11.429 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-09-12T16:51:11.429 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-09-12T16:51:11.429 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:51:11.429 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.430 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:51:11.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = 172.21.15.122 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 5046056a-17be-43b6-80d1-88da5e3ce49b 2024-09-12T16:51:11.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-09-12T16:51:11.433 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-09-12T16:51:11.434 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: debug objclass = 20 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: bdev async discard = True 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: bdev enable discard = True 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore allocator = bitmap 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 1/20 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 1/20 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 4/10 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:51:11.435 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-09-12T16:51:11.436 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:51:11.437 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-09-12T16:51:11.438 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi122.stdout: rgw gc obj min wait = 15 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi122.stdout: debug rgw = 20 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi122.stdout: setgroup = ceph 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi122.stdout: setuser = ceph 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-09-12T16:51:11.439 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:51:11.441 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-09-12T16:51:11.442 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = 172.21.15.122 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 5046056a-17be-43b6-80d1-88da5e3ce49b 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.443 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-09-12T16:51:11.444 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: debug objclass = 20 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-09-12T16:51:11.445 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-12T16:51:11.446 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-09-12T16:51:11.447 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.448 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: rgw gc obj min wait = 15 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: debug rgw = 20 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: setgroup = ceph 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout: setuser = ceph 2024-09-12T16:51:11.449 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-09-12T16:51:11.451 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T16:51:11.451 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T16:51:11.545 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T16:51:11.545 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:11.545 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T16:51:11.551 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:11.551 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T16:51:11.599 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-09-12T16:51:11.599 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:11.599 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:51:11.599 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:51:11.663 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:11.664 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:11.711 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:51:11.711 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:11.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:51:11.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:51:11.735 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:11.735 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:11.783 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T16:51:11.783 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T16:51:11.783 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T16:51:11.868 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T16:51:11.882 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T16:51:11.882 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T16:51:11.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T16:51:11.959 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T16:51:11.970 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T16:51:11.970 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-12T16:51:11.971 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T16:51:11.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T16:51:11.985 INFO:tasks.ceph:role: osd.0 2024-09-12T16:51:11.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-12T16:51:11.986 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T16:51:12.050 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:51:12.050 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:51:12.050 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:51:12.050 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:51:12.051 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:51:12.051 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:51:12.051 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:51:12.051 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:51:12.051 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:51:12.051 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:51:12.517 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-09-12T16:51:12.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-09-12T16:51:12.519 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T16:51:12.663 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T16:51:12.674 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:51:12.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:51:12.675 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:12.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:12.785+0000 7f629f9c97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T16:51:12.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:12.789+0000 7f629f9c97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T16:51:12.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:12.789+0000 7f629f9c97c0 -1 bdev(0x55f93634f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T16:51:12.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:12.789+0000 7f629f9c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T16:51:15.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T16:51:15.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T16:51:15.996 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T16:51:15.996 INFO:tasks.ceph:role: osd.1 2024-09-12T16:51:15.996 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:51:15.996 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T16:51:16.058 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:51:16.059 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:51:16.059 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:51:16.059 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:51:16.059 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:51:16.059 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:51:16.059 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:51:16.059 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:51:16.060 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:51:16.060 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:51:16.517 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-12T16:51:16.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-12T16:51:16.519 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T16:51:16.619 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T16:51:16.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:51:16.629 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:51:16.629 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T16:51:16.680 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T16:51:16.680 INFO:tasks.ceph:role: osd.2 2024-09-12T16:51:16.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:51:16.680 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:51:16.746 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:51:17.215 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-12T16:51:17.216 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-12T16:51:17.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-12T16:51:17.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T16:51:17.379 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:51:17.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:51:17.380 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T16:51:17.434 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T16:51:17.434 INFO:tasks.ceph:role: osd.3 2024-09-12T16:51:17.434 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:51:17.434 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T16:51:17.498 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:51:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:51:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:51:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:51:17.498 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:51:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:51:17.499 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:51:17.499 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:51:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:51:17.499 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:51:17.981 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-12T16:51:17.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-12T16:51:17.983 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-12T16:51:18.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T16:51:18.149 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:51:18.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:51:18.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:18.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:18.262+0000 7f802d85d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T16:51:18.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:18.262+0000 7f802d85d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T16:51:18.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:18.262+0000 7f802d85d7c0 -1 bdev(0x56291676d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T16:51:18.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:18.262+0000 7f802d85d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T16:51:21.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T16:51:21.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:21.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:21.474+0000 7f283e3d17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T16:51:21.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:21.474+0000 7f283e3d17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T16:51:21.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:21.478+0000 7f283e3d17c0 -1 bdev(0x55a436b33800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T16:51:21.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:21.478+0000 7f283e3d17c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T16:51:24.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T16:51:24.698 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:24.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:24.774+0000 7fcf91d9e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T16:51:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:24.778+0000 7fcf91d9e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T16:51:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:24.778+0000 7fcf91d9e7c0 -1 bdev(0x555565937800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T16:51:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:24.778+0000 7fcf91d9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T16:51:27.914 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T16:51:27.971 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T16:51:27.971 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:27.971 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T16:51:27.986 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:27.986 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T16:51:28.025 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:28.025 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T16:51:28.078 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:28.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T16:51:28.134 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:28.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T16:51:28.189 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:28.190 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T16:51:28.234 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T16:51:28.235 DEBUG:teuthology.orchestra.run.smithi122:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAAHONmyj8MLxAAI01pxAZTlCcptB4F2lr9kw== 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.x] 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQD/G+NmXKjAMxAAo/dfk9F0fAvdDifjbkuuzw== 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAGHONmcq2qDxAAQmQJZIbOWXmKo+XHGAPHEQ== 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAJHONmbi92HBAAMhe6SdXWDluGfG5FdCIcGg== 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.3] 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQAMHONmk41fLhAAjt0YazkKbAAJI8lIqABhGg== 2024-09-12T16:51:28.247 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-09-12T16:51:28.248 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQD/G+NmuwI0ORAAHUJ9yBIgcYAEw1jOz4wCEA== 2024-09-12T16:51:28.248 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:51:28.337 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:51:28.421 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:51:28.508 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:51:28.593 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:51:28.674 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:51:28.761 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T16:51:28.762 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T16:51:28.814 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:51:28.905 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T16:51:28.917 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:51:28.965 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T16:51:28.966 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T16:51:28.966 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T16:51:29.008 INFO:tasks.ceph.mon.a:Started 2024-09-12T16:51:29.008 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T16:51:29.008 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T16:51:29.009 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T16:51:29.013 INFO:tasks.ceph.mgr.x:Started 2024-09-12T16:51:29.013 DEBUG:tasks.ceph:set 0 configs 2024-09-12T16:51:29.013 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T16:51:29.013 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T16:51:29.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa356f36640 1 Processor -- start 2024-09-12T16:51:29.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa356f36640 1 -- start start 2024-09-12T16:51:29.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa356f36640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 0x7fa350096cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:29.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa356f36640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa350098bc0 con 0x7fa350097210 2024-09-12T16:51:29.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa356f36640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa350097af0 con 0x7fa3500968f0 2024-09-12T16:51:29.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa354cd2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 0x7fa350096cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:29.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa354cd2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 0x7fa350096cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53592/0 (socket says 172.21.15.122:53592) 2024-09-12T16:51:29.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa354cd2640 1 -- 172.21.15.122:0/2118298237 learned_addr learned my addr 172.21.15.122:0/2118298237 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:29.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa354cd2640 1 -- 172.21.15.122:0/2118298237 >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 msgr2=0x7fa350096cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T16:51:29.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa354cd2640 1 -- 172.21.15.122:0/2118298237 >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 msgr2=0x7fa350096cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T16:51:29.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa354cd2640 1 --2- 172.21.15.122:0/2118298237 >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 0x7fa350096cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T16:51:29.137 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.133+0000 7fa354cd2640 1 --2- 172.21.15.122:0/2118298237 >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 0x7fa350096cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T16:51:29.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360731688 0 0) 0x7fa350098bc0 con 0x7fa350097210 2024-09-12T16:51:29.164 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa33c005740 con 0x7fa350097210 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3366537135 0 0) 0x7fa33c005740 con 0x7fa350097210 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 msgr2=0x7fa350096cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 --2- 172.21.15.122:0/2118298237 >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 0x7fa350096cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3500988b0 con 0x7fa350097210 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3718109123 0 0) 0x7fa338001630 con 0x7fa350097210 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 >> v1:172.21.15.122:6789/0 conn(0x7fa350097210 legacy=0x7fa35012be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 --2- 172.21.15.122:0/2118298237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa33c006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa350097af0 con 0x7fa33c005c70 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa354cd2640 1 --2- 172.21.15.122:0/2118298237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa33c006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:29.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.161+0000 7fa354cd2640 1 -- 172.21.15.122:0/2118298237 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c005740 con 0x7fa33c005c70 2024-09-12T16:51:29.185 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa354cd2640 1 --2- 172.21.15.122:0/2118298237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa33c006070 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa340009810 tx=0x7fa34001c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae7f5e719e50645 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:29.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34000f040 con 0x7fa33c005c70 2024-09-12T16:51:29.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3400a9530 con 0x7fa33c005c70 2024-09-12T16:51:29.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa34f7fe640 1 -- 172.21.15.122:0/2118298237 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3400a9850 con 0x7fa33c005c70 2024-09-12T16:51:29.186 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa356f36640 1 -- 172.21.15.122:0/2118298237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 msgr2=0x7fa33c006070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa356f36640 1 --2- 172.21.15.122:0/2118298237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa33c006070 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa340009810 tx=0x7fa34001c6b0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa356f36640 1 -- 172.21.15.122:0/2118298237 shutdown_connections 2024-09-12T16:51:29.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa356f36640 1 --2- 172.21.15.122:0/2118298237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa33c006070 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa356f36640 1 --2- 172.21.15.122:0/2118298237 >> v2:172.21.15.122:3300/0 conn(0x7fa3500968f0 0x7fa350096cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa356f36640 1 -- 172.21.15.122:0/2118298237 >> 172.21.15.122:0/2118298237 conn(0x7fa35009cf70 msgr2=0x7fa35009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:29.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa356f36640 1 -- 172.21.15.122:0/2118298237 shutdown_connections 2024-09-12T16:51:29.187 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.181+0000 7fa356f36640 1 -- 172.21.15.122:0/2118298237 wait complete. 2024-09-12T16:51:29.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa356f36640 1 Processor -- start 2024-09-12T16:51:29.188 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa356f36640 1 -- start start 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa356f36640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa350124b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa356f36640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa35006e880 con 0x7fa33c005c70 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa354cd2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa350124b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa354cd2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa350124b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53618/0 (socket says 172.21.15.122:53618) 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa354cd2640 1 -- 172.21.15.122:0/1170282132 learned_addr learned my addr 172.21.15.122:0/1170282132 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa354cd2640 1 -- 172.21.15.122:0/1170282132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa350127ae0 con 0x7fa33c005c70 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa354cd2640 1 --2- 172.21.15.122:0/1170282132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa350124b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa34001ad60 tx=0x7fa33c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa34d7fa640 1 -- 172.21.15.122:0/1170282132 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3400c1070 con 0x7fa33c005c70 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa34d7fa640 1 -- 172.21.15.122:0/1170282132 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34000f000 con 0x7fa33c005c70 2024-09-12T16:51:29.189 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa34d7fa640 1 -- 172.21.15.122:0/1170282132 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3400bc600 con 0x7fa33c005c70 2024-09-12T16:51:29.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa350074020 con 0x7fa33c005c70 2024-09-12T16:51:29.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa350127da0 con 0x7fa33c005c70 2024-09-12T16:51:29.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa34d7fa640 1 -- 172.21.15.122:0/1170282132 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa3400c4070 con 0x7fa33c005c70 2024-09-12T16:51:29.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa34d7fa640 1 -- 172.21.15.122:0/1170282132 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa3400b8030 con 0x7fa33c005c70 2024-09-12T16:51:29.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.185+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3501274f0 con 0x7fa33c005c70 2024-09-12T16:51:29.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.193+0000 7fa34d7fa640 1 -- 172.21.15.122:0/1170282132 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa3400cb080 con 0x7fa33c005c70 2024-09-12T16:51:29.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa3501278b0 con 0x7fa33c005c70 2024-09-12T16:51:29.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa34d7fa640 1 -- 172.21.15.122:0/1170282132 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa350127ae0 con 0x7fa33c005c70 2024-09-12T16:51:29.261 INFO:teuthology.orchestra.run.smithi122.stderr:adjusted tunables profile to default 2024-09-12T16:51:29.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 msgr2=0x7fa350124b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.262 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa356f36640 1 --2- 172.21.15.122:0/1170282132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa350124b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa34001ad60 tx=0x7fa33c007a50 comp rx=0 tx=0).stop 2024-09-12T16:51:29.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 shutdown_connections 2024-09-12T16:51:29.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa356f36640 1 --2- 172.21.15.122:0/1170282132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa33c005c70 0x7fa350124b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 >> 172.21.15.122:0/1170282132 conn(0x7fa35009cf70 msgr2=0x7fa35009aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:29.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 shutdown_connections 2024-09-12T16:51:29.263 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:29.257+0000 7fa356f36640 1 -- 172.21.15.122:0/1170282132 wait complete. 2024-09-12T16:51:29.279 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T16:51:29.279 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T16:51:29.279 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-12T16:51:29.280 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T16:51:29.291 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:29.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T16:51:29.305 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:29.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T16:51:29.358 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-12T16:51:29.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T16:51:29.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new b980825b-63eb-43eb-ac4e-92bc8be6c667 0 2024-09-12T16:51:29.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.578+0000 7f03f33f0640 1 Processor -- start 2024-09-12T16:51:29.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.578+0000 7f03f33f0640 1 -- start start 2024-09-12T16:51:29.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.578+0000 7f03f33f0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f03ec1196b0 0x7f03ec11baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:29.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.578+0000 7f03f33f0640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec11c070 con 0x7f03ec114790 2024-09-12T16:51:29.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.578+0000 7f03f33f0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f03ec11d250 con 0x7f03ec1196b0 2024-09-12T16:51:29.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.578+0000 7f03f098b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f03ec1196b0 0x7f03ec11baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:29.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.578+0000 7f03f118c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f03ec114790 0x7f03ec114b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:34484/0 (socket says 172.21.15.151:34484) 2024-09-12T16:51:29.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.578+0000 7f03f118c640 1 -- 172.21.15.151:0/738334369 learned_addr learned my addr 172.21.15.151:0/738334369 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:51:29.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.582+0000 7f03f098b640 1 -- 172.21.15.151:0/738334369 >> v1:172.21.15.122:6789/0 conn(0x7f03ec114790 legacy=0x7f03ec114b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.582+0000 7f03f098b640 1 -- 172.21.15.151:0/738334369 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec11d3d0 con 0x7f03ec1196b0 2024-09-12T16:51:29.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.582+0000 7f03f098b640 1 --2- 172.21.15.151:0/738334369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec1196b0 0x7f03ec11baa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009740 tx=0x7f03dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfc709c189a6c37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:29.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.582+0000 7f03e3fff640 1 -- 172.21.15.151:0/738334369 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03dc0b1070 con 0x7f03ec1196b0 2024-09-12T16:51:29.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.582+0000 7f03e3fff640 1 -- 172.21.15.151:0/738334369 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03dc0ac520 con 0x7f03ec1196b0 2024-09-12T16:51:29.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.582+0000 7f03e3fff640 1 -- 172.21.15.151:0/738334369 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03dc0ac820 con 0x7f03ec1196b0 2024-09-12T16:51:29.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.582+0000 7f03f33f0640 1 -- 172.21.15.151:0/738334369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec1196b0 msgr2=0x7f03ec11baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.582+0000 7f03f33f0640 1 --2- 172.21.15.151:0/738334369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec1196b0 0x7f03ec11baa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009740 tx=0x7f03dc01c370 comp rx=0 tx=0).stop 2024-09-12T16:51:29.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- 172.21.15.151:0/738334369 shutdown_connections 2024-09-12T16:51:29.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 --2- 172.21.15.151:0/738334369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec1196b0 0x7f03ec11baa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- 172.21.15.151:0/738334369 >> 172.21.15.151:0/738334369 conn(0x7f03ec070d50 msgr2=0x7f03ec073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:29.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- 172.21.15.151:0/738334369 shutdown_connections 2024-09-12T16:51:29.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- 172.21.15.151:0/738334369 wait complete. 2024-09-12T16:51:29.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 Processor -- start 2024-09-12T16:51:29.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- start start 2024-09-12T16:51:29.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec114790 0x7f03ec1a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:29.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec11cf30 con 0x7f03ec114790 2024-09-12T16:51:29.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f118c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec114790 0x7f03ec1a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:29.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f118c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec114790 0x7f03ec1a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50408/0 (socket says 172.21.15.151:50408) 2024-09-12T16:51:29.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f118c640 1 -- 172.21.15.151:0/4242275897 learned_addr learned my addr 172.21.15.151:0/4242275897 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:29.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f118c640 1 -- 172.21.15.151:0/4242275897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec1a8320 con 0x7f03ec114790 2024-09-12T16:51:29.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f118c640 1 --2- 172.21.15.151:0/4242275897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec114790 0x7f03ec1a7d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f03e400cb40 tx=0x7f03e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:29.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03e1ffb640 1 -- 172.21.15.151:0/4242275897 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03e4017070 con 0x7f03ec114790 2024-09-12T16:51:29.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03e1ffb640 1 -- 172.21.15.151:0/4242275897 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e400aba0 con 0x7f03ec114790 2024-09-12T16:51:29.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec1a8610 con 0x7f03ec114790 2024-09-12T16:51:29.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03e1ffb640 1 -- 172.21.15.151:0/4242275897 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03e4012400 con 0x7f03ec114790 2024-09-12T16:51:29.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec1ad760 con 0x7f03ec114790 2024-09-12T16:51:29.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03e1ffb640 1 -- 172.21.15.151:0/4242275897 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03e401a070 con 0x7f03ec114790 2024-09-12T16:51:29.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03e1ffb640 1 -- 172.21.15.151:0/4242275897 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f03e401cbb0 con 0x7f03ec114790 2024-09-12T16:51:29.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.586+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec114bf0 con 0x7f03ec114790 2024-09-12T16:51:29.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.594+0000 7f03e1ffb640 1 -- 172.21.15.151:0/4242275897 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f03e4021070 con 0x7f03ec114790 2024-09-12T16:51:29.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.662+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b980825b-63eb-43eb-ac4e-92bc8be6c667", "id": 0} v 0) -- 0x7f03ec1a8950 con 0x7f03ec114790 2024-09-12T16:51:29.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.666+0000 7f03e1ffb640 1 -- 172.21.15.151:0/4242275897 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b980825b-63eb-43eb-ac4e-92bc8be6c667", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f03e40125a0 con 0x7f03ec114790 2024-09-12T16:51:29.668 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-09-12T16:51:29.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.666+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec114790 msgr2=0x7f03ec1a7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.666+0000 7f03f33f0640 1 --2- 172.21.15.151:0/4242275897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec114790 0x7f03ec1a7d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f03e400cb40 tx=0x7f03e400a060 comp rx=0 tx=0).stop 2024-09-12T16:51:29.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.666+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 shutdown_connections 2024-09-12T16:51:29.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.666+0000 7f03f33f0640 1 --2- 172.21.15.151:0/4242275897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03ec114790 0x7f03ec1a7d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.666+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 >> 172.21.15.151:0/4242275897 conn(0x7f03ec070d50 msgr2=0x7f03ec115ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:29.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.666+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 shutdown_connections 2024-09-12T16:51:29.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.666+0000 7f03f33f0640 1 -- 172.21.15.151:0/4242275897 wait complete. 2024-09-12T16:51:29.685 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa 1 2024-09-12T16:51:29.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.802+0000 7fe11d997640 1 Processor -- start 2024-09-12T16:51:29.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.802+0000 7fe11d997640 1 -- start start 2024-09-12T16:51:29.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.802+0000 7fe11d997640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe118110050 0x7fe118110430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:29.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.802+0000 7fe11d997640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe118110b50 con 0x7fe1181153e0 2024-09-12T16:51:29.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.802+0000 7fe11d997640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe118115f80 con 0x7fe118110050 2024-09-12T16:51:29.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.802+0000 7fe116ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe118110050 0x7fe118110430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:29.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.802+0000 7fe116ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe118110050 0x7fe118110430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50416/0 (socket says 172.21.15.151:50416) 2024-09-12T16:51:29.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.802+0000 7fe116ffd640 1 -- 172.21.15.151:0/2902829891 learned_addr learned my addr 172.21.15.151:0/2902829891 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:29.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe116ffd640 1 -- 172.21.15.151:0/2902829891 >> v1:172.21.15.122:6789/0 conn(0x7fe1181153e0 legacy=0x7fe118115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe116ffd640 1 -- 172.21.15.151:0/2902829891 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe118116130 con 0x7fe118110050 2024-09-12T16:51:29.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe116ffd640 1 --2- 172.21.15.151:0/2902829891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe118110430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1080097f0 tx=0x7fe10801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344f05b90ec60b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:29.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe1167fc640 1 -- 172.21.15.151:0/2902829891 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1080ab580 con 0x7fe118110050 2024-09-12T16:51:29.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe1167fc640 1 -- 172.21.15.151:0/2902829891 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1080b0070 con 0x7fe118110050 2024-09-12T16:51:29.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe1167fc640 1 -- 172.21.15.151:0/2902829891 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1080ab870 con 0x7fe118110050 2024-09-12T16:51:29.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe11d997640 1 -- 172.21.15.151:0/2902829891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 msgr2=0x7fe118110430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe11d997640 1 --2- 172.21.15.151:0/2902829891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe118110430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1080097f0 tx=0x7fe10801c430 comp rx=0 tx=0).stop 2024-09-12T16:51:29.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe11d997640 1 -- 172.21.15.151:0/2902829891 shutdown_connections 2024-09-12T16:51:29.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe11d997640 1 --2- 172.21.15.151:0/2902829891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe118110430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe11d997640 1 -- 172.21.15.151:0/2902829891 >> 172.21.15.151:0/2902829891 conn(0x7fe118070d50 msgr2=0x7fe118073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:29.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe11d997640 1 -- 172.21.15.151:0/2902829891 shutdown_connections 2024-09-12T16:51:29.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.806+0000 7fe11d997640 1 -- 172.21.15.151:0/2902829891 wait complete. 2024-09-12T16:51:29.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe11d997640 1 Processor -- start 2024-09-12T16:51:29.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe11d997640 1 -- start start 2024-09-12T16:51:29.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe11d997640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe1181a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:29.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe11d997640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe11806d720 con 0x7fe118110050 2024-09-12T16:51:29.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe116ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe1181a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:29.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe116ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe1181a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50422/0 (socket says 172.21.15.151:50422) 2024-09-12T16:51:29.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe116ffd640 1 -- 172.21.15.151:0/1669004824 learned_addr learned my addr 172.21.15.151:0/1669004824 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:29.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe116ffd640 1 -- 172.21.15.151:0/1669004824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1181aa4a0 con 0x7fe118110050 2024-09-12T16:51:29.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe116ffd640 1 --2- 172.21.15.151:0/1669004824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe1181a9ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe10801a060 tx=0x7fe10801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:29.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe114ff9640 1 -- 172.21.15.151:0/1669004824 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1080aa7d0 con 0x7fe118110050 2024-09-12T16:51:29.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe114ff9640 1 -- 172.21.15.151:0/1669004824 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1080aa970 con 0x7fe118110050 2024-09-12T16:51:29.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1181aa730 con 0x7fe118110050 2024-09-12T16:51:29.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe114ff9640 1 -- 172.21.15.151:0/1669004824 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1080aac70 con 0x7fe118110050 2024-09-12T16:51:29.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1181af790 con 0x7fe118110050 2024-09-12T16:51:29.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe114ff9640 1 -- 172.21.15.151:0/1669004824 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1080c77d0 con 0x7fe118110050 2024-09-12T16:51:29.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe114ff9640 1 -- 172.21.15.151:0/1669004824 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe1080be990 con 0x7fe118110050 2024-09-12T16:51:29.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.810+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1181104b0 con 0x7fe118110050 2024-09-12T16:51:29.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.818+0000 7fe114ff9640 1 -- 172.21.15.151:0/1669004824 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe1080de860 con 0x7fe118110050 2024-09-12T16:51:29.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.886+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa", "id": 1} v 0) -- 0x7fe1181153e0 con 0x7fe118110050 2024-09-12T16:51:29.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.894+0000 7fe114ff9640 1 -- 172.21.15.151:0/1669004824 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe1080cc030 con 0x7fe118110050 2024-09-12T16:51:29.895 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-09-12T16:51:29.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.894+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 msgr2=0x7fe1181a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:29.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.894+0000 7fe11d997640 1 --2- 172.21.15.151:0/1669004824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe1181a9ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe10801a060 tx=0x7fe10801ac70 comp rx=0 tx=0).stop 2024-09-12T16:51:29.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.894+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 shutdown_connections 2024-09-12T16:51:29.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.894+0000 7fe11d997640 1 --2- 172.21.15.151:0/1669004824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe118110050 0x7fe1181a9ed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:29.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.894+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 >> 172.21.15.151:0/1669004824 conn(0x7fe118070d50 msgr2=0x7fe118073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:29.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.894+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 shutdown_connections 2024-09-12T16:51:29.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:29.894+0000 7fe11d997640 1 -- 172.21.15.151:0/1669004824 wait complete. 2024-09-12T16:51:29.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6 2 2024-09-12T16:51:30.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.026+0000 7f1bf5b50640 1 Processor -- start 2024-09-12T16:51:30.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.026+0000 7f1bf5b50640 1 -- start start 2024-09-12T16:51:30.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.026+0000 7f1bf5b50640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1bf0111060 0x7f1bf0111440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:30.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.026+0000 7f1bf5b50640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf0111b60 con 0x7f1bf01164f0 2024-09-12T16:51:30.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.026+0000 7f1bf5b50640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf0117090 con 0x7f1bf0111060 2024-09-12T16:51:30.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bef7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1bf0111060 0x7f1bf0111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:30.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bef7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1bf0111060 0x7f1bf0111440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50426/0 (socket says 172.21.15.151:50426) 2024-09-12T16:51:30.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bef7fe640 1 -- 172.21.15.151:0/2913531893 learned_addr learned my addr 172.21.15.151:0/2913531893 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:30.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bef7fe640 1 -- 172.21.15.151:0/2913531893 >> v1:172.21.15.122:6789/0 conn(0x7f1bf01164f0 legacy=0x7f1bf0116980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bef7fe640 1 -- 172.21.15.151:0/2913531893 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf0117240 con 0x7f1bf0111060 2024-09-12T16:51:30.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bef7fe640 1 --2- 172.21.15.151:0/2913531893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf0111440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1be00097f0 tx=0x7f1be001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7490c38bc8af75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:30.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1beeffd640 1 -- 172.21.15.151:0/2913531893 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be00ab580 con 0x7f1bf0111060 2024-09-12T16:51:30.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1beeffd640 1 -- 172.21.15.151:0/2913531893 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be00b0070 con 0x7f1bf0111060 2024-09-12T16:51:30.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1beeffd640 1 -- 172.21.15.151:0/2913531893 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be00ab870 con 0x7f1bf0111060 2024-09-12T16:51:30.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2913531893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 msgr2=0x7f1bf0111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bf5b50640 1 --2- 172.21.15.151:0/2913531893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf0111440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1be00097f0 tx=0x7f1be001c430 comp rx=0 tx=0).stop 2024-09-12T16:51:30.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2913531893 shutdown_connections 2024-09-12T16:51:30.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bf5b50640 1 --2- 172.21.15.151:0/2913531893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf0111440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2913531893 >> 172.21.15.151:0/2913531893 conn(0x7f1bf0071e50 msgr2=0x7f1bf0074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2913531893 shutdown_connections 2024-09-12T16:51:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.030+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2913531893 wait complete. 2024-09-12T16:51:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bf5b50640 1 Processor -- start 2024-09-12T16:51:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bf5b50640 1 -- start start 2024-09-12T16:51:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bf5b50640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf006e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:30.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bf5b50640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf011f2c0 con 0x7f1bf0111060 2024-09-12T16:51:30.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bef7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:30.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bef7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf006e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50432/0 (socket says 172.21.15.151:50432) 2024-09-12T16:51:30.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bef7fe640 1 -- 172.21.15.151:0/2629721352 learned_addr learned my addr 172.21.15.151:0/2629721352 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bef7fe640 1 -- 172.21.15.151:0/2629721352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf0070450 con 0x7f1bf0111060 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bef7fe640 1 --2- 172.21.15.151:0/2629721352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf006e560 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1be0019040 tx=0x7f1be001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1becff9640 1 -- 172.21.15.151:0/2629721352 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be00abe10 con 0x7f1bf0111060 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1becff9640 1 -- 172.21.15.151:0/2629721352 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be00aa8f0 con 0x7f1bf0111060 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf006eb00 con 0x7f1bf0111060 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf006f090 con 0x7f1bf0111060 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1becff9640 1 -- 172.21.15.151:0/2629721352 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be00aaaa0 con 0x7f1bf0111060 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1becff9640 1 -- 172.21.15.151:0/2629721352 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1be00c7440 con 0x7f1bf0111060 2024-09-12T16:51:30.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1becff9640 1 -- 172.21.15.151:0/2629721352 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f1be00be3f0 con 0x7f1bf0111060 2024-09-12T16:51:30.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.034+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf006f3d0 con 0x7f1bf0111060 2024-09-12T16:51:30.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.042+0000 7f1becff9640 1 -- 172.21.15.151:0/2629721352 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1be00160b0 con 0x7f1bf0111060 2024-09-12T16:51:30.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.110+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6", "id": 2} v 0) -- 0x7f1bf01114c0 con 0x7f1bf0111060 2024-09-12T16:51:30.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.114+0000 7f1becff9640 1 -- 172.21.15.151:0/2629721352 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f1be00cc020 con 0x7f1bf0111060 2024-09-12T16:51:30.117 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-09-12T16:51:30.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.118+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 msgr2=0x7f1bf006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.118+0000 7f1bf5b50640 1 --2- 172.21.15.151:0/2629721352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf006e560 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1be0019040 tx=0x7f1be001ac70 comp rx=0 tx=0).stop 2024-09-12T16:51:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.118+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 shutdown_connections 2024-09-12T16:51:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.118+0000 7f1bf5b50640 1 --2- 172.21.15.151:0/2629721352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1bf0111060 0x7f1bf006e560 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.118+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 >> 172.21.15.151:0/2629721352 conn(0x7f1bf0071e50 msgr2=0x7f1bf0112490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.118+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 shutdown_connections 2024-09-12T16:51:30.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.118+0000 7f1bf5b50640 1 -- 172.21.15.151:0/2629721352 wait complete. 2024-09-12T16:51:30.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 61fba858-88d7-4f24-b3a4-cfed25eca39b 3 2024-09-12T16:51:30.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e9a29d640 1 Processor -- start 2024-09-12T16:51:30.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e9a29d640 1 -- start start 2024-09-12T16:51:30.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e9a29d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9e94114790 0x7f9e94114b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:30.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e9a29d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e94115260 con 0x7f9e9406d1f0 2024-09-12T16:51:30.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e9a29d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9406dd90 con 0x7f9e94114790 2024-09-12T16:51:30.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e93fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9e94114790 0x7f9e94114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:30.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e93fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9e94114790 0x7f9e94114b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:49918/0 (socket says 172.21.15.151:49918) 2024-09-12T16:51:30.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e93fff640 1 -- 172.21.15.151:0/2032246247 learned_addr learned my addr 172.21.15.151:0/2032246247 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:30.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e8bfff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f9e9406d1f0 0x7f9e9406d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:59744/0 (socket says 172.21.15.151:59744) 2024-09-12T16:51:30.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e93fff640 1 -- 172.21.15.151:0/2032246247 >> v1:172.21.15.122:6789/0 conn(0x7f9e9406d1f0 legacy=0x7f9e9406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.250+0000 7f9e93fff640 1 -- 172.21.15.151:0/2032246247 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9406df40 con 0x7f9e94114790 2024-09-12T16:51:30.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e93fff640 1 --2- 172.21.15.151:0/2032246247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e94114790 0x7f9e94114b70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9e840097f0 tx=0x7f9e8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2958e3c272247c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:30.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e937fe640 1 -- 172.21.15.151:0/2032246247 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e840ab580 con 0x7f9e94114790 2024-09-12T16:51:30.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e937fe640 1 -- 172.21.15.151:0/2032246247 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840b0070 con 0x7f9e94114790 2024-09-12T16:51:30.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e937fe640 1 -- 172.21.15.151:0/2032246247 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e840ab870 con 0x7f9e94114790 2024-09-12T16:51:30.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e9a29d640 1 -- 172.21.15.151:0/2032246247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e94114790 msgr2=0x7f9e94114b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e9a29d640 1 --2- 172.21.15.151:0/2032246247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e94114790 0x7f9e94114b70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9e840097f0 tx=0x7f9e8401c430 comp rx=0 tx=0).stop 2024-09-12T16:51:30.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e9a29d640 1 -- 172.21.15.151:0/2032246247 shutdown_connections 2024-09-12T16:51:30.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e9a29d640 1 --2- 172.21.15.151:0/2032246247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e94114790 0x7f9e94114b70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:30.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e9a29d640 1 -- 172.21.15.151:0/2032246247 >> 172.21.15.151:0/2032246247 conn(0x7f9e94070d50 msgr2=0x7f9e94073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:30.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e9a29d640 1 -- 172.21.15.151:0/2032246247 shutdown_connections 2024-09-12T16:51:30.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.254+0000 7f9e9a29d640 1 -- 172.21.15.151:0/2032246247 wait complete. 2024-09-12T16:51:30.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e9a29d640 1 Processor -- start 2024-09-12T16:51:30.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e9a29d640 1 -- start start 2024-09-12T16:51:30.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e9a29d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e9406d1f0 0x7f9e941a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:30.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e9a29d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9411f2e0 con 0x7f9e9406d1f0 2024-09-12T16:51:30.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e9406d1f0 0x7f9e941a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:30.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e9406d1f0 0x7f9e941a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:49926/0 (socket says 172.21.15.151:49926) 2024-09-12T16:51:30.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e93fff640 1 -- 172.21.15.151:0/1573829433 learned_addr learned my addr 172.21.15.151:0/1573829433 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:30.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e93fff640 1 -- 172.21.15.151:0/1573829433 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e941a8250 con 0x7f9e9406d1f0 2024-09-12T16:51:30.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e93fff640 1 --2- 172.21.15.151:0/1573829433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e9406d1f0 0x7f9e941a7c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e840ad040 tx=0x7f9e8401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:30.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e917fa640 1 -- 172.21.15.151:0/1573829433 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e840aa7f0 con 0x7f9e9406d1f0 2024-09-12T16:51:30.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e941a84e0 con 0x7f9e9406d1f0 2024-09-12T16:51:30.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e917fa640 1 -- 172.21.15.151:0/1573829433 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840aa990 con 0x7f9e9406d1f0 2024-09-12T16:51:30.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e917fa640 1 -- 172.21.15.151:0/1573829433 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e840aac70 con 0x7f9e9406d1f0 2024-09-12T16:51:30.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e941ad540 con 0x7f9e9406d1f0 2024-09-12T16:51:30.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e917fa640 1 -- 172.21.15.151:0/1573829433 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e840c77d0 con 0x7f9e9406d1f0 2024-09-12T16:51:30.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e917fa640 1 -- 172.21.15.151:0/1573829433 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9e840bedd0 con 0x7f9e9406d1f0 2024-09-12T16:51:30.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.258+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e94114bf0 con 0x7f9e9406d1f0 2024-09-12T16:51:30.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.266+0000 7f9e917fa640 1 -- 172.21.15.151:0/1573829433 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9e840160b0 con 0x7f9e9406d1f0 2024-09-12T16:51:30.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.334+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "61fba858-88d7-4f24-b3a4-cfed25eca39b", "id": 3} v 0) -- 0x7f9e94114790 con 0x7f9e9406d1f0 2024-09-12T16:51:30.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.338+0000 7f9e917fa640 1 -- 172.21.15.151:0/1573829433 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61fba858-88d7-4f24-b3a4-cfed25eca39b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9e840be3f0 con 0x7f9e9406d1f0 2024-09-12T16:51:30.340 INFO:teuthology.orchestra.run.smithi151.stdout:3 2024-09-12T16:51:30.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.338+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e9406d1f0 msgr2=0x7f9e941a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.338+0000 7f9e9a29d640 1 --2- 172.21.15.151:0/1573829433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e9406d1f0 0x7f9e941a7c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e840ad040 tx=0x7f9e8401ac70 comp rx=0 tx=0).stop 2024-09-12T16:51:30.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.338+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 shutdown_connections 2024-09-12T16:51:30.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.338+0000 7f9e9a29d640 1 --2- 172.21.15.151:0/1573829433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e9406d1f0 0x7f9e941a7c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:30.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.338+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 >> 172.21.15.151:0/1573829433 conn(0x7f9e94070d50 msgr2=0x7f9e94113150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:30.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.338+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 shutdown_connections 2024-09-12T16:51:30.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:30.338+0000 7f9e9a29d640 1 -- 172.21.15.151:0/1573829433 wait complete. 2024-09-12T16:51:30.357 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T16:51:30.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T16:51:30.360 INFO:tasks.ceph.osd.0:Started 2024-09-12T16:51:30.360 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T16:51:30.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T16:51:30.362 INFO:tasks.ceph.osd.1:Started 2024-09-12T16:51:30.362 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T16:51:30.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T16:51:30.364 INFO:tasks.ceph.osd.2:Started 2024-09-12T16:51:30.364 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T16:51:30.364 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T16:51:30.366 INFO:tasks.ceph.osd.3:Started 2024-09-12T16:51:30.367 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:51:30.488 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee2d9b1640 1 Processor -- start 2024-09-12T16:51:30.489 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee2d9b1640 1 -- start start 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee2d9b1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fee2812aee0 0x7fee2812b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee2d9b1640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee280008e0 con 0x7fee2812f110 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee2d9b1640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fee28071e70 con 0x7fee2812aee0 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee26ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fee2812aee0 0x7fee2812b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee26ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fee2812aee0 0x7fee2812b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53630/0 (socket says 172.21.15.122:53630) 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee1e7fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fee2812f110 0x7fee2812f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:33868/0 (socket says 172.21.15.122:33868) 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee26ffd640 1 -- 172.21.15.122:0/2233259682 learned_addr learned my addr 172.21.15.122:0/2233259682 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee26ffd640 1 -- 172.21.15.122:0/2233259682 >> v1:172.21.15.122:6789/0 conn(0x7fee2812f110 legacy=0x7fee2812f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee26ffd640 1 -- 172.21.15.122:0/2233259682 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee280a30b0 con 0x7fee2812aee0 2024-09-12T16:51:30.490 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.485+0000 7fee267fc640 1 -- 172.21.15.122:0/2233259682 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302107749 0 0) 0x7fee280008e0 con 0x7fee2812f110 2024-09-12T16:51:30.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee26ffd640 1 --2- 172.21.15.122:0/2233259682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee2812b2c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee180097f0 tx=0x7fee1801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d37b745d51c862 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:30.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee267fc640 1 -- 172.21.15.122:0/2233259682 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee180ab580 con 0x7fee2812aee0 2024-09-12T16:51:30.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee267fc640 1 -- 172.21.15.122:0/2233259682 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee180b0070 con 0x7fee2812aee0 2024-09-12T16:51:30.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee267fc640 1 -- 172.21.15.122:0/2233259682 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee180ab870 con 0x7fee2812aee0 2024-09-12T16:51:30.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2233259682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 msgr2=0x7fee2812b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 --2- 172.21.15.122:0/2233259682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee2812b2c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee180097f0 tx=0x7fee1801c430 comp rx=0 tx=0).stop 2024-09-12T16:51:30.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2233259682 shutdown_connections 2024-09-12T16:51:30.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 --2- 172.21.15.122:0/2233259682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee2812b2c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:30.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2233259682 >> 172.21.15.122:0/2233259682 conn(0x7fee280a0a60 msgr2=0x7fee2806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:30.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2233259682 shutdown_connections 2024-09-12T16:51:30.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2233259682 wait complete. 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 Processor -- start 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- start start 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee281293f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fee2812b980 con 0x7fee2812aee0 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee26ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee281293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee26ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee281293f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53638/0 (socket says 172.21.15.122:53638) 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee26ffd640 1 -- 172.21.15.122:0/2783077564 learned_addr learned my addr 172.21.15.122:0/2783077564 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee26ffd640 1 -- 172.21.15.122:0/2783077564 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2811cdc0 con 0x7fee2812aee0 2024-09-12T16:51:30.495 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee26ffd640 1 --2- 172.21.15.122:0/2783077564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee281293f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee18019040 tx=0x7fee1801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:30.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee24ff9640 1 -- 172.21.15.122:0/2783077564 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee180b4600 con 0x7fee2812aee0 2024-09-12T16:51:30.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee24ff9640 1 -- 172.21.15.122:0/2783077564 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee180b47c0 con 0x7fee2812aee0 2024-09-12T16:51:30.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2811b7c0 con 0x7fee2812aee0 2024-09-12T16:51:30.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee24ff9640 1 -- 172.21.15.122:0/2783077564 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee180b4ae0 con 0x7fee2812aee0 2024-09-12T16:51:30.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.489+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee28129b00 con 0x7fee2812aee0 2024-09-12T16:51:30.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.493+0000 7fee24ff9640 1 -- 172.21.15.122:0/2783077564 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee180c77d0 con 0x7fee2812aee0 2024-09-12T16:51:30.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.493+0000 7fee24ff9640 1 -- 172.21.15.122:0/2783077564 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fee180bec20 con 0x7fee2812aee0 2024-09-12T16:51:30.496 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.493+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee2812b2c0 con 0x7fee2812aee0 2024-09-12T16:51:30.497 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.493+0000 7fee24ff9640 1 -- 172.21.15.122:0/2783077564 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fee180160b0 con 0x7fee2812aee0 2024-09-12T16:51:30.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.553+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee2811c150 con 0x7fee2812aee0 2024-09-12T16:51:30.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.553+0000 7fee24ff9640 1 -- 172.21.15.122:0/2783077564 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fee180b4c80 con 0x7fee2812aee0 2024-09-12T16:51:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:30.558 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":6,"fsid":"5046056a-17be-43b6-80d1-88da5e3ce49b","created":"2024-09-12T16:51:29.157028+0000","modified":"2024-09-12T16:51:30.340067+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:51:30.340067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b980825b-63eb-43eb-ac4e-92bc8be6c667","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"61fba858-88d7-4f24-b3a4-cfed25eca39b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:51:30.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.557+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 msgr2=0x7fee281293f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:30.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.557+0000 7fee2d9b1640 1 --2- 172.21.15.122:0/2783077564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee281293f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee18019040 tx=0x7fee1801ac70 comp rx=0 tx=0).stop 2024-09-12T16:51:30.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.557+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 shutdown_connections 2024-09-12T16:51:30.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.557+0000 7fee2d9b1640 1 --2- 172.21.15.122:0/2783077564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee2812aee0 0x7fee281293f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:30.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.557+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 >> 172.21.15.122:0/2783077564 conn(0x7fee280a0a60 msgr2=0x7fee280a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:30.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.557+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 shutdown_connections 2024-09-12T16:51:30.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:30.557+0000 7fee2d9b1640 1 -- 172.21.15.122:0/2783077564 wait complete. 2024-09-12T16:51:30.576 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T16:51:30.576 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T16:51:30.979 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:51:31.123 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.113+0000 7f8c27f96640 1 Processor -- start 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.113+0000 7f8c27f96640 1 -- start start 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.113+0000 7f8c27f96640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8c2012d580 0x7f8c2012d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.113+0000 7f8c27f96640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c20073730 con 0x7f8c20110da0 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.113+0000 7f8c27f96640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8c20114b80 con 0x7f8c2012d580 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c25d32640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8c2012d580 0x7f8c2012d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c25531640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f8c20110da0 0x7f8c201111a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:33884/0 (socket says 172.21.15.122:33884) 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c25531640 1 -- 172.21.15.122:0/4038111790 learned_addr learned my addr 172.21.15.122:0/4038111790 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c25d32640 1 -- 172.21.15.122:0/4038111790 >> v1:172.21.15.122:6789/0 conn(0x7f8c20110da0 legacy=0x7f8c201111a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c24d30640 1 -- 172.21.15.122:0/4038111790 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 311596924 0 0) 0x7f8c20073730 con 0x7f8c20110da0 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c25d32640 1 -- 172.21.15.122:0/4038111790 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2012d130 con 0x7f8c2012d580 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c25d32640 1 --2- 172.21.15.122:0/4038111790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c2012d580 0x7f8c2012d960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009740 tx=0x7f8c1001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d08afb33674283 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c24d30640 1 -- 172.21.15.122:0/4038111790 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c100b0070 con 0x7f8c2012d580 2024-09-12T16:51:31.124 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c24d30640 1 -- 172.21.15.122:0/4038111790 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c100ab530 con 0x7f8c2012d580 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c24d30640 1 -- 172.21.15.122:0/4038111790 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c100ab830 con 0x7f8c2012d580 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c27f96640 1 -- 172.21.15.122:0/4038111790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c2012d580 msgr2=0x7f8c2012d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c27f96640 1 --2- 172.21.15.122:0/4038111790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c2012d580 0x7f8c2012d960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009740 tx=0x7f8c1001c370 comp rx=0 tx=0).stop 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c27f96640 1 -- 172.21.15.122:0/4038111790 shutdown_connections 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c27f96640 1 --2- 172.21.15.122:0/4038111790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c2012d580 0x7f8c2012d960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c27f96640 1 -- 172.21.15.122:0/4038111790 >> 172.21.15.122:0/4038111790 conn(0x7f8c200709a0 msgr2=0x7f8c20072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c27f96640 1 -- 172.21.15.122:0/4038111790 shutdown_connections 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.117+0000 7f8c27f96640 1 -- 172.21.15.122:0/4038111790 wait complete. 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c27f96640 1 Processor -- start 2024-09-12T16:51:31.125 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c27f96640 1 -- start start 2024-09-12T16:51:31.127 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c27f96640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c20110da0 0x7f8c201228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:31.127 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c27f96640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20135d50 con 0x7f8c20110da0 2024-09-12T16:51:31.127 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c25d32640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c20110da0 0x7f8c201228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c25d32640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c20110da0 0x7f8c201228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53648/0 (socket says 172.21.15.122:53648) 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c25d32640 1 -- 172.21.15.122:0/2357227897 learned_addr learned my addr 172.21.15.122:0/2357227897 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c25d32640 1 -- 172.21.15.122:0/2357227897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c20132740 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c25d32640 1 --2- 172.21.15.122:0/2357227897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c20110da0 0x7f8c201228f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c100ae040 tx=0x7f8c1001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c167fc640 1 -- 172.21.15.122:0/2357227897 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c100b0050 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c167fc640 1 -- 172.21.15.122:0/2357227897 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c100b1040 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c20115710 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c167fc640 1 -- 172.21.15.122:0/2357227897 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c100b5780 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c20123000 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c167fc640 1 -- 172.21.15.122:0/2357227897 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c100be030 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c167fc640 1 -- 172.21.15.122:0/2357227897 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8c100bc070 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.121+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c20127790 con 0x7f8c20110da0 2024-09-12T16:51:31.128 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.125+0000 7f8c167fc640 1 -- 172.21.15.122:0/2357227897 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8c20127790 con 0x7f8c20110da0 2024-09-12T16:51:31.188 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c20074f70 con 0x7f8c20110da0 2024-09-12T16:51:31.189 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c167fc640 1 -- 172.21.15.122:0/2357227897 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f8c100c5060 con 0x7f8c20110da0 2024-09-12T16:51:31.189 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-12T16:51:31.189 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":6,"fsid":"5046056a-17be-43b6-80d1-88da5e3ce49b","created":"2024-09-12T16:51:29.157028+0000","modified":"2024-09-12T16:51:30.340067+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:51:30.340067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b980825b-63eb-43eb-ac4e-92bc8be6c667","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"61fba858-88d7-4f24-b3a4-cfed25eca39b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:51:31.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c20110da0 msgr2=0x7f8c201228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:31.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c27f96640 1 --2- 172.21.15.122:0/2357227897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c20110da0 0x7f8c201228f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c100ae040 tx=0x7f8c1001abb0 comp rx=0 tx=0).stop 2024-09-12T16:51:31.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 shutdown_connections 2024-09-12T16:51:31.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c27f96640 1 --2- 172.21.15.122:0/2357227897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c20110da0 0x7f8c201228f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:31.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 >> 172.21.15.122:0/2357227897 conn(0x7f8c200709a0 msgr2=0x7f8c200719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:31.190 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 shutdown_connections 2024-09-12T16:51:31.191 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:31.185+0000 7f8c27f96640 1 -- 172.21.15.122:0/2357227897 wait complete. 2024-09-12T16:51:31.206 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-12T16:51:31.420 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-12T16:51:31.417+0000 7faab2c9c7c0 -1 Falling back to public interface 2024-09-12T16:51:31.671 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-12T16:51:31.670+0000 7f56782907c0 -1 Falling back to public interface 2024-09-12T16:51:32.058 INFO:tasks.ceph.mgr.x.smithi151.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T16:51:32.058 INFO:tasks.ceph.mgr.x.smithi151.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T16:51:32.058 INFO:tasks.ceph.mgr.x.smithi151.stderr: from numpy import show_config as show_numpy_config 2024-09-12T16:51:32.192 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-12T16:51:32.190+0000 7f0621ba37c0 -1 Falling back to public interface 2024-09-12T16:51:32.256 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T16:51:32.254+0000 7f0f8b1e87c0 -1 Falling back to public interface 2024-09-12T16:51:34.927 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-12T16:51:34.926+0000 7faa0d5b8640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-12T16:51:35.489 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-12T16:51:35.485+0000 7faab2c9c7c0 -1 osd.0 0 log_to_monitors true 2024-09-12T16:51:35.709 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-12T16:51:35.706+0000 7f56782907c0 -1 osd.2 0 log_to_monitors true 2024-09-12T16:51:36.217 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-12T16:51:36.214+0000 7f0621ba37c0 -1 osd.3 0 log_to_monitors true 2024-09-12T16:51:36.470 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T16:51:36.470+0000 7f0f8b1e87c0 -1 osd.1 0 log_to_monitors true 2024-09-12T16:51:37.610 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:51:37.727 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa0799e6640 1 Processor -- start 2024-09-12T16:51:37.727 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa0799e6640 1 -- start start 2024-09-12T16:51:37.728 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa0799e6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa07412bfe0 0x7fa07412c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:37.728 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa0799e6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07412bc50 con 0x7fa07412c900 2024-09-12T16:51:37.728 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa0799e6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa0740691a0 con 0x7fa07412bfe0 2024-09-12T16:51:37.729 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa072ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa07412bfe0 0x7fa07412c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:37.729 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa072ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa07412bfe0 0x7fa07412c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53086/0 (socket says 172.21.15.122:53086) 2024-09-12T16:51:37.729 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa072ffd640 1 -- 172.21.15.122:0/205195115 learned_addr learned my addr 172.21.15.122:0/205195115 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:37.729 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa06bfff640 1 --1- 172.21.15.122:0/205195115 >> v1:172.21.15.122:6789/0 conn(0x7fa07412c900 0x7fa0741151b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:37704/0 (socket says 172.21.15.122:37704) 2024-09-12T16:51:37.729 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa072ffd640 1 -- 172.21.15.122:0/205195115 >> v1:172.21.15.122:6789/0 conn(0x7fa07412c900 legacy=0x7fa0741151b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:37.729 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.725+0000 7fa072ffd640 1 -- 172.21.15.122:0/205195115 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074073870 con 0x7fa07412bfe0 2024-09-12T16:51:37.731 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa072ffd640 1 --2- 172.21.15.122:0/205195115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa07412c3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa0640097f0 tx=0x7fa06401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f6f66a377eb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:37.731 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0727fc640 1 -- 172.21.15.122:0/205195115 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0640b0070 con 0x7fa07412bfe0 2024-09-12T16:51:37.731 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0727fc640 1 -- 172.21.15.122:0/205195115 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0640ab530 con 0x7fa07412bfe0 2024-09-12T16:51:37.731 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0727fc640 1 -- 172.21.15.122:0/205195115 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0640ab830 con 0x7fa07412bfe0 2024-09-12T16:51:37.732 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 -- 172.21.15.122:0/205195115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 msgr2=0x7fa07412c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:37.732 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 --2- 172.21.15.122:0/205195115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa07412c3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa0640097f0 tx=0x7fa06401c4c0 comp rx=0 tx=0).stop 2024-09-12T16:51:37.732 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 -- 172.21.15.122:0/205195115 shutdown_connections 2024-09-12T16:51:37.732 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 --2- 172.21.15.122:0/205195115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa07412c3c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:37.732 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 -- 172.21.15.122:0/205195115 >> 172.21.15.122:0/205195115 conn(0x7fa074070630 msgr2=0x7fa074072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:37.732 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 -- 172.21.15.122:0/205195115 shutdown_connections 2024-09-12T16:51:37.733 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 -- 172.21.15.122:0/205195115 wait complete. 2024-09-12T16:51:37.733 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 Processor -- start 2024-09-12T16:51:37.733 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 -- start start 2024-09-12T16:51:37.734 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa074124d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:37.734 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa0799e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741378e0 con 0x7fa07412bfe0 2024-09-12T16:51:37.734 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa072ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa074124d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:37.734 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa072ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa074124d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53098/0 (socket says 172.21.15.122:53098) 2024-09-12T16:51:37.734 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa072ffd640 1 -- 172.21.15.122:0/915619768 learned_addr learned my addr 172.21.15.122:0/915619768 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:37.734 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.729+0000 7fa072ffd640 1 -- 172.21.15.122:0/915619768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0741347f0 con 0x7fa07412bfe0 2024-09-12T16:51:37.735 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa072ffd640 1 --2- 172.21.15.122:0/915619768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa074124d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa0640ae040 tx=0x7fa064019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:37.735 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa070ff9640 1 -- 172.21.15.122:0/915619768 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0640b8020 con 0x7fa07412bfe0 2024-09-12T16:51:37.735 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa070ff9640 1 -- 172.21.15.122:0/915619768 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0640abe40 con 0x7fa07412bfe0 2024-09-12T16:51:37.736 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa074129900 con 0x7fa07412bfe0 2024-09-12T16:51:37.736 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa070ff9640 1 -- 172.21.15.122:0/915619768 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0640b0040 con 0x7fa07412bfe0 2024-09-12T16:51:37.736 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa074117c50 con 0x7fa07412bfe0 2024-09-12T16:51:37.736 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07412c3c0 con 0x7fa07412bfe0 2024-09-12T16:51:37.737 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa070ff9640 1 -- 172.21.15.122:0/915619768 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 4) ==== 48276+0+0 (secure 0 0 0) 0x7fa0640bb020 con 0x7fa07412bfe0 2024-09-12T16:51:37.737 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa070ff9640 1 --2- 172.21.15.122:0/915619768 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa05403b140 0x7fa05403d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:37.737 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa070ff9640 1 -- 172.21.15.122:0/915619768 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1591+0+0 (secure 0 0 0) 0x7fa0640e8250 con 0x7fa07412bfe0 2024-09-12T16:51:37.737 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa06bfff640 1 --2- 172.21.15.122:0/915619768 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa05403b140 0x7fa05403d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:37.737 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.733+0000 7fa06bfff640 1 --2- 172.21.15.122:0/915619768 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa05403b140 0x7fa05403d600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0015f0 tx=0x7fa05c007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:37.745 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.741+0000 7fa070ff9640 1 -- 172.21.15.122:0/915619768 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa0640c2030 con 0x7fa07412bfe0 2024-09-12T16:51:37.891 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-12T16:51:37.889+0000 7faaaf457640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T16:51:37.915 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-09-12T16:51:37.913+0000 7faaa6a77640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:51:37.955 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa074117970 con 0x7fa07412bfe0 2024-09-12T16:51:37.955 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa070ff9640 1 -- 172.21.15.122:0/915619768 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7fa0640160b0 con 0x7fa07412bfe0 2024-09-12T16:51:37.955 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-12T16:51:37.955 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":8,"fsid":"5046056a-17be-43b6-80d1-88da5e3ce49b","created":"2024-09-12T16:51:29.157028+0000","modified":"2024-09-12T16:51:36.973793+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:51:30.340067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b980825b-63eb-43eb-ac4e-92bc8be6c667","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"61fba858-88d7-4f24-b3a4-cfed25eca39b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:51:37.958 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa05403b140 msgr2=0x7fa05403d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:37.958 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 --2- 172.21.15.122:0/915619768 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa05403b140 0x7fa05403d600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0015f0 tx=0x7fa05c007a50 comp rx=0 tx=0).stop 2024-09-12T16:51:37.958 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 msgr2=0x7fa074124d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:37.958 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 --2- 172.21.15.122:0/915619768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa074124d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa0640ae040 tx=0x7fa064019260 comp rx=0 tx=0).stop 2024-09-12T16:51:37.958 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 shutdown_connections 2024-09-12T16:51:37.958 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 --2- 172.21.15.122:0/915619768 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa05403b140 0x7fa05403d600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:37.959 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 --2- 172.21.15.122:0/915619768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa07412bfe0 0x7fa074124d60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:37.959 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 >> 172.21.15.122:0/915619768 conn(0x7fa074070630 msgr2=0x7fa0741286a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:37.959 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 shutdown_connections 2024-09-12T16:51:37.959 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:37.953+0000 7fa0799e6640 1 -- 172.21.15.122:0/915619768 wait complete. 2024-09-12T16:51:37.974 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-12T16:51:38.099 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-12T16:51:38.098+0000 7f5674239640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T16:51:38.161 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-12T16:51:38.158+0000 7f566c06b640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:51:39.333 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-12T16:51:39.329+0000 7f061db4c640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T16:51:39.344 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T16:51:39.341+0000 7f0f879a3640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T16:51:39.362 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-12T16:51:39.361+0000 7f061597e640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:51:39.374 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-12T16:51:39.373+0000 7f0f7efc3640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:51:44.377 DEBUG:teuthology.orchestra.run.smithi122:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:51:44.502 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.497+0000 7f2e1bb59640 1 Processor -- start 2024-09-12T16:51:44.502 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.497+0000 7f2e1bb59640 1 -- start start 2024-09-12T16:51:44.503 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e1bb59640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2e1412bc00 0x7f2e1412bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:44.503 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e1bb59640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e14073730 con 0x7f2e14111630 2024-09-12T16:51:44.503 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e1bb59640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1406de90 con 0x7f2e1412bc00 2024-09-12T16:51:44.503 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e198f5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2e1412bc00 0x7f2e1412bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:44.503 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e190f4640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f2e14111630 0x7f2e14111a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52004/0 (socket says 172.21.15.122:52004) 2024-09-12T16:51:44.503 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e190f4640 1 -- 172.21.15.122:0/1113299070 learned_addr learned my addr 172.21.15.122:0/1113299070 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:44.504 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e198f5640 1 -- 172.21.15.122:0/1113299070 >> v1:172.21.15.122:6789/0 conn(0x7f2e14111630 legacy=0x7f2e14111a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:44.504 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e198f5640 1 -- 172.21.15.122:0/1113299070 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1412b7b0 con 0x7f2e1412bc00 2024-09-12T16:51:44.504 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e188f3640 1 -- 172.21.15.122:0/1113299070 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052008506 0 0) 0x7f2e14073730 con 0x7f2e14111630 2024-09-12T16:51:44.506 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.501+0000 7f2e198f5640 1 --2- 172.21.15.122:0/1113299070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e1412bc00 0x7f2e1412bfe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009740 tx=0x7f2e1001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8323c165371687 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:44.506 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e188f3640 1 -- 172.21.15.122:0/1113299070 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e100b0070 con 0x7f2e1412bc00 2024-09-12T16:51:44.506 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e188f3640 1 -- 172.21.15.122:0/1113299070 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e100ab530 con 0x7f2e1412bc00 2024-09-12T16:51:44.506 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e188f3640 1 -- 172.21.15.122:0/1113299070 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e100ab830 con 0x7f2e1412bc00 2024-09-12T16:51:44.507 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1113299070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e1412bc00 msgr2=0x7f2e1412bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:44.507 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 --2- 172.21.15.122:0/1113299070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e1412bc00 0x7f2e1412bfe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009740 tx=0x7f2e1001c370 comp rx=0 tx=0).stop 2024-09-12T16:51:44.507 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1113299070 shutdown_connections 2024-09-12T16:51:44.508 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 --2- 172.21.15.122:0/1113299070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e1412bc00 0x7f2e1412bfe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:44.508 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1113299070 >> 172.21.15.122:0/1113299070 conn(0x7f2e140709a0 msgr2=0x7f2e14072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:44.508 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1113299070 shutdown_connections 2024-09-12T16:51:44.508 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1113299070 wait complete. 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 Processor -- start 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- start start 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e14111630 0x7f2e141302b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14113130 con 0x7f2e14111630 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e198f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e14111630 0x7f2e141302b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e198f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e14111630 0x7f2e141302b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48824/0 (socket says 172.21.15.122:48824) 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e198f5640 1 -- 172.21.15.122:0/1473888802 learned_addr learned my addr 172.21.15.122:0/1473888802 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e198f5640 1 -- 172.21.15.122:0/1473888802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e141144b0 con 0x7f2e14111630 2024-09-12T16:51:44.509 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e198f5640 1 --2- 172.21.15.122:0/1473888802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e14111630 0x7f2e141302b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2e100ae040 tx=0x7f2e10019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:44.510 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e0a7fc640 1 -- 172.21.15.122:0/1473888802 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e100b0050 con 0x7f2e14111630 2024-09-12T16:51:44.510 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e0a7fc640 1 -- 172.21.15.122:0/1473888802 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e100b1040 con 0x7f2e14111630 2024-09-12T16:51:44.511 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e0a7fc640 1 -- 172.21.15.122:0/1473888802 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e100b5780 con 0x7f2e14111630 2024-09-12T16:51:44.511 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e14114900 con 0x7f2e14111630 2024-09-12T16:51:44.511 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.505+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141309c0 con 0x7f2e14111630 2024-09-12T16:51:44.511 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.509+0000 7f2e0a7fc640 1 -- 172.21.15.122:0/1473888802 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e100be030 con 0x7f2e14111630 2024-09-12T16:51:44.511 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.509+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e14110d20 con 0x7f2e14111630 2024-09-12T16:51:44.511 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.509+0000 7f2e0a7fc640 1 --2- 172.21.15.122:0/1473888802 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2df803b1d0 0x7f2df803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:44.511 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.509+0000 7f2e0a7fc640 1 -- 172.21.15.122:0/1473888802 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f2e100bc070 con 0x7f2e14111630 2024-09-12T16:51:44.511 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.509+0000 7f2e190f4640 1 --2- 172.21.15.122:0/1473888802 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2df803b1d0 0x7f2df803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:44.512 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.509+0000 7f2e190f4640 1 --2- 172.21.15.122:0/1473888802 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2df803b1d0 0x7f2df803d690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e04007fd0 tx=0x7f2e04007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:44.515 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.513+0000 7f2e0a7fc640 1 -- 172.21.15.122:0/1473888802 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f2e100c5060 con 0x7f2e14111630 2024-09-12T16:51:44.685 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.681+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e14111180 con 0x7f2e14111630 2024-09-12T16:51:44.686 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.681+0000 7f2e0a7fc640 1 -- 172.21.15.122:0/1473888802 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8002 (secure 0 0 0) 0x7f2e10015ff0 con 0x7f2e14111630 2024-09-12T16:51:44.686 INFO:teuthology.misc.health.smithi122.stdout: 2024-09-12T16:51:44.686 INFO:teuthology.misc.health.smithi122.stdout:{"epoch":13,"fsid":"5046056a-17be-43b6-80d1-88da5e3ce49b","created":"2024-09-12T16:51:29.157028+0000","modified":"2024-09-12T16:51:42.352272+0000","last_up_change":"2024-09-12T16:51:40.347390+0000","last_in_change":"2024-09-12T16:51:30.340067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:51:39.964026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b980825b-63eb-43eb-ac4e-92bc8be6c667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6801","nonce":3868153603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6803","nonce":3868153603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6807","nonce":3868153603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6805","nonce":3868153603}]},"public_addr":"172.21.15.122:6801/3868153603","cluster_addr":"172.21.15.122:6803/3868153603","heartbeat_back_addr":"172.21.15.122:6807/3868153603","heartbeat_front_addr":"172.21.15.122:6805/3868153603","state":["exists","up"]},{"osd":1,"uuid":"ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6817","nonce":883447514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6819","nonce":883447514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6823","nonce":883447514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6821","nonce":883447514}]},"public_addr":"172.21.15.151:6817/883447514","cluster_addr":"172.21.15.151:6819/883447514","heartbeat_back_addr":"172.21.15.151:6823/883447514","heartbeat_front_addr":"172.21.15.151:6821/883447514","state":["exists","up"]},{"osd":2,"uuid":"9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6801","nonce":1197700885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6803","nonce":1197700885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6807","nonce":1197700885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6805","nonce":1197700885}]},"public_addr":"172.21.15.151:6801/1197700885","cluster_addr":"172.21.15.151:6803/1197700885","heartbeat_back_addr":"172.21.15.151:6807/1197700885","heartbeat_front_addr":"172.21.15.151:6805/1197700885","state":["exists","up"]},{"osd":3,"uuid":"61fba858-88d7-4f24-b3a4-cfed25eca39b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6809","nonce":987175333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6811","nonce":987175333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6815","nonce":987175333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6813","nonce":987175333}]},"public_addr":"172.21.15.151:6809/987175333","cluster_addr":"172.21.15.151:6811/987175333","heartbeat_back_addr":"172.21.15.151:6815/987175333","heartbeat_front_addr":"172.21.15.151:6813/987175333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:36.468476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:37.504802+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:36.679834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:37.189623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2df803b1d0 msgr2=0x7f2df803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 --2- 172.21.15.122:0/1473888802 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2df803b1d0 0x7f2df803d690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e04007fd0 tx=0x7f2e04007900 comp rx=0 tx=0).stop 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e14111630 msgr2=0x7f2e141302b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 --2- 172.21.15.122:0/1473888802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e14111630 0x7f2e141302b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2e100ae040 tx=0x7f2e10019110 comp rx=0 tx=0).stop 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 shutdown_connections 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 --2- 172.21.15.122:0/1473888802 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2df803b1d0 0x7f2df803d690 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 --2- 172.21.15.122:0/1473888802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e14111630 0x7f2e141302b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 >> 172.21.15.122:0/1473888802 conn(0x7f2e140709a0 msgr2=0x7f2e14134a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 shutdown_connections 2024-09-12T16:51:44.689 INFO:teuthology.misc.health.smithi122.stderr:2024-09-12T16:51:44.685+0000 7f2e1bb59640 1 -- 172.21.15.122:0/1473888802 wait complete. 2024-09-12T16:51:44.704 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-12T16:51:44.704 INFO:tasks.ceph:Creating RBD pool 2024-09-12T16:51:44.705 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T16:51:44.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.817+0000 7f289a50a640 1 Processor -- start 2024-09-12T16:51:44.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.817+0000 7f289a50a640 1 -- start start 2024-09-12T16:51:44.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f289a50a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f289412da20 0x7f2894132460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:44.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f289a50a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2894096ac0 con 0x7f289412cf30 2024-09-12T16:51:44.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f289a50a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f2894099b00 con 0x7f289412da20 2024-09-12T16:51:44.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f28937fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f289412da20 0x7f2894132460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:44.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f2893fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f289412cf30 0x7f289412d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52012/0 (socket says 172.21.15.122:52012) 2024-09-12T16:51:44.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f2893fff640 1 -- 172.21.15.122:0/1702391754 learned_addr learned my addr 172.21.15.122:0/1702391754 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:44.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f28937fe640 1 -- 172.21.15.122:0/1702391754 >> v1:172.21.15.122:6789/0 conn(0x7f289412cf30 legacy=0x7f289412d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:44.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f28937fe640 1 -- 172.21.15.122:0/1702391754 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289409a160 con 0x7f289412da20 2024-09-12T16:51:44.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f28937fe640 1 --2- 172.21.15.122:0/1702391754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412da20 0x7f2894132460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f288c009d90 tx=0x7f288c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee316688a1c3436b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:44.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f2892ffd640 1 -- 172.21.15.122:0/1702391754 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0b2070 con 0x7f289412da20 2024-09-12T16:51:44.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f2892ffd640 1 -- 172.21.15.122:0/1702391754 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0a57d0 con 0x7f289412da20 2024-09-12T16:51:44.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f2892ffd640 1 -- 172.21.15.122:0/1702391754 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f288c0a5ad0 con 0x7f289412da20 2024-09-12T16:51:44.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f289a50a640 1 -- 172.21.15.122:0/1702391754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412da20 msgr2=0x7f2894132460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:44.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f289a50a640 1 --2- 172.21.15.122:0/1702391754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412da20 0x7f2894132460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f288c009d90 tx=0x7f288c01c950 comp rx=0 tx=0).stop 2024-09-12T16:51:44.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f289a50a640 1 -- 172.21.15.122:0/1702391754 shutdown_connections 2024-09-12T16:51:44.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f289a50a640 1 --2- 172.21.15.122:0/1702391754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412da20 0x7f2894132460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:44.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.821+0000 7f289a50a640 1 -- 172.21.15.122:0/1702391754 >> 172.21.15.122:0/1702391754 conn(0x7f289409a930 msgr2=0x7f289409ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:44.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 -- 172.21.15.122:0/1702391754 shutdown_connections 2024-09-12T16:51:44.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 -- 172.21.15.122:0/1702391754 wait complete. 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 Processor -- start 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 -- start start 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412cf30 0x7f289408e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2894135550 con 0x7f289412cf30 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2893fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412cf30 0x7f289408e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2893fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412cf30 0x7f289408e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48848/0 (socket says 172.21.15.122:48848) 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2893fff640 1 -- 172.21.15.122:0/11405581 learned_addr learned my addr 172.21.15.122:0/11405581 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2893fff640 1 -- 172.21.15.122:0/11405581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2894091390 con 0x7f289412cf30 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2893fff640 1 --2- 172.21.15.122:0/11405581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412cf30 0x7f289408e410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c450 tx=0x7f287c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2890ff9640 1 -- 172.21.15.122:0/11405581 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f287c017070 con 0x7f289412cf30 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2890ff9640 1 -- 172.21.15.122:0/11405581 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f287c005c20 con 0x7f289412cf30 2024-09-12T16:51:44.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289408f9e0 con 0x7f289412cf30 2024-09-12T16:51:44.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2890ff9640 1 -- 172.21.15.122:0/11405581 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f287c0070d0 con 0x7f289412cf30 2024-09-12T16:51:44.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28940916c0 con 0x7f289412cf30 2024-09-12T16:51:44.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289412d390 con 0x7f289412cf30 2024-09-12T16:51:44.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2890ff9640 1 -- 172.21.15.122:0/11405581 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f287c01a070 con 0x7f289412cf30 2024-09-12T16:51:44.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2890ff9640 1 --2- 172.21.15.122:0/11405581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f287403b1d0 0x7f287403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:44.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.825+0000 7f2890ff9640 1 -- 172.21.15.122:0/11405581 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f287c04ddb0 con 0x7f289412cf30 2024-09-12T16:51:44.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.829+0000 7f28937fe640 1 --2- 172.21.15.122:0/11405581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f287403b1d0 0x7f287403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:44.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.829+0000 7f28937fe640 1 --2- 172.21.15.122:0/11405581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f287403b1d0 0x7f287403d690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f288c0af000 tx=0x7f288c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:44.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.833+0000 7f2890ff9640 1 -- 172.21.15.122:0/11405581 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f287c007270 con 0x7f289412cf30 2024-09-12T16:51:45.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:44.997+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f2894090da0 con 0x7f289412cf30 2024-09-12T16:51:45.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f2890ff9640 1 -- 172.21.15.122:0/11405581 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f2894090da0 con 0x7f289412cf30 2024-09-12T16:51:45.375 INFO:teuthology.orchestra.run.smithi122.stderr:pool 'rbd' created 2024-09-12T16:51:45.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f287403b1d0 msgr2=0x7f287403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 --2- 172.21.15.122:0/11405581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f287403b1d0 0x7f287403d690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f288c0af000 tx=0x7f288c0a7070 comp rx=0 tx=0).stop 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412cf30 msgr2=0x7f289408e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 --2- 172.21.15.122:0/11405581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412cf30 0x7f289408e410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c450 tx=0x7f287c00c910 comp rx=0 tx=0).stop 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 shutdown_connections 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 --2- 172.21.15.122:0/11405581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f287403b1d0 0x7f287403d690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 --2- 172.21.15.122:0/11405581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289412cf30 0x7f289408e410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 >> 172.21.15.122:0/11405581 conn(0x7f289409a930 msgr2=0x7f289409bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.373+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 shutdown_connections 2024-09-12T16:51:45.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.377+0000 7f289a50a640 1 -- 172.21.15.122:0/11405581 wait complete. 2024-09-12T16:51:45.405 DEBUG:teuthology.orchestra.run.smithi122:> rbd --cluster ceph pool init rbd 2024-09-12T16:51:45.465 INFO:teuthology.orchestra.run.smithi122.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:51:45.466 INFO:teuthology.orchestra.run.smithi122.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:51:45.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49dacbc100 1 Processor -- start 2024-09-12T16:51:45.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49dacbc100 1 -- start start 2024-09-12T16:51:45.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49dacbc100 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55897dd5efb0 0x55897dd5f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:45.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49dacbc100 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55897dbcbc50 con 0x55897dd5f8d0 2024-09-12T16:51:45.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49dacbc100 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55897dc4c600 con 0x55897dd5efb0 2024-09-12T16:51:45.469 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49d97c5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55897dd5efb0 0x55897dd5f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:45.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49d8fc4640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55897dd5f8d0 0x55897de0c1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52016/0 (socket says 172.21.15.122:52016) 2024-09-12T16:51:45.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49d8fc4640 1 -- 172.21.15.122:0/2302863624 learned_addr learned my addr 172.21.15.122:0/2302863624 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:45.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49d97c5640 1 -- 172.21.15.122:0/2302863624 >> v1:172.21.15.122:6789/0 conn(0x55897dd5f8d0 legacy=0x55897de0c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:45.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49cbfff640 1 -- 172.21.15.122:0/2302863624 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3055252378 0 0) 0x55897dbcbc50 con 0x55897dd5f8d0 2024-09-12T16:51:45.470 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.465+0000 7f49d97c5640 1 -- 172.21.15.122:0/2302863624 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897dd7c340 con 0x55897dd5efb0 2024-09-12T16:51:45.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49d97c5640 1 --2- 172.21.15.122:0/2302863624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897dd5f390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00a480 tx=0x7f49cc01b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaa30fecc460a4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:45.471 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49cbfff640 1 -- 172.21.15.122:0/2302863624 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc0a9560 con 0x55897dd5efb0 2024-09-12T16:51:45.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49cbfff640 1 -- 172.21.15.122:0/2302863624 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc0ae070 con 0x55897dd5efb0 2024-09-12T16:51:45.472 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49cbfff640 1 -- 172.21.15.122:0/2302863624 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc0a9850 con 0x55897dd5efb0 2024-09-12T16:51:45.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 -- 172.21.15.122:0/2302863624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 msgr2=0x55897dd5f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:45.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 --2- 172.21.15.122:0/2302863624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897dd5f390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00a480 tx=0x7f49cc01b6a0 comp rx=0 tx=0).stop 2024-09-12T16:51:45.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 -- 172.21.15.122:0/2302863624 shutdown_connections 2024-09-12T16:51:45.473 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 --2- 172.21.15.122:0/2302863624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897dd5f390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:45.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 -- 172.21.15.122:0/2302863624 >> 172.21.15.122:0/2302863624 conn(0x55897dd7bc90 msgr2=0x55897dd78050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:45.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 -- 172.21.15.122:0/2302863624 shutdown_connections 2024-09-12T16:51:45.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 -- 172.21.15.122:0/2302863624 wait complete. 2024-09-12T16:51:45.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 Processor -- start 2024-09-12T16:51:45.474 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 -- start start 2024-09-12T16:51:45.476 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897de08bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:45.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49dacbc100 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55897dc505b0 con 0x55897dd5efb0 2024-09-12T16:51:45.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49d97c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897de08bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:45.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49d97c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897de08bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48864/0 (socket says 172.21.15.122:48864) 2024-09-12T16:51:45.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49d97c5640 1 -- 172.21.15.122:0/3352910381 learned_addr learned my addr 172.21.15.122:0/3352910381 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:45.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.469+0000 7f49d97c5640 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897ddfa440 con 0x55897dd5efb0 2024-09-12T16:51:45.477 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49d97c5640 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897de08bc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0182b0 tx=0x7f49cc018440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:45.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc0a9b40 con 0x55897dd5efb0 2024-09-12T16:51:45.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc0a9ce0 con 0x55897dd5efb0 2024-09-12T16:51:45.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55897ddfa890 con 0x55897dd5efb0 2024-09-12T16:51:45.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc0bd3f0 con 0x55897dd5efb0 2024-09-12T16:51:45.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897de09310 con 0x55897dd5efb0 2024-09-12T16:51:45.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f49cc0c6440 con 0x55897dd5efb0 2024-09-12T16:51:45.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49c97fa640 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f49bc039ac0 0x7f49bc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:45.478 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f49cc0a6070 con 0x55897dd5efb0 2024-09-12T16:51:45.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55897ddf7dc0 con 0x55897dd5efb0 2024-09-12T16:51:45.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49d8fc4640 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f49bc039ac0 0x7f49bc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:45.479 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:45.473+0000 7f49d8fc4640 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f49bc039ac0 0x7f49bc03bf80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49d0000c10 tx=0x7f49d00013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:46.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.373+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7f49cc0b8070 con 0x55897dd5efb0 2024-09-12T16:51:46.376 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.373+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49cc0ae070 con 0x55897dd5efb0 2024-09-12T16:51:46.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.377+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f49cc0b28c0 con 0x55897dd5efb0 2024-09-12T16:51:46.379 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.377+0000 7f49cb7fe640 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f49b4002af0 con 0x55897dd5efb0 2024-09-12T16:51:46.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.381+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f49cc0bb340 con 0x55897dd5efb0 2024-09-12T16:51:46.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.381+0000 7f49dacbc100 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55897dd5f8d0 0x55897ddf8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:46.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.381+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x55897de22de0 con 0x55897dd5f8d0 2024-09-12T16:51:46.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.381+0000 7f49daa27640 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55897dd5f8d0 0x55897ddf8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:46.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.381+0000 7f49daa27640 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55897dd5f8d0 0x55897ddf8c90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:46.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.389+0000 7f49daa27640 1 -- 172.21.15.122:0/3352910381 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f49d400a4d0 con 0x55897dd5f8d0 2024-09-12T16:51:46.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.397+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x55897de75160 con 0x55897dd5f8d0 2024-09-12T16:51:46.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.397+0000 7f49daa27640 1 -- 172.21.15.122:0/3352910381 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49d400a4d0 con 0x55897dd5f8d0 2024-09-12T16:51:46.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.397+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x55897de74270 con 0x55897dd5f8d0 2024-09-12T16:51:46.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.397+0000 7f49daa27640 1 -- 172.21.15.122:0/3352910381 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49d400a4d0 con 0x55897dd5f8d0 2024-09-12T16:51:46.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:46.397+0000 7f49caffd640 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f49b8001f10 con 0x55897dd5efb0 2024-09-12T16:51:47.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:47.385+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x55897dd7c340 con 0x55897dd5efb0 2024-09-12T16:51:47.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:47.385+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f49bc03f670 con 0x55897dd5efb0 2024-09-12T16:51:47.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:47.385+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f49cc0bb840 con 0x55897dd5efb0 2024-09-12T16:51:47.389 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:47.385+0000 7f49cb7fe640 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f49b4005790 con 0x55897dd5f8d0 2024-09-12T16:51:47.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:47.393+0000 7f49daa27640 1 -- 172.21.15.122:0/3352910381 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f49d400a4d0 con 0x55897dd5f8d0 2024-09-12T16:51:47.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:47.393+0000 7f49caffd640 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f49b8003360 con 0x55897dd5efb0 2024-09-12T16:51:48.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.388+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f49cc0d5020 con 0x55897dd5efb0 2024-09-12T16:51:48.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.388+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f49bc03f8f0 con 0x55897dd5efb0 2024-09-12T16:51:48.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.388+0000 7f49c97fa640 1 -- 172.21.15.122:0/3352910381 <== mon.0 v2:172.21.15.122:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f49cc0c5c50 con 0x55897dd5efb0 2024-09-12T16:51:48.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.392+0000 7f49cb7fe640 1 -- 172.21.15.122:0/3352910381 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f49b4005b50 con 0x55897dd5f8d0 2024-09-12T16:51:48.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.396+0000 7f49daa27640 1 -- 172.21.15.122:0/3352910381 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d400a4d0 con 0x55897dd5f8d0 2024-09-12T16:51:48.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55897dd5f8d0 msgr2=0x55897ddf8c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55897dd5f8d0 0x55897ddf8c90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f49bc039ac0 msgr2=0x7f49bc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f49bc039ac0 0x7f49bc03bf80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49d0000c10 tx=0x7f49d00013c0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 msgr2=0x55897de08bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897de08bc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0182b0 tx=0x7f49cc018440 comp rx=0 tx=0).stop 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 shutdown_connections 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55897dd5f8d0 0x55897ddf8c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f49bc039ac0 0x7f49bc03bf80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 --2- 172.21.15.122:0/3352910381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55897dd5efb0 0x55897de08bc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 >> 172.21.15.122:0/3352910381 conn(0x55897dd7bc90 msgr2=0x55897dd76980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 shutdown_connections 2024-09-12T16:51:48.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.400+0000 7f49dacbc100 1 -- 172.21.15.122:0/3352910381 wait complete. 2024-09-12T16:51:48.412 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T16:51:48.413 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T16:51:48.413 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T16:51:48.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c3d1b640 1 Processor -- start 2024-09-12T16:51:48.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c3d1b640 1 -- start start 2024-09-12T16:51:48.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c3d1b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52bc130260 0x7f52bc132650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:48.546 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c3d1b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52bc1122f0 con 0x7f52bc12d2e0 2024-09-12T16:51:48.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c3d1b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f52bc06dcb0 con 0x7f52bc130260 2024-09-12T16:51:48.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c12b6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52bc130260 0x7f52bc132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:48.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c1ab7640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f52bc12d2e0 0x7f52bc12d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52018/0 (socket says 172.21.15.122:52018) 2024-09-12T16:51:48.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c12b6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52bc130260 0x7f52bc132650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48868/0 (socket says 172.21.15.122:48868) 2024-09-12T16:51:48.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.540+0000 7f52c1ab7640 1 -- 172.21.15.122:0/2898159891 learned_addr learned my addr 172.21.15.122:0/2898159891 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:48.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c12b6640 1 -- 172.21.15.122:0/2898159891 >> v1:172.21.15.122:6789/0 conn(0x7f52bc12d2e0 legacy=0x7f52bc12d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.547 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c0ab5640 1 -- 172.21.15.122:0/2898159891 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3039877088 0 0) 0x7f52bc1122f0 con 0x7f52bc12d2e0 2024-09-12T16:51:48.548 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c12b6640 1 -- 172.21.15.122:0/2898159891 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc073ad0 con 0x7f52bc130260 2024-09-12T16:51:48.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c12b6640 1 --2- 172.21.15.122:0/2898159891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc130260 0x7f52bc132650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009740 tx=0x7f52ac01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93703c940d73a18f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:48.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c0ab5640 1 -- 172.21.15.122:0/2898159891 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac0b0070 con 0x7f52bc130260 2024-09-12T16:51:48.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c0ab5640 1 -- 172.21.15.122:0/2898159891 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac0ab530 con 0x7f52bc130260 2024-09-12T16:51:48.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c0ab5640 1 -- 172.21.15.122:0/2898159891 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52ac0ab830 con 0x7f52bc130260 2024-09-12T16:51:48.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c3d1b640 1 -- 172.21.15.122:0/2898159891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc130260 msgr2=0x7f52bc132650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c3d1b640 1 --2- 172.21.15.122:0/2898159891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc130260 0x7f52bc132650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009740 tx=0x7f52ac01c370 comp rx=0 tx=0).stop 2024-09-12T16:51:48.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c3d1b640 1 -- 172.21.15.122:0/2898159891 shutdown_connections 2024-09-12T16:51:48.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c3d1b640 1 --2- 172.21.15.122:0/2898159891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc130260 0x7f52bc132650 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c3d1b640 1 -- 172.21.15.122:0/2898159891 >> 172.21.15.122:0/2898159891 conn(0x7f52bc070940 msgr2=0x7f52bc072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:48.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c3d1b640 1 -- 172.21.15.122:0/2898159891 shutdown_connections 2024-09-12T16:51:48.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.544+0000 7f52c3d1b640 1 -- 172.21.15.122:0/2898159891 wait complete. 2024-09-12T16:51:48.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c3d1b640 1 Processor -- start 2024-09-12T16:51:48.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c3d1b640 1 -- start start 2024-09-12T16:51:48.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c3d1b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc12d2e0 0x7f52bc1236c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:48.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c3d1b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc135740 con 0x7f52bc12d2e0 2024-09-12T16:51:48.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c1ab7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc12d2e0 0x7f52bc1236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:48.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c1ab7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc12d2e0 0x7f52bc1236c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48874/0 (socket says 172.21.15.122:48874) 2024-09-12T16:51:48.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c1ab7640 1 -- 172.21.15.122:0/1095689208 learned_addr learned my addr 172.21.15.122:0/1095689208 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:48.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c1ab7640 1 -- 172.21.15.122:0/1095689208 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc127640 con 0x7f52bc12d2e0 2024-09-12T16:51:48.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c1ab7640 1 --2- 172.21.15.122:0/1095689208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc12d2e0 0x7f52bc1236c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c3d0 tx=0x7f52b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:48.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52b27fc640 1 -- 172.21.15.122:0/1095689208 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8007410 con 0x7f52bc12d2e0 2024-09-12T16:51:48.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52b27fc640 1 -- 172.21.15.122:0/1095689208 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b80075d0 con 0x7f52bc12d2e0 2024-09-12T16:51:48.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52b27fc640 1 -- 172.21.15.122:0/1095689208 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8004960 con 0x7f52bc12d2e0 2024-09-12T16:51:48.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc129090 con 0x7f52bc12d2e0 2024-09-12T16:51:48.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc123dd0 con 0x7f52bc12d2e0 2024-09-12T16:51:48.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc128c40 con 0x7f52bc12d2e0 2024-09-12T16:51:48.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52b27fc640 1 -- 172.21.15.122:0/1095689208 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f52b8011070 con 0x7f52bc12d2e0 2024-09-12T16:51:48.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52b27fc640 1 --2- 172.21.15.122:0/1095689208 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f52a003b1d0 0x7f52a003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:48.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52b27fc640 1 -- 172.21.15.122:0/1095689208 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f52b804e8b0 con 0x7f52bc12d2e0 2024-09-12T16:51:48.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c12b6640 1 --2- 172.21.15.122:0/1095689208 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f52a003b1d0 0x7f52a003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:48.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.548+0000 7f52c12b6640 1 --2- 172.21.15.122:0/1095689208 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f52a003b1d0 0x7f52a003d690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0ad000 tx=0x7f52ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:48.558 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.552+0000 7f52b27fc640 1 -- 172.21.15.122:0/1095689208 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f52bc127640 con 0x7f52bc12d2e0 2024-09-12T16:51:48.724 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.720+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f52bc12d6c0 con 0x7f52bc12d2e0 2024-09-12T16:51:48.725 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.720+0000 7f52b27fc640 1 -- 172.21.15.122:0/1095689208 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7f52b8010d50 con 0x7f52bc12d2e0 2024-09-12T16:51:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f52a003b1d0 msgr2=0x7f52a003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 --2- 172.21.15.122:0/1095689208 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f52a003b1d0 0x7f52a003d690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0ad000 tx=0x7f52ac008040 comp rx=0 tx=0).stop 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc12d2e0 msgr2=0x7f52bc1236c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 --2- 172.21.15.122:0/1095689208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc12d2e0 0x7f52bc1236c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c3d0 tx=0x7f52b800c890 comp rx=0 tx=0).stop 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 shutdown_connections 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 --2- 172.21.15.122:0/1095689208 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f52a003b1d0 0x7f52a003d690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 --2- 172.21.15.122:0/1095689208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52bc12d2e0 0x7f52bc1236c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 >> 172.21.15.122:0/1095689208 conn(0x7f52bc070940 msgr2=0x7f52bc12b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 shutdown_connections 2024-09-12T16:51:48.727 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.724+0000 7f52c3d1b640 1 -- 172.21.15.122:0/1095689208 wait complete. 2024-09-12T16:51:48.741 INFO:teuthology.orchestra.run.smithi122.stdout:[{"version":5,"timestamp":"2024-09-12T16:51:39.346496+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"6235.814522"}]}] 2024-09-12T16:51:48.741 INFO:tasks.ceph_manager:config epoch is 5 2024-09-12T16:51:48.742 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T16:51:48.742 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T16:51:48.742 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T16:51:48.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5cc066640 1 Processor -- start 2024-09-12T16:51:48.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5cc066640 1 -- start start 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5cc066640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe5c409c160 0x7fe5c409c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5cc066640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c409e460 con 0x7fe5c409dbc0 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5cc066640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c4073c10 con 0x7fe5c409c160 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5c9601640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe5c409dbc0 0x7fe5c4125770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52032/0 (socket says 172.21.15.122:52032) 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5c9601640 1 -- 172.21.15.122:0/3735060951 learned_addr learned my addr 172.21.15.122:0/3735060951 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5c9e02640 1 --2- 172.21.15.122:0/3735060951 >> v2:172.21.15.122:3300/0 conn(0x7fe5c409c160 0x7fe5c409c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5c8e00640 1 -- 172.21.15.122:0/3735060951 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411952662 0 0) 0x7fe5c409e460 con 0x7fe5c409dbc0 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5c8e00640 1 -- 172.21.15.122:0/3735060951 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5b0003530 con 0x7fe5c409dbc0 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5c9e02640 1 -- 172.21.15.122:0/3735060951 >> v1:172.21.15.122:6789/0 conn(0x7fe5c409dbc0 legacy=0x7fe5c4125770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5c9e02640 1 -- 172.21.15.122:0/3735060951 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c409e770 con 0x7fe5c409c160 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.856+0000 7fe5c9e02640 1 --2- 172.21.15.122:0/3735060951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c409c540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009740 tx=0x7fe5c001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf07deee3f8820e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:48.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5c8e00640 1 -- 172.21.15.122:0/3735060951 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c00b0070 con 0x7fe5c409c160 2024-09-12T16:51:48.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5c8e00640 1 -- 172.21.15.122:0/3735060951 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c00ab530 con 0x7fe5c409c160 2024-09-12T16:51:48.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5c8e00640 1 -- 172.21.15.122:0/3735060951 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c00ab810 con 0x7fe5c409c160 2024-09-12T16:51:48.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- 172.21.15.122:0/3735060951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 msgr2=0x7fe5c409c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:48.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 --2- 172.21.15.122:0/3735060951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c409c540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009740 tx=0x7fe5c001c370 comp rx=0 tx=0).stop 2024-09-12T16:51:48.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- 172.21.15.122:0/3735060951 shutdown_connections 2024-09-12T16:51:48.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 --2- 172.21.15.122:0/3735060951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c409c540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:48.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- 172.21.15.122:0/3735060951 >> 172.21.15.122:0/3735060951 conn(0x7fe5c40715c0 msgr2=0x7fe5c409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:48.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- 172.21.15.122:0/3735060951 shutdown_connections 2024-09-12T16:51:48.867 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- 172.21.15.122:0/3735060951 wait complete. 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 Processor -- start 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- start start 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c41269e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4134880 con 0x7fe5c409c160 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5c9e02640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c41269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5c9e02640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c41269e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48888/0 (socket says 172.21.15.122:48888) 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5c9e02640 1 -- 172.21.15.122:0/2215400496 learned_addr learned my addr 172.21.15.122:0/2215400496 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5c9e02640 1 -- 172.21.15.122:0/2215400496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c411a9c0 con 0x7fe5c409c160 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5c9e02640 1 --2- 172.21.15.122:0/2215400496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c41269e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0018f80 tx=0x7fe5c001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5ba7fc640 1 -- 172.21.15.122:0/2215400496 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c00b9020 con 0x7fe5c409c160 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5ba7fc640 1 -- 172.21.15.122:0/2215400496 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c00b1040 con 0x7fe5c409c160 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5ba7fc640 1 -- 172.21.15.122:0/2215400496 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c00b0070 con 0x7fe5c409c160 2024-09-12T16:51:48.868 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c4128130 con 0x7fe5c409c160 2024-09-12T16:51:48.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c411acf0 con 0x7fe5c409c160 2024-09-12T16:51:48.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.860+0000 7fe5ba7fc640 1 -- 172.21.15.122:0/2215400496 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe5c00bc020 con 0x7fe5c409c160 2024-09-12T16:51:48.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.864+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c4127c70 con 0x7fe5c409c160 2024-09-12T16:51:48.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.864+0000 7fe5ba7fc640 1 --2- 172.21.15.122:0/2215400496 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe5a803b200 0x7fe5a803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:48.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.864+0000 7fe5ba7fc640 1 -- 172.21.15.122:0/2215400496 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe5c00e8b30 con 0x7fe5c409c160 2024-09-12T16:51:48.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.864+0000 7fe5c9601640 1 --2- 172.21.15.122:0/2215400496 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe5a803b200 0x7fe5a803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:48.869 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.864+0000 7fe5c9601640 1 --2- 172.21.15.122:0/2215400496 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe5a803b200 0x7fe5a803d6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4007fd0 tx=0x7fe5b4007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:48.871 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:48.868+0000 7fe5ba7fc640 1 -- 172.21.15.122:0/2215400496 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe5c4127c70 con 0x7fe5c409c160 2024-09-12T16:51:49.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.072+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe5c409c540 con 0x7fe5c409c160 2024-09-12T16:51:49.081 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.076+0000 7fe5ba7fc640 1 -- 172.21.15.122:0/2215400496 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+92913 (secure 0 0 0) 0x7fe5c00c3030 con 0x7fe5c409c160 2024-09-12T16:51:49.082 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe5a803b200 msgr2=0x7fe5a803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 --2- 172.21.15.122:0/2215400496 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe5a803b200 0x7fe5a803d6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4007fd0 tx=0x7fe5b4007900 comp rx=0 tx=0).stop 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 msgr2=0x7fe5c41269e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 --2- 172.21.15.122:0/2215400496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c41269e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0018f80 tx=0x7fe5c001abb0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 shutdown_connections 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 --2- 172.21.15.122:0/2215400496 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe5a803b200 0x7fe5a803d6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 --2- 172.21.15.122:0/2215400496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5c409c160 0x7fe5c41269e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 >> 172.21.15.122:0/2215400496 conn(0x7fe5c40715c0 msgr2=0x7fe5c406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 shutdown_connections 2024-09-12T16:51:49.084 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.080+0000 7fe5cc066640 1 -- 172.21.15.122:0/2215400496 wait complete. 2024-09-12T16:51:49.098 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":919571907},{"type":"v1","addr":"172.21.15.151:6825","nonce":919571907}]},"active_addr":"172.21.15.151:6825/919571907","active_change":"2024-09-12T16:51:33.914146+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":3313882697}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":929281593}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1345360283}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":4108515656}]}]} 2024-09-12T16:51:49.101 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T16:51:49.101 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T16:51:49.101 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:51:49.205 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc9293640 1 Processor -- start 2024-09-12T16:51:49.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc9293640 1 -- start start 2024-09-12T16:51:49.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc9293640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcbc412aee0 0x7fcbc412b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc9293640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc40008e0 con 0x7fcbc412f110 2024-09-12T16:51:49.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc9293640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fcbc4071e70 con 0x7fcbc412aee0 2024-09-12T16:51:49.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc27fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fcbc412f110 0x7fcbc412f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52038/0 (socket says 172.21.15.122:52038) 2024-09-12T16:51:49.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc27fc640 1 -- 172.21.15.122:0/612913005 learned_addr learned my addr 172.21.15.122:0/612913005 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:49.206 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc2ffd640 1 --2- 172.21.15.122:0/612913005 >> v2:172.21.15.122:3300/0 conn(0x7fcbc412aee0 0x7fcbc412b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc1ffb640 1 -- 172.21.15.122:0/612913005 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930488338 0 0) 0x7fcbc40008e0 con 0x7fcbc412f110 2024-09-12T16:51:49.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc1ffb640 1 -- 172.21.15.122:0/612913005 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbb0003530 con 0x7fcbc412f110 2024-09-12T16:51:49.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc2ffd640 1 -- 172.21.15.122:0/612913005 >> v1:172.21.15.122:6789/0 conn(0x7fcbc412f110 legacy=0x7fcbc412f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.207 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.200+0000 7fcbc2ffd640 1 -- 172.21.15.122:0/612913005 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc40a30b0 con 0x7fcbc412aee0 2024-09-12T16:51:49.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc2ffd640 1 --2- 172.21.15.122:0/612913005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc412b2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009740 tx=0x7fcbac01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de4f63fce345c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc1ffb640 1 -- 172.21.15.122:0/612913005 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0b1070 con 0x7fcbc412aee0 2024-09-12T16:51:49.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc1ffb640 1 -- 172.21.15.122:0/612913005 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac0ac520 con 0x7fcbc412aee0 2024-09-12T16:51:49.208 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc1ffb640 1 -- 172.21.15.122:0/612913005 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0ac800 con 0x7fcbc412aee0 2024-09-12T16:51:49.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 -- 172.21.15.122:0/612913005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 msgr2=0x7fcbc412b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 --2- 172.21.15.122:0/612913005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc412b2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009740 tx=0x7fcbac01c370 comp rx=0 tx=0).stop 2024-09-12T16:51:49.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 -- 172.21.15.122:0/612913005 shutdown_connections 2024-09-12T16:51:49.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 --2- 172.21.15.122:0/612913005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc412b2c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 -- 172.21.15.122:0/612913005 >> 172.21.15.122:0/612913005 conn(0x7fcbc40a0a60 msgr2=0x7fcbc406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 -- 172.21.15.122:0/612913005 shutdown_connections 2024-09-12T16:51:49.209 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 -- 172.21.15.122:0/612913005 wait complete. 2024-09-12T16:51:49.211 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 Processor -- start 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 -- start start 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc4129560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc9293640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc412b980 con 0x7fcbc412aee0 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc4129560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc4129560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48898/0 (socket says 172.21.15.122:48898) 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.204+0000 7fcbc2ffd640 1 -- 172.21.15.122:0/1761158024 learned_addr learned my addr 172.21.15.122:0/1761158024 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbc2ffd640 1 -- 172.21.15.122:0/1761158024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc411ce10 con 0x7fcbc412aee0 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbc2ffd640 1 --2- 172.21.15.122:0/1761158024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc4129560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcbac019fa0 tx=0x7fcbac01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbbb7fe640 1 -- 172.21.15.122:0/1761158024 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0bc070 con 0x7fcbc412aee0 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbbb7fe640 1 -- 172.21.15.122:0/1761158024 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac004020 con 0x7fcbc412aee0 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc411b810 con 0x7fcbc412aee0 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbbb7fe640 1 -- 172.21.15.122:0/1761158024 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0b1040 con 0x7fcbc412aee0 2024-09-12T16:51:49.212 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc4129c70 con 0x7fcbc412aee0 2024-09-12T16:51:49.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbbb7fe640 1 -- 172.21.15.122:0/1761158024 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcbac004340 con 0x7fcbc412aee0 2024-09-12T16:51:49.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc412b2c0 con 0x7fcbc412aee0 2024-09-12T16:51:49.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbbb7fe640 1 --2- 172.21.15.122:0/1761158024 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba403b1d0 0x7fcba403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbbb7fe640 1 -- 172.21.15.122:0/1761158024 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fcbac0e92f0 con 0x7fcbc412aee0 2024-09-12T16:51:49.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbc27fc640 1 --2- 172.21.15.122:0/1761158024 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba403b1d0 0x7fcba403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.213 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.208+0000 7fcbc27fc640 1 --2- 172.21.15.122:0/1761158024 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba403b1d0 0x7fcba403d690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc007fd0 tx=0x7fcbbc007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.217 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.212+0000 7fcbbb7fe640 1 -- 172.21.15.122:0/1761158024 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcbac0a9070 con 0x7fcbc412aee0 2024-09-12T16:51:49.373 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.368+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbc411c1a0 con 0x7fcbc412aee0 2024-09-12T16:51:49.374 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbbb7fe640 1 -- 172.21.15.122:0/1761158024 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9902 (secure 0 0 0) 0x7fcbac015ff0 con 0x7fcbc412aee0 2024-09-12T16:51:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:49.375 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":17,"fsid":"5046056a-17be-43b6-80d1-88da5e3ce49b","created":"2024-09-12T16:51:29.157028+0000","modified":"2024-09-12T16:51:48.387519+0000","last_up_change":"2024-09-12T16:51:40.347390+0000","last_in_change":"2024-09-12T16:51:30.340067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:51:39.964026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:51:45.007883+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b980825b-63eb-43eb-ac4e-92bc8be6c667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6801","nonce":3868153603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6803","nonce":3868153603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6807","nonce":3868153603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6805","nonce":3868153603}]},"public_addr":"172.21.15.122:6801/3868153603","cluster_addr":"172.21.15.122:6803/3868153603","heartbeat_back_addr":"172.21.15.122:6807/3868153603","heartbeat_front_addr":"172.21.15.122:6805/3868153603","state":["exists","up"]},{"osd":1,"uuid":"ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6817","nonce":883447514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6819","nonce":883447514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6823","nonce":883447514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6821","nonce":883447514}]},"public_addr":"172.21.15.151:6817/883447514","cluster_addr":"172.21.15.151:6819/883447514","heartbeat_back_addr":"172.21.15.151:6823/883447514","heartbeat_front_addr":"172.21.15.151:6821/883447514","state":["exists","up"]},{"osd":2,"uuid":"9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6801","nonce":1197700885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6803","nonce":1197700885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6807","nonce":1197700885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6805","nonce":1197700885}]},"public_addr":"172.21.15.151:6801/1197700885","cluster_addr":"172.21.15.151:6803/1197700885","heartbeat_back_addr":"172.21.15.151:6807/1197700885","heartbeat_front_addr":"172.21.15.151:6805/1197700885","state":["exists","up"]},{"osd":3,"uuid":"61fba858-88d7-4f24-b3a4-cfed25eca39b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6809","nonce":987175333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6811","nonce":987175333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6815","nonce":987175333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6813","nonce":987175333}]},"public_addr":"172.21.15.151:6809/987175333","cluster_addr":"172.21.15.151:6811/987175333","heartbeat_back_addr":"172.21.15.151:6815/987175333","heartbeat_front_addr":"172.21.15.151:6813/987175333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:36.468476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:37.504802+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:36.679834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:37.189623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba403b1d0 msgr2=0x7fcba403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 --2- 172.21.15.122:0/1761158024 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba403b1d0 0x7fcba403d690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc007fd0 tx=0x7fcbbc007900 comp rx=0 tx=0).stop 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 msgr2=0x7fcbc4129560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 --2- 172.21.15.122:0/1761158024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc4129560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcbac019fa0 tx=0x7fcbac01abb0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 shutdown_connections 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 --2- 172.21.15.122:0/1761158024 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba403b1d0 0x7fcba403d690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 --2- 172.21.15.122:0/1761158024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbc412aee0 0x7fcbc4129560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 >> 172.21.15.122:0/1761158024 conn(0x7fcbc40a0a60 msgr2=0x7fcbc40a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 shutdown_connections 2024-09-12T16:51:49.378 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.372+0000 7fcbc9293640 1 -- 172.21.15.122:0/1761158024 wait complete. 2024-09-12T16:51:49.392 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T16:51:49.392 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:51:49.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.500+0000 7fde2d350640 1 Processor -- start 2024-09-12T16:51:49.506 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.500+0000 7fde2d350640 1 -- start start 2024-09-12T16:51:49.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fde28111890 0x7fde28132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde28073a90 con 0x7fde28110da0 2024-09-12T16:51:49.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fde280696e0 con 0x7fde28111890 2024-09-12T16:51:49.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde267fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fde28111890 0x7fde28132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde26ffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fde28110da0 0x7fde28111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52052/0 (socket says 172.21.15.122:52052) 2024-09-12T16:51:49.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde26ffd640 1 -- 172.21.15.122:0/381673356 learned_addr learned my addr 172.21.15.122:0/381673356 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:49.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde267fc640 1 -- 172.21.15.122:0/381673356 >> v1:172.21.15.122:6789/0 conn(0x7fde28110da0 legacy=0x7fde28111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde267fc640 1 -- 172.21.15.122:0/381673356 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2806dd50 con 0x7fde28111890 2024-09-12T16:51:49.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde267fc640 1 --2- 172.21.15.122:0/381673356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28111890 0x7fde28132450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde10009740 tx=0x7fde1001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ad7647afab64ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde25ffb640 1 -- 172.21.15.122:0/381673356 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde100b0070 con 0x7fde28111890 2024-09-12T16:51:49.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde25ffb640 1 -- 172.21.15.122:0/381673356 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde100ab530 con 0x7fde28111890 2024-09-12T16:51:49.509 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde25ffb640 1 -- 172.21.15.122:0/381673356 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde100ab830 con 0x7fde28111890 2024-09-12T16:51:49.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 -- 172.21.15.122:0/381673356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28111890 msgr2=0x7fde28132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 --2- 172.21.15.122:0/381673356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28111890 0x7fde28132450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde10009740 tx=0x7fde1001c370 comp rx=0 tx=0).stop 2024-09-12T16:51:49.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 -- 172.21.15.122:0/381673356 shutdown_connections 2024-09-12T16:51:49.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 --2- 172.21.15.122:0/381673356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28111890 0x7fde28132450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 -- 172.21.15.122:0/381673356 >> 172.21.15.122:0/381673356 conn(0x7fde28070900 msgr2=0x7fde28072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 -- 172.21.15.122:0/381673356 shutdown_connections 2024-09-12T16:51:49.510 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.504+0000 7fde2d350640 1 -- 172.21.15.122:0/381673356 wait complete. 2024-09-12T16:51:49.511 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde2d350640 1 Processor -- start 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde2d350640 1 -- start start 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde2d350640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28110da0 0x7fde2812f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde2d350640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fde28135330 con 0x7fde28110da0 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde26ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28110da0 0x7fde2812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde26ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28110da0 0x7fde2812f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48906/0 (socket says 172.21.15.122:48906) 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde26ffd640 1 -- 172.21.15.122:0/1240357344 learned_addr learned my addr 172.21.15.122:0/1240357344 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde26ffd640 1 -- 172.21.15.122:0/1240357344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde281323a0 con 0x7fde28110da0 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde26ffd640 1 --2- 172.21.15.122:0/1240357344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28110da0 0x7fde2812f890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde2000cbd0 tx=0x7fde2000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde1f7fe640 1 -- 172.21.15.122:0/1240357344 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde20017070 con 0x7fde28110da0 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde1f7fe640 1 -- 172.21.15.122:0/1240357344 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2000abc0 con 0x7fde28110da0 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde281320c0 con 0x7fde28110da0 2024-09-12T16:51:49.512 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde1f7fe640 1 -- 172.21.15.122:0/1240357344 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde20012400 con 0x7fde28110da0 2024-09-12T16:51:49.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2812fdd0 con 0x7fde28110da0 2024-09-12T16:51:49.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde28111180 con 0x7fde28110da0 2024-09-12T16:51:49.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde1f7fe640 1 -- 172.21.15.122:0/1240357344 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fde2001a070 con 0x7fde28110da0 2024-09-12T16:51:49.513 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde1f7fe640 1 --2- 172.21.15.122:0/1240357344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde0803b1d0 0x7fde0803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde1f7fe640 1 -- 172.21.15.122:0/1240357344 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fde2004ebe0 con 0x7fde28110da0 2024-09-12T16:51:49.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde267fc640 1 --2- 172.21.15.122:0/1240357344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde0803b1d0 0x7fde0803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.508+0000 7fde267fc640 1 --2- 172.21.15.122:0/1240357344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde0803b1d0 0x7fde0803d690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fde100ad000 tx=0x7fde100a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.512+0000 7fde1f7fe640 1 -- 172.21.15.122:0/1240357344 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fde200078c0 con 0x7fde28110da0 2024-09-12T16:51:49.674 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.668+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde28131c70 con 0x7fde28110da0 2024-09-12T16:51:49.675 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde1f7fe640 1 -- 172.21.15.122:0/1240357344 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9902 (secure 0 0 0) 0x7fde2001a360 con 0x7fde28110da0 2024-09-12T16:51:49.675 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:49.675 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":17,"fsid":"5046056a-17be-43b6-80d1-88da5e3ce49b","created":"2024-09-12T16:51:29.157028+0000","modified":"2024-09-12T16:51:48.387519+0000","last_up_change":"2024-09-12T16:51:40.347390+0000","last_in_change":"2024-09-12T16:51:30.340067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:51:39.964026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:51:45.007883+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b980825b-63eb-43eb-ac4e-92bc8be6c667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6801","nonce":3868153603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6803","nonce":3868153603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6807","nonce":3868153603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6805","nonce":3868153603}]},"public_addr":"172.21.15.122:6801/3868153603","cluster_addr":"172.21.15.122:6803/3868153603","heartbeat_back_addr":"172.21.15.122:6807/3868153603","heartbeat_front_addr":"172.21.15.122:6805/3868153603","state":["exists","up"]},{"osd":1,"uuid":"ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6817","nonce":883447514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6819","nonce":883447514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6823","nonce":883447514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6821","nonce":883447514}]},"public_addr":"172.21.15.151:6817/883447514","cluster_addr":"172.21.15.151:6819/883447514","heartbeat_back_addr":"172.21.15.151:6823/883447514","heartbeat_front_addr":"172.21.15.151:6821/883447514","state":["exists","up"]},{"osd":2,"uuid":"9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6801","nonce":1197700885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6803","nonce":1197700885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6807","nonce":1197700885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6805","nonce":1197700885}]},"public_addr":"172.21.15.151:6801/1197700885","cluster_addr":"172.21.15.151:6803/1197700885","heartbeat_back_addr":"172.21.15.151:6807/1197700885","heartbeat_front_addr":"172.21.15.151:6805/1197700885","state":["exists","up"]},{"osd":3,"uuid":"61fba858-88d7-4f24-b3a4-cfed25eca39b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6809","nonce":987175333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6811","nonce":987175333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6815","nonce":987175333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6813","nonce":987175333}]},"public_addr":"172.21.15.151:6809/987175333","cluster_addr":"172.21.15.151:6811/987175333","heartbeat_back_addr":"172.21.15.151:6815/987175333","heartbeat_front_addr":"172.21.15.151:6813/987175333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:36.468476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:37.504802+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:36.679834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:37.189623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:51:49.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde0803b1d0 msgr2=0x7fde0803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 --2- 172.21.15.122:0/1240357344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde0803b1d0 0x7fde0803d690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fde100ad000 tx=0x7fde100a6000 comp rx=0 tx=0).stop 2024-09-12T16:51:49.677 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28110da0 msgr2=0x7fde2812f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 --2- 172.21.15.122:0/1240357344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28110da0 0x7fde2812f890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde2000cbd0 tx=0x7fde2000a430 comp rx=0 tx=0).stop 2024-09-12T16:51:49.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 shutdown_connections 2024-09-12T16:51:49.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 --2- 172.21.15.122:0/1240357344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde0803b1d0 0x7fde0803d690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 --2- 172.21.15.122:0/1240357344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde28110da0 0x7fde2812f890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 >> 172.21.15.122:0/1240357344 conn(0x7fde28070900 msgr2=0x7fde28071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 shutdown_connections 2024-09-12T16:51:49.678 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.672+0000 7fde2d350640 1 -- 172.21.15.122:0/1240357344 wait complete. 2024-09-12T16:51:49.693 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T16:51:49.693 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T16:51:49.694 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T16:51:49.694 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T16:51:49.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f8962f3b640 1 Processor -- start 2024-09-12T16:51:49.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f8962f3b640 1 -- start start 2024-09-12T16:51:49.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f8962f3b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f895c12a7c0 0x7f895c132780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f8962f3b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f895c09fa20 con 0x7f895c129cd0 2024-09-12T16:51:49.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f8962f3b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f895c09f5e0 con 0x7f895c12a7c0 2024-09-12T16:51:49.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f8960cd7640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f895c129cd0 0x7f895c12a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52060/0 (socket says 172.21.15.122:52060) 2024-09-12T16:51:49.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f8960cd7640 1 -- 172.21.15.122:0/1429681921 learned_addr learned my addr 172.21.15.122:0/1429681921 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:49.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f895bfff640 1 --2- 172.21.15.122:0/1429681921 >> v2:172.21.15.122:3300/0 conn(0x7f895c12a7c0 0x7f895c132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f895bfff640 1 -- 172.21.15.122:0/1429681921 >> v1:172.21.15.122:6789/0 conn(0x7f895c129cd0 legacy=0x7f895c12a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f895b7fe640 1 -- 172.21.15.122:0/1429681921 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780685633 0 0) 0x7f895c09fa20 con 0x7f895c129cd0 2024-09-12T16:51:49.802 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f895bfff640 1 -- 172.21.15.122:0/1429681921 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c073900 con 0x7f895c12a7c0 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f75138a1640 1 Processor -- start 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f75138a1640 1 -- start start 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f75138a1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f750c06f3d0 0x7f750c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f75138a1640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750c0731e0 con 0x7f750c0738b0 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f75138a1640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f750c114d90 con 0x7f750c06f3d0 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f751163d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f750c06f3d0 0x7f750c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f7510e3c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f750c0738b0 0x7f750c123130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52070/0 (socket says 172.21.15.122:52070) 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.796+0000 7f7510e3c640 1 -- 172.21.15.122:0/85259219 learned_addr learned my addr 172.21.15.122:0/85259219 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f751163d640 1 -- 172.21.15.122:0/85259219 >> v1:172.21.15.122:6789/0 conn(0x7f750c0738b0 legacy=0x7f750c123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.803 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f751163d640 1 -- 172.21.15.122:0/85259219 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c0706d0 con 0x7f750c06f3d0 2024-09-12T16:51:49.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd41044e640 1 Processor -- start 2024-09-12T16:51:49.804 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd41044e640 1 -- start start 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd41044e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd408132800 0x7fd408134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd41044e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40812c010 con 0x7fd40812c210 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd41044e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd40809d9e0 con 0x7fd408132800 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40d9e9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd408132800 0x7fd408134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40d9e9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd408132800 0x7fd408134bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48928/0 (socket says 172.21.15.122:48928) 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40e1ea640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd40812c210 0x7fd40812c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52072/0 (socket says 172.21.15.122:52072) 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40d9e9640 1 -- 172.21.15.122:0/2554112607 learned_addr learned my addr 172.21.15.122:0/2554112607 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40d1e8640 1 -- 172.21.15.122:0/2554112607 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791588579 0 0) 0x7fd40812c010 con 0x7fd40812c210 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40d9e9640 1 -- 172.21.15.122:0/2554112607 >> v1:172.21.15.122:6789/0 conn(0x7fd40812c210 legacy=0x7fd40812c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40d9e9640 1 -- 172.21.15.122:0/2554112607 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40806df40 con 0x7fd408132800 2024-09-12T16:51:49.805 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f895bfff640 1 --2- 172.21.15.122:0/1429681921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c12a7c0 0x7f895c132780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8948009740 tx=0x7f894801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad5369adc9376fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19ad8e2640 1 Processor -- start 2024-09-12T16:51:49.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f895b7fe640 1 -- 172.21.15.122:0/1429681921 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89480b0070 con 0x7f895c12a7c0 2024-09-12T16:51:49.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f895b7fe640 1 -- 172.21.15.122:0/1429681921 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89480ab530 con 0x7f895c12a7c0 2024-09-12T16:51:49.806 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f895b7fe640 1 -- 172.21.15.122:0/1429681921 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89480ab830 con 0x7f895c12a7c0 2024-09-12T16:51:49.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19ad8e2640 1 -- start start 2024-09-12T16:51:49.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19ad8e2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f19a809dbf0 0x7f19a812ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19ad8e2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19a8073a20 con 0x7f19a812bf40 2024-09-12T16:51:49.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19ad8e2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f19a809e550 con 0x7f19a809dbf0 2024-09-12T16:51:49.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19a6ffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f19a812bf40 0x7f19a812c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52080/0 (socket says 172.21.15.122:52080) 2024-09-12T16:51:49.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19a6ffd640 1 -- 172.21.15.122:0/2727543142 learned_addr learned my addr 172.21.15.122:0/2727543142 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:49.807 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f199e7fc640 1 --2- 172.21.15.122:0/2727543142 >> v2:172.21.15.122:3300/0 conn(0x7f19a809dbf0 0x7f19a812ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 -- 172.21.15.122:0/1429681921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c12a7c0 msgr2=0x7f895c132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 --2- 172.21.15.122:0/1429681921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c12a7c0 0x7f895c132780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8948009740 tx=0x7f894801c400 comp rx=0 tx=0).stop 2024-09-12T16:51:49.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 -- 172.21.15.122:0/1429681921 shutdown_connections 2024-09-12T16:51:49.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 --2- 172.21.15.122:0/1429681921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c12a7c0 0x7f895c132780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 -- 172.21.15.122:0/1429681921 >> 172.21.15.122:0/1429681921 conn(0x7f895c072b80 msgr2=0x7f895c072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.808 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 -- 172.21.15.122:0/1429681921 shutdown_connections 2024-09-12T16:51:49.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 -- 172.21.15.122:0/1429681921 wait complete. 2024-09-12T16:51:49.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19a67fc640 1 -- 172.21.15.122:0/2727543142 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140625568 0 0) 0x7f19a8073a20 con 0x7f19a812bf40 2024-09-12T16:51:49.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f19a67fc640 1 -- 172.21.15.122:0/2727543142 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1994005740 con 0x7f19a812bf40 2024-09-12T16:51:49.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f199e7fc640 1 -- 172.21.15.122:0/2727543142 >> v1:172.21.15.122:6789/0 conn(0x7f19a812bf40 legacy=0x7f19a812c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.809 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f199e7fc640 1 -- 172.21.15.122:0/2727543142 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a81322d0 con 0x7f19a809dbf0 2024-09-12T16:51:49.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f751163d640 1 --2- 172.21.15.122:0/85259219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c06f7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7508009740 tx=0x7f750801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2ce87b3ff2d52a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f7503fff640 1 -- 172.21.15.122:0/85259219 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75080b0070 con 0x7f750c06f3d0 2024-09-12T16:51:49.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f7503fff640 1 -- 172.21.15.122:0/85259219 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75080ab530 con 0x7f750c06f3d0 2024-09-12T16:51:49.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f7503fff640 1 -- 172.21.15.122:0/85259219 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75080ab830 con 0x7f750c06f3d0 2024-09-12T16:51:49.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 Processor -- start 2024-09-12T16:51:49.810 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f8962f3b640 1 -- start start 2024-09-12T16:51:49.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40d9e9640 1 --2- 172.21.15.122:0/2554112607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd408132800 0x7fd408134bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80097f0 tx=0x7fd3f801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736999be6634ab32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7fd40d1e8640 1 -- 172.21.15.122:0/2554112607 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f80b0070 con 0x7fd408132800 2024-09-12T16:51:49.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f75138a1640 1 -- 172.21.15.122:0/85259219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 msgr2=0x7f750c06f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.811 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.800+0000 7f75138a1640 1 --2- 172.21.15.122:0/85259219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c06f7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7508009740 tx=0x7f750801c370 comp rx=0 tx=0).stop 2024-09-12T16:51:49.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd40d1e8640 1 -- 172.21.15.122:0/2554112607 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f80ab530 con 0x7fd408132800 2024-09-12T16:51:49.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd40d1e8640 1 -- 172.21.15.122:0/2554112607 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3f80ab830 con 0x7fd408132800 2024-09-12T16:51:49.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 -- 172.21.15.122:0/85259219 shutdown_connections 2024-09-12T16:51:49.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 --2- 172.21.15.122:0/85259219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c06f7b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 -- 172.21.15.122:0/85259219 >> 172.21.15.122:0/85259219 conn(0x7f750c09b890 msgr2=0x7f750c06dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 -- 172.21.15.122:0/85259219 shutdown_connections 2024-09-12T16:51:49.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 -- 172.21.15.122:0/85259219 wait complete. 2024-09-12T16:51:49.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 -- 172.21.15.122:0/2554112607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd408132800 msgr2=0x7fd408134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 --2- 172.21.15.122:0/2554112607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd408132800 0x7fd408134bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80097f0 tx=0x7fd3f801c430 comp rx=0 tx=0).stop 2024-09-12T16:51:49.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8962f3b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c129cd0 0x7f895c1c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8962f3b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1356f0 con 0x7f895c129cd0 2024-09-12T16:51:49.813 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8960cd7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c129cd0 0x7f895c1c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8960cd7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c129cd0 0x7f895c1c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48954/0 (socket says 172.21.15.122:48954) 2024-09-12T16:51:49.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8960cd7640 1 -- 172.21.15.122:0/2763388569 learned_addr learned my addr 172.21.15.122:0/2763388569 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8960cd7640 1 -- 172.21.15.122:0/2763388569 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c11b960 con 0x7f895c129cd0 2024-09-12T16:51:49.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8960cd7640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c129cd0 0x7f895c1c6ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f895000c410 tx=0x7f895000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 -- 172.21.15.122:0/2554112607 shutdown_connections 2024-09-12T16:51:49.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 --2- 172.21.15.122:0/2554112607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd408132800 0x7fd408134bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 -- 172.21.15.122:0/2554112607 >> 172.21.15.122:0/2554112607 conn(0x7fd408071650 msgr2=0x7fd40809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89500074d0 con 0x7f895c129cd0 2024-09-12T16:51:49.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89500047f0 con 0x7f895c129cd0 2024-09-12T16:51:49.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8950004b10 con 0x7f895c129cd0 2024-09-12T16:51:49.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 -- 172.21.15.122:0/2554112607 shutdown_connections 2024-09-12T16:51:49.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 -- 172.21.15.122:0/2554112607 wait complete. 2024-09-12T16:51:49.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895c11b170 con 0x7f895c129cd0 2024-09-12T16:51:49.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895c1278e0 con 0x7f895c129cd0 2024-09-12T16:51:49.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 Processor -- start 2024-09-12T16:51:49.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 -- start start 2024-09-12T16:51:49.816 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f199e7fc640 1 --2- 172.21.15.122:0/2727543142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a812ca30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1990009740 tx=0x7f199001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2f5398277699c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19a67fc640 1 -- 172.21.15.122:0/2727543142 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19900b0070 con 0x7f19a809dbf0 2024-09-12T16:51:49.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19a67fc640 1 -- 172.21.15.122:0/2727543142 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19900ab530 con 0x7f19a809dbf0 2024-09-12T16:51:49.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19a67fc640 1 -- 172.21.15.122:0/2727543142 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19900ab830 con 0x7f19a809dbf0 2024-09-12T16:51:49.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.817 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f750c135890 con 0x7f750c06f3d0 2024-09-12T16:51:49.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f895c0703f0 con 0x7f895c129cd0 2024-09-12T16:51:49.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f751163d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f751163d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c122670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48966/0 (socket says 172.21.15.122:48966) 2024-09-12T16:51:49.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f751163d640 1 -- 172.21.15.122:0/2285174704 learned_addr learned my addr 172.21.15.122:0/2285174704 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.818 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 Processor -- start 2024-09-12T16:51:49.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 -- start start 2024-09-12T16:51:49.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f751163d640 1 -- 172.21.15.122:0/2285174704 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c130860 con 0x7f750c06f3d0 2024-09-12T16:51:49.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f751163d640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c122670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7508019fc0 tx=0x7f750801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 -- 172.21.15.122:0/2727543142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 msgr2=0x7f19a812ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 --2- 172.21.15.122:0/2727543142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a812ca30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1990009740 tx=0x7f199001c370 comp rx=0 tx=0).stop 2024-09-12T16:51:49.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd40812c210 0x7fd408119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd41044e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd408137ad0 con 0x7fd40812c210 2024-09-12T16:51:49.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 -- 172.21.15.122:0/2727543142 shutdown_connections 2024-09-12T16:51:49.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 --2- 172.21.15.122:0/2727543142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a812ca30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 -- 172.21.15.122:0/2727543142 >> 172.21.15.122:0/2727543142 conn(0x7f19a8071630 msgr2=0x7f19a809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 -- 172.21.15.122:0/2727543142 shutdown_connections 2024-09-12T16:51:49.820 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 -- 172.21.15.122:0/2727543142 wait complete. 2024-09-12T16:51:49.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8950011070 con 0x7f895c129cd0 2024-09-12T16:51:49.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd40e1ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd40812c210 0x7fd408119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd40e1ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd40812c210 0x7fd408119a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48970/0 (socket says 172.21.15.122:48970) 2024-09-12T16:51:49.821 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75080b0050 con 0x7f750c06f3d0 2024-09-12T16:51:49.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75080b1040 con 0x7f750c06f3d0 2024-09-12T16:51:49.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd40e1ea640 1 -- 172.21.15.122:0/3867616645 learned_addr learned my addr 172.21.15.122:0/3867616645 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750c130d20 con 0x7f750c06f3d0 2024-09-12T16:51:49.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75080aab40 con 0x7f750c06f3d0 2024-09-12T16:51:49.822 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f894003b200 0x7f894003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750c122d80 con 0x7f750c06f3d0 2024-09-12T16:51:49.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f895004f1f0 con 0x7f895c129cd0 2024-09-12T16:51:49.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8940040980 0x7f8940042e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f895000fe50 con 0x7f8940040980 2024-09-12T16:51:49.823 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f895004f630 con 0x7f895c129cd0 2024-09-12T16:51:49.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 Processor -- start 2024-09-12T16:51:49.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7fd40e1ea640 1 -- 172.21.15.122:0/3867616645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40812f3b0 con 0x7fd40812c210 2024-09-12T16:51:49.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f19ad8e2640 1 -- start start 2024-09-12T16:51:49.824 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.804+0000 7f895bfff640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f894003b200 0x7f894003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd40e1ea640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd40812c210 0x7fd408119a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c3d0 tx=0x7fd40400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f89614d8640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8940040980 0x7f8940042e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.825 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd404007410 con 0x7fd40812c210 2024-09-12T16:51:49.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f750c131000 con 0x7f750c06f3d0 2024-09-12T16:51:49.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19ad8e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a8118bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19ad8e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f19a8131e60 con 0x7f19a809dbf0 2024-09-12T16:51:49.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4040075d0 con 0x7fd40812c210 2024-09-12T16:51:49.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40811bd00 con 0x7fd40812c210 2024-09-12T16:51:49.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd404004960 con 0x7fd40812c210 2024-09-12T16:51:49.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd408119fc0 con 0x7fd40812c210 2024-09-12T16:51:49.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a6ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a8118bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a6ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a8118bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48984/0 (socket says 172.21.15.122:48984) 2024-09-12T16:51:49.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a6ffd640 1 -- 172.21.15.122:0/119636412 learned_addr learned my addr 172.21.15.122:0/119636412 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a6ffd640 1 -- 172.21.15.122:0/119636412 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a8129880 con 0x7f19a809dbf0 2024-09-12T16:51:49.827 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f895bfff640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f894003b200 0x7f894003d6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f89480ad000 tx=0x7f89480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f89614d8640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8940040980 0x7f8940042e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.828 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3f0000f90 con 0x7fd40812c210 2024-09-12T16:51:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a6ffd640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a8118bd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f199800cb50 tx=0x7f199800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1998017070 con 0x7f19a809dbf0 2024-09-12T16:51:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199800abf0 con 0x7f19a809dbf0 2024-09-12T16:51:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a811bca0 con 0x7f19a809dbf0 2024-09-12T16:51:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1998012400 con 0x7f19a809dbf0 2024-09-12T16:51:49.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a811bfb0 con 0x7f19a809dbf0 2024-09-12T16:51:49.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd404011070 con 0x7fd40812c210 2024-09-12T16:51:49.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd3ec03b1d0 0x7fd3ec03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd40404e8b0 con 0x7fd40812c210 2024-09-12T16:51:49.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fd3ec040950 0x7fd3ec042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd40400fe50 con 0x7fd3ec040950 2024-09-12T16:51:49.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd4040532a0 con 0x7fd40812c210 2024-09-12T16:51:49.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd40d9e9640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd3ec03b1d0 0x7fd3ec03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f75080be030 con 0x7f750c06f3d0 2024-09-12T16:51:49.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd40e9eb640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fd3ec040950 0x7fd3ec042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19a811b640 con 0x7f19a809dbf0 2024-09-12T16:51:49.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7501ffb640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f74f003b270 0x7f74f003d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f75080bc070 con 0x7f750c06f3d0 2024-09-12T16:51:49.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f199801a070 con 0x7f19a809dbf0 2024-09-12T16:51:49.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7501ffb640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f74f0040a70 0x7f74f0042ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75080ab530 con 0x7f74f0040a70 2024-09-12T16:51:49.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f75080f0050 con 0x7f750c06f3d0 2024-09-12T16:51:49.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd40e9eb640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fd3ec040950 0x7fd3ec042dd0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f198803b1d0 0x7f198803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f199804e9d0 con 0x7f19a809dbf0 2024-09-12T16:51:49.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7510e3c640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f74f003b270 0x7f74f003d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.833 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f895000fe50 con 0x7f8940040980 2024-09-12T16:51:49.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7f1988040950 0x7f1988042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f199801de80 con 0x7f1988040950 2024-09-12T16:51:49.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f19980532a0 con 0x7f19a809dbf0 2024-09-12T16:51:49.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd40d9e9640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd3ec03b1d0 0x7fd3ec03d690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd408069620 tx=0x7fd3f80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7511e3e640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f74f0040a70 0x7f74f0042ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f199e7fc640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f198803b1d0 0x7f198803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a77fe640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7f1988040950 0x7f1988042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd40400fe50 con 0x7fd3ec040950 2024-09-12T16:51:49.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f7511e3e640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f74f0040a70 0x7f74f0042ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.808+0000 7f19a77fe640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7f1988040950 0x7f1988042dd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.812+0000 7f7510e3c640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f74f003b270 0x7f74f003d730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74fc005890 tx=0x7f74fc007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.812+0000 7f199e7fc640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f198803b1d0 0x7f198803d690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1990009740 tx=0x7f1990008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.812+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75080ab530 con 0x7f74f0040a70 2024-09-12T16:51:49.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.812+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f199801de80 con 0x7f1988040950 2024-09-12T16:51:49.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f895c12a0b0 con 0x7f8940040980 2024-09-12T16:51:49.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f89597fa640 1 -- 172.21.15.122:0/2763388569 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f895c12a0b0 con 0x7f8940040980 2024-09-12T16:51:49.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8940040980 msgr2=0x7f8940042e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8940040980 0x7f8940042e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f894003b200 msgr2=0x7f894003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f894003b200 0x7f894003d6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f89480ad000 tx=0x7f89480a6000 comp rx=0 tx=0).stop 2024-09-12T16:51:49.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c129cd0 msgr2=0x7f895c1c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c129cd0 0x7f895c1c6ab0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f895000c410 tx=0x7f895000c8d0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 shutdown_connections 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8940040980 0x7f8940042e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f894003b200 0x7f894003d6c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 --2- 172.21.15.122:0/2763388569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f895c129cd0 0x7f895c1c6ab0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 >> 172.21.15.122:0/2763388569 conn(0x7f895c072b80 msgr2=0x7f895c12bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 shutdown_connections 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f8962f3b640 1 -- 172.21.15.122:0/2763388569 wait complete. 2024-09-12T16:51:49.840 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.824+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f750c06f7b0 con 0x7f74f0040a70 2024-09-12T16:51:49.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f7501ffb640 1 -- 172.21.15.122:0/2285174704 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f750c06f7b0 con 0x7f74f0040a70 2024-09-12T16:51:49.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f74f0040a70 msgr2=0x7f74f0042ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f74f0040a70 0x7f74f0042ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f74f003b270 msgr2=0x7f74f003d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f74f003b270 0x7f74f003d730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74fc005890 tx=0x7f74fc007ab0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 msgr2=0x7f750c122670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c122670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7508019fc0 tx=0x7f750801abb0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 shutdown_connections 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f74f0040a70 0x7f74f0042ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f74f003b270 0x7f74f003d730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 --2- 172.21.15.122:0/2285174704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f750c06f3d0 0x7f750c122670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 >> 172.21.15.122:0/2285174704 conn(0x7f750c09b890 msgr2=0x7f750c09bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 shutdown_connections 2024-09-12T16:51:49.842 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.828+0000 7f75138a1640 1 -- 172.21.15.122:0/2285174704 wait complete. 2024-09-12T16:51:49.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd3f0002c80 con 0x7fd3ec040950 2024-09-12T16:51:49.843 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd3feffd640 1 -- 172.21.15.122:0/3867616645 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd3f0002c80 con 0x7fd3ec040950 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fd3ec040950 msgr2=0x7fd3ec042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fd3ec040950 0x7fd3ec042dd0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd3ec03b1d0 msgr2=0x7fd3ec03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd3ec03b1d0 0x7fd3ec03d690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd408069620 tx=0x7fd3f80a6000 comp rx=0 tx=0).stop 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd40812c210 msgr2=0x7fd408119a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd40812c210 0x7fd408119a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c3d0 tx=0x7fd40400c890 comp rx=0 tx=0).stop 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 shutdown_connections 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fd3ec040950 0x7fd3ec042dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd3ec03b1d0 0x7fd3ec03d690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 --2- 172.21.15.122:0/3867616645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd40812c210 0x7fd408119a80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.844 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 >> 172.21.15.122:0/3867616645 conn(0x7fd408071650 msgr2=0x7fd408071df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 shutdown_connections 2024-09-12T16:51:49.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.836+0000 7fd41044e640 1 -- 172.21.15.122:0/3867616645 wait complete. 2024-09-12T16:51:49.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f19a812c190 con 0x7f1988040950 2024-09-12T16:51:49.845 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19a4ff9640 1 -- 172.21.15.122:0/119636412 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f19a812c190 con 0x7f1988040950 2024-09-12T16:51:49.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7f1988040950 msgr2=0x7f1988042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.846 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7f1988040950 0x7f1988042dd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f198803b1d0 msgr2=0x7f198803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f198803b1d0 0x7f198803d690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1990009740 tx=0x7f1990008040 comp rx=0 tx=0).stop 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 msgr2=0x7f19a8118bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a8118bd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f199800cb50 tx=0x7f199800a430 comp rx=0 tx=0).stop 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 shutdown_connections 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7f1988040950 0x7f1988042dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f198803b1d0 0x7f198803d690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 --2- 172.21.15.122:0/119636412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19a809dbf0 0x7f19a8118bd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 >> 172.21.15.122:0/119636412 conn(0x7f19a8071630 msgr2=0x7f19a8072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 shutdown_connections 2024-09-12T16:51:49.847 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.840+0000 7f19ad8e2640 1 -- 172.21.15.122:0/119636412 wait complete. 2024-09-12T16:51:49.849 INFO:teuthology.orchestra.run.smithi122.stdout:42949672965 2024-09-12T16:51:49.849 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:51:49.850 INFO:teuthology.orchestra.run.smithi122.stdout:47244640261 2024-09-12T16:51:49.850 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:51:49.861 INFO:teuthology.orchestra.run.smithi122.stdout:38654705670 2024-09-12T16:51:49.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:51:49.862 INFO:teuthology.orchestra.run.smithi122.stdout:47244640260 2024-09-12T16:51:49.863 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T16:51:49.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f90690ae640 1 Processor -- start 2024-09-12T16:51:49.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f90690ae640 1 -- start start 2024-09-12T16:51:49.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f90690ae640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f906412bf90 0x7f906412c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f90690ae640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f906409d690 con 0x7f906409dc20 2024-09-12T16:51:49.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f90690ae640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9064073ae0 con 0x7f906412bf90 2024-09-12T16:51:49.965 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee88da640 1 Processor -- start 2024-09-12T16:51:49.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee88da640 1 -- start start 2024-09-12T16:51:49.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f9062d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f906412bf90 0x7f906412c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f906259c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f906409dc20 0x7f906412c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52094/0 (socket says 172.21.15.122:52094) 2024-09-12T16:51:49.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f906259c640 1 -- 172.21.15.122:0/2424678051 learned_addr learned my addr 172.21.15.122:0/2424678051 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:49.966 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f9061d9b640 1 -- 172.21.15.122:0/2424678051 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682162669 0 0) 0x7f906409d690 con 0x7f906409dc20 2024-09-12T16:51:49.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f9061d9b640 1 -- 172.21.15.122:0/2424678051 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f904c003530 con 0x7f906409dc20 2024-09-12T16:51:49.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f9062d9d640 1 -- 172.21.15.122:0/2424678051 >> v1:172.21.15.122:6789/0 conn(0x7f906409dc20 legacy=0x7f906412c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f9062d9d640 1 -- 172.21.15.122:0/2424678051 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906409e390 con 0x7f906412bf90 2024-09-12T16:51:49.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee88da640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8ee409eca0 0x7f8ee41326c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.967 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee88da640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ee4073bb0 con 0x7f8ee409ca50 2024-09-12T16:51:49.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee88da640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee409f850 con 0x7f8ee409eca0 2024-09-12T16:51:49.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee1d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8ee409eca0 0x7f8ee41326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee1d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8ee409eca0 0x7f8ee41326c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49000/0 (socket says 172.21.15.122:49000) 2024-09-12T16:51:49.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee1d9b640 1 -- 172.21.15.122:0/3429222196 learned_addr learned my addr 172.21.15.122:0/3429222196 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee1d9b640 1 -- 172.21.15.122:0/3429222196 >> v1:172.21.15.122:6789/0 conn(0x7f8ee409ca50 legacy=0x7f8ee409ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee159a640 1 -- 172.21.15.122:0/3429222196 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097580877 0 0) 0x7f8ee4073bb0 con 0x7f8ee409ca50 2024-09-12T16:51:49.968 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.960+0000 7f8ee1d9b640 1 -- 172.21.15.122:0/3429222196 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee409e630 con 0x7f8ee409eca0 2024-09-12T16:51:49.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f9062d9d640 1 --2- 172.21.15.122:0/2424678051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906412bf90 0x7f906412c370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9054009740 tx=0x7f905401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54fc1c9193b9c74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f9061d9b640 1 -- 172.21.15.122:0/2424678051 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90540b0070 con 0x7f906412bf90 2024-09-12T16:51:49.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f9061d9b640 1 -- 172.21.15.122:0/2424678051 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90540ab530 con 0x7f906412bf90 2024-09-12T16:51:49.969 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f9061d9b640 1 -- 172.21.15.122:0/2424678051 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90540ab830 con 0x7f906412bf90 2024-09-12T16:51:49.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f8ee1d9b640 1 --2- 172.21.15.122:0/3429222196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409eca0 0x7f8ee41326c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40097f0 tx=0x7f8ed401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849e8e8678c659f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f8ee159a640 1 -- 172.21.15.122:0/3429222196 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed40b0070 con 0x7f8ee409eca0 2024-09-12T16:51:49.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f8ee159a640 1 -- 172.21.15.122:0/3429222196 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed40ab530 con 0x7f8ee409eca0 2024-09-12T16:51:49.970 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f8ee159a640 1 -- 172.21.15.122:0/3429222196 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed40ab830 con 0x7f8ee409eca0 2024-09-12T16:51:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f90690ae640 1 -- 172.21.15.122:0/2424678051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906412bf90 msgr2=0x7f906412c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f90690ae640 1 --2- 172.21.15.122:0/2424678051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906412bf90 0x7f906412c370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9054009740 tx=0x7f905401c370 comp rx=0 tx=0).stop 2024-09-12T16:51:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f90690ae640 1 -- 172.21.15.122:0/2424678051 shutdown_connections 2024-09-12T16:51:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f90690ae640 1 --2- 172.21.15.122:0/2424678051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906412bf90 0x7f906412c370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f90690ae640 1 -- 172.21.15.122:0/2424678051 >> 172.21.15.122:0/2424678051 conn(0x7f90640715e0 msgr2=0x7f906409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f90690ae640 1 -- 172.21.15.122:0/2424678051 shutdown_connections 2024-09-12T16:51:49.971 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f90690ae640 1 -- 172.21.15.122:0/2424678051 wait complete. 2024-09-12T16:51:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f8ee88da640 1 -- 172.21.15.122:0/3429222196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409eca0 msgr2=0x7f8ee41326c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.964+0000 7f8ee88da640 1 --2- 172.21.15.122:0/3429222196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409eca0 0x7f8ee41326c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40097f0 tx=0x7f8ed401c430 comp rx=0 tx=0).stop 2024-09-12T16:51:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 -- 172.21.15.122:0/3429222196 shutdown_connections 2024-09-12T16:51:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 --2- 172.21.15.122:0/3429222196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409eca0 0x7f8ee41326c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 -- 172.21.15.122:0/3429222196 >> 172.21.15.122:0/3429222196 conn(0x7f8ee4071e50 msgr2=0x7f8ee4072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 -- 172.21.15.122:0/3429222196 shutdown_connections 2024-09-12T16:51:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 -- 172.21.15.122:0/3429222196 wait complete. 2024-09-12T16:51:49.972 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 Processor -- start 2024-09-12T16:51:49.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 -- start start 2024-09-12T16:51:49.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f90690ae640 1 Processor -- start 2024-09-12T16:51:49.973 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f90690ae640 1 -- start start 2024-09-12T16:51:49.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409ca50 0x7f8ee41c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee41357b0 con 0x7f8ee409ca50 2024-09-12T16:51:49.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409ca50 0x7f8ee41c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409ca50 0x7f8ee41c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49016/0 (socket says 172.21.15.122:49016) 2024-09-12T16:51:49.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee259c640 1 -- 172.21.15.122:0/2571083881 learned_addr learned my addr 172.21.15.122:0/2571083881 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f90690ae640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906409dc20 0x7f90641c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.974 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f90690ae640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9064133e60 con 0x7f906409dc20 2024-09-12T16:51:49.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee259c640 1 -- 172.21.15.122:0/2571083881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee411b280 con 0x7f8ee409ca50 2024-09-12T16:51:49.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f9062d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906409dc20 0x7f90641c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f9062d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906409dc20 0x7f90641c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49018/0 (socket says 172.21.15.122:49018) 2024-09-12T16:51:49.975 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f9062d9d640 1 -- 172.21.15.122:0/3079211449 learned_addr learned my addr 172.21.15.122:0/3079211449 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:49.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee259c640 1 --2- 172.21.15.122:0/2571083881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409ca50 0x7f8ee41c6cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c480 tx=0x7f8ed800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ed2ffd640 1 -- 172.21.15.122:0/2571083881 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed8017070 con 0x7f8ee409ca50 2024-09-12T16:51:49.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ed2ffd640 1 -- 172.21.15.122:0/2571083881 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed8005470 con 0x7f8ee409ca50 2024-09-12T16:51:49.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee411ae20 con 0x7f8ee409ca50 2024-09-12T16:51:49.976 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f9062d9d640 1 -- 172.21.15.122:0/3079211449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9064126780 con 0x7f906409dc20 2024-09-12T16:51:49.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f9062d9d640 1 --2- 172.21.15.122:0/3079211449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906409dc20 0x7f90641c43f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f90540ae040 tx=0x7f905401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f904b7fe640 1 -- 172.21.15.122:0/3079211449 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90540b0050 con 0x7f906409dc20 2024-09-12T16:51:49.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f904b7fe640 1 -- 172.21.15.122:0/3079211449 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90540b1040 con 0x7f906409dc20 2024-09-12T16:51:49.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9064117ff0 con 0x7f906409dc20 2024-09-12T16:51:49.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ed2ffd640 1 -- 172.21.15.122:0/2571083881 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed8003730 con 0x7f8ee409ca50 2024-09-12T16:51:49.977 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee41c7200 con 0x7f8ee409ca50 2024-09-12T16:51:49.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f904b7fe640 1 -- 172.21.15.122:0/3079211449 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90540b0050 con 0x7f906409dc20 2024-09-12T16:51:49.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906406df20 con 0x7f906409dc20 2024-09-12T16:51:49.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906406e6c0 con 0x7f906409dc20 2024-09-12T16:51:49.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.968+0000 7f8ed2ffd640 1 -- 172.21.15.122:0/2571083881 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ed801a070 con 0x7f8ee409ca50 2024-09-12T16:51:49.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f904b7fe640 1 -- 172.21.15.122:0/3079211449 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90540be030 con 0x7f906409dc20 2024-09-12T16:51:49.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f904b7fe640 1 --2- 172.21.15.122:0/3079211449 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f905003b2c0 0x7f905003d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f904b7fe640 1 -- 172.21.15.122:0/3079211449 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f90540bc070 con 0x7f906409dc20 2024-09-12T16:51:49.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f906259c640 1 --2- 172.21.15.122:0/3079211449 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f905003b2c0 0x7f905003d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f906259c640 1 --2- 172.21.15.122:0/3079211449 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f905003b2c0 0x7f905003d780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9058007fd0 tx=0x7f9058007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f8ed2ffd640 1 --2- 172.21.15.122:0/2571083881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ec403b190 0x7f8ec403d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:49.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f8ed2ffd640 1 -- 172.21.15.122:0/2571083881 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f8ed80522a0 con 0x7f8ee409ca50 2024-09-12T16:51:49.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f8ee1d9b640 1 --2- 172.21.15.122:0/2571083881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ec403b190 0x7f8ec403d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:49.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.972+0000 7f8ee1d9b640 1 --2- 172.21.15.122:0/2571083881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ec403b190 0x7f8ec403d650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40ad000 tx=0x7f8ed4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:49.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.976+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee409ce30 con 0x7f8ee409ca50 2024-09-12T16:51:49.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.976+0000 7f904b7fe640 1 -- 172.21.15.122:0/3079211449 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f90540c5020 con 0x7f906409dc20 2024-09-12T16:51:49.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:49.980+0000 7f8ed2ffd640 1 -- 172.21.15.122:0/2571083881 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8ed804cd70 con 0x7f8ee409ca50 2024-09-12T16:51:50.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcc26e2640 1 Processor -- start 2024-09-12T16:51:50.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcc26e2640 1 -- start start 2024-09-12T16:51:50.017 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcc26e2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbcbc113620 0x7fbcbc132590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:50.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcc26e2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcbc073b10 con 0x7fbcbc06dce0 2024-09-12T16:51:50.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcc26e2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fbcbc114a30 con 0x7fbcbc113620 2024-09-12T16:51:50.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcbb7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbcbc113620 0x7fbcbc132590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:50.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcbb7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbcbc113620 0x7fbcbc132590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49024/0 (socket says 172.21.15.122:49024) 2024-09-12T16:51:50.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcbb7fe640 1 -- 172.21.15.122:0/3292882338 learned_addr learned my addr 172.21.15.122:0/3292882338 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:50.018 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcbbfff640 1 --1- 172.21.15.122:0/3292882338 >> v1:172.21.15.122:6789/0 conn(0x7fbcbc06dce0 0x7fbcbc06e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52122/0 (socket says 172.21.15.122:52122) 2024-09-12T16:51:50.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcbb7fe640 1 -- 172.21.15.122:0/3292882338 >> v1:172.21.15.122:6789/0 conn(0x7fbcbc06dce0 legacy=0x7fbcbc06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcbaffd640 1 -- 172.21.15.122:0/3292882338 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634976307 0 0) 0x7fbcbc073b10 con 0x7fbcbc06dce0 2024-09-12T16:51:50.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.012+0000 7fbcbb7fe640 1 -- 172.21.15.122:0/3292882338 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc114d60 con 0x7fbcbc113620 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd79a60f640 1 Processor -- start 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd79a60f640 1 -- start start 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd79a60f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd79412ff60 0x7fd7941349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd79a60f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd794070550 con 0x7fd79412f470 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd79a60f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd794070aa0 con 0x7fd79412ff60 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd793fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd79412f470 0x7fd79412f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52128/0 (socket says 172.21.15.122:52128) 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd793fff640 1 -- 172.21.15.122:0/3477767078 learned_addr learned my addr 172.21.15.122:0/3477767078 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1424957732 0 0) 0x7fd794070550 con 0x7fd79412f470 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c003530 con 0x7fd79412f470 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd7937fe640 1 --2- 172.21.15.122:0/3477767078 >> v2:172.21.15.122:3300/0 conn(0x7fd79412ff60 0x7fd7941349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3875913550 0 0) 0x7fd77c003530 con 0x7fd79412f470 2024-09-12T16:51:50.020 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 >> v2:172.21.15.122:3300/0 conn(0x7fd79412ff60 msgr2=0x7fd7941349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 --2- 172.21.15.122:0/3477767078 >> v2:172.21.15.122:3300/0 conn(0x7fd79412ff60 0x7fd7941349a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd794073d90 con 0x7fd79412f470 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3718109123 0 0) 0x7fd784001630 con 0x7fd79412f470 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 >> v1:172.21.15.122:6789/0 conn(0x7fd79412f470 legacy=0x7fd79412f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 --2- 172.21.15.122:0/3477767078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd77c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd794070aa0 con 0x7fd77c003a90 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd7937fe640 1 --2- 172.21.15.122:0/3477767078 >> v2:172.21.15.122:3300/0 conn(0x7fd79412ff60 0x7fd7941349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd793fff640 1 --2- 172.21.15.122:0/3477767078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd77c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:50.021 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fd793fff640 1 -- 172.21.15.122:0/3477767078 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c003530 con 0x7fd77c003a90 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fbcbb7fe640 1 --2- 172.21.15.122:0/3292882338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc113620 0x7fbcbc132590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00097f0 tx=0x7fbcb001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d1a29c76d1db5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fbcbaffd640 1 -- 172.21.15.122:0/3292882338 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb00b1070 con 0x7fbcbc113620 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fbcbaffd640 1 -- 172.21.15.122:0/3292882338 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb00ac560 con 0x7fbcbc113620 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fbcbaffd640 1 -- 172.21.15.122:0/3292882338 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb00a8050 con 0x7fbcbc113620 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fbcc26e2640 1 -- 172.21.15.122:0/3292882338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc113620 msgr2=0x7fbcbc132590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.016+0000 7fbcc26e2640 1 --2- 172.21.15.122:0/3292882338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc113620 0x7fbcbc132590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00097f0 tx=0x7fbcb001c4c0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 -- 172.21.15.122:0/3292882338 shutdown_connections 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 --2- 172.21.15.122:0/3292882338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc113620 0x7fbcbc132590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 -- 172.21.15.122:0/3292882338 >> 172.21.15.122:0/3292882338 conn(0x7fbcbc0709b0 msgr2=0x7fbcbc072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 -- 172.21.15.122:0/3292882338 shutdown_connections 2024-09-12T16:51:50.023 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 -- 172.21.15.122:0/3292882338 wait complete. 2024-09-12T16:51:50.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd793fff640 1 --2- 172.21.15.122:0/3477767078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd77c003e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd784007fc0 tx=0x7fd78401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f54391a6792dc03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:50.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 Processor -- start 2024-09-12T16:51:50.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd784007c90 con 0x7fd77c003a90 2024-09-12T16:51:50.024 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7840a9020 con 0x7fd77c003a90 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd792ffd640 1 -- 172.21.15.122:0/3477767078 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd784005ba0 con 0x7fd77c003a90 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 -- start start 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc06dce0 0x7fbcbc110da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc1357a0 con 0x7fbcbc06dce0 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcbbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc06dce0 0x7fbcbc110da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcbbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc06dce0 0x7fbcbc110da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49050/0 (socket says 172.21.15.122:49050) 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcbbfff640 1 -- 172.21.15.122:0/2955688692 learned_addr learned my addr 172.21.15.122:0/2955688692 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 -- 172.21.15.122:0/3477767078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 msgr2=0x7fd77c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.025 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 --2- 172.21.15.122:0/3477767078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd77c003e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd784007fc0 tx=0x7fd78401cca0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcbbfff640 1 -- 172.21.15.122:0/2955688692 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc111f90 con 0x7fbcbc06dce0 2024-09-12T16:51:50.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 -- 172.21.15.122:0/3477767078 shutdown_connections 2024-09-12T16:51:50.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 --2- 172.21.15.122:0/3477767078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd77c003e90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 --2- 172.21.15.122:0/3477767078 >> v2:172.21.15.122:3300/0 conn(0x7fd79412ff60 0x7fd7941349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.026 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 -- 172.21.15.122:0/3477767078 >> 172.21.15.122:0/3477767078 conn(0x7fd794072b80 msgr2=0x7fd794072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:50.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 -- 172.21.15.122:0/3477767078 shutdown_connections 2024-09-12T16:51:50.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 -- 172.21.15.122:0/3477767078 wait complete. 2024-09-12T16:51:50.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcbbfff640 1 --2- 172.21.15.122:0/2955688692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc06dce0 0x7fbcbc110da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbcac01d6c0 tx=0x7fbcac01db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:50.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcb8ff9640 1 -- 172.21.15.122:0/2955688692 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcac029070 con 0x7fbcbc06dce0 2024-09-12T16:51:50.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcb8ff9640 1 -- 172.21.15.122:0/2955688692 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac0070d0 con 0x7fbcbc06dce0 2024-09-12T16:51:50.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcbc12e8e0 con 0x7fbcbc06dce0 2024-09-12T16:51:50.027 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcbc1112e0 con 0x7fbcbc06dce0 2024-09-12T16:51:50.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 Processor -- start 2024-09-12T16:51:50.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.020+0000 7fd79a60f640 1 -- start start 2024-09-12T16:51:50.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fbcb8ff9640 1 -- 172.21.15.122:0/2955688692 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcac0073f0 con 0x7fbcbc06dce0 2024-09-12T16:51:50.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fd79a60f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd7941c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:50.028 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fd79a60f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd794119100 con 0x7fd77c003a90 2024-09-12T16:51:50.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc9c005090 con 0x7fbcbc06dce0 2024-09-12T16:51:50.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fd793fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd7941c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:50.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fd793fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd7941c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49062/0 (socket says 172.21.15.122:49062) 2024-09-12T16:51:50.029 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fd793fff640 1 -- 172.21.15.122:0/701692402 learned_addr learned my addr 172.21.15.122:0/701692402 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:50.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fd793fff640 1 -- 172.21.15.122:0/701692402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd794129c60 con 0x7fd77c003a90 2024-09-12T16:51:50.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.024+0000 7fd793fff640 1 --2- 172.21.15.122:0/701692402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd7941c2760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd78401cce0 tx=0x7fd77c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:50.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fbcb8ff9640 1 -- 172.21.15.122:0/2955688692 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbcac02c070 con 0x7fbcbc06dce0 2024-09-12T16:51:50.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fbcb8ff9640 1 --2- 172.21.15.122:0/2955688692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbca803b270 0x7fbca803d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:50.030 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fbcb8ff9640 1 -- 172.21.15.122:0/2955688692 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fbcac020070 con 0x7fbcbc06dce0 2024-09-12T16:51:50.031 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fbcbb7fe640 1 --2- 172.21.15.122:0/2955688692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbca803b270 0x7fbca803d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:50.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fd790ff9640 1 -- 172.21.15.122:0/701692402 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7840bc070 con 0x7fd77c003a90 2024-09-12T16:51:50.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fbcb8ff9640 1 -- 172.21.15.122:0/2955688692 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbcac01b670 con 0x7fbcbc06dce0 2024-09-12T16:51:50.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fd790ff9640 1 -- 172.21.15.122:0/701692402 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd784007c70 con 0x7fd77c003a90 2024-09-12T16:51:50.032 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fd790ff9640 1 -- 172.21.15.122:0/701692402 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd784004920 con 0x7fd77c003a90 2024-09-12T16:51:50.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fbcbb7fe640 1 --2- 172.21.15.122:0/2955688692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbca803b270 0x7fbca803d730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00ae000 tx=0x7fbcb00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:50.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79411df20 con 0x7fd77c003a90 2024-09-12T16:51:50.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79411dad0 con 0x7fd77c003a90 2024-09-12T16:51:50.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd794076880 con 0x7fd77c003a90 2024-09-12T16:51:50.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fd790ff9640 1 -- 172.21.15.122:0/701692402 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd7840bf070 con 0x7fd77c003a90 2024-09-12T16:51:50.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.028+0000 7fd790ff9640 1 --2- 172.21.15.122:0/701692402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd78003b1d0 0x7fd78003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:50.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.032+0000 7fd790ff9640 1 -- 172.21.15.122:0/701692402 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd7840aa030 con 0x7fd77c003a90 2024-09-12T16:51:50.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.032+0000 7fd7937fe640 1 --2- 172.21.15.122:0/701692402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd78003b1d0 0x7fd78003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:50.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.032+0000 7fd7937fe640 1 --2- 172.21.15.122:0/701692402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd78003b1d0 0x7fd78003d690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd7880096b0 tx=0x7fd788008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:50.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.040+0000 7fd790ff9640 1 -- 172.21.15.122:0/701692402 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd784016890 con 0x7fd77c003a90 2024-09-12T16:51:50.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.160+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8ee411bd90 con 0x7f8ee409ca50 2024-09-12T16:51:50.165 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.160+0000 7f8ed2ffd640 1 -- 172.21.15.122:0/2571083881 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ed8011de0 con 0x7f8ee409ca50 2024-09-12T16:51:50.165 INFO:teuthology.orchestra.run.smithi122.stdout:42949672964 2024-09-12T16:51:50.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ec403b190 msgr2=0x7f8ec403d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 --2- 172.21.15.122:0/2571083881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ec403b190 0x7f8ec403d650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40ad000 tx=0x7f8ed4008040 comp rx=0 tx=0).stop 2024-09-12T16:51:50.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409ca50 msgr2=0x7f8ee41c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 --2- 172.21.15.122:0/2571083881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409ca50 0x7f8ee41c6cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c480 tx=0x7f8ed800c940 comp rx=0 tx=0).stop 2024-09-12T16:51:50.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 shutdown_connections 2024-09-12T16:51:50.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 --2- 172.21.15.122:0/2571083881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ec403b190 0x7f8ec403d650 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 --2- 172.21.15.122:0/2571083881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee409ca50 0x7f8ee41c6cc0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c480 tx=0x7f8ed800c940 comp rx=0 tx=0).stop 2024-09-12T16:51:50.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 >> 172.21.15.122:0/2571083881 conn(0x7f8ee4071e50 msgr2=0x7f8ee406edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:50.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 shutdown_connections 2024-09-12T16:51:50.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.164+0000 7f8ee88da640 1 -- 172.21.15.122:0/2571083881 wait complete. 2024-09-12T16:51:50.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.2 2024-09-12T16:51:50.197 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.192+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbc9c005380 con 0x7fbcbc06dce0 2024-09-12T16:51:50.198 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.192+0000 7fbcb8ff9640 1 -- 172.21.15.122:0/2955688692 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbcac02cbb0 con 0x7fbcbc06dce0 2024-09-12T16:51:50.198 INFO:teuthology.orchestra.run.smithi122.stdout:38654705668 2024-09-12T16:51:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbca803b270 msgr2=0x7fbca803d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 --2- 172.21.15.122:0/2955688692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbca803b270 0x7fbca803d730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00ae000 tx=0x7fbcb00a7000 comp rx=0 tx=0).stop 2024-09-12T16:51:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc06dce0 msgr2=0x7fbcbc110da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 --2- 172.21.15.122:0/2955688692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc06dce0 0x7fbcbc110da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbcac01d6c0 tx=0x7fbcac01db80 comp rx=0 tx=0).stop 2024-09-12T16:51:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 shutdown_connections 2024-09-12T16:51:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 --2- 172.21.15.122:0/2955688692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbca803b270 0x7fbca803d730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.200 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 --2- 172.21.15.122:0/2955688692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcbc06dce0 0x7fbcbc110da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 >> 172.21.15.122:0/2955688692 conn(0x7fbcbc0709b0 msgr2=0x7fbcbc1287d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:50.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 shutdown_connections 2024-09-12T16:51:50.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.196+0000 7fbcc26e2640 1 -- 172.21.15.122:0/2955688692 wait complete. 2024-09-12T16:51:50.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-09-12T16:51:50.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.216+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd794069c30 con 0x7fd77c003a90 2024-09-12T16:51:50.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd790ff9640 1 -- 172.21.15.122:0/701692402 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd794069c30 con 0x7fd77c003a90 2024-09-12T16:51:50.222 INFO:teuthology.orchestra.run.smithi122.stdout:47244640259 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd78003b1d0 msgr2=0x7fd78003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 --2- 172.21.15.122:0/701692402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd78003b1d0 0x7fd78003d690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd7880096b0 tx=0x7fd788008040 comp rx=0 tx=0).stop 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 msgr2=0x7fd7941c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 --2- 172.21.15.122:0/701692402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd7941c2760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd78401cce0 tx=0x7fd77c005840 comp rx=0 tx=0).stop 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 shutdown_connections 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 --2- 172.21.15.122:0/701692402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd78003b1d0 0x7fd78003d690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 --2- 172.21.15.122:0/701692402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c003a90 0x7fd7941c2760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 >> 172.21.15.122:0/701692402 conn(0x7fd794072b80 msgr2=0x7fd79409fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 shutdown_connections 2024-09-12T16:51:50.225 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.220+0000 7fd79a60f640 1 -- 172.21.15.122:0/701692402 wait complete. 2024-09-12T16:51:50.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2024-09-12T16:51:50.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.252+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9064068e50 con 0x7f906409dc20 2024-09-12T16:51:50.257 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.252+0000 7f904b7fe640 1 -- 172.21.15.122:0/3079211449 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9054015ff0 con 0x7f906409dc20 2024-09-12T16:51:50.257 INFO:teuthology.orchestra.run.smithi122.stdout:47244640260 2024-09-12T16:51:50.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f905003b2c0 msgr2=0x7f905003d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 --2- 172.21.15.122:0/3079211449 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f905003b2c0 0x7f905003d780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9058007fd0 tx=0x7f9058007900 comp rx=0 tx=0).stop 2024-09-12T16:51:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906409dc20 msgr2=0x7f90641c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 --2- 172.21.15.122:0/3079211449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906409dc20 0x7f90641c43f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f90540ae040 tx=0x7f905401abb0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 shutdown_connections 2024-09-12T16:51:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 --2- 172.21.15.122:0/3079211449 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f905003b2c0 0x7f905003d780 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 --2- 172.21.15.122:0/3079211449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f906409dc20 0x7f90641c43f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 >> 172.21.15.122:0/3079211449 conn(0x7f90640715e0 msgr2=0x7f9064129d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 shutdown_connections 2024-09-12T16:51:50.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:50.256+0000 7f90690ae640 1 -- 172.21.15.122:0/3079211449 wait complete. 2024-09-12T16:51:50.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-09-12T16:51:51.190 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:51:51.222 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:51:51.241 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T16:51:51.275 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:51:51.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa6838e7640 1 Processor -- start 2024-09-12T16:51:51.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa6838e7640 1 -- start start 2024-09-12T16:51:51.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa6838e7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa67c09ee60 0x7fa67c1325c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa6838e7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c06df40 con 0x7fa67c09e370 2024-09-12T16:51:51.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa6838e7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa67c09f8a0 con 0x7fa67c09ee60 2024-09-12T16:51:51.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa680e82640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa67c09ee60 0x7fa67c1325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa680e82640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa67c09ee60 0x7fa67c1325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49066/0 (socket says 172.21.15.122:49066) 2024-09-12T16:51:51.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa680e82640 1 -- 172.21.15.122:0/2649249220 learned_addr learned my addr 172.21.15.122:0/2649249220 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:51.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa681683640 1 --1- 172.21.15.122:0/2649249220 >> v1:172.21.15.122:6789/0 conn(0x7fa67c09e370 0x7fa67c09e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52136/0 (socket says 172.21.15.122:52136) 2024-09-12T16:51:51.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa680e82640 1 -- 172.21.15.122:0/2649249220 >> v1:172.21.15.122:6789/0 conn(0x7fa67c09e370 legacy=0x7fa67c09e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.318 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.312+0000 7fa680e82640 1 -- 172.21.15.122:0/2649249220 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c09fcc0 con 0x7fa67c09ee60 2024-09-12T16:51:51.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa680e82640 1 --2- 172.21.15.122:0/2649249220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09ee60 0x7fa67c1325c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0097f0 tx=0x7fa66c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c12ecd7ecabaef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa673fff640 1 -- 172.21.15.122:0/2649249220 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0ab580 con 0x7fa67c09ee60 2024-09-12T16:51:51.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa673fff640 1 -- 172.21.15.122:0/2649249220 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0b0070 con 0x7fa67c09ee60 2024-09-12T16:51:51.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa673fff640 1 -- 172.21.15.122:0/2649249220 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0ab870 con 0x7fa67c09ee60 2024-09-12T16:51:51.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa6838e7640 1 -- 172.21.15.122:0/2649249220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09ee60 msgr2=0x7fa67c1325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa6838e7640 1 --2- 172.21.15.122:0/2649249220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09ee60 0x7fa67c1325c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0097f0 tx=0x7fa66c01c430 comp rx=0 tx=0).stop 2024-09-12T16:51:51.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa6838e7640 1 -- 172.21.15.122:0/2649249220 shutdown_connections 2024-09-12T16:51:51.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa6838e7640 1 --2- 172.21.15.122:0/2649249220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09ee60 0x7fa67c1325c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa6838e7640 1 -- 172.21.15.122:0/2649249220 >> 172.21.15.122:0/2649249220 conn(0x7fa67c071630 msgr2=0x7fa67c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa6838e7640 1 -- 172.21.15.122:0/2649249220 shutdown_connections 2024-09-12T16:51:51.321 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.316+0000 7fa6838e7640 1 -- 172.21.15.122:0/2649249220 wait complete. 2024-09-12T16:51:51.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa6838e7640 1 Processor -- start 2024-09-12T16:51:51.322 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa6838e7640 1 -- start start 2024-09-12T16:51:51.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa6838e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09e370 0x7fa67c126230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.323 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa6838e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c1356b0 con 0x7fa67c09e370 2024-09-12T16:51:51.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa681683640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09e370 0x7fa67c126230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa681683640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09e370 0x7fa67c126230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49070/0 (socket says 172.21.15.122:49070) 2024-09-12T16:51:51.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa681683640 1 -- 172.21.15.122:0/2500176847 learned_addr learned my addr 172.21.15.122:0/2500176847 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:51.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa681683640 1 -- 172.21.15.122:0/2500176847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c118b00 con 0x7fa67c09e370 2024-09-12T16:51:51.324 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa681683640 1 --2- 172.21.15.122:0/2500176847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09e370 0x7fa67c126230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c450 tx=0x7fa67800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa671ffb640 1 -- 172.21.15.122:0/2500176847 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa678007410 con 0x7fa67c09e370 2024-09-12T16:51:51.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa6838e7640 1 -- 172.21.15.122:0/2500176847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c117e20 con 0x7fa67c09e370 2024-09-12T16:51:51.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa671ffb640 1 -- 172.21.15.122:0/2500176847 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6780075b0 con 0x7fa67c09e370 2024-09-12T16:51:51.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa671ffb640 1 -- 172.21.15.122:0/2500176847 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa678004960 con 0x7fa67c09e370 2024-09-12T16:51:51.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa6838e7640 1 -- 172.21.15.122:0/2500176847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c126770 con 0x7fa67c09e370 2024-09-12T16:51:51.325 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa6677fe640 1 -- 172.21.15.122:0/2500176847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa654005090 con 0x7fa67c09e370 2024-09-12T16:51:51.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa671ffb640 1 -- 172.21.15.122:0/2500176847 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa67801a020 con 0x7fa67c09e370 2024-09-12T16:51:51.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa671ffb640 1 --2- 172.21.15.122:0/2500176847 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa66003b180 0x7fa66003d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.320+0000 7fa671ffb640 1 -- 172.21.15.122:0/2500176847 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fa67804e550 con 0x7fa67c09e370 2024-09-12T16:51:51.326 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.324+0000 7fa680e82640 1 --2- 172.21.15.122:0/2500176847 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa66003b180 0x7fa66003d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.327 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.324+0000 7fa680e82640 1 --2- 172.21.15.122:0/2500176847 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa66003b180 0x7fa66003d640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af000 tx=0x7fa66c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.332+0000 7fa671ffb640 1 -- 172.21.15.122:0/2500176847 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa678012de0 con 0x7fa67c09e370 2024-09-12T16:51:51.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e8ded640 1 Processor -- start 2024-09-12T16:51:51.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e8ded640 1 -- start start 2024-09-12T16:51:51.351 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e8ded640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd0e409e370 0x7fd0e409e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e8ded640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e406df40 con 0x7fd0e409ec90 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e8ded640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e409f8a0 con 0x7fd0e409e370 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e259c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd0e409e370 0x7fd0e409e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e1d9b640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd0e409ec90 0x7fd0e4126780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52144/0 (socket says 172.21.15.122:52144) 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e1d9b640 1 -- 172.21.15.122:0/1471528216 learned_addr learned my addr 172.21.15.122:0/1471528216 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:51.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e159a640 1 -- 172.21.15.122:0/1471528216 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201484495 0 0) 0x7fd0e406df40 con 0x7fd0e409ec90 2024-09-12T16:51:51.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e159a640 1 -- 172.21.15.122:0/1471528216 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0cc003530 con 0x7fd0e409ec90 2024-09-12T16:51:51.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e259c640 1 -- 172.21.15.122:0/1471528216 >> v1:172.21.15.122:6789/0 conn(0x7fd0e409ec90 legacy=0x7fd0e4126780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.353 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e259c640 1 -- 172.21.15.122:0/1471528216 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e409fcc0 con 0x7fd0e409e370 2024-09-12T16:51:51.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.348+0000 7fd0e259c640 1 --2- 172.21.15.122:0/1471528216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409e750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009740 tx=0x7fd0d401c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643827c934990a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e159a640 1 -- 172.21.15.122:0/1471528216 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40b0070 con 0x7fd0e409e370 2024-09-12T16:51:51.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e159a640 1 -- 172.21.15.122:0/1471528216 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40ab530 con 0x7fd0e409e370 2024-09-12T16:51:51.354 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e159a640 1 -- 172.21.15.122:0/1471528216 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40ab830 con 0x7fd0e409e370 2024-09-12T16:51:51.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 -- 172.21.15.122:0/1471528216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 msgr2=0x7fd0e409e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 --2- 172.21.15.122:0/1471528216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409e750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009740 tx=0x7fd0d401c2e0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.355 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 -- 172.21.15.122:0/1471528216 shutdown_connections 2024-09-12T16:51:51.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 --2- 172.21.15.122:0/1471528216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409e750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 -- 172.21.15.122:0/1471528216 >> 172.21.15.122:0/1471528216 conn(0x7fd0e4071630 msgr2=0x7fd0e409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 -- 172.21.15.122:0/1471528216 shutdown_connections 2024-09-12T16:51:51.356 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 -- 172.21.15.122:0/1471528216 wait complete. 2024-09-12T16:51:51.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 Processor -- start 2024-09-12T16:51:51.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 -- start start 2024-09-12T16:51:51.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e4135760 con 0x7fd0e409e370 2024-09-12T16:51:51.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49094/0 (socket says 172.21.15.122:49094) 2024-09-12T16:51:51.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e259c640 1 -- 172.21.15.122:0/2558271373 learned_addr learned my addr 172.21.15.122:0/2558271373 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:51.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e259c640 1 -- 172.21.15.122:0/2558271373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e411abe0 con 0x7fd0e409e370 2024-09-12T16:51:51.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e259c640 1 --2- 172.21.15.122:0/2558271373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409c3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4019f10 tx=0x7fd0d401ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0d2ffd640 1 -- 172.21.15.122:0/2558271373 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40b0050 con 0x7fd0e409e370 2024-09-12T16:51:51.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0d2ffd640 1 -- 172.21.15.122:0/2558271373 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40b1040 con 0x7fd0e409e370 2024-09-12T16:51:51.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.352+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e409da90 con 0x7fd0e409e370 2024-09-12T16:51:51.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.356+0000 7fd0d2ffd640 1 -- 172.21.15.122:0/2558271373 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40b7580 con 0x7fd0e409e370 2024-09-12T16:51:51.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.356+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e411ae80 con 0x7fd0e409e370 2024-09-12T16:51:51.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.356+0000 7fd0d2ffd640 1 -- 172.21.15.122:0/2558271373 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd0d40be030 con 0x7fd0e409e370 2024-09-12T16:51:51.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.356+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e409e750 con 0x7fd0e409e370 2024-09-12T16:51:51.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.356+0000 7fd0d2ffd640 1 --2- 172.21.15.122:0/2558271373 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0c403b220 0x7fd0c403d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.356+0000 7fd0d2ffd640 1 -- 172.21.15.122:0/2558271373 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd0d40bc070 con 0x7fd0e409e370 2024-09-12T16:51:51.359 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.356+0000 7fd0e1d9b640 1 --2- 172.21.15.122:0/2558271373 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0c403b220 0x7fd0c403d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.356+0000 7fd0e1d9b640 1 --2- 172.21.15.122:0/2558271373 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0c403b220 0x7fd0c403d6e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8007fd0 tx=0x7fd0d8007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.364+0000 7fd0d2ffd640 1 -- 172.21.15.122:0/2558271373 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd0e411abe0 con 0x7fd0e409e370 2024-09-12T16:51:51.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f9682477640 1 Processor -- start 2024-09-12T16:51:51.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f9682477640 1 -- start start 2024-09-12T16:51:51.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f9682477640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f967c12c700 0x7f967c1346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f9682477640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f967c073830 con 0x7f967c12bc10 2024-09-12T16:51:51.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f9682477640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f967c071eb0 con 0x7f967c12c700 2024-09-12T16:51:51.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f967b7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f967c12c700 0x7f967c1346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f967bfff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f967c12bc10 0x7f967c12bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52150/0 (socket says 172.21.15.122:52150) 2024-09-12T16:51:51.393 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f967bfff640 1 -- 172.21.15.122:0/2471445142 learned_addr learned my addr 172.21.15.122:0/2471445142 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:51.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f967b7fe640 1 -- 172.21.15.122:0/2471445142 >> v1:172.21.15.122:6789/0 conn(0x7f967c12bc10 legacy=0x7f967c12bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.394 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.388+0000 7f967b7fe640 1 -- 172.21.15.122:0/2471445142 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c0a30b0 con 0x7f967c12c700 2024-09-12T16:51:51.395 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f967b7fe640 1 --2- 172.21.15.122:0/2471445142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12c700 0x7f967c1346a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9670009740 tx=0x7f967001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a486e2709591f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f967affd640 1 -- 172.21.15.122:0/2471445142 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96700b0070 con 0x7f967c12c700 2024-09-12T16:51:51.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f967affd640 1 -- 172.21.15.122:0/2471445142 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96700ab530 con 0x7f967c12c700 2024-09-12T16:51:51.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f967affd640 1 -- 172.21.15.122:0/2471445142 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96700ab830 con 0x7f967c12c700 2024-09-12T16:51:51.396 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 -- 172.21.15.122:0/2471445142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12c700 msgr2=0x7f967c1346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 --2- 172.21.15.122:0/2471445142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12c700 0x7f967c1346a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9670009740 tx=0x7f967001c370 comp rx=0 tx=0).stop 2024-09-12T16:51:51.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 -- 172.21.15.122:0/2471445142 shutdown_connections 2024-09-12T16:51:51.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 --2- 172.21.15.122:0/2471445142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12c700 0x7f967c1346a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 -- 172.21.15.122:0/2471445142 >> 172.21.15.122:0/2471445142 conn(0x7f967c0a0a60 msgr2=0x7f967c06e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 -- 172.21.15.122:0/2471445142 shutdown_connections 2024-09-12T16:51:51.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 -- 172.21.15.122:0/2471445142 wait complete. 2024-09-12T16:51:51.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 Processor -- start 2024-09-12T16:51:51.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.392+0000 7f9682477640 1 -- start start 2024-09-12T16:51:51.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9682477640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12bc10 0x7f967c12a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9682477640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f967c137790 con 0x7f967c12bc10 2024-09-12T16:51:51.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f967bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12bc10 0x7f967c12a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f967bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12bc10 0x7f967c12a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49112/0 (socket says 172.21.15.122:49112) 2024-09-12T16:51:51.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f967bfff640 1 -- 172.21.15.122:0/1870960453 learned_addr learned my addr 172.21.15.122:0/1870960453 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:51.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f967bfff640 1 -- 172.21.15.122:0/1870960453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c073a50 con 0x7f967c12bc10 2024-09-12T16:51:51.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f967bfff640 1 --2- 172.21.15.122:0/1870960453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12bc10 0x7f967c12a6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f966c00c450 tx=0x7f966c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9678ff9640 1 -- 172.21.15.122:0/1870960453 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966c017070 con 0x7f967c12bc10 2024-09-12T16:51:51.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967c11ce20 con 0x7f967c12bc10 2024-09-12T16:51:51.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9678ff9640 1 -- 172.21.15.122:0/1870960453 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966c005c20 con 0x7f967c12bc10 2024-09-12T16:51:51.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9678ff9640 1 -- 172.21.15.122:0/1870960453 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966c017070 con 0x7f967c12bc10 2024-09-12T16:51:51.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967c12ac00 con 0x7f967c12bc10 2024-09-12T16:51:51.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9678ff9640 1 -- 172.21.15.122:0/1870960453 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f966c01a070 con 0x7f967c12bc10 2024-09-12T16:51:51.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967c12bff0 con 0x7f967c12bc10 2024-09-12T16:51:51.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9678ff9640 1 --2- 172.21.15.122:0/1870960453 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f966803b360 0x7f966803d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f9678ff9640 1 -- 172.21.15.122:0/1870960453 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f966c04dd90 con 0x7f967c12bc10 2024-09-12T16:51:51.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f967b7fe640 1 --2- 172.21.15.122:0/1870960453 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f966803b360 0x7f966803d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7ff67d2c4640 1 Processor -- start 2024-09-12T16:51:51.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7f967b7fe640 1 --2- 172.21.15.122:0/1870960453 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f966803b360 0x7f966803d820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f96700ad000 tx=0x7f9670008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.396+0000 7ff67d2c4640 1 -- start start 2024-09-12T16:51:51.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff67d2c4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff67809e370 0x7ff67809e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff67d2c4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67806df40 con 0x7ff67809ec90 2024-09-12T16:51:51.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff67d2c4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff67809f8a0 con 0x7ff67809e370 2024-09-12T16:51:51.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff676ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff67809e370 0x7ff67809e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff6767fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff67809ec90 0x7ff678126780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52154/0 (socket says 172.21.15.122:52154) 2024-09-12T16:51:51.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff6767fc640 1 -- 172.21.15.122:0/3213438705 learned_addr learned my addr 172.21.15.122:0/3213438705 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:51.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff676ffd640 1 -- 172.21.15.122:0/3213438705 >> v1:172.21.15.122:6789/0 conn(0x7ff67809ec90 legacy=0x7ff678126780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff676ffd640 1 -- 172.21.15.122:0/3213438705 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67809fcc0 con 0x7ff67809e370 2024-09-12T16:51:51.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.400+0000 7ff676ffd640 1 --2- 172.21.15.122:0/3213438705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809e370 0x7ff67809e750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff668009740 tx=0x7ff66801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16a2a6f9c6a15e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.404+0000 7ff675ffb640 1 -- 172.21.15.122:0/3213438705 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6680b0070 con 0x7ff67809e370 2024-09-12T16:51:51.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.404+0000 7ff675ffb640 1 -- 172.21.15.122:0/3213438705 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6680ab530 con 0x7ff67809e370 2024-09-12T16:51:51.409 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.404+0000 7ff675ffb640 1 -- 172.21.15.122:0/3213438705 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6680ab830 con 0x7ff67809e370 2024-09-12T16:51:51.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.404+0000 7f9678ff9640 1 -- 172.21.15.122:0/1870960453 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f966c0076e0 con 0x7f967c12bc10 2024-09-12T16:51:51.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.404+0000 7ff67d2c4640 1 -- 172.21.15.122:0/3213438705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809e370 msgr2=0x7ff67809e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.410 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.404+0000 7ff67d2c4640 1 --2- 172.21.15.122:0/3213438705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809e370 0x7ff67809e750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff668009740 tx=0x7ff66801c2e0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 -- 172.21.15.122:0/3213438705 shutdown_connections 2024-09-12T16:51:51.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 --2- 172.21.15.122:0/3213438705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809e370 0x7ff67809e750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 -- 172.21.15.122:0/3213438705 >> 172.21.15.122:0/3213438705 conn(0x7ff678071630 msgr2=0x7ff67809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 -- 172.21.15.122:0/3213438705 shutdown_connections 2024-09-12T16:51:51.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 -- 172.21.15.122:0/3213438705 wait complete. 2024-09-12T16:51:51.411 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 Processor -- start 2024-09-12T16:51:51.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 -- start start 2024-09-12T16:51:51.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809ec90 0x7ff67809c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.412 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff678135760 con 0x7ff67809ec90 2024-09-12T16:51:51.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff676ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809ec90 0x7ff67809c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff676ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809ec90 0x7ff67809c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49138/0 (socket says 172.21.15.122:49138) 2024-09-12T16:51:51.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff676ffd640 1 -- 172.21.15.122:0/1527796108 learned_addr learned my addr 172.21.15.122:0/1527796108 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:51.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff676ffd640 1 -- 172.21.15.122:0/1527796108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67811a290 con 0x7ff67809ec90 2024-09-12T16:51:51.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff676ffd640 1 --2- 172.21.15.122:0/1527796108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809ec90 0x7ff67809c410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff66801c320 tx=0x7ff66801ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff65f7fe640 1 -- 172.21.15.122:0/1527796108 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6680b0050 con 0x7ff67809ec90 2024-09-12T16:51:51.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67811a820 con 0x7ff67809ec90 2024-09-12T16:51:51.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff65f7fe640 1 -- 172.21.15.122:0/1527796108 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6680bc070 con 0x7ff67809ec90 2024-09-12T16:51:51.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67811acb0 con 0x7ff67809ec90 2024-09-12T16:51:51.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff65f7fe640 1 -- 172.21.15.122:0/1527796108 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6680b76b0 con 0x7ff67809ec90 2024-09-12T16:51:51.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.408+0000 7ff65f7fe640 1 -- 172.21.15.122:0/1527796108 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff6680b7910 con 0x7ff67809ec90 2024-09-12T16:51:51.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.412+0000 7ff65f7fe640 1 --2- 172.21.15.122:0/1527796108 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff66403b1e0 0x7ff66403d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.412+0000 7ff6767fc640 1 --2- 172.21.15.122:0/1527796108 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff66403b1e0 0x7ff66403d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.412+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67809e750 con 0x7ff67809ec90 2024-09-12T16:51:51.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.412+0000 7ff65f7fe640 1 -- 172.21.15.122:0/1527796108 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ff6680e8370 con 0x7ff67809ec90 2024-09-12T16:51:51.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.412+0000 7ff6767fc640 1 --2- 172.21.15.122:0/1527796108 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff66403b1e0 0x7ff66403d6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0015f0 tx=0x7ff66c007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.421 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.416+0000 7ff65f7fe640 1 -- 172.21.15.122:0/1527796108 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff668015ff0 con 0x7ff67809ec90 2024-09-12T16:51:51.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.500+0000 7fa6677fe640 1 -- 172.21.15.122:0/2500176847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa654005380 con 0x7fa67c09e370 2024-09-12T16:51:51.505 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.500+0000 7fa671ffb640 1 -- 172.21.15.122:0/2500176847 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa6780113a0 con 0x7fa67c09e370 2024-09-12T16:51:51.505 INFO:teuthology.orchestra.run.smithi122.stdout:42949672965 2024-09-12T16:51:51.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 -- 172.21.15.122:0/2500176847 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa66003b180 msgr2=0x7fa66003d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 --2- 172.21.15.122:0/2500176847 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa66003b180 0x7fa66003d640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af000 tx=0x7fa66c0a7000 comp rx=0 tx=0).stop 2024-09-12T16:51:51.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 -- 172.21.15.122:0/2500176847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09e370 msgr2=0x7fa67c126230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 --2- 172.21.15.122:0/2500176847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09e370 0x7fa67c126230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa67800c450 tx=0x7fa67800c910 comp rx=0 tx=0).stop 2024-09-12T16:51:51.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 -- 172.21.15.122:0/2500176847 shutdown_connections 2024-09-12T16:51:51.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 --2- 172.21.15.122:0/2500176847 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa66003b180 0x7fa66003d640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 --2- 172.21.15.122:0/2500176847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c09e370 0x7fa67c126230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.507 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 -- 172.21.15.122:0/2500176847 >> 172.21.15.122:0/2500176847 conn(0x7fa67c071630 msgr2=0x7fa67c127a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 -- 172.21.15.122:0/2500176847 shutdown_connections 2024-09-12T16:51:51.508 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.504+0000 7fa6677fe640 1 -- 172.21.15.122:0/2500176847 wait complete. 2024-09-12T16:51:51.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2024-09-12T16:51:51.524 DEBUG:teuthology.parallel:result is None 2024-09-12T16:51:51.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.548+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd0e411a230 con 0x7fd0e409e370 2024-09-12T16:51:51.553 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.548+0000 7fd0d2ffd640 1 -- 172.21.15.122:0/2558271373 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd0d4015ff0 con 0x7fd0e409e370 2024-09-12T16:51:51.553 INFO:teuthology.orchestra.run.smithi122.stdout:38654705670 2024-09-12T16:51:51.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0c403b220 msgr2=0x7fd0c403d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 --2- 172.21.15.122:0/2558271373 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0c403b220 0x7fd0c403d6e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8007fd0 tx=0x7fd0d8007900 comp rx=0 tx=0).stop 2024-09-12T16:51:51.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 msgr2=0x7fd0e409c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 --2- 172.21.15.122:0/2558271373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409c3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4019f10 tx=0x7fd0d401ab20 comp rx=0 tx=0).stop 2024-09-12T16:51:51.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 shutdown_connections 2024-09-12T16:51:51.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 --2- 172.21.15.122:0/2558271373 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0c403b220 0x7fd0c403d6e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 --2- 172.21.15.122:0/2558271373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e409e370 0x7fd0e409c3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 >> 172.21.15.122:0/2558271373 conn(0x7fd0e4071630 msgr2=0x7fd0e4127a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 shutdown_connections 2024-09-12T16:51:51.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.552+0000 7fd0e8ded640 1 -- 172.21.15.122:0/2558271373 wait complete. 2024-09-12T16:51:51.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-12T16:51:51.576 DEBUG:teuthology.parallel:result is None 2024-09-12T16:51:51.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.572+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f967c11ddf0 con 0x7f967c12bc10 2024-09-12T16:51:51.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.572+0000 7f9678ff9640 1 -- 172.21.15.122:0/1870960453 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f966c005dd0 con 0x7f967c12bc10 2024-09-12T16:51:51.577 INFO:teuthology.orchestra.run.smithi122.stdout:47244640261 2024-09-12T16:51:51.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f966803b360 msgr2=0x7f966803d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 --2- 172.21.15.122:0/1870960453 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f966803b360 0x7f966803d820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f96700ad000 tx=0x7f9670008040 comp rx=0 tx=0).stop 2024-09-12T16:51:51.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12bc10 msgr2=0x7f967c12a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 --2- 172.21.15.122:0/1870960453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12bc10 0x7f967c12a6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f966c00c450 tx=0x7f966c00c910 comp rx=0 tx=0).stop 2024-09-12T16:51:51.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 shutdown_connections 2024-09-12T16:51:51.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 --2- 172.21.15.122:0/1870960453 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f966803b360 0x7f966803d820 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 --2- 172.21.15.122:0/1870960453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f967c12bc10 0x7f967c12a6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 >> 172.21.15.122:0/1870960453 conn(0x7f967c0a0a60 msgr2=0x7f967c0a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 shutdown_connections 2024-09-12T16:51:51.580 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.576+0000 7f9682477640 1 -- 172.21.15.122:0/1870960453 wait complete. 2024-09-12T16:51:51.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.1 2024-09-12T16:51:51.594 DEBUG:teuthology.parallel:result is None 2024-09-12T16:51:51.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.592+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff678068e50 con 0x7ff67809ec90 2024-09-12T16:51:51.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.592+0000 7ff65f7fe640 1 -- 172.21.15.122:0/1527796108 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6680ab500 con 0x7ff67809ec90 2024-09-12T16:51:51.597 INFO:teuthology.orchestra.run.smithi122.stdout:47244640260 2024-09-12T16:51:51.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff66403b1e0 msgr2=0x7ff66403d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 --2- 172.21.15.122:0/1527796108 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff66403b1e0 0x7ff66403d6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0015f0 tx=0x7ff66c007ab0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809ec90 msgr2=0x7ff67809c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 --2- 172.21.15.122:0/1527796108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809ec90 0x7ff67809c410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff66801c320 tx=0x7ff66801ab20 comp rx=0 tx=0).stop 2024-09-12T16:51:51.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 shutdown_connections 2024-09-12T16:51:51.599 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 --2- 172.21.15.122:0/1527796108 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff66403b1e0 0x7ff66403d6a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 --2- 172.21.15.122:0/1527796108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67809ec90 0x7ff67809c410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 >> 172.21.15.122:0/1527796108 conn(0x7ff678071630 msgr2=0x7ff67812ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 shutdown_connections 2024-09-12T16:51:51.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.596+0000 7ff67d2c4640 1 -- 172.21.15.122:0/1527796108 wait complete. 2024-09-12T16:51:51.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2024-09-12T16:51:51.614 DEBUG:teuthology.parallel:result is None 2024-09-12T16:51:51.614 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T16:51:51.614 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:51:51.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.752+0000 7f1c72e8c640 1 Processor -- start 2024-09-12T16:51:51.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.752+0000 7f1c72e8c640 1 -- start start 2024-09-12T16:51:51.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.752+0000 7f1c72e8c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1c6c110da0 0x7f1c6c111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.752+0000 7f1c72e8c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c6c073a90 con 0x7f1c6c1116c0 2024-09-12T16:51:51.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.752+0000 7f1c72e8c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f1c6c0696e0 con 0x7f1c6c110da0 2024-09-12T16:51:51.758 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c70c28640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1c6c110da0 0x7f1c6c111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c6bfff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f1c6c1116c0 0x7f1c6c1231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52164/0 (socket says 172.21.15.122:52164) 2024-09-12T16:51:51.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c6bfff640 1 -- 172.21.15.122:0/4075571852 learned_addr learned my addr 172.21.15.122:0/4075571852 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:51.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c70c28640 1 -- 172.21.15.122:0/4075571852 >> v1:172.21.15.122:6789/0 conn(0x7f1c6c1116c0 legacy=0x7f1c6c1231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.759 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c70c28640 1 -- 172.21.15.122:0/4075571852 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c06dd50 con 0x7f1c6c110da0 2024-09-12T16:51:51.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c70c28640 1 --2- 172.21.15.122:0/4075571852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c111180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009740 tx=0x7f1c5c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb418bc5ebb61f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c6b7fe640 1 -- 172.21.15.122:0/4075571852 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c5c0b0070 con 0x7f1c6c110da0 2024-09-12T16:51:51.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c6b7fe640 1 -- 172.21.15.122:0/4075571852 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0ab530 con 0x7f1c6c110da0 2024-09-12T16:51:51.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c6b7fe640 1 -- 172.21.15.122:0/4075571852 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c5c0ab830 con 0x7f1c6c110da0 2024-09-12T16:51:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4075571852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 msgr2=0x7f1c6c111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c72e8c640 1 --2- 172.21.15.122:0/4075571852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c111180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009740 tx=0x7f1c5c01c370 comp rx=0 tx=0).stop 2024-09-12T16:51:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4075571852 shutdown_connections 2024-09-12T16:51:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c72e8c640 1 --2- 172.21.15.122:0/4075571852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c111180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4075571852 >> 172.21.15.122:0/4075571852 conn(0x7f1c6c070900 msgr2=0x7f1c6c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4075571852 shutdown_connections 2024-09-12T16:51:51.763 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.756+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4075571852 wait complete. 2024-09-12T16:51:51.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c72e8c640 1 Processor -- start 2024-09-12T16:51:51.764 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c72e8c640 1 -- start start 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c72e8c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c12f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c72e8c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c135470 con 0x7f1c6c110da0 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c70c28640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c12f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c70c28640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c12f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49154/0 (socket says 172.21.15.122:49154) 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c70c28640 1 -- 172.21.15.122:0/4167326029 learned_addr learned my addr 172.21.15.122:0/4167326029 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c70c28640 1 -- 172.21.15.122:0/4167326029 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c1155f0 con 0x7f1c6c110da0 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c70c28640 1 --2- 172.21.15.122:0/4167326029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c12f9f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ae040 tx=0x7f1c5c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c697fa640 1 -- 172.21.15.122:0/4167326029 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c5c0b8020 con 0x7f1c6c110da0 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c697fa640 1 -- 172.21.15.122:0/4167326029 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0b4600 con 0x7f1c6c110da0 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c131da0 con 0x7f1c6c110da0 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c697fa640 1 -- 172.21.15.122:0/4167326029 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c5c0b0040 con 0x7f1c6c110da0 2024-09-12T16:51:51.765 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c12ff30 con 0x7f1c6c110da0 2024-09-12T16:51:51.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6c111180 con 0x7f1c6c110da0 2024-09-12T16:51:51.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c697fa640 1 -- 172.21.15.122:0/4167326029 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1c5c0bb020 con 0x7f1c6c110da0 2024-09-12T16:51:51.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c697fa640 1 --2- 172.21.15.122:0/4167326029 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5803b1d0 0x7f1c5803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:51.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c697fa640 1 -- 172.21.15.122:0/4167326029 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f1c5c0e8c30 con 0x7f1c6c110da0 2024-09-12T16:51:51.766 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.760+0000 7f1c6bfff640 1 --2- 172.21.15.122:0/4167326029 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5803b1d0 0x7f1c5803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:51.767 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.764+0000 7f1c6bfff640 1 --2- 172.21.15.122:0/4167326029 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5803b1d0 0x7f1c5803d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c600015f0 tx=0x7f1c60007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:51.769 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.764+0000 7f1c697fa640 1 -- 172.21.15.122:0/4167326029 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1c5c0ef080 con 0x7f1c6c110da0 2024-09-12T16:51:51.927 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.924+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c6c1120e0 con 0x7f1c5803b1d0 2024-09-12T16:51:51.929 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.924+0000 7f1c697fa640 1 -- 172.21.15.122:0/4167326029 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32178 (secure 0 0 0) 0x7f1c600058c0 con 0x7f1c5803b1d0 2024-09-12T16:51:51.932 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:51:51.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5803b1d0 msgr2=0x7f1c5803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 --2- 172.21.15.122:0/4167326029 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5803b1d0 0x7f1c5803d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c600015f0 tx=0x7f1c60007ab0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 msgr2=0x7f1c6c12f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 --2- 172.21.15.122:0/4167326029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c12f9f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ae040 tx=0x7f1c5c019110 comp rx=0 tx=0).stop 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 shutdown_connections 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 --2- 172.21.15.122:0/4167326029 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5803b1d0 0x7f1c5803d690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 --2- 172.21.15.122:0/4167326029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c6c110da0 0x7f1c6c12f9f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 >> 172.21.15.122:0/4167326029 conn(0x7f1c6c070900 msgr2=0x7f1c6c071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 shutdown_connections 2024-09-12T16:51:51.934 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:51.928+0000 7f1c72e8c640 1 -- 172.21.15.122:0/4167326029 wait complete. 2024-09-12T16:51:51.947 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T16:51:51.924410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114040,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373320,"statfs":{"total":386547056640,"available":386430279680,"internally_reserved":0,"allocated":1785856,"data_stored":1370114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.547137"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.400512+0000","last_change":"2024-09-12T16:51:48.400908+0000","last_active":"2024-09-12T16:51:48.400512+0000","last_peered":"2024-09-12T16:51:48.400512+0000","last_clean":"2024-09-12T16:51:48.400512+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:51:48.400512+0000","last_undegraded":"2024-09-12T16:51:48.400512+0000","last_fullsized":"2024-09-12T16:51:48.400512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.059679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.405954+0000","last_change":"2024-09-12T16:51:48.405954+0000","last_active":"2024-09-12T16:51:48.405954+0000","last_peered":"2024-09-12T16:51:48.405954+0000","last_clean":"2024-09-12T16:51:48.405954+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:51:48.405954+0000","last_undegraded":"2024-09-12T16:51:48.405954+0000","last_fullsized":"2024-09-12T16:51:48.405954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.399278+0000","last_change":"2024-09-12T16:51:48.399706+0000","last_active":"2024-09-12T16:51:48.399278+0000","last_peered":"2024-09-12T16:51:48.399278+0000","last_clean":"2024-09-12T16:51:48.399278+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:51:48.399278+0000","last_undegraded":"2024-09-12T16:51:48.399278+0000","last_fullsized":"2024-09-12T16:51:48.399278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.814087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.406183+0000","last_change":"2024-09-12T16:51:48.406183+0000","last_active":"2024-09-12T16:51:48.406183+0000","last_peered":"2024-09-12T16:51:48.406183+0000","last_clean":"2024-09-12T16:51:48.406183+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:51:48.406183+0000","last_undegraded":"2024-09-12T16:51:48.406183+0000","last_fullsized":"2024-09-12T16:51:48.406183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:06.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.400929+0000","last_change":"2024-09-12T16:51:48.400929+0000","last_active":"2024-09-12T16:51:48.400929+0000","last_peered":"2024-09-12T16:51:48.400929+0000","last_clean":"2024-09-12T16:51:48.400929+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:51:48.400929+0000","last_undegraded":"2024-09-12T16:51:48.400929+0000","last_fullsized":"2024-09-12T16:51:48.400929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:21.707361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.565817+0000","last_change":"2024-09-12T16:51:48.565817+0000","last_active":"2024-09-12T16:51:48.565817+0000","last_peered":"2024-09-12T16:51:48.565817+0000","last_clean":"2024-09-12T16:51:48.565817+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:51:48.565817+0000","last_undegraded":"2024-09-12T16:51:48.565817+0000","last_fullsized":"2024-09-12T16:51:48.565817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:05.344141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.399143+0000","last_change":"2024-09-12T16:51:48.399639+0000","last_active":"2024-09-12T16:51:48.399143+0000","last_peered":"2024-09-12T16:51:48.399143+0000","last_clean":"2024-09-12T16:51:48.399143+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:51:48.399143+0000","last_undegraded":"2024-09-12T16:51:48.399143+0000","last_fullsized":"2024-09-12T16:51:48.399143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.533236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.399786+0000","last_change":"2024-09-12T16:51:48.400219+0000","last_active":"2024-09-12T16:51:48.399786+0000","last_peered":"2024-09-12T16:51:48.399786+0000","last_clean":"2024-09-12T16:51:48.399786+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:51:48.399786+0000","last_undegraded":"2024-09-12T16:51:48.399786+0000","last_fullsized":"2024-09-12T16:51:48.399786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.307866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.393152+0000","last_change":"2024-09-12T16:51:41.681357+0000","last_active":"2024-09-12T16:51:48.393152+0000","last_peered":"2024-09-12T16:51:48.393152+0000","last_clean":"2024-09-12T16:51:48.393152+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:51:48.393152+0000","last_undegraded":"2024-09-12T16:51:48.393152+0000","last_fullsized":"2024-09-12T16:51:48.393152+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_clean_scrub_stamp":"2024-09-12T16:51:40.347390+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:18.394696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:51:51.949 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:51:52.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.052+0000 7f48ac622640 1 Processor -- start 2024-09-12T16:51:52.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.052+0000 7f48ac622640 1 -- start start 2024-09-12T16:51:52.058 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f48a412f150 0x7f48a4131540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a406dcb0 con 0x7f48a4128c60 2024-09-12T16:51:52.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f48a4075000 con 0x7f48a412f150 2024-09-12T16:51:52.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48a9bbd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f48a412f150 0x7f48a4131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48aa3be640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f48a4128c60 0x7f48a4129040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:37820/0 (socket says 172.21.15.122:37820) 2024-09-12T16:51:52.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48a9bbd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f48a412f150 0x7f48a4131540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53022/0 (socket says 172.21.15.122:53022) 2024-09-12T16:51:52.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48aa3be640 1 -- 172.21.15.122:0/498640899 learned_addr learned my addr 172.21.15.122:0/498640899 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:52.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48a9bbd640 1 -- 172.21.15.122:0/498640899 >> v1:172.21.15.122:6789/0 conn(0x7f48a4128c60 legacy=0x7f48a4129040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.059 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48a9bbd640 1 -- 172.21.15.122:0/498640899 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a4073a90 con 0x7f48a412f150 2024-09-12T16:51:52.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48a9bbd640 1 --2- 172.21.15.122:0/498640899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a412f150 0x7f48a4131540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009740 tx=0x7f48a001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f3876caeb3fbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48a93bc640 1 -- 172.21.15.122:0/498640899 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a00b0070 con 0x7f48a412f150 2024-09-12T16:51:52.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48a93bc640 1 -- 172.21.15.122:0/498640899 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a00ab530 con 0x7f48a412f150 2024-09-12T16:51:52.061 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48a93bc640 1 -- 172.21.15.122:0/498640899 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a00ab830 con 0x7f48a412f150 2024-09-12T16:51:52.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 -- 172.21.15.122:0/498640899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a412f150 msgr2=0x7f48a4131540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 --2- 172.21.15.122:0/498640899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a412f150 0x7f48a4131540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009740 tx=0x7f48a001c370 comp rx=0 tx=0).stop 2024-09-12T16:51:52.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 -- 172.21.15.122:0/498640899 shutdown_connections 2024-09-12T16:51:52.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 --2- 172.21.15.122:0/498640899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a412f150 0x7f48a4131540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:52.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 -- 172.21.15.122:0/498640899 >> 172.21.15.122:0/498640899 conn(0x7f48a4070900 msgr2=0x7f48a4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:52.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 -- 172.21.15.122:0/498640899 shutdown_connections 2024-09-12T16:51:52.062 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.056+0000 7f48ac622640 1 -- 172.21.15.122:0/498640899 wait complete. 2024-09-12T16:51:52.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48ac622640 1 Processor -- start 2024-09-12T16:51:52.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48ac622640 1 -- start start 2024-09-12T16:51:52.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48ac622640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a4128c60 0x7f48a412a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48ac622640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f48a41119c0 con 0x7f48a4128c60 2024-09-12T16:51:52.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48aa3be640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a4128c60 0x7f48a412a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48aa3be640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a4128c60 0x7f48a412a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53028/0 (socket says 172.21.15.122:53028) 2024-09-12T16:51:52.063 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48aa3be640 1 -- 172.21.15.122:0/1224154829 learned_addr learned my addr 172.21.15.122:0/1224154829 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48aa3be640 1 -- 172.21.15.122:0/1224154829 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a41265d0 con 0x7f48a4128c60 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48aa3be640 1 --2- 172.21.15.122:0/1224154829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a4128c60 0x7f48a412a3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f489400c450 tx=0x7f489400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f489affd640 1 -- 172.21.15.122:0/1224154829 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4894017070 con 0x7f48a4128c60 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f489affd640 1 -- 172.21.15.122:0/1224154829 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4894005c20 con 0x7f48a4128c60 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f489affd640 1 -- 172.21.15.122:0/1224154829 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48940070d0 con 0x7f48a4128c60 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a4114540 con 0x7f48a4128c60 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a4113ee0 con 0x7f48a4128c60 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a4129040 con 0x7f48a4128c60 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f489affd640 1 -- 172.21.15.122:0/1224154829 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f489401a070 con 0x7f48a4128c60 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f489affd640 1 --2- 172.21.15.122:0/1224154829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f488803b200 0x7f488803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.065 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f489affd640 1 -- 172.21.15.122:0/1224154829 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f489404df70 con 0x7f48a4128c60 2024-09-12T16:51:52.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48a9bbd640 1 --2- 172.21.15.122:0/1224154829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f488803b200 0x7f488803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.066 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.060+0000 7f48a9bbd640 1 --2- 172.21.15.122:0/1224154829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f488803b200 0x7f488803d6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48a00ad000 tx=0x7f48a00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.064+0000 7f489affd640 1 -- 172.21.15.122:0/1224154829 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4894007270 con 0x7f48a4128c60 2024-09-12T16:51:52.222 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.216+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48a412cb50 con 0x7f488803b200 2024-09-12T16:51:52.224 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f489affd640 1 -- 172.21.15.122:0/1224154829 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32178 (secure 0 0 0) 0x7f48a412cb50 con 0x7f488803b200 2024-09-12T16:51:52.225 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:52.225 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:51:52.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f488803b200 msgr2=0x7f488803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 --2- 172.21.15.122:0/1224154829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f488803b200 0x7f488803d6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48a00ad000 tx=0x7f48a00a6000 comp rx=0 tx=0).stop 2024-09-12T16:51:52.226 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a4128c60 msgr2=0x7f48a412a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 --2- 172.21.15.122:0/1224154829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a4128c60 0x7f48a412a3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f489400c450 tx=0x7f489400c910 comp rx=0 tx=0).stop 2024-09-12T16:51:52.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 shutdown_connections 2024-09-12T16:51:52.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 --2- 172.21.15.122:0/1224154829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f488803b200 0x7f488803d6c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:52.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 --2- 172.21.15.122:0/1224154829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48a4128c60 0x7f48a412a3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:52.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 >> 172.21.15.122:0/1224154829 conn(0x7f48a4070900 msgr2=0x7f48a4127000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:52.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.220+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 shutdown_connections 2024-09-12T16:51:52.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.224+0000 7f48ac622640 1 -- 172.21.15.122:0/1224154829 wait complete. 2024-09-12T16:51:52.241 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T16:51:51.924410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114040,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373320,"statfs":{"total":386547056640,"available":386430279680,"internally_reserved":0,"allocated":1785856,"data_stored":1370114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.547137"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.400512+0000","last_change":"2024-09-12T16:51:48.400908+0000","last_active":"2024-09-12T16:51:48.400512+0000","last_peered":"2024-09-12T16:51:48.400512+0000","last_clean":"2024-09-12T16:51:48.400512+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:51:48.400512+0000","last_undegraded":"2024-09-12T16:51:48.400512+0000","last_fullsized":"2024-09-12T16:51:48.400512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.059679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.405954+0000","last_change":"2024-09-12T16:51:48.405954+0000","last_active":"2024-09-12T16:51:48.405954+0000","last_peered":"2024-09-12T16:51:48.405954+0000","last_clean":"2024-09-12T16:51:48.405954+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:51:48.405954+0000","last_undegraded":"2024-09-12T16:51:48.405954+0000","last_fullsized":"2024-09-12T16:51:48.405954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.399278+0000","last_change":"2024-09-12T16:51:48.399706+0000","last_active":"2024-09-12T16:51:48.399278+0000","last_peered":"2024-09-12T16:51:48.399278+0000","last_clean":"2024-09-12T16:51:48.399278+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:51:48.399278+0000","last_undegraded":"2024-09-12T16:51:48.399278+0000","last_fullsized":"2024-09-12T16:51:48.399278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.814087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.406183+0000","last_change":"2024-09-12T16:51:48.406183+0000","last_active":"2024-09-12T16:51:48.406183+0000","last_peered":"2024-09-12T16:51:48.406183+0000","last_clean":"2024-09-12T16:51:48.406183+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:51:48.406183+0000","last_undegraded":"2024-09-12T16:51:48.406183+0000","last_fullsized":"2024-09-12T16:51:48.406183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:06.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.400929+0000","last_change":"2024-09-12T16:51:48.400929+0000","last_active":"2024-09-12T16:51:48.400929+0000","last_peered":"2024-09-12T16:51:48.400929+0000","last_clean":"2024-09-12T16:51:48.400929+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:51:48.400929+0000","last_undegraded":"2024-09-12T16:51:48.400929+0000","last_fullsized":"2024-09-12T16:51:48.400929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:21.707361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.565817+0000","last_change":"2024-09-12T16:51:48.565817+0000","last_active":"2024-09-12T16:51:48.565817+0000","last_peered":"2024-09-12T16:51:48.565817+0000","last_clean":"2024-09-12T16:51:48.565817+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:51:48.565817+0000","last_undegraded":"2024-09-12T16:51:48.565817+0000","last_fullsized":"2024-09-12T16:51:48.565817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:05.344141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.399143+0000","last_change":"2024-09-12T16:51:48.399639+0000","last_active":"2024-09-12T16:51:48.399143+0000","last_peered":"2024-09-12T16:51:48.399143+0000","last_clean":"2024-09-12T16:51:48.399143+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:51:48.399143+0000","last_undegraded":"2024-09-12T16:51:48.399143+0000","last_fullsized":"2024-09-12T16:51:48.399143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.533236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.399786+0000","last_change":"2024-09-12T16:51:48.400219+0000","last_active":"2024-09-12T16:51:48.399786+0000","last_peered":"2024-09-12T16:51:48.399786+0000","last_clean":"2024-09-12T16:51:48.399786+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:51:48.399786+0000","last_undegraded":"2024-09-12T16:51:48.399786+0000","last_fullsized":"2024-09-12T16:51:48.399786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.307866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T16:51:48.393152+0000","last_change":"2024-09-12T16:51:41.681357+0000","last_active":"2024-09-12T16:51:48.393152+0000","last_peered":"2024-09-12T16:51:48.393152+0000","last_clean":"2024-09-12T16:51:48.393152+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:51:48.393152+0000","last_undegraded":"2024-09-12T16:51:48.393152+0000","last_fullsized":"2024-09-12T16:51:48.393152+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_clean_scrub_stamp":"2024-09-12T16:51:40.347390+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:18.394696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:51:52.242 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T16:51:52.242 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T16:51:52.242 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T16:51:52.242 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T16:51:52.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f61364db640 1 Processor -- start 2024-09-12T16:51:52.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f61364db640 1 -- start start 2024-09-12T16:51:52.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f61364db640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f613006d2c0 0x7f613006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.357 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f61364db640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613006d6a0 con 0x7f613006e200 2024-09-12T16:51:52.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f61364db640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6130073860 con 0x7f613006d2c0 2024-09-12T16:51:52.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f612ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f613006d2c0 0x7f613006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f612f7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f613006e200 0x7f613006e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:37832/0 (socket says 172.21.15.122:37832) 2024-09-12T16:51:52.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f612f7fe640 1 -- 172.21.15.122:0/1630164282 learned_addr learned my addr 172.21.15.122:0/1630164282 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:51:52.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f612ffff640 1 --2- 172.21.15.122:0/1630164282 >> v2:172.21.15.122:3300/0 conn(0x7f613006d2c0 0x7f613006dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53040/0 (socket says 172.21.15.122:53040) 2024-09-12T16:51:52.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f612ffff640 1 -- 172.21.15.122:0/1630164282 >> v1:172.21.15.122:6789/0 conn(0x7f613006e200 legacy=0x7f613006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f612ffff640 1 -- 172.21.15.122:0/1630164282 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61300700f0 con 0x7f613006d2c0 2024-09-12T16:51:52.358 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.352+0000 7f612effd640 1 -- 172.21.15.122:0/1630164282 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850662603 0 0) 0x7f613006d6a0 con 0x7f613006e200 2024-09-12T16:51:52.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f612ffff640 1 --2- 172.21.15.122:0/1630164282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f613006dcc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6128009740 tx=0x7f612801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e747c8b4967b34e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f612effd640 1 -- 172.21.15.122:0/1630164282 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61280b0070 con 0x7f613006d2c0 2024-09-12T16:51:52.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f612effd640 1 -- 172.21.15.122:0/1630164282 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61280ab530 con 0x7f613006d2c0 2024-09-12T16:51:52.360 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f612effd640 1 -- 172.21.15.122:0/1630164282 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61280ab830 con 0x7f613006d2c0 2024-09-12T16:51:52.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 -- 172.21.15.122:0/1630164282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 msgr2=0x7f613006dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 --2- 172.21.15.122:0/1630164282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f613006dcc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6128009740 tx=0x7f612801c370 comp rx=0 tx=0).stop 2024-09-12T16:51:52.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 -- 172.21.15.122:0/1630164282 shutdown_connections 2024-09-12T16:51:52.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 --2- 172.21.15.122:0/1630164282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f613006dcc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:52.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 -- 172.21.15.122:0/1630164282 >> 172.21.15.122:0/1630164282 conn(0x7f613009e730 msgr2=0x7f613009eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:52.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 -- 172.21.15.122:0/1630164282 shutdown_connections 2024-09-12T16:51:52.361 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 -- 172.21.15.122:0/1630164282 wait complete. 2024-09-12T16:51:52.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 Processor -- start 2024-09-12T16:51:52.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.356+0000 7f61364db640 1 -- start start 2024-09-12T16:51:52.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f61364db640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f6130133480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f61364db640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6130137310 con 0x7f613006d2c0 2024-09-12T16:51:52.362 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f6130133480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f6130133480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53056/0 (socket says 172.21.15.122:53056) 2024-09-12T16:51:52.363 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612ffff640 1 -- 172.21.15.122:0/2046488567 learned_addr learned my addr 172.21.15.122:0/2046488567 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612ffff640 1 -- 172.21.15.122:0/2046488567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6130125730 con 0x7f613006d2c0 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612ffff640 1 --2- 172.21.15.122:0/2046488567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f6130133480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6128019fa0 tx=0x7f612801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612cff9640 1 -- 172.21.15.122:0/2046488567 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61280bb070 con 0x7f613006d2c0 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612cff9640 1 -- 172.21.15.122:0/2046488567 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6128004020 con 0x7f613006d2c0 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6130073a10 con 0x7f613006d2c0 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612cff9640 1 -- 172.21.15.122:0/2046488567 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61280b0040 con 0x7f613006d2c0 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61301262c0 con 0x7f613006d2c0 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6130125900 con 0x7f613006d2c0 2024-09-12T16:51:52.364 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612cff9640 1 -- 172.21.15.122:0/2046488567 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6128004300 con 0x7f613006d2c0 2024-09-12T16:51:52.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612cff9640 1 --2- 172.21.15.122:0/2046488567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f611403b1d0 0x7f611403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612cff9640 1 -- 172.21.15.122:0/2046488567 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f61280a4e00 con 0x7f613006d2c0 2024-09-12T16:51:52.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612f7fe640 1 --2- 172.21.15.122:0/2046488567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f611403b1d0 0x7f611403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.365 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.360+0000 7f612f7fe640 1 --2- 172.21.15.122:0/2046488567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f611403b1d0 0x7f611403d690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6118000f90 tx=0x7f6118001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.364+0000 7f612cff9640 1 -- 172.21.15.122:0/2046488567 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6130073a10 con 0x7f613006d2c0 2024-09-12T16:51:52.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f613006dd40 con 0x7f613006d2c0 2024-09-12T16:51:52.559 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f612cff9640 1 -- 172.21.15.122:0/2046488567 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6128015ff0 con 0x7f613006d2c0 2024-09-12T16:51:52.560 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:51:52.560 INFO:teuthology.orchestra.run.smithi122.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T16:51:52.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f611403b1d0 msgr2=0x7f611403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 --2- 172.21.15.122:0/2046488567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f611403b1d0 0x7f611403d690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6118000f90 tx=0x7f6118001680 comp rx=0 tx=0).stop 2024-09-12T16:51:52.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 msgr2=0x7f6130133480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 --2- 172.21.15.122:0/2046488567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f6130133480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6128019fa0 tx=0x7f612801abb0 comp rx=0 tx=0).stop 2024-09-12T16:51:52.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 shutdown_connections 2024-09-12T16:51:52.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 --2- 172.21.15.122:0/2046488567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f611403b1d0 0x7f611403d690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:52.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 --2- 172.21.15.122:0/2046488567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f613006d2c0 0x7f6130133480 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:52.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 >> 172.21.15.122:0/2046488567 conn(0x7f613009e730 msgr2=0x7f61300719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:52.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 shutdown_connections 2024-09-12T16:51:52.563 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:51:52.556+0000 7f61364db640 1 -- 172.21.15.122:0/2046488567 wait complete. 2024-09-12T16:51:52.577 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T16:51:52.577 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T16:51:52.597 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T16:51:52.597 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T16:51:52.597 INFO:tasks.rgw:Creating data pools 2024-09-12T16:51:52.597 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T16:51:52.597 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T16:51:52.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f0110e37640 1 Processor -- start 2024-09-12T16:51:52.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f0110e37640 1 -- start start 2024-09-12T16:51:52.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f0110e37640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f010c1104a0 0x7f010c11c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f0110e37640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010c110930 con 0x7f010c074bf0 2024-09-12T16:51:52.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f0110e37640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f010c110b00 con 0x7f010c1104a0 2024-09-12T16:51:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f0109d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f010c1104a0 0x7f010c11c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f010a59c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f010c074bf0 0x7f010c10fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37616/0 (socket says 172.21.15.151:37616) 2024-09-12T16:51:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f010a59c640 1 -- 172.21.15.151:0/3012147705 learned_addr learned my addr 172.21.15.151:0/3012147705 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:51:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f010959a640 1 -- 172.21.15.151:0/3012147705 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267634912 0 0) 0x7f010c110930 con 0x7f010c074bf0 2024-09-12T16:51:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f010959a640 1 -- 172.21.15.151:0/3012147705 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00f8003530 con 0x7f010c074bf0 2024-09-12T16:51:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f0109d9b640 1 -- 172.21.15.151:0/3012147705 >> v1:172.21.15.122:6789/0 conn(0x7f010c074bf0 legacy=0x7f010c10fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.729+0000 7f0109d9b640 1 -- 172.21.15.151:0/3012147705 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c11d670 con 0x7f010c1104a0 2024-09-12T16:51:52.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0109d9b640 1 --2- 172.21.15.151:0/3012147705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c1104a0 0x7f010c11c120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009740 tx=0x7f00fc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81447e116a7b40c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f010959a640 1 -- 172.21.15.151:0/3012147705 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00fc0b0070 con 0x7f010c1104a0 2024-09-12T16:51:52.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f010959a640 1 -- 172.21.15.151:0/3012147705 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc0ab530 con 0x7f010c1104a0 2024-09-12T16:51:52.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f010959a640 1 -- 172.21.15.151:0/3012147705 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00fc0ab830 con 0x7f010c1104a0 2024-09-12T16:51:52.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 -- 172.21.15.151:0/3012147705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c1104a0 msgr2=0x7f010c11c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:52.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 --2- 172.21.15.151:0/3012147705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c1104a0 0x7f010c11c120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009740 tx=0x7f00fc01c370 comp rx=0 tx=0).stop 2024-09-12T16:51:52.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 -- 172.21.15.151:0/3012147705 shutdown_connections 2024-09-12T16:51:52.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 --2- 172.21.15.151:0/3012147705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c1104a0 0x7f010c11c120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:52.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 -- 172.21.15.151:0/3012147705 >> 172.21.15.151:0/3012147705 conn(0x7f010c06fe70 msgr2=0x7f010c072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:52.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 -- 172.21.15.151:0/3012147705 shutdown_connections 2024-09-12T16:51:52.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 -- 172.21.15.151:0/3012147705 wait complete. 2024-09-12T16:51:52.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 Processor -- start 2024-09-12T16:51:52.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 -- start start 2024-09-12T16:51:52.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c074bf0 0x7f010c110fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f0110e37640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f010c11d320 con 0x7f010c074bf0 2024-09-12T16:51:52.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f010a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c074bf0 0x7f010c110fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f010a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c074bf0 0x7f010c110fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50198/0 (socket says 172.21.15.151:50198) 2024-09-12T16:51:52.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f010a59c640 1 -- 172.21.15.151:0/2735147344 learned_addr learned my addr 172.21.15.151:0/2735147344 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:52.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.733+0000 7f010a59c640 1 -- 172.21.15.151:0/2735147344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c112eb0 con 0x7f010c074bf0 2024-09-12T16:51:52.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f010a59c640 1 --2- 172.21.15.151:0/2735147344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c074bf0 0x7f010c110fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c450 tx=0x7f00f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0102ffd640 1 -- 172.21.15.151:0/2735147344 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f4017070 con 0x7f010c074bf0 2024-09-12T16:51:52.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010c111560 con 0x7f010c074bf0 2024-09-12T16:51:52.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0102ffd640 1 -- 172.21.15.151:0/2735147344 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f4005ce0 con 0x7f010c074bf0 2024-09-12T16:51:52.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010c111af0 con 0x7f010c074bf0 2024-09-12T16:51:52.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0102ffd640 1 -- 172.21.15.151:0/2735147344 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f4007200 con 0x7f010c074bf0 2024-09-12T16:51:52.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f0005090 con 0x7f010c074bf0 2024-09-12T16:51:52.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0102ffd640 1 -- 172.21.15.151:0/2735147344 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f00f401a070 con 0x7f010c074bf0 2024-09-12T16:51:52.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0102ffd640 1 --2- 172.21.15.151:0/2735147344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f00ec03b1b0 0x7f00ec03d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:52.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0102ffd640 1 -- 172.21.15.151:0/2735147344 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f00f404e080 con 0x7f010c074bf0 2024-09-12T16:51:52.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0109d9b640 1 --2- 172.21.15.151:0/2735147344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f00ec03b1b0 0x7f00ec03d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:52.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.737+0000 7f0109d9b640 1 --2- 172.21.15.151:0/2735147344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f00ec03b1b0 0x7f00ec03d670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0ad000 tx=0x7f00fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:52.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.749+0000 7f0102ffd640 1 -- 172.21.15.151:0/2735147344 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f00f401b3b0 con 0x7f010c074bf0 2024-09-12T16:51:52.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:52.929+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7f00f0005380 con 0x7f010c074bf0 2024-09-12T16:51:53.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.561+0000 7f0102ffd640 1 -- 172.21.15.151:0/2735147344 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v18) ==== 171+0+0 (secure 0 0 0) 0x7f00f401b730 con 0x7f010c074bf0 2024-09-12T16:51:53.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f00ec03b1b0 msgr2=0x7f00ec03d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:53.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 --2- 172.21.15.151:0/2735147344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f00ec03b1b0 0x7f00ec03d670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0ad000 tx=0x7f00fc0a6000 comp rx=0 tx=0).stop 2024-09-12T16:51:53.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c074bf0 msgr2=0x7f010c110fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:53.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 --2- 172.21.15.151:0/2735147344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c074bf0 0x7f010c110fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c450 tx=0x7f00f400c910 comp rx=0 tx=0).stop 2024-09-12T16:51:53.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 shutdown_connections 2024-09-12T16:51:53.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 --2- 172.21.15.151:0/2735147344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f00ec03b1b0 0x7f00ec03d670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:53.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 --2- 172.21.15.151:0/2735147344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f010c074bf0 0x7f010c110fc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:53.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 >> 172.21.15.151:0/2735147344 conn(0x7f010c06fe70 msgr2=0x7f010c118290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:53.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 shutdown_connections 2024-09-12T16:51:53.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.565+0000 7f0110e37640 1 -- 172.21.15.151:0/2735147344 wait complete. 2024-09-12T16:51:53.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T16:51:53.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9fb61640 1 Processor -- start 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9fb61640 1 -- start start 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9fb61640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea98117e00 0x7fea9811a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9fb61640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9811a730 con 0x7fea9810fff0 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9fb61640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fea9811b910 con 0x7fea98117e00 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9d0fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea98117e00 0x7fea9811a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9d0fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea98117e00 0x7fea9811a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50214/0 (socket says 172.21.15.151:50214) 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9d0fc640 1 -- 172.21.15.151:0/3329452906 learned_addr learned my addr 172.21.15.151:0/3329452906 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9d8fd640 1 --1- 172.21.15.151:0/3329452906 >> v1:172.21.15.122:6789/0 conn(0x7fea9810fff0 0x7fea981103d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37626/0 (socket says 172.21.15.151:37626) 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230894540 0 0) 0x7fea9811a730 con 0x7fea9810fff0 2024-09-12T16:51:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea84003450 con 0x7fea9810fff0 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1012036332 0 0) 0x7fea84003450 con 0x7fea9810fff0 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 >> v2:172.21.15.122:3300/0 conn(0x7fea98117e00 msgr2=0x7fea9811a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 --2- 172.21.15.151:0/3329452906 >> v2:172.21.15.122:3300/0 conn(0x7fea98117e00 0x7fea9811a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9811ba90 con 0x7fea9810fff0 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3718109123 0 0) 0x7fea940019b0 con 0x7fea9810fff0 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 >> v1:172.21.15.122:6789/0 conn(0x7fea9810fff0 legacy=0x7fea981103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 --2- 172.21.15.151:0/3329452906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea84003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fea9811b910 con 0x7fea84003ba0 2024-09-12T16:51:53.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.717+0000 7fea9d8fd640 1 --2- 172.21.15.151:0/3329452906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea84003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:53.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.721+0000 7fea9d8fd640 1 -- 172.21.15.151:0/3329452906 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea84003450 con 0x7fea84003ba0 2024-09-12T16:51:53.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.721+0000 7fea9d8fd640 1 --2- 172.21.15.151:0/3329452906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea84003fa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c440 tx=0x7fea9401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e5305ee601f831 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:53.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.721+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea9400c0e0 con 0x7fea84003ba0 2024-09-12T16:51:53.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.721+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea940a9020 con 0x7fea84003ba0 2024-09-12T16:51:53.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.721+0000 7fea9c8fb640 1 -- 172.21.15.151:0/3329452906 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94005e40 con 0x7fea84003ba0 2024-09-12T16:51:53.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- 172.21.15.151:0/3329452906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 msgr2=0x7fea84003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:53.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 --2- 172.21.15.151:0/3329452906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea84003fa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c440 tx=0x7fea9401cee0 comp rx=0 tx=0).stop 2024-09-12T16:51:53.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- 172.21.15.151:0/3329452906 shutdown_connections 2024-09-12T16:51:53.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 --2- 172.21.15.151:0/3329452906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea84003fa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:53.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 --2- 172.21.15.151:0/3329452906 >> v2:172.21.15.122:3300/0 conn(0x7fea98117e00 0x7fea9811a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:53.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- 172.21.15.151:0/3329452906 >> 172.21.15.151:0/3329452906 conn(0x7fea9806fe70 msgr2=0x7fea98072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:53.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- 172.21.15.151:0/3329452906 shutdown_connections 2024-09-12T16:51:53.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- 172.21.15.151:0/3329452906 wait complete. 2024-09-12T16:51:53.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 Processor -- start 2024-09-12T16:51:53.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- start start 2024-09-12T16:51:53.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea981aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:53.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fea9811b5f0 con 0x7fea84003ba0 2024-09-12T16:51:53.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9d8fd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea981aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:53.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9d8fd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea981aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50228/0 (socket says 172.21.15.151:50228) 2024-09-12T16:51:53.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9d8fd640 1 -- 172.21.15.151:0/2561615495 learned_addr learned my addr 172.21.15.151:0/2561615495 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:53.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9d8fd640 1 -- 172.21.15.151:0/2561615495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea981aa900 con 0x7fea84003ba0 2024-09-12T16:51:53.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9d8fd640 1 --2- 172.21.15.151:0/2561615495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea981aa330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fea9401d780 tx=0x7fea84003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:53.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea8e7fc640 1 -- 172.21.15.151:0/2561615495 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94007110 con 0x7fea84003ba0 2024-09-12T16:51:53.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea981aab90 con 0x7fea84003ba0 2024-09-12T16:51:53.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea8e7fc640 1 -- 172.21.15.151:0/2561615495 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea940072b0 con 0x7fea84003ba0 2024-09-12T16:51:53.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea8e7fc640 1 -- 172.21.15.151:0/2561615495 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea940075b0 con 0x7fea84003ba0 2024-09-12T16:51:53.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.725+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea981afb70 con 0x7fea84003ba0 2024-09-12T16:51:53.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.729+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea98117e00 con 0x7fea84003ba0 2024-09-12T16:51:53.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.729+0000 7fea8e7fc640 1 -- 172.21.15.151:0/2561615495 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fea94007750 con 0x7fea84003ba0 2024-09-12T16:51:53.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.729+0000 7fea8e7fc640 1 --2- 172.21.15.151:0/2561615495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fea7c03b200 0x7fea7c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:53.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.729+0000 7fea8e7fc640 1 -- 172.21.15.151:0/2561615495 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3825+0+0 (secure 0 0 0) 0x7fea940aa030 con 0x7fea84003ba0 2024-09-12T16:51:53.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.729+0000 7fea9d0fc640 1 --2- 172.21.15.151:0/2561615495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fea7c03b200 0x7fea7c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:53.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.729+0000 7fea9d0fc640 1 --2- 172.21.15.151:0/2561615495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fea7c03b200 0x7fea7c03d6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea88009920 tx=0x7fea88009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:53.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.741+0000 7fea8e7fc640 1 -- 172.21.15.151:0/2561615495 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fea94016ad0 con 0x7fea84003ba0 2024-09-12T16:51:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:53.909+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fea9810fff0 con 0x7fea84003ba0 2024-09-12T16:51:55.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.097+0000 7fea8e7fc640 1 -- 172.21.15.151:0/2561615495 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7fea940e7850 con 0x7fea84003ba0 2024-09-12T16:51:55.099 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T16:51:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fea7c03b200 msgr2=0x7fea7c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 --2- 172.21.15.151:0/2561615495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fea7c03b200 0x7fea7c03d6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea88009920 tx=0x7fea88009240 comp rx=0 tx=0).stop 2024-09-12T16:51:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 msgr2=0x7fea981aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 --2- 172.21.15.151:0/2561615495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea981aa330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fea9401d780 tx=0x7fea84003740 comp rx=0 tx=0).stop 2024-09-12T16:51:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 shutdown_connections 2024-09-12T16:51:55.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 --2- 172.21.15.151:0/2561615495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fea7c03b200 0x7fea7c03d6c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:55.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 --2- 172.21.15.151:0/2561615495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea84003ba0 0x7fea981aa330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:55.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 >> 172.21.15.151:0/2561615495 conn(0x7fea9806fe70 msgr2=0x7fea98070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:55.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 shutdown_connections 2024-09-12T16:51:55.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.101+0000 7fea9fb61640 1 -- 172.21.15.151:0/2561615495 wait complete. 2024-09-12T16:51:55.136 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T16:51:55.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd96ddd640 1 Processor -- start 2024-09-12T16:51:55.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd96ddd640 1 -- start start 2024-09-12T16:51:55.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd96ddd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efd901104a0 0x7efd9011c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:55.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd96ddd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd90110930 con 0x7efd90074bf0 2024-09-12T16:51:55.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd96ddd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7efd90110b00 con 0x7efd901104a0 2024-09-12T16:51:55.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd8ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efd901104a0 0x7efd9011c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:55.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd8ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efd901104a0 0x7efd9011c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50238/0 (socket says 172.21.15.151:50238) 2024-09-12T16:51:55.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd8ffff640 1 -- 172.21.15.151:0/2262780118 learned_addr learned my addr 172.21.15.151:0/2262780118 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:55.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd8ffff640 1 -- 172.21.15.151:0/2262780118 >> v1:172.21.15.122:6789/0 conn(0x7efd90074bf0 legacy=0x7efd9010fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:55.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.257+0000 7efd8ffff640 1 -- 172.21.15.151:0/2262780118 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9011d670 con 0x7efd901104a0 2024-09-12T16:51:55.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd8ffff640 1 --2- 172.21.15.151:0/2262780118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd901104a0 0x7efd9011c120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd840097f0 tx=0x7efd8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d373b83fd6bf6be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:55.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd8f7fe640 1 -- 172.21.15.151:0/2262780118 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd840b0070 con 0x7efd901104a0 2024-09-12T16:51:55.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd8f7fe640 1 -- 172.21.15.151:0/2262780118 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd840ab530 con 0x7efd901104a0 2024-09-12T16:51:55.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd8f7fe640 1 -- 172.21.15.151:0/2262780118 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd840ab830 con 0x7efd901104a0 2024-09-12T16:51:55.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 -- 172.21.15.151:0/2262780118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd901104a0 msgr2=0x7efd9011c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:55.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 --2- 172.21.15.151:0/2262780118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd901104a0 0x7efd9011c120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd840097f0 tx=0x7efd8401c430 comp rx=0 tx=0).stop 2024-09-12T16:51:55.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 -- 172.21.15.151:0/2262780118 shutdown_connections 2024-09-12T16:51:55.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 --2- 172.21.15.151:0/2262780118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd901104a0 0x7efd9011c120 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:55.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 -- 172.21.15.151:0/2262780118 >> 172.21.15.151:0/2262780118 conn(0x7efd9006fe70 msgr2=0x7efd90072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:55.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 -- 172.21.15.151:0/2262780118 shutdown_connections 2024-09-12T16:51:55.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 -- 172.21.15.151:0/2262780118 wait complete. 2024-09-12T16:51:55.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 Processor -- start 2024-09-12T16:51:55.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 -- start start 2024-09-12T16:51:55.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd90074bf0 0x7efd901a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:55.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd96ddd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efd9011d320 con 0x7efd90074bf0 2024-09-12T16:51:55.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd94b79640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd90074bf0 0x7efd901a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:55.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd94b79640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd90074bf0 0x7efd901a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50240/0 (socket says 172.21.15.151:50240) 2024-09-12T16:51:55.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd94b79640 1 -- 172.21.15.151:0/3927034744 learned_addr learned my addr 172.21.15.151:0/3927034744 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:55.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.261+0000 7efd94b79640 1 -- 172.21.15.151:0/3927034744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd901aa5c0 con 0x7efd90074bf0 2024-09-12T16:51:55.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd94b79640 1 --2- 172.21.15.151:0/3927034744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd90074bf0 0x7efd901a9ff0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c7f0 tx=0x7efd8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:55.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd8d7fa640 1 -- 172.21.15.151:0/3927034744 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd88003ab0 con 0x7efd90074bf0 2024-09-12T16:51:55.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd8d7fa640 1 -- 172.21.15.151:0/3927034744 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd88003c50 con 0x7efd90074bf0 2024-09-12T16:51:55.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd901aa8b0 con 0x7efd90074bf0 2024-09-12T16:51:55.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd8d7fa640 1 -- 172.21.15.151:0/3927034744 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8800a820 con 0x7efd90074bf0 2024-09-12T16:51:55.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd901afa80 con 0x7efd90074bf0 2024-09-12T16:51:55.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9010fd90 con 0x7efd90074bf0 2024-09-12T16:51:55.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd8d7fa640 1 -- 172.21.15.151:0/3927034744 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd8800a9c0 con 0x7efd90074bf0 2024-09-12T16:51:55.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd8d7fa640 1 --2- 172.21.15.151:0/3927034744 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efd7c03b250 0x7efd7c03d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:55.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd8d7fa640 1 -- 172.21.15.151:0/3927034744 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4272+0+0 (secure 0 0 0) 0x7efd8804fa10 con 0x7efd90074bf0 2024-09-12T16:51:55.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd8ffff640 1 --2- 172.21.15.151:0/3927034744 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efd7c03b250 0x7efd7c03d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:55.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.265+0000 7efd8ffff640 1 --2- 172.21.15.151:0/3927034744 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efd7c03b250 0x7efd7c03d710 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd90069f60 tx=0x7efd840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:55.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.277+0000 7efd8d7fa640 1 -- 172.21.15.151:0/3927034744 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7efd8801adf0 con 0x7efd90074bf0 2024-09-12T16:51:55.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:55.449+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7efd901aabf0 con 0x7efd90074bf0 2024-09-12T16:51:56.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.101+0000 7efd8d7fa640 1 -- 172.21.15.151:0/3927034744 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7efd8804d640 con 0x7efd90074bf0 2024-09-12T16:51:56.106 INFO:teuthology.orchestra.run.smithi151.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T16:51:56.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.105+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efd7c03b250 msgr2=0x7efd7c03d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:56.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.105+0000 7efd96ddd640 1 --2- 172.21.15.151:0/3927034744 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efd7c03b250 0x7efd7c03d710 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd90069f60 tx=0x7efd840a6000 comp rx=0 tx=0).stop 2024-09-12T16:51:56.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.109+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd90074bf0 msgr2=0x7efd901a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:56.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.109+0000 7efd96ddd640 1 --2- 172.21.15.151:0/3927034744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd90074bf0 0x7efd901a9ff0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c7f0 tx=0x7efd8800ccb0 comp rx=0 tx=0).stop 2024-09-12T16:51:56.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.109+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 shutdown_connections 2024-09-12T16:51:56.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.109+0000 7efd96ddd640 1 --2- 172.21.15.151:0/3927034744 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efd7c03b250 0x7efd7c03d710 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:56.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.109+0000 7efd96ddd640 1 --2- 172.21.15.151:0/3927034744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd90074bf0 0x7efd901a9ff0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c7f0 tx=0x7efd8800ccb0 comp rx=0 tx=0).stop 2024-09-12T16:51:56.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.109+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 >> 172.21.15.151:0/3927034744 conn(0x7efd9006fe70 msgr2=0x7efd901183f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:56.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.109+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 shutdown_connections 2024-09-12T16:51:56.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.109+0000 7efd96ddd640 1 -- 172.21.15.151:0/3927034744 wait complete. 2024-09-12T16:51:56.147 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T16:51:56.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff89ea44640 1 Processor -- start 2024-09-12T16:51:56.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff89ea44640 1 -- start start 2024-09-12T16:51:56.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff89ea44640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff89811b8d0 0x7ff89811dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:56.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff89ea44640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89811e200 con 0x7ff898113070 2024-09-12T16:51:56.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff89ea44640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff89811f400 con 0x7ff89811b8d0 2024-09-12T16:51:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff8977fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff89811b8d0 0x7ff89811dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff8977fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff89811b8d0 0x7ff89811dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50246/0 (socket says 172.21.15.151:50246) 2024-09-12T16:51:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff8977fe640 1 -- 172.21.15.151:0/604799183 learned_addr learned my addr 172.21.15.151:0/604799183 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff897fff640 1 --1- 172.21.15.151:0/604799183 >> v1:172.21.15.122:6789/0 conn(0x7ff898113070 0x7ff898113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37656/0 (socket says 172.21.15.151:37656) 2024-09-12T16:51:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff8977fe640 1 -- 172.21.15.151:0/604799183 >> v1:172.21.15.122:6789/0 conn(0x7ff898113070 legacy=0x7ff898113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.273+0000 7ff8977fe640 1 -- 172.21.15.151:0/604799183 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89811f5b0 con 0x7ff89811b8d0 2024-09-12T16:51:56.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff8977fe640 1 --2- 172.21.15.151:0/604799183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff89811b8d0 0x7ff89811dcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff880009e50 tx=0x7ff88001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8f6e91330ce50e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:56.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff896ffd640 1 -- 172.21.15.151:0/604799183 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff880009200 con 0x7ff89811b8d0 2024-09-12T16:51:56.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff896ffd640 1 -- 172.21.15.151:0/604799183 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8800a5880 con 0x7ff89811b8d0 2024-09-12T16:51:56.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff896ffd640 1 -- 172.21.15.151:0/604799183 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8800a5b80 con 0x7ff89811b8d0 2024-09-12T16:51:56.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 -- 172.21.15.151:0/604799183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff89811b8d0 msgr2=0x7ff89811dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:56.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 --2- 172.21.15.151:0/604799183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff89811b8d0 0x7ff89811dcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff880009e50 tx=0x7ff88001ca10 comp rx=0 tx=0).stop 2024-09-12T16:51:56.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 -- 172.21.15.151:0/604799183 shutdown_connections 2024-09-12T16:51:56.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 --2- 172.21.15.151:0/604799183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff89811b8d0 0x7ff89811dcc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:56.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 -- 172.21.15.151:0/604799183 >> 172.21.15.151:0/604799183 conn(0x7ff89806f370 msgr2=0x7ff89806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:56.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 -- 172.21.15.151:0/604799183 shutdown_connections 2024-09-12T16:51:56.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 -- 172.21.15.151:0/604799183 wait complete. 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 Processor -- start 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 -- start start 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff898113070 0x7ff8981a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff89ea44640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff89811f060 con 0x7ff898113070 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff897fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff898113070 0x7ff8981a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff897fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff898113070 0x7ff8981a9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50248/0 (socket says 172.21.15.151:50248) 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.277+0000 7ff897fff640 1 -- 172.21.15.151:0/807303 learned_addr learned my addr 172.21.15.151:0/807303 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff897fff640 1 -- 172.21.15.151:0/807303 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8981aa470 con 0x7ff898113070 2024-09-12T16:51:56.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff897fff640 1 --2- 172.21.15.151:0/807303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff898113070 0x7ff8981a9ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c480 tx=0x7ff88800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:56.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff894ff9640 1 -- 172.21.15.151:0/807303 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff888007410 con 0x7ff898113070 2024-09-12T16:51:56.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff894ff9640 1 -- 172.21.15.151:0/807303 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8880075b0 con 0x7ff898113070 2024-09-12T16:51:56.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8981aa700 con 0x7ff898113070 2024-09-12T16:51:56.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff894ff9640 1 -- 172.21.15.151:0/807303 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff888004920 con 0x7ff898113070 2024-09-12T16:51:56.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8981af6e0 con 0x7ff898113070 2024-09-12T16:51:56.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8981134d0 con 0x7ff898113070 2024-09-12T16:51:56.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff894ff9640 1 -- 172.21.15.151:0/807303 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff88801a020 con 0x7ff898113070 2024-09-12T16:51:56.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff894ff9640 1 --2- 172.21.15.151:0/807303 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff87803b200 0x7ff87803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:56.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff894ff9640 1 -- 172.21.15.151:0/807303 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4283+0+0 (secure 0 0 0) 0x7ff88804eed0 con 0x7ff898113070 2024-09-12T16:51:56.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff8977fe640 1 --2- 172.21.15.151:0/807303 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff87803b200 0x7ff87803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:56.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.281+0000 7ff8977fe640 1 --2- 172.21.15.151:0/807303 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff87803b200 0x7ff87803d6c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8800ae000 tx=0x7ff8800a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:56.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.293+0000 7ff894ff9640 1 -- 172.21.15.151:0/807303 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff888021070 con 0x7ff898113070 2024-09-12T16:51:56.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:56.465+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7ff89811b8d0 con 0x7ff898113070 2024-09-12T16:51:57.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.109+0000 7ff894ff9640 1 -- 172.21.15.151:0/807303 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7ff8880113a0 con 0x7ff898113070 2024-09-12T16:51:57.114 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T16:51:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff87803b200 msgr2=0x7ff87803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 --2- 172.21.15.151:0/807303 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff87803b200 0x7ff87803d6c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8800ae000 tx=0x7ff8800a7070 comp rx=0 tx=0).stop 2024-09-12T16:51:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff898113070 msgr2=0x7ff8981a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 --2- 172.21.15.151:0/807303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff898113070 0x7ff8981a9ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c480 tx=0x7ff88800c940 comp rx=0 tx=0).stop 2024-09-12T16:51:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 shutdown_connections 2024-09-12T16:51:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 --2- 172.21.15.151:0/807303 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff87803b200 0x7ff87803d6c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 --2- 172.21.15.151:0/807303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff898113070 0x7ff8981a9ea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 >> 172.21.15.151:0/807303 conn(0x7ff89806f370 msgr2=0x7ff89811c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 shutdown_connections 2024-09-12T16:51:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.113+0000 7ff89ea44640 1 -- 172.21.15.151:0/807303 wait complete. 2024-09-12T16:51:57.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T16:51:57.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e8ccd640 1 Processor -- start 2024-09-12T16:51:57.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e8ccd640 1 -- start start 2024-09-12T16:51:57.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e8ccd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd4e4074bf0 0x7fd4e410fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e8ccd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e4110760 con 0x7fd4e41102d0 2024-09-12T16:51:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e8ccd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e4110930 con 0x7fd4e4074bf0 2024-09-12T16:51:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e259c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd4e4074bf0 0x7fd4e410fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e259c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd4e4074bf0 0x7fd4e410fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50258/0 (socket says 172.21.15.151:50258) 2024-09-12T16:51:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e259c640 1 -- 172.21.15.151:0/1839775077 learned_addr learned my addr 172.21.15.151:0/1839775077 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e259c640 1 -- 172.21.15.151:0/1839775077 >> v1:172.21.15.122:6789/0 conn(0x7fd4e41102d0 legacy=0x7fd4e411b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.273+0000 7fd4e259c640 1 -- 172.21.15.151:0/1839775077 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e4110ae0 con 0x7fd4e4074bf0 2024-09-12T16:51:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e259c640 1 --2- 172.21.15.151:0/1839775077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e410fd90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40097f0 tx=0x7fd4d401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6723d98528df1fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e159a640 1 -- 172.21.15.151:0/1839775077 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d40b1070 con 0x7fd4e4074bf0 2024-09-12T16:51:57.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e159a640 1 -- 172.21.15.151:0/1839775077 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d40ac560 con 0x7fd4e4074bf0 2024-09-12T16:51:57.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e159a640 1 -- 172.21.15.151:0/1839775077 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d40a8050 con 0x7fd4e4074bf0 2024-09-12T16:51:57.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/1839775077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 msgr2=0x7fd4e410fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:57.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 --2- 172.21.15.151:0/1839775077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e410fd90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40097f0 tx=0x7fd4d401c4c0 comp rx=0 tx=0).stop 2024-09-12T16:51:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/1839775077 shutdown_connections 2024-09-12T16:51:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 --2- 172.21.15.151:0/1839775077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e410fd90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/1839775077 >> 172.21.15.151:0/1839775077 conn(0x7fd4e406fe70 msgr2=0x7fd4e4072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/1839775077 shutdown_connections 2024-09-12T16:51:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/1839775077 wait complete. 2024-09-12T16:51:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 Processor -- start 2024-09-12T16:51:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 -- start start 2024-09-12T16:51:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e41a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.277+0000 7fd4e8ccd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e411f4a0 con 0x7fd4e4074bf0 2024-09-12T16:51:57.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e41a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:57.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e41a7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:50272/0 (socket says 172.21.15.151:50272) 2024-09-12T16:51:57.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e259c640 1 -- 172.21.15.151:0/48381027 learned_addr learned my addr 172.21.15.151:0/48381027 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:51:57.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e259c640 1 -- 172.21.15.151:0/48381027 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e41a8330 con 0x7fd4e4074bf0 2024-09-12T16:51:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e259c640 1 --2- 172.21.15.151:0/48381027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e41a7d60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40af040 tx=0x7fd4d401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4d2ffd640 1 -- 172.21.15.151:0/48381027 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d40bb020 con 0x7fd4e4074bf0 2024-09-12T16:51:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4d2ffd640 1 -- 172.21.15.151:0/48381027 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d40ab700 con 0x7fd4e4074bf0 2024-09-12T16:51:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e41a85c0 con 0x7fd4e4074bf0 2024-09-12T16:51:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4d2ffd640 1 -- 172.21.15.151:0/48381027 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4d40b1040 con 0x7fd4e4074bf0 2024-09-12T16:51:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e41ad5a0 con 0x7fd4e4074bf0 2024-09-12T16:51:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e410fd90 con 0x7fd4e4074bf0 2024-09-12T16:51:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4d2ffd640 1 -- 172.21.15.151:0/48381027 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd4d40be020 con 0x7fd4e4074bf0 2024-09-12T16:51:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4d2ffd640 1 --2- 172.21.15.151:0/48381027 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd4c403b200 0x7fd4c403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:51:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4d2ffd640 1 -- 172.21.15.151:0/48381027 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4647+0+0 (secure 0 0 0) 0x7fd4d40e9dc0 con 0x7fd4e4074bf0 2024-09-12T16:51:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e1d9b640 1 --2- 172.21.15.151:0/48381027 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd4c403b200 0x7fd4c403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:51:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.281+0000 7fd4e1d9b640 1 --2- 172.21.15.151:0/48381027 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd4c403b200 0x7fd4c403d6c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8000f70 tx=0x7fd4d8007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:51:57.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.297+0000 7fd4d2ffd640 1 -- 172.21.15.151:0/48381027 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd4d40c5030 con 0x7fd4e4074bf0 2024-09-12T16:51:57.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:57.465+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fd4e41102d0 con 0x7fd4e4074bf0 2024-09-12T16:51:58.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.117+0000 7fd4d2ffd640 1 -- 172.21.15.151:0/48381027 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7fd4d40160b0 con 0x7fd4e4074bf0 2024-09-12T16:51:58.120 INFO:teuthology.orchestra.run.smithi151.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T16:51:58.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.121+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd4c403b200 msgr2=0x7fd4c403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:58.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.121+0000 7fd4e8ccd640 1 --2- 172.21.15.151:0/48381027 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd4c403b200 0x7fd4c403d6c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8000f70 tx=0x7fd4d8007a40 comp rx=0 tx=0).stop 2024-09-12T16:51:58.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.121+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 msgr2=0x7fd4e41a7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:51:58.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.121+0000 7fd4e8ccd640 1 --2- 172.21.15.151:0/48381027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e41a7d60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40af040 tx=0x7fd4d401ad00 comp rx=0 tx=0).stop 2024-09-12T16:51:58.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.121+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 shutdown_connections 2024-09-12T16:51:58.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.121+0000 7fd4e8ccd640 1 --2- 172.21.15.151:0/48381027 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd4c403b200 0x7fd4c403d6c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:58.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.121+0000 7fd4e8ccd640 1 --2- 172.21.15.151:0/48381027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4e4074bf0 0x7fd4e41a7d60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:51:58.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.121+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 >> 172.21.15.151:0/48381027 conn(0x7fd4e406fe70 msgr2=0x7fd4e4118580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:51:58.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.125+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 shutdown_connections 2024-09-12T16:51:58.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:51:58.125+0000 7fd4e8ccd640 1 -- 172.21.15.151:0/48381027 wait complete. 2024-09-12T16:51:58.174 DEBUG:tasks.rgw:Pools created 2024-09-12T16:51:58.175 INFO:tasks.rgw:Starting rgw... 2024-09-12T16:51:58.175 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T16:51:58.175 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T16:51:58.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo echo -n http://smithi151.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T16:51:58.187 INFO:teuthology.orchestra.run.smithi151.stdout:http://smithi151.front.sepia.ceph.com:80 2024-09-12T16:51:58.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T16:51:58.239 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T16:51:58.239 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T16:51:58.283 INFO:tasks.rgw.client.0:Started 2024-09-12T16:51:58.283 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi151.front.sepia.ceph.com:80/ 2024-09-12T16:51:58.284 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-12T16:51:58.316 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T16:51:58.317 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T16:51:58.317 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-12T16:51:58.317 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T16:51:58.317 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T16:51:59.319 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-12T16:51:59.330 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T16:51:59.330 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-12T16:51:59.330 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T16:51:59.330 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T16:51:59.331 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T16:52:01.333 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-12T16:52:01.344 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T16:52:01.344 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-12T16:52:01.344 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T16:52:01.345 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T16:52:01.345 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T16:52:05.346 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-12T16:52:05.358 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T16:52:05.358 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-12T16:52:05.358 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T16:52:05.358 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T16:52:05.359 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T16:52:13.360 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-12T16:52:13.372 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T16:52:13.372 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-12T16:52:13.375 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 53489 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-12T16:52:13.376 INFO:teuthology.orchestra.run.smithi151.stdout:anonymous 2024-09-12T16:52:13.376 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-12T16:52:13.866 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-12T16:52:13.866 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-12T16:52:13.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-12T16:52:13.866 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-12T16:52:13.905 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:13.905 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:13.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.901+0000 7f3a70dd39c0 1 Processor -- start 2024-09-12T16:52:13.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.901+0000 7f3a70dd39c0 1 -- start start 2024-09-12T16:52:13.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.901+0000 7f3a70dd39c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5645f6e49dd0 0x5645f6e4a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.901+0000 7f3a70dd39c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5645f6cff9c0 con 0x5645f6e4cfb0 2024-09-12T16:52:13.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.901+0000 7f3a70dd39c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5645f6d4f6d0 con 0x5645f6e49dd0 2024-09-12T16:52:13.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.905+0000 7f3a6e8d9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5645f6e49dd0 0x5645f6e4a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.905+0000 7f3a6e8d9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5645f6e49dd0 0x5645f6e4a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33156/0 (socket says 172.21.15.151:33156) 2024-09-12T16:52:13.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.905+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1430989966 learned_addr learned my addr 172.21.15.151:0/1430989966 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:13.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.905+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1430989966 >> v1:172.21.15.122:6789/0 conn(0x5645f6e4cfb0 legacy=0x5645f6e4f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:13.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.905+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1430989966 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f6cf3ca0 con 0x5645f6e49dd0 2024-09-12T16:52:13.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.905+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/1430989966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6e4a1b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000a4e0 tx=0x7f3a6001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e854eb7e9d346ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.905+0000 7f3a6d8d7640 1 -- 172.21.15.151:0/1430989966 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a600aa540 con 0x5645f6e49dd0 2024-09-12T16:52:13.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a6d8d7640 1 -- 172.21.15.151:0/1430989966 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a600aa6e0 con 0x5645f6e49dd0 2024-09-12T16:52:13.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a6d8d7640 1 -- 172.21.15.151:0/1430989966 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a600aaa40 con 0x5645f6e49dd0 2024-09-12T16:52:13.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1430989966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 msgr2=0x5645f6e4a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1430989966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6e4a1b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000a4e0 tx=0x7f3a6001b090 comp rx=0 tx=0).stop 2024-09-12T16:52:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1430989966 shutdown_connections 2024-09-12T16:52:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1430989966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6e4a1b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1430989966 >> 172.21.15.151:0/1430989966 conn(0x5645f6e458f0 msgr2=0x5645f6e47d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1430989966 shutdown_connections 2024-09-12T16:52:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.909+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1430989966 wait complete. 2024-09-12T16:52:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 Processor -- start 2024-09-12T16:52:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 -- start start 2024-09-12T16:52:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6dbed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5645f6d53680 con 0x5645f6e49dd0 2024-09-12T16:52:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a6e8d9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6dbed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a6e8d9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6dbed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33164/0 (socket says 172.21.15.151:33164) 2024-09-12T16:52:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/2255875048 learned_addr learned my addr 172.21.15.151:0/2255875048 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/2255875048 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f6cceda0 con 0x5645f6e49dd0 2024-09-12T16:52:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/2255875048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6dbed20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a60019740 tx=0x7f3a600033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e382cc07b23a8c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f395ce09640 1 -- 172.21.15.151:0/2255875048 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a600b9070 con 0x5645f6e49dd0 2024-09-12T16:52:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f395ce09640 1 -- 172.21.15.151:0/2255875048 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a600aaa90 con 0x5645f6e49dd0 2024-09-12T16:52:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f395ce09640 1 -- 172.21.15.151:0/2255875048 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a600aad70 con 0x5645f6e49dd0 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2255875048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 msgr2=0x5645f6dbed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2255875048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6dbed20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a60019740 tx=0x7f3a600033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2255875048 shutdown_connections 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2255875048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6dbed20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2255875048 >> 172.21.15.151:0/2255875048 conn(0x5645f6e458f0 msgr2=0x5645f6f31170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2255875048 shutdown_connections 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2255875048 wait complete. 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 Processor -- start 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.925+0000 7f3a70dd39c0 1 -- start start 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a70dd39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6f3dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a70dd39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5645f6cf5a50 con 0x5645f6e49dd0 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a6e8d9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6f3dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a6e8d9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6f3dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33172/0 (socket says 172.21.15.151:33172) 2024-09-12T16:52:13.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/2305111555 learned_addr learned my addr 172.21.15.151:0/2305111555 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:13.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/2305111555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f6f3e170 con 0x5645f6e49dd0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6f3dc10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a60000f90 tx=0x7f3a60017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f395b606640 1 -- 172.21.15.151:0/2305111555 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a600b9030 con 0x5645f6e49dd0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f395b606640 1 -- 172.21.15.151:0/2305111555 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a600b5ad0 con 0x5645f6e49dd0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f395b606640 1 -- 172.21.15.151:0/2305111555 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a600b5db0 con 0x5645f6e49dd0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645f6f3e400 con 0x5645f6e49dd0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645f6f3ee30 con 0x5645f6e49dd0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f395b606640 1 -- 172.21.15.151:0/2305111555 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a600b3040 con 0x5645f6e49dd0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f395b606640 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3954039ac0 0x7f395403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f395b606640 1 -- 172.21.15.151:0/2305111555 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3a600c4030 con 0x5645f6e49dd0 2024-09-12T16:52:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a6e0d8640 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3954039ac0 0x7f395403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6e4cfb0 0x5645f6f44d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.929+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f452c0 con 0x5645f6e4cfb0 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6f0da640 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6e4cfb0 0x5645f6f44d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6e0d8640 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3954039ac0 0x7f395403bf80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a58001ec0 tx=0x7f3a58001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6f0da640 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6e4cfb0 0x5645f6f44d80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6f0da640 1 -- 172.21.15.151:0/2305111555 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6e4cfb0 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f3f0e0 con 0x5645f6e4cfb0 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6f0da640 1 -- 172.21.15.151:0/2305111555 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6e4cfb0 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f47560 0x5645f6f49950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f4a090 con 0x5645f6f47560 2024-09-12T16:52:13.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f47560 0x5645f6f49950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f47560 0x5645f6f49950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/2305111555 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3a600a93c0 con 0x5645f6f47560 2024-09-12T16:52:13.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f463d0 con 0x5645f6e4cfb0 2024-09-12T16:52:13.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6f0da640 1 -- 172.21.15.151:0/2305111555 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6e4cfb0 2024-09-12T16:52:13.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f46800 con 0x5645f6e4cfb0 2024-09-12T16:52:13.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.933+0000 7f3a6f0da640 1 -- 172.21.15.151:0/2305111555 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6e4cfb0 2024-09-12T16:52:13.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a70dd39c0 1 Processor -- start 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a70dd39c0 1 -- start start 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a70dd39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f36b20 0x5645f6f353c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a70dd39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5645f6d60450 con 0x5645f6f36b20 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a6f0da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f36b20 0x5645f6f353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a6f0da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f36b20 0x5645f6f353c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33178/0 (socket says 172.21.15.151:33178) 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1455214652 learned_addr learned my addr 172.21.15.151:0/1455214652 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1455214652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f6f37040 con 0x5645f6f36b20 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a6f0da640 1 --2- 172.21.15.151:0/1455214652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f36b20 0x5645f6f353c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5645f6f3e650 tx=0x7f3a6800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3958e01640 1 -- 172.21.15.151:0/1455214652 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a68007dd0 con 0x5645f6f36b20 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1455214652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645f6f35900 con 0x5645f6f36b20 2024-09-12T16:52:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3958e01640 1 -- 172.21.15.151:0/1455214652 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6801e020 con 0x5645f6f36b20 2024-09-12T16:52:13.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1455214652 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645f6f35e70 con 0x5645f6f36b20 2024-09-12T16:52:13.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3958e01640 1 -- 172.21.15.151:0/1455214652 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a68019550 con 0x5645f6f36b20 2024-09-12T16:52:13.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3958e01640 1 -- 172.21.15.151:0/1455214652 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a68016040 con 0x5645f6f36b20 2024-09-12T16:52:13.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3958e01640 1 --2- 172.21.15.151:0/1455214652 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3948039a70 0x7f394803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3958e01640 1 -- 172.21.15.151:0/1455214652 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3a6801f030 con 0x5645f6f36b20 2024-09-12T16:52:13.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.937+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/1455214652 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3948039a70 0x7f394803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 Processor -- start 2024-09-12T16:52:13.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- start start 2024-09-12T16:52:13.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/1455214652 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3948039a70 0x7f394803bf30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5645f6f456d0 tx=0x7f3a600a4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f68670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5645f6dbf4b0 con 0x5645f6f68270 2024-09-12T16:52:13.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6f0da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f68670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6f0da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f68670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33194/0 (socket says 172.21.15.151:33194) 2024-09-12T16:52:13.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6f0da640 1 -- 172.21.15.151:0/353312535 learned_addr learned my addr 172.21.15.151:0/353312535 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:13.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6f0da640 1 -- 172.21.15.151:0/353312535 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f6f68c60 con 0x5645f6f68270 2024-09-12T16:52:13.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6f0da640 1 --2- 172.21.15.151:0/353312535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f68670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3a68050600 tx=0x7f3a68016f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3427b573658e765 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f39527fc640 1 -- 172.21.15.151:0/353312535 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a6801d070 con 0x5645f6f68270 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f39527fc640 1 -- 172.21.15.151:0/353312535 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a68022540 con 0x5645f6f68270 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f39527fc640 1 -- 172.21.15.151:0/353312535 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a680520d0 con 0x5645f6f68270 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/353312535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 msgr2=0x5645f6f68670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/353312535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f68670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3a68050600 tx=0x7f3a68016f50 comp rx=0 tx=0).stop 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/353312535 shutdown_connections 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/353312535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f68670 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/353312535 >> 172.21.15.151:0/353312535 conn(0x5645f6f63670 msgr2=0x5645f6f618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/353312535 shutdown_connections 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/353312535 wait complete. 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 Processor -- start 2024-09-12T16:52:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- start start 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f6e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a70dd39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5645f6f671a0 con 0x5645f6f68270 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6f0da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f6e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6f0da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f6e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33196/0 (socket says 172.21.15.151:33196) 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.941+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 learned_addr learned my addr 172.21.15.151:0/1905608213 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f6f6ec80 con 0x5645f6f68270 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6f0da640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f6e720 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a68019fd0 tx=0x7f3a68050590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3950ff9640 1 -- 172.21.15.151:0/1905608213 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a68050c20 con 0x5645f6f68270 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3950ff9640 1 -- 172.21.15.151:0/1905608213 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a68031070 con 0x5645f6f68270 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3950ff9640 1 -- 172.21.15.151:0/1905608213 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a68018910 con 0x5645f6f68270 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645f6f6ef10 con 0x5645f6f68270 2024-09-12T16:52:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645f6f6f8c0 con 0x5645f6f68270 2024-09-12T16:52:13.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3950ff9640 1 -- 172.21.15.151:0/1905608213 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a68018ab0 con 0x5645f6f68270 2024-09-12T16:52:13.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3950ff9640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3938039ac0 0x7f393803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3950ff9640 1 -- 172.21.15.151:0/1905608213 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3a6804a000 con 0x5645f6f68270 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3938039ac0 0x7f393803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6f79990 0x5645f6f7be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f7c570 con 0x5645f6f79990 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6e0d8640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6f79990 0x5645f6f7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3938039ac0 0x7f393803bf80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a600d73f0 tx=0x7f3a600e2000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6e0d8640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6f79990 0x5645f6f7be20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a5800d040 con 0x5645f6f79990 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 20 realm 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f78da0 con 0x5645f6f79990 2024-09-12T16:52:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a5800d040 con 0x5645f6f79990 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f7d070 con 0x5645f6f79990 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a5800d040 con 0x5645f6f79990 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.945+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f7d940 con 0x5645f6f79990 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a5800d040 con 0x5645f6f79990 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a70dd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f7e240 0x5645f6f80630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f80d90 con 0x5645f6f7e240 2024-09-12T16:52:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6f0da640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f7e240 0x5645f6f80630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6f0da640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f7e240 0x5645f6f80630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a70dd39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a70dd39c0 20 searching for the correct realm 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5645f6f82d30 0x5645f6f851f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5645f6f82d30 0x5645f6f851f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5645f6f82d30 0x5645f6f851f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e8d9640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f3a600f7040 0x7f3a600ea430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x7f3a600f7040 2024-09-12T16:52:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e0d8640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f3a600f7040 0x7f3a600ea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e0d8640 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f3a600f7040 0x7f3a600ea430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5800d040 con 0x7f3a600f7040 2024-09-12T16:52:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.949+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f79990 2024-09-12T16:52:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5800d040 con 0x5645f6f79990 2024-09-12T16:52:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f79990 2024-09-12T16:52:13.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x7f3a600f7040 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f79990 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.953+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f79990 2024-09-12T16:52:13.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x7f3a600f7040 2024-09-12T16:52:13.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f79990 2024-09-12T16:52:13.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f79990 2024-09-12T16:52:13.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.957+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x7f3a600f7040 2024-09-12T16:52:13.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f79990 2024-09-12T16:52:13.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x7f3a600f7040 2024-09-12T16:52:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.961+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f82d30 2024-09-12T16:52:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f7e240 2024-09-12T16:52:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x5645f6f79990 2024-09-12T16:52:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f858c0 con 0x7f3a600f7040 2024-09-12T16:52:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f79990 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81bd0 con 0x5645f6f79990 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81ff0 con 0x5645f6f79990 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 zone default found 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 4 Realm: () 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 zonegroup default 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81ff0 con 0x5645f6f7e240 2024-09-12T16:52:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f878b0 con 0x5645f6f82d30 2024-09-12T16:52:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.965+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f87d40 con 0x5645f6f82d30 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a70dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a70dd39c0 20 started sync module instance, tier type = 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a70dd39c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f86bd0 con 0x7f3a600f7040 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94858496209104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f86bd0 con 0x7f3a600f7040 2024-09-12T16:52:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f888b0 con 0x5645f6f79990 2024-09-12T16:52:13.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94858496209104] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94858496213904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f86bd0 con 0x5645f6f79990 2024-09-12T16:52:13.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.969+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f892c0 con 0x5645f6f82d30 2024-09-12T16:52:13.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.973+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94858496213904] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.973+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.973+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94858496206624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f86b40 con 0x5645f6f82d30 2024-09-12T16:52:13.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.973+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f89fc0 con 0x7f3a600f7040 2024-09-12T16:52:13.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.973+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.973+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94858496220192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8a630 con 0x7f3a600f7040 2024-09-12T16:52:13.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.973+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b150 con 0x5645f6f79990 2024-09-12T16:52:13.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.977+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94858496206624] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.977+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94858496220192] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.977+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.977+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94858496224288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b110 con 0x5645f6f79990 2024-09-12T16:52:13.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.977+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f7e240 2024-09-12T16:52:13.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.977+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94858496224288] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.981+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.981+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94858496226624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b110 con 0x5645f6f7e240 2024-09-12T16:52:13.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.981+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8c260 con 0x5645f6f7e240 2024-09-12T16:52:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.981+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94858496226624] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.981+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.981+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94858496228752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8c260 con 0x5645f6f7e240 2024-09-12T16:52:13.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.981+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8cc80 con 0x5645f6f7e240 2024-09-12T16:52:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94858496228752] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94858496231280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8cc40 con 0x5645f6f7e240 2024-09-12T16:52:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 20 add_watcher() i=0 2024-09-12T16:52:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 20 add_watcher() i=1 2024-09-12T16:52:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 20 add_watcher() i=2 2024-09-12T16:52:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 20 add_watcher() i=3 2024-09-12T16:52:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 20 add_watcher() i=4 2024-09-12T16:52:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 20 add_watcher() i=5 2024-09-12T16:52:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 20 add_watcher() i=6 2024-09-12T16:52:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94858496231280] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 20 add_watcher() i=7 2024-09-12T16:52:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f900d0 con 0x5645f6f79990 2024-09-12T16:52:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.985+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94858496218720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8d5f0 con 0x5645f6f79990 2024-09-12T16:52:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94858496218720] v32'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f39257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a70dd39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a70dd39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a70dd39c0 5 note: GC not initialized 2024-09-12T16:52:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f389ffff640 20 reqs_thread_entry: start 2024-09-12T16:52:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a70dd39c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a70dd39c0 20 Filter name: none 2024-09-12T16:52:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f389dffb640 20 reqs_thread_entry: start 2024-09-12T16:52:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6fb2bd0 con 0x5645f6f82d30 2024-09-12T16:52:13.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6fb2bd0 con 0x5645f6f82d30 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6fb2bd0 con 0x5645f6f79990 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f79990 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x7f3a600f7040 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f82d30 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.989+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f79990 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f82d30 2024-09-12T16:52:13.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x7f3a600f7040 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f82d30 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f79990 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f7e240 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f7e240 2024-09-12T16:52:13.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f82d30 2024-09-12T16:52:13.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:13.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.993+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f7e240 2024-09-12T16:52:13.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a680083f0 con 0x5645f6f7e240 2024-09-12T16:52:13.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f7e240 2024-09-12T16:52:13.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68066040 con 0x5645f6f7e240 2024-09-12T16:52:13.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f7e240 2024-09-12T16:52:13.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68066040 con 0x5645f6f7e240 2024-09-12T16:52:13.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f82d30 2024-09-12T16:52:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x7f3a600f7040 2024-09-12T16:52:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f79990 2024-09-12T16:52:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f79990 2024-09-12T16:52:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f82d30 2024-09-12T16:52:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x7f3a600f7040 2024-09-12T16:52:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f7e240 2024-09-12T16:52:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68066040 con 0x5645f6f7e240 2024-09-12T16:52:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:13.997+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f79990 2024-09-12T16:52:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f7e240 2024-09-12T16:52:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68066040 con 0x5645f6f7e240 2024-09-12T16:52:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f82d30 2024-09-12T16:52:14.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:14.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x7f3a600f7040 2024-09-12T16:52:14.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:14.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f7e240 2024-09-12T16:52:14.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a68066040 con 0x5645f6f7e240 2024-09-12T16:52:14.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f79990 2024-09-12T16:52:14.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:14.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x5645f6f82d30 2024-09-12T16:52:14.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:14.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b9f0 con 0x7f3a600f7040 2024-09-12T16:52:14.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.001+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:14.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.005+0000 7f39257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:14.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.005+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94858496218720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f79990 2024-09-12T16:52:14.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.005+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94858496218720] v32'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:14.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.005+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94858496209104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x7f3a600f7040 2024-09-12T16:52:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.005+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94858496209104] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.005+0000 7f3a70dd39c0 20 remove_watcher() i=0 2024-09-12T16:52:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.005+0000 7f3a70dd39c0 2 removed watcher, disabling cache 2024-09-12T16:52:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.005+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94858496213904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f79990 2024-09-12T16:52:14.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.009+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94858496213904] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:14.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.009+0000 7f3a70dd39c0 20 remove_watcher() i=1 2024-09-12T16:52:14.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.009+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94858496206624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f81750 con 0x5645f6f82d30 2024-09-12T16:52:14.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.009+0000 7f3a6e8d9640 1 -- 172.21.15.151:0/1905608213 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94858496206624] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a600f4040 con 0x5645f6f82d30 2024-09-12T16:52:14.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.009+0000 7f3a70dd39c0 20 remove_watcher() i=2 2024-09-12T16:52:14.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.009+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94858496220192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f86720 con 0x7f3a600f7040 2024-09-12T16:52:14.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.013+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94858496220192] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x7f3a600f7040 2024-09-12T16:52:14.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.013+0000 7f3a70dd39c0 20 remove_watcher() i=3 2024-09-12T16:52:14.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.013+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94858496224288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f89c20 con 0x5645f6f79990 2024-09-12T16:52:14.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.013+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94858496224288] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a5802a040 con 0x5645f6f79990 2024-09-12T16:52:14.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.013+0000 7f3a70dd39c0 20 remove_watcher() i=4 2024-09-12T16:52:14.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.013+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94858496226624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f86720 con 0x5645f6f7e240 2024-09-12T16:52:14.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.017+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94858496226624] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68066040 con 0x5645f6f7e240 2024-09-12T16:52:14.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.017+0000 7f3a70dd39c0 20 remove_watcher() i=5 2024-09-12T16:52:14.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.017+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94858496228752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8b540 con 0x5645f6f7e240 2024-09-12T16:52:14.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.017+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94858496228752] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68066040 con 0x5645f6f7e240 2024-09-12T16:52:14.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.017+0000 7f3a70dd39c0 20 remove_watcher() i=6 2024-09-12T16:52:14.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.017+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94858496231280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5645f6f8bd90 con 0x5645f6f7e240 2024-09-12T16:52:14.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a6f0da640 1 -- 172.21.15.151:0/1905608213 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94858496231280] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a68066040 con 0x5645f6f7e240 2024-09-12T16:52:14.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 20 remove_watcher() i=7 2024-09-12T16:52:14.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f7e240 msgr2=0x5645f6f80630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f7e240 0x5645f6f80630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6f79990 msgr2=0x5645f6f7be20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6f79990 0x5645f6f7be20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f3a600f7040 msgr2=0x7f3a600ea430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f3a600f7040 0x7f3a600ea430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5645f6f82d30 msgr2=0x5645f6f851f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5645f6f82d30 0x5645f6f851f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3938039ac0 msgr2=0x7f393803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3938039ac0 0x7f393803bf80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a600d73f0 tx=0x7f3a600e2000 comp rx=0 tx=0).stop 2024-09-12T16:52:14.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a6e0d8640 1 -- 172.21.15.151:0/1905608213 reap_dead start 2024-09-12T16:52:14.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 msgr2=0x5645f6f6e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f6e720 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a68019fd0 tx=0x7f3a68050590 comp rx=0 tx=0).stop 2024-09-12T16:52:14.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 shutdown_connections 2024-09-12T16:52:14.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1905608213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f68270 0x5645f6f6e720 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 >> 172.21.15.151:0/1905608213 conn(0x5645f6f63670 msgr2=0x5645f6f61880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 shutdown_connections 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1905608213 wait complete. 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1455214652 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3948039a70 msgr2=0x7f394803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1455214652 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3948039a70 0x7f394803bf30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5645f6f456d0 tx=0x7f3a600a4000 comp rx=0 tx=0).stop 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1455214652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f36b20 msgr2=0x5645f6f353c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1455214652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f36b20 0x5645f6f353c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5645f6f3e650 tx=0x7f3a6800af40 comp rx=0 tx=0).stop 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1455214652 shutdown_connections 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1455214652 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3948039a70 0x7f394803bf30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/1455214652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6f36b20 0x5645f6f353c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1455214652 >> 172.21.15.151:0/1455214652 conn(0x5645f6f4e090 msgr2=0x5645f6f4e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1455214652 shutdown_connections 2024-09-12T16:52:14.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/1455214652 wait complete. 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f47560 msgr2=0x5645f6f49950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f47560 0x5645f6f49950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6e4cfb0 msgr2=0x5645f6f44d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6e4cfb0 0x5645f6f44d80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3954039ac0 msgr2=0x7f395403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3954039ac0 0x7f395403bf80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a58001ec0 tx=0x7f3a58001440 comp rx=0 tx=0).stop 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 msgr2=0x5645f6f3dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6f3dc10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a60000f90 tx=0x7f3a60017e30 comp rx=0 tx=0).stop 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 shutdown_connections 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5645f6f47560 0x5645f6f49950 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5645f6e4cfb0 0x5645f6f44d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3954039ac0 0x7f395403bf80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 --2- 172.21.15.151:0/2305111555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645f6e49dd0 0x5645f6f3dc10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 >> 172.21.15.151:0/2305111555 conn(0x5645f6e458f0 msgr2=0x5645f6f2fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 shutdown_connections 2024-09-12T16:52:14.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.021+0000 7f3a70dd39c0 1 -- 172.21.15.151:0/2305111555 wait complete. 2024-09-12T16:52:14.035 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-12T16:52:14.035 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T16:52:14.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-12T16:52:14.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-12T16:52:14.036 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-12T16:52:14.111 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:14.111 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:14.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f2683cc39c0 1 Processor -- start 2024-09-12T16:52:14.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f2683cc39c0 1 -- start start 2024-09-12T16:52:14.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f2683cc39c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5570f12ff240 0x5570f138fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f2683cc39c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5570f123f9c0 con 0x5570f12ff620 2024-09-12T16:52:14.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f2683cc39c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5570f128f6d0 con 0x5570f12ff240 2024-09-12T16:52:14.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f26817c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5570f12ff240 0x5570f138fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f2680fc8640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5570f12ff620 0x5570f1392540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37916/0 (socket says 172.21.15.151:37916) 2024-09-12T16:52:14.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f26817c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5570f12ff240 0x5570f138fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33212/0 (socket says 172.21.15.151:33212) 2024-09-12T16:52:14.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f2680fc8640 1 -- 172.21.15.151:0/4107885804 learned_addr learned my addr 172.21.15.151:0/4107885804 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:14.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f26817c9640 1 -- 172.21.15.151:0/4107885804 >> v1:172.21.15.122:6789/0 conn(0x5570f12ff620 legacy=0x5570f1392540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.109+0000 7f26817c9640 1 -- 172.21.15.151:0/4107885804 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f1233ca0 con 0x5570f12ff240 2024-09-12T16:52:14.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f26817c9640 1 --2- 172.21.15.151:0/4107885804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f138fff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f267400a480 tx=0x7f267401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8e86d97c36a10a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f267bfff640 1 -- 172.21.15.151:0/4107885804 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26740b0070 con 0x5570f12ff240 2024-09-12T16:52:14.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f267bfff640 1 -- 172.21.15.151:0/4107885804 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26740ab540 con 0x5570f12ff240 2024-09-12T16:52:14.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f267bfff640 1 -- 172.21.15.151:0/4107885804 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26740ab840 con 0x5570f12ff240 2024-09-12T16:52:14.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f2683cc39c0 1 -- 172.21.15.151:0/4107885804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 msgr2=0x5570f138fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/4107885804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f138fff0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f267400a480 tx=0x7f267401b280 comp rx=0 tx=0).stop 2024-09-12T16:52:14.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f2683cc39c0 1 -- 172.21.15.151:0/4107885804 shutdown_connections 2024-09-12T16:52:14.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/4107885804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f138fff0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f2683cc39c0 1 -- 172.21.15.151:0/4107885804 >> 172.21.15.151:0/4107885804 conn(0x5570f1385920 msgr2=0x5570f1387d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f2683cc39c0 1 -- 172.21.15.151:0/4107885804 shutdown_connections 2024-09-12T16:52:14.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.113+0000 7f2683cc39c0 1 -- 172.21.15.151:0/4107885804 wait complete. 2024-09-12T16:52:14.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.129+0000 7f2683cc39c0 1 Processor -- start 2024-09-12T16:52:14.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.129+0000 7f2683cc39c0 1 -- start start 2024-09-12T16:52:14.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.129+0000 7f2683cc39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f14788c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.129+0000 7f2683cc39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f1293680 con 0x5570f12ff240 2024-09-12T16:52:14.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f26817c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f14788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f26817c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f14788c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33220/0 (socket says 172.21.15.151:33220) 2024-09-12T16:52:14.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f26817c9640 1 -- 172.21.15.151:0/392100146 learned_addr learned my addr 172.21.15.151:0/392100146 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f26817c9640 1 -- 172.21.15.151:0/392100146 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f120eda0 con 0x5570f12ff240 2024-09-12T16:52:14.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f26817c9640 1 --2- 172.21.15.151:0/392100146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f14788c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2674018eb0 tx=0x7f2674003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b627a754f38755 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f256f606640 1 -- 172.21.15.151:0/392100146 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26740b0030 con 0x5570f12ff240 2024-09-12T16:52:14.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f256f606640 1 -- 172.21.15.151:0/392100146 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26740bb070 con 0x5570f12ff240 2024-09-12T16:52:14.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f256f606640 1 -- 172.21.15.151:0/392100146 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26740ab820 con 0x5570f12ff240 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 -- 172.21.15.151:0/392100146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 msgr2=0x5570f14788c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/392100146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f14788c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2674018eb0 tx=0x7f2674003030 comp rx=0 tx=0).stop 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 -- 172.21.15.151:0/392100146 shutdown_connections 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/392100146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f14788c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 -- 172.21.15.151:0/392100146 >> 172.21.15.151:0/392100146 conn(0x5570f1385920 msgr2=0x5570f1474500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 -- 172.21.15.151:0/392100146 shutdown_connections 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 -- 172.21.15.151:0/392100146 wait complete. 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 Processor -- start 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 -- start start 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f147fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f2683cc39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f1235a50 con 0x5570f12ff240 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f26817c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f147fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f26817c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f147fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33234/0 (socket says 172.21.15.151:33234) 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.133+0000 7f26817c9640 1 -- 172.21.15.151:0/3237962411 learned_addr learned my addr 172.21.15.151:0/3237962411 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f26817c9640 1 -- 172.21.15.151:0/3237962411 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f1480400 con 0x5570f12ff240 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f26817c9640 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f147fea0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f26740b8040 tx=0x7f2674018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f256de03640 1 -- 172.21.15.151:0/3237962411 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26740c95a0 con 0x5570f12ff240 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f256de03640 1 -- 172.21.15.151:0/3237962411 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26740c4070 con 0x5570f12ff240 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570f1480690 con 0x5570f12ff240 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f256de03640 1 -- 172.21.15.151:0/3237962411 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26740c98d0 con 0x5570f12ff240 2024-09-12T16:52:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f1481040 con 0x5570f12ff240 2024-09-12T16:52:14.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f256de03640 1 -- 172.21.15.151:0/3237962411 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f26740c9a70 con 0x5570f12ff240 2024-09-12T16:52:14.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f256de03640 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2568039ac0 0x7f256803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f256de03640 1 -- 172.21.15.151:0/3237962411 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f26740a8070 con 0x5570f12ff240 2024-09-12T16:52:14.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2680fc8640 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2568039ac0 0x7f256803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f12ff620 0x5570f1487010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f1487550 con 0x5570f12ff620 2024-09-12T16:52:14.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2681fca640 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f12ff620 0x5570f1487010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2680fc8640 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2568039ac0 0x7f256803bf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f266c004180 tx=0x7f266c001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2681fca640 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f12ff620 0x5570f1487010 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2681fca640 1 -- 172.21.15.151:0/3237962411 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f267c00a4d0 con 0x5570f12ff620 2024-09-12T16:52:14.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.137+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14879a0 con 0x5570f12ff620 2024-09-12T16:52:14.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2681fca640 1 -- 172.21.15.151:0/3237962411 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f267c00a4d0 con 0x5570f12ff620 2024-09-12T16:52:14.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14897b0 0x5570f148bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f148c290 con 0x5570f14897b0 2024-09-12T16:52:14.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f26817c9640 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14897b0 0x5570f148bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f26817c9640 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14897b0 0x5570f148bba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f26817c9640 1 -- 172.21.15.151:0/3237962411 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f26740b6c70 con 0x5570f14897b0 2024-09-12T16:52:14.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f1488650 con 0x5570f12ff620 2024-09-12T16:52:14.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2681fca640 1 -- 172.21.15.151:0/3237962411 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f267c00a4d0 con 0x5570f12ff620 2024-09-12T16:52:14.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f1488af0 con 0x5570f12ff620 2024-09-12T16:52:14.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2681fca640 1 -- 172.21.15.151:0/3237962411 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f267c00a4d0 con 0x5570f12ff620 2024-09-12T16:52:14.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2683cc39c0 1 Processor -- start 2024-09-12T16:52:14.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2683cc39c0 1 -- start start 2024-09-12T16:52:14.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2683cc39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f149a920 0x5570f149ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2683cc39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f12a0450 con 0x5570f149a920 2024-09-12T16:52:14.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2681fca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f149a920 0x5570f149ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2681fca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f149a920 0x5570f149ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33246/0 (socket says 172.21.15.151:33246) 2024-09-12T16:52:14.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.141+0000 7f2681fca640 1 -- 172.21.15.151:0/2664140495 learned_addr learned my addr 172.21.15.151:0/2664140495 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2681fca640 1 -- 172.21.15.151:0/2664140495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f149b380 con 0x5570f149a920 2024-09-12T16:52:14.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2681fca640 1 --2- 172.21.15.151:0/2664140495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f149a920 0x5570f149ad40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5570f1481230 tx=0x7f267c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2566ffd640 1 -- 172.21.15.151:0/2664140495 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f267c014450 con 0x5570f149a920 2024-09-12T16:52:14.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2566ffd640 1 -- 172.21.15.151:0/2664140495 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c014610 con 0x5570f149a920 2024-09-12T16:52:14.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2683cc39c0 1 -- 172.21.15.151:0/2664140495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570f149bbe0 con 0x5570f149a920 2024-09-12T16:52:14.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2566ffd640 1 -- 172.21.15.151:0/2664140495 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f267c014930 con 0x5570f149a920 2024-09-12T16:52:14.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2683cc39c0 1 -- 172.21.15.151:0/2664140495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f149c150 con 0x5570f149a920 2024-09-12T16:52:14.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2566ffd640 1 -- 172.21.15.151:0/2664140495 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f267c011040 con 0x5570f149a920 2024-09-12T16:52:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2566ffd640 1 --2- 172.21.15.151:0/2664140495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2558039a70 0x7f255803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2566ffd640 1 -- 172.21.15.151:0/2664140495 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f267c01e070 con 0x5570f149a920 2024-09-12T16:52:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f26817c9640 1 --2- 172.21.15.151:0/2664140495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2558039a70 0x7f255803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2683cc39c0 1 Processor -- start 2024-09-12T16:52:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2683cc39c0 1 -- start start 2024-09-12T16:52:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f26817c9640 1 --2- 172.21.15.151:0/2664140495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2558039a70 0x7f255803bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5570f1481330 tx=0x7f26740c0400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2683cc39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14a7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2683cc39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f1479050 con 0x5570f14a7220 2024-09-12T16:52:14.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.145+0000 7f2681fca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33250/0 (socket says 172.21.15.151:33250) 2024-09-12T16:52:14.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 -- 172.21.15.151:0/3882807317 learned_addr learned my addr 172.21.15.151:0/3882807317 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 -- 172.21.15.151:0/3882807317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f14a7bd0 con 0x5570f14a7220 2024-09-12T16:52:14.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 --2- 172.21.15.151:0/3882807317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14a7600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f267c016fd0 tx=0x7f267c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc023965fc163d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2564ff9640 1 -- 172.21.15.151:0/3882807317 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f267c022df0 con 0x5570f14a7220 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2564ff9640 1 -- 172.21.15.151:0/3882807317 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c011d50 con 0x5570f14a7220 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2564ff9640 1 -- 172.21.15.151:0/3882807317 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f267c0168f0 con 0x5570f14a7220 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3882807317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 msgr2=0x5570f14a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3882807317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14a7600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f267c016fd0 tx=0x7f267c011a80 comp rx=0 tx=0).stop 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3882807317 shutdown_connections 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3882807317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14a7600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3882807317 >> 172.21.15.151:0/3882807317 conn(0x5570f14a3650 msgr2=0x5570f14a1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3882807317 shutdown_connections 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3882807317 wait complete. 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 Processor -- start 2024-09-12T16:52:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 -- start start 2024-09-12T16:52:14.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2683cc39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5570f14a8230 con 0x5570f14a7220 2024-09-12T16:52:14.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33260/0 (socket says 172.21.15.151:33260) 2024-09-12T16:52:14.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 learned_addr learned my addr 172.21.15.151:0/3256018047 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f14aebf0 con 0x5570f14a7220 2024-09-12T16:52:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.149+0000 7f2681fca640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14ae690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f267c016fd0 tx=0x7f267c050550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2556ffd640 1 -- 172.21.15.151:0/3256018047 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f267c031070 con 0x5570f14a7220 2024-09-12T16:52:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2556ffd640 1 -- 172.21.15.151:0/3256018047 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c011330 con 0x5570f14a7220 2024-09-12T16:52:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570f14aee80 con 0x5570f14a7220 2024-09-12T16:52:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2556ffd640 1 -- 172.21.15.151:0/3256018047 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f267c048040 con 0x5570f14a7220 2024-09-12T16:52:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f14af830 con 0x5570f14a7220 2024-09-12T16:52:14.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2556ffd640 1 -- 172.21.15.151:0/3256018047 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f267c034070 con 0x5570f14a7220 2024-09-12T16:52:14.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2556ffd640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f254c039a70 0x7f254c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2556ffd640 1 -- 172.21.15.151:0/3256018047 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f267c00e040 con 0x5570f14a7220 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f26817c9640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f254c039a70 0x7f254c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f14b9b70 0x5570f14bc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14bc750 con 0x5570f14b9b70 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2680fc8640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f14b9b70 0x5570f14bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f26817c9640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f254c039a70 0x7f254c03bf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f26740b6f80 tx=0x7f26740db000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2680fc8640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f14b9b70 0x5570f14bc000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c00e640 con 0x5570f14b9b70 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 20 realm 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14b8f80 con 0x5570f14b9b70 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c00e640 con 0x5570f14b9b70 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14bd250 con 0x5570f14b9b70 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c00e640 con 0x5570f14b9b70 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.153+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14bdb20 con 0x5570f14b9b70 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f266c00e640 con 0x5570f14b9b70 2024-09-12T16:52:14.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2683cc39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:14.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14be540 0x5570f14c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c1000 con 0x5570f14be540 2024-09-12T16:52:14.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2681fca640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14be540 0x5570f14c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2681fca640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14be540 0x5570f14c0930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2683cc39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2683cc39c0 20 searching for the correct realm 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5570f14c2f50 0x5570f14c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f26817c9640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5570f14c2f50 0x5570f14c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f26817c9640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5570f14c2f50 0x5570f14c5380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f26817c9640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f26740f8040 0x7f26740e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x7f26740f8040 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2680fc8640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f26740f8040 0x7f26740e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.157+0000 7f2680fc8640 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f26740f8040 0x7f26740e98d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c00e640 con 0x7f26740f8040 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14b9b70 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c00e640 con 0x5570f14b9b70 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14b9b70 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x7f26740f8040 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x7f26740f8040 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14b9b70 2024-09-12T16:52:14.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.161+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14b9b70 2024-09-12T16:52:14.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x7f26740f8040 2024-09-12T16:52:14.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f266c029040 con 0x7f26740f8040 2024-09-12T16:52:14.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14b9b70 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14b9b70 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.165+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x7f26740f8040 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x7f26740f8040 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14b9b70 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x7f26740f8040 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x7f26740f8040 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14c2f50 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14be540 2024-09-12T16:52:14.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.169+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x5570f14b9b70 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c5a50 con 0x7f26740f8040 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c029040 con 0x7f26740f8040 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c19c0 con 0x5570f14b9b70 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c2260 con 0x5570f14b9b70 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f266c029040 con 0x5570f14b9b70 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c1600 con 0x5570f14b9b70 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 zone default found 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 4 Realm: () 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 zonegroup default 2024-09-12T16:52:14.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c2260 con 0x5570f14be540 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c7dc0 con 0x5570f14c2f50 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c8160 con 0x5570f14c2f50 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 started sync module instance, tier type = 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c7250 con 0x7f26740f8040 2024-09-12T16:52:14.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.173+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.177+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93943573018480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c7250 con 0x7f26740f8040 2024-09-12T16:52:14.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.177+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c8c30 con 0x5570f14b9b70 2024-09-12T16:52:14.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.177+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.177+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93943573022464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c8bf0 con 0x5570f14b9b70 2024-09-12T16:52:14.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.177+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c9b60 con 0x5570f14c2f50 2024-09-12T16:52:14.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.177+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93943573018480] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.181+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93943573022464] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.181+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.181+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93943573024800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c6da0 con 0x5570f14c2f50 2024-09-12T16:52:14.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.181+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14ca400 con 0x7f26740f8040 2024-09-12T16:52:14.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.181+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.181+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93943573028688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14caa40 con 0x7f26740f8040 2024-09-12T16:52:14.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.181+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cb540 con 0x5570f14b9b70 2024-09-12T16:52:14.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.181+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93943573024800] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.185+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.185+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93943573033008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cb500 con 0x5570f14b9b70 2024-09-12T16:52:14.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.185+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cbf80 con 0x5570f14be540 2024-09-12T16:52:14.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93943573028688] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93943573035728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cc320 con 0x5570f14be540 2024-09-12T16:52:14.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14ccc10 con 0x5570f14be540 2024-09-12T16:52:14.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93943573033008] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93943573035728] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93943573030032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cc380 con 0x5570f14be540 2024-09-12T16:52:14.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.189+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cc380 con 0x5570f14be540 2024-09-12T16:52:14.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93943573030032] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93943573026416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cd2a0 con 0x5570f14be540 2024-09-12T16:52:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 20 add_watcher() i=0 2024-09-12T16:52:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 20 add_watcher() i=1 2024-09-12T16:52:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 20 add_watcher() i=2 2024-09-12T16:52:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 20 add_watcher() i=3 2024-09-12T16:52:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 20 add_watcher() i=4 2024-09-12T16:52:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 20 add_watcher() i=5 2024-09-12T16:52:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 20 add_watcher() i=6 2024-09-12T16:52:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93943573026416] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 20 add_watcher() i=7 2024-09-12T16:52:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d05a0 con 0x5570f14b9b70 2024-09-12T16:52:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.193+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93943573053200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cd2f0 con 0x5570f14b9b70 2024-09-12T16:52:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.197+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93943573053200] v32'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.197+0000 7f2537fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.197+0000 7f2683cc39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.197+0000 7f2683cc39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.197+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d8dd0 con 0x5570f14b9b70 2024-09-12T16:52:14.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.197+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.197+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d9360 con 0x5570f14be540 2024-09-12T16:52:14.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.201+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.201+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d9400 con 0x5570f14c2f50 2024-09-12T16:52:14.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.201+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.201+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d9cb0 con 0x5570f14b9b70 2024-09-12T16:52:14.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.205+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.205+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d6d10 con 0x7f26740f8040 2024-09-12T16:52:14.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.205+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.205+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d6cb0 con 0x5570f14c2f50 2024-09-12T16:52:14.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.205+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.205+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d6cb0 con 0x5570f14b9b70 2024-09-12T16:52:14.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.209+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.209+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d6e80 con 0x5570f14be540 2024-09-12T16:52:14.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.213+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.213+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da7b0 con 0x7f26740f8040 2024-09-12T16:52:14.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.213+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.213+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da7b0 con 0x5570f14c2f50 2024-09-12T16:52:14.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.213+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.213+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da7b0 con 0x7f26740f8040 2024-09-12T16:52:14.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.217+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.217+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da7b0 con 0x5570f14be540 2024-09-12T16:52:14.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.217+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.217+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da7b0 con 0x7f26740f8040 2024-09-12T16:52:14.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.221+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.221+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da7b0 con 0x5570f14be540 2024-09-12T16:52:14.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.221+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.221+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da7b0 con 0x5570f14b9b70 2024-09-12T16:52:14.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.221+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.221+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da7b0 con 0x5570f14c2f50 2024-09-12T16:52:14.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.225+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.225+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da870 con 0x7f26740f8040 2024-09-12T16:52:14.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.225+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.225+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da870 con 0x5570f14c2f50 2024-09-12T16:52:14.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.229+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.229+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da860 con 0x5570f14b9b70 2024-09-12T16:52:14.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.229+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.229+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da860 con 0x5570f14b9b70 2024-09-12T16:52:14.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.233+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.233+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da860 con 0x5570f14c2f50 2024-09-12T16:52:14.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.233+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.233+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da860 con 0x7f26740f8040 2024-09-12T16:52:14.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.237+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.237+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da860 con 0x5570f14c2f50 2024-09-12T16:52:14.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.237+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.237+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da860 con 0x5570f14c2f50 2024-09-12T16:52:14.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.241+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.241+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da8a0 con 0x5570f14c2f50 2024-09-12T16:52:14.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.245+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.245+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da8a0 con 0x5570f14c2f50 2024-09-12T16:52:14.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.245+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.245+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da8c0 con 0x5570f14be540 2024-09-12T16:52:14.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.249+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.249+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da900 con 0x5570f14c2f50 2024-09-12T16:52:14.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.249+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.249+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da900 con 0x5570f14be540 2024-09-12T16:52:14.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.253+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.253+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da900 con 0x5570f14c2f50 2024-09-12T16:52:14.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.253+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.253+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da930 con 0x5570f14be540 2024-09-12T16:52:14.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14da970 con 0x7f26740f8040 2024-09-12T16:52:14.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2536fe5640 20 reqs_thread_entry: start 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2683cc39c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2683cc39c0 20 Filter name: none 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2534fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2683cc39c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2683cc39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.257+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d5fe0 con 0x7f26740f8040 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.261+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.261+0000 7f2683cc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.261+0000 7f2683cc39c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-12T16:52:14.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.261+0000 7f2683cc39c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T16:52:14.263 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T16:52:14.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.261+0000 7f2537fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:14.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.261+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93943573053200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14d4ca0 con 0x5570f14b9b70 2024-09-12T16:52:14.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.261+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93943573053200] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.261+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93943573018480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cff10 con 0x7f26740f8040 2024-09-12T16:52:14.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93943573018480] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2683cc39c0 20 remove_watcher() i=0 2024-09-12T16:52:14.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2683cc39c0 2 removed watcher, disabling cache 2024-09-12T16:52:14.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93943573022464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cff10 con 0x5570f14b9b70 2024-09-12T16:52:14.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93943573022464] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2683cc39c0 20 remove_watcher() i=1 2024-09-12T16:52:14.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93943573024800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cff10 con 0x5570f14c2f50 2024-09-12T16:52:14.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f26817c9640 1 -- 172.21.15.151:0/3256018047 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93943573024800] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26740f5040 con 0x5570f14c2f50 2024-09-12T16:52:14.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2683cc39c0 20 remove_watcher() i=2 2024-09-12T16:52:14.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.265+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93943573028688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c9020 con 0x7f26740f8040 2024-09-12T16:52:14.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.269+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93943573028688] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x7f26740f8040 2024-09-12T16:52:14.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.269+0000 7f2683cc39c0 20 remove_watcher() i=3 2024-09-12T16:52:14.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.269+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93943573033008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cff10 con 0x5570f14b9b70 2024-09-12T16:52:14.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.269+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93943573033008] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0391c0 con 0x5570f14b9b70 2024-09-12T16:52:14.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.269+0000 7f2683cc39c0 20 remove_watcher() i=4 2024-09-12T16:52:14.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.269+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93943573035728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14c9f50 con 0x5570f14be540 2024-09-12T16:52:14.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.273+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93943573035728] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.273+0000 7f2683cc39c0 20 remove_watcher() i=5 2024-09-12T16:52:14.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.273+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93943573030032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cff10 con 0x5570f14be540 2024-09-12T16:52:14.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.273+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93943573030032] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.273+0000 7f2683cc39c0 20 remove_watcher() i=6 2024-09-12T16:52:14.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93943573026416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570f14cbad0 con 0x5570f14be540 2024-09-12T16:52:14.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2681fca640 1 -- 172.21.15.151:0/3256018047 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93943573026416] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f267c03d070 con 0x5570f14be540 2024-09-12T16:52:14.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 20 remove_watcher() i=7 2024-09-12T16:52:14.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14be540 msgr2=0x5570f14c0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14be540 0x5570f14c0930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f14b9b70 msgr2=0x5570f14bc000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f14b9b70 0x5570f14bc000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f26740f8040 msgr2=0x7f26740e98d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f26740f8040 0x7f26740e98d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5570f14c2f50 msgr2=0x5570f14c5380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5570f14c2f50 0x5570f14c5380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f254c039a70 msgr2=0x7f254c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f254c039a70 0x7f254c03bf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f26740b6f80 tx=0x7f26740db000 comp rx=0 tx=0).stop 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 msgr2=0x5570f14ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2680fc8640 1 -- 172.21.15.151:0/3256018047 reap_dead start 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14ae690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f267c016fd0 tx=0x7f267c050550 comp rx=0 tx=0).stop 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 shutdown_connections 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3256018047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f14a7220 0x5570f14ae690 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 >> 172.21.15.151:0/3256018047 conn(0x5570f14a3650 msgr2=0x5570f14a1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 shutdown_connections 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3256018047 wait complete. 2024-09-12T16:52:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/2664140495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2558039a70 msgr2=0x7f255803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/2664140495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2558039a70 0x7f255803bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5570f1481330 tx=0x7f26740c0400 comp rx=0 tx=0).stop 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/2664140495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f149a920 msgr2=0x5570f149ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/2664140495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f149a920 0x5570f149ad40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5570f1481230 tx=0x7f267c018830 comp rx=0 tx=0).stop 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/2664140495 shutdown_connections 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/2664140495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2558039a70 0x7f255803bf30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/2664140495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f149a920 0x5570f149ad40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/2664140495 >> 172.21.15.151:0/2664140495 conn(0x5570f14902d0 msgr2=0x5570f14906b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/2664140495 shutdown_connections 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/2664140495 wait complete. 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14897b0 msgr2=0x5570f148bba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14897b0 0x5570f148bba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f12ff620 msgr2=0x5570f1487010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f12ff620 0x5570f1487010 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2568039ac0 msgr2=0x7f256803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2568039ac0 0x7f256803bf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f266c004180 tx=0x7f266c001340 comp rx=0 tx=0).stop 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 msgr2=0x5570f147fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.277+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f147fea0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f26740b8040 tx=0x7f2674018020 comp rx=0 tx=0).stop 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.281+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 shutdown_connections 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.281+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5570f14897b0 0x5570f148bba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.281+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5570f12ff620 0x5570f1487010 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.281+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2568039ac0 0x7f256803bf80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.281+0000 7f2683cc39c0 1 --2- 172.21.15.151:0/3237962411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5570f12ff240 0x5570f147fea0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.281+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 >> 172.21.15.151:0/3237962411 conn(0x5570f1385920 msgr2=0x5570f1472f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.281+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 shutdown_connections 2024-09-12T16:52:14.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.281+0000 7f2683cc39c0 1 -- 172.21.15.151:0/3237962411 wait complete. 2024-09-12T16:52:14.294 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T16:52:14.294 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-12T16:52:14.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-12T16:52:14.295 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-12T16:52:14.376 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:14.377 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:14.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.373+0000 7f49e8d529c0 1 Processor -- start 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e8d529c0 1 -- start start 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e8d529c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a76ddde200 0x55a76de6cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e8d529c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a76dd1e9c0 con 0x55a76de6d170 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e8d529c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55a76dd6e6d0 con 0x55a76ddde200 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e6858640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a76ddde200 0x55a76de6cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e6858640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a76ddde200 0x55a76de6cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33262/0 (socket says 172.21.15.151:33262) 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e6858640 1 -- 172.21.15.151:0/2891355380 learned_addr learned my addr 172.21.15.151:0/2891355380 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49de057640 1 --1- 172.21.15.151:0/2891355380 >> v1:172.21.15.122:6789/0 conn(0x55a76de6d170 0x55a76de6f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37926/0 (socket says 172.21.15.151:37926) 2024-09-12T16:52:14.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e6858640 1 -- 172.21.15.151:0/2891355380 >> v1:172.21.15.122:6789/0 conn(0x55a76de6d170 legacy=0x55a76de6f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e6858640 1 -- 172.21.15.151:0/2891355380 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76dd12ca0 con 0x55a76ddde200 2024-09-12T16:52:14.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.377+0000 7f49e6858640 1 --2- 172.21.15.151:0/2891355380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76de6cc30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49d800a5c0 tx=0x7f49d801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1959e1f5d29c8ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e6057640 1 -- 172.21.15.151:0/2891355380 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d80b1070 con 0x55a76ddde200 2024-09-12T16:52:14.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e6057640 1 -- 172.21.15.151:0/2891355380 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d80a8070 con 0x55a76ddde200 2024-09-12T16:52:14.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e6057640 1 -- 172.21.15.151:0/2891355380 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d80ac5b0 con 0x55a76ddde200 2024-09-12T16:52:14.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2891355380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 msgr2=0x55a76de6cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2891355380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76de6cc30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49d800a5c0 tx=0x7f49d801b340 comp rx=0 tx=0).stop 2024-09-12T16:52:14.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2891355380 shutdown_connections 2024-09-12T16:52:14.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2891355380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76de6cc30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2891355380 >> 172.21.15.151:0/2891355380 conn(0x55a76de64920 msgr2=0x55a76de66d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2891355380 shutdown_connections 2024-09-12T16:52:14.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.381+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2891355380 wait complete. 2024-09-12T16:52:14.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 Processor -- start 2024-09-12T16:52:14.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- start start 2024-09-12T16:52:14.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a76dd72680 con 0x55a76ddde200 2024-09-12T16:52:14.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e6858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e6858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33272/0 (socket says 172.21.15.151:33272) 2024-09-12T16:52:14.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e6858640 1 -- 172.21.15.151:0/2472103513 learned_addr learned my addr 172.21.15.151:0/2472103513 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e6858640 1 -- 172.21.15.151:0/2472103513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76dcedda0 con 0x55a76ddde200 2024-09-12T16:52:14.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e6858640 1 --2- 172.21.15.151:0/2472103513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df557b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49d80af040 tx=0x7f49d8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff87686627c8c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f48d4e09640 1 -- 172.21.15.151:0/2472103513 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d80b1040 con 0x55a76ddde200 2024-09-12T16:52:14.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f48d4e09640 1 -- 172.21.15.151:0/2472103513 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d80ac820 con 0x55a76ddde200 2024-09-12T16:52:14.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f48d4e09640 1 -- 172.21.15.151:0/2472103513 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d80acb00 con 0x55a76ddde200 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2472103513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 msgr2=0x55a76df557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2472103513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df557b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49d80af040 tx=0x7f49d8003030 comp rx=0 tx=0).stop 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2472103513 shutdown_connections 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2472103513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df557b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2472103513 >> 172.21.15.151:0/2472103513 conn(0x55a76de64920 msgr2=0x55a76df513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2472103513 shutdown_connections 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2472103513 wait complete. 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 Processor -- start 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- start start 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df5ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.397+0000 7f49e8d529c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a76dd14a50 con 0x55a76ddde200 2024-09-12T16:52:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e6858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df5ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e6858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df5ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33274/0 (socket says 172.21.15.151:33274) 2024-09-12T16:52:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e6858640 1 -- 172.21.15.151:0/2374598696 learned_addr learned my addr 172.21.15.151:0/2374598696 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e6858640 1 -- 172.21.15.151:0/2374598696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76df5d360 con 0x55a76ddde200 2024-09-12T16:52:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e6858640 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df5ce00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f49d801b820 tx=0x7f49d80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f48d3606640 1 -- 172.21.15.151:0/2374598696 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d80b1050 con 0x55a76ddde200 2024-09-12T16:52:14.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f48d3606640 1 -- 172.21.15.151:0/2374598696 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d80b7750 con 0x55a76ddde200 2024-09-12T16:52:14.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a76df5d5f0 con 0x55a76ddde200 2024-09-12T16:52:14.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f48d3606640 1 -- 172.21.15.151:0/2374598696 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d80b7a50 con 0x55a76ddde200 2024-09-12T16:52:14.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76df5e020 con 0x55a76ddde200 2024-09-12T16:52:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f48d3606640 1 -- 172.21.15.151:0/2374598696 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f49d80aa070 con 0x55a76ddde200 2024-09-12T16:52:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f48d3606640 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48cc039a70 0x7f48cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f48d3606640 1 -- 172.21.15.151:0/2374598696 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f49d80eb120 con 0x55a76ddde200 2024-09-12T16:52:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49de057640 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48cc039a70 0x7f48cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76de6d170 0x55a76df63f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df644b0 con 0x55a76de6d170 2024-09-12T16:52:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e7059640 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76de6d170 0x55a76df63f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49de057640 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48cc039a70 0x7f48cc03bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f49d0001e40 tx=0x7f49d00013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.401+0000 7f49e7059640 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76de6d170 0x55a76df63f70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e7059640 1 -- 172.21.15.151:0/2374598696 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49e000a4d0 con 0x55a76de6d170 2024-09-12T16:52:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df5e320 con 0x55a76de6d170 2024-09-12T16:52:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e7059640 1 -- 172.21.15.151:0/2374598696 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49e000a4d0 con 0x55a76de6d170 2024-09-12T16:52:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df66750 0x55a76df68b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df69210 con 0x55a76df66750 2024-09-12T16:52:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e6858640 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df66750 0x55a76df68b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e6858640 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df66750 0x55a76df68b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e6858640 1 -- 172.21.15.151:0/2374598696 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f49d80be070 con 0x55a76df66750 2024-09-12T16:52:14.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df655f0 con 0x55a76de6d170 2024-09-12T16:52:14.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e7059640 1 -- 172.21.15.151:0/2374598696 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49e000a4d0 con 0x55a76de6d170 2024-09-12T16:52:14.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df65a90 con 0x55a76de6d170 2024-09-12T16:52:14.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.405+0000 7f49e7059640 1 -- 172.21.15.151:0/2374598696 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f49e000a4d0 con 0x55a76de6d170 2024-09-12T16:52:14.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e8d529c0 1 Processor -- start 2024-09-12T16:52:14.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e8d529c0 1 -- start start 2024-09-12T16:52:14.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e8d529c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76df778a0 0x55a76df77cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e8d529c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a76dd7f450 con 0x55a76df778a0 2024-09-12T16:52:14.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e7059640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76df778a0 0x55a76df77cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e7059640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76df778a0 0x55a76df77cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33288/0 (socket says 172.21.15.151:33288) 2024-09-12T16:52:14.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e7059640 1 -- 172.21.15.151:0/946838273 learned_addr learned my addr 172.21.15.151:0/946838273 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e7059640 1 -- 172.21.15.151:0/946838273 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76df78300 con 0x55a76df778a0 2024-09-12T16:52:14.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e7059640 1 --2- 172.21.15.151:0/946838273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76df778a0 0x55a76df77cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55a76df5d840 tx=0x7f49e0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f48d0e01640 1 -- 172.21.15.151:0/946838273 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e0014450 con 0x55a76df778a0 2024-09-12T16:52:14.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e8d529c0 1 -- 172.21.15.151:0/946838273 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a76df78b60 con 0x55a76df778a0 2024-09-12T16:52:14.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f48d0e01640 1 -- 172.21.15.151:0/946838273 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e0014610 con 0x55a76df778a0 2024-09-12T16:52:14.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f48d0e01640 1 -- 172.21.15.151:0/946838273 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e0014930 con 0x55a76df778a0 2024-09-12T16:52:14.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e8d529c0 1 -- 172.21.15.151:0/946838273 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76df790d0 con 0x55a76df778a0 2024-09-12T16:52:14.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f48d0e01640 1 -- 172.21.15.151:0/946838273 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f49e0011040 con 0x55a76df778a0 2024-09-12T16:52:14.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f48d0e01640 1 --2- 172.21.15.151:0/946838273 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48c0039ac0 0x7f48c003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f48d0e01640 1 -- 172.21.15.151:0/946838273 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f49e001e070 con 0x55a76df778a0 2024-09-12T16:52:14.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e6858640 1 --2- 172.21.15.151:0/946838273 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48c0039ac0 0x7f48c003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e8d529c0 1 Processor -- start 2024-09-12T16:52:14.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e8d529c0 1 -- start start 2024-09-12T16:52:14.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.409+0000 7f49e6858640 1 --2- 172.21.15.151:0/946838273 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48c0039ac0 0x7f48c003bf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55a76df64880 tx=0x7f49d80d3da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76de68ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a76df55fa0 con 0x55a76de68bf0 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76de68ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76de68ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33302/0 (socket says 172.21.15.151:33302) 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 -- 172.21.15.151:0/2690686701 learned_addr learned my addr 172.21.15.151:0/2690686701 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 -- 172.21.15.151:0/2690686701 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76de69530 con 0x55a76de68bf0 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 --2- 172.21.15.151:0/2690686701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76de68ff0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f49e002bfb0 tx=0x7f49e0049f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11904344661fd2f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f48ca7fc640 1 -- 172.21.15.151:0/2690686701 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e0011d50 con 0x55a76de68bf0 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f48ca7fc640 1 -- 172.21.15.151:0/2690686701 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e00167c0 con 0x55a76de68bf0 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f48ca7fc640 1 -- 172.21.15.151:0/2690686701 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e0011330 con 0x55a76de68bf0 2024-09-12T16:52:14.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2690686701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 msgr2=0x55a76de68ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2690686701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76de68ff0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f49e002bfb0 tx=0x7f49e0049f50 comp rx=0 tx=0).stop 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2690686701 shutdown_connections 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2690686701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76de68ff0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2690686701 >> 172.21.15.151:0/2690686701 conn(0x55a76df80590 msgr2=0x55a76df7e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2690686701 shutdown_connections 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2690686701 wait complete. 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 Processor -- start 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 -- start start 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76df8d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e8d529c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a76de69a80 con 0x55a76de68bf0 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76df8d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76df8d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33310/0 (socket says 172.21.15.151:33310) 2024-09-12T16:52:14.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 learned_addr learned my addr 172.21.15.151:0/2938144329 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76df8ddb0 con 0x55a76de68bf0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.413+0000 7f49e7059640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76df8d850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f49e0022bf0 tx=0x7f49e00504e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f48c8ff9640 1 -- 172.21.15.151:0/2938144329 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e0031070 con 0x55a76de68bf0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f48c8ff9640 1 -- 172.21.15.151:0/2938144329 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e0011330 con 0x55a76de68bf0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a76df8e040 con 0x55a76de68bf0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f48c8ff9640 1 -- 172.21.15.151:0/2938144329 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e0050960 con 0x55a76de68bf0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76df8e9f0 con 0x55a76de68bf0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f48c8ff9640 1 -- 172.21.15.151:0/2938144329 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f49e0053020 con 0x55a76de68bf0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f48c8ff9640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48b0039a70 0x7f48b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f48c8ff9640 1 -- 172.21.15.151:0/2938144329 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f49e000e040 con 0x55a76de68bf0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e6858640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48b0039a70 0x7f48b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76df98d30 0x55a76df9b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df9b940 con 0x55a76df98d30 2024-09-12T16:52:14.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49de057640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76df98d30 0x55a76df9b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e6858640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48b0039a70 0x7f48b003bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f49d80b5500 tx=0x7f49d80df000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49de057640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76df98d30 0x55a76df9b1f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d000f620 con 0x55a76df98d30 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 20 realm 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df98080 con 0x55a76df98d30 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d000f620 con 0x55a76df98d30 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df9c440 con 0x55a76df98d30 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d000f620 con 0x55a76df98d30 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.417+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76df9cd10 con 0x55a76df98d30 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49d000f620 con 0x55a76df98d30 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e8d529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df9d730 0x55a76df9fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa0260 con 0x55a76df9d730 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e7059640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df9d730 0x55a76df9fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e7059640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df9d730 0x55a76df9fb20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e8d529c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e8d529c0 20 searching for the correct realm 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a76dfa21b0 0x55a76dfa45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e6858640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a76dfa21b0 0x55a76dfa45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e6858640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a76dfa21b0 0x55a76dfa45c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e6858640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f49d80f8040 0x7f49d80065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x7f49d80f8040 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49de057640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f49d80f8040 0x7f49d80065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49de057640 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f49d80f8040 0x7f49d80065b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d000f620 con 0x7f49d80f8040 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.421+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df98d30 2024-09-12T16:52:14.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d000f620 con 0x55a76df98d30 2024-09-12T16:52:14.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df98d30 2024-09-12T16:52:14.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x7f49d80f8040 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df98d30 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df98d30 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.425+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x7f49d80f8040 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df98d30 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df98d30 2024-09-12T16:52:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.429+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x7f49d80f8040 2024-09-12T16:52:14.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df98d30 2024-09-12T16:52:14.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x7f49d80f8040 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76dfa21b0 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df9d730 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x55a76df98d30 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.433+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa4c90 con 0x7f49d80f8040 2024-09-12T16:52:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa0c20 con 0x55a76df98d30 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa14c0 con 0x55a76df98d30 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa0860 con 0x55a76df98d30 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 zone default found 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 4 Realm: () 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 zonegroup default 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa5110 con 0x55a76df9d730 2024-09-12T16:52:14.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa73f0 con 0x55a76dfa21b0 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa7790 con 0x55a76dfa21b0 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 started sync module instance, tier type = 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa6880 con 0x7f49d80f8040 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.437+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.441+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94177593028000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa6880 con 0x7f49d80f8040 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.441+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa8260 con 0x55a76df98d30 2024-09-12T16:52:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.441+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94177593028000] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.441+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.441+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94177593032048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa6880 con 0x55a76df98d30 2024-09-12T16:52:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.441+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa8ca0 con 0x55a76dfa21b0 2024-09-12T16:52:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94177593032048] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94177593025488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa67f0 con 0x55a76dfa21b0 2024-09-12T16:52:14.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa99f0 con 0x7f49d80f8040 2024-09-12T16:52:14.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94177593038448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfaa290 con 0x7f49d80f8040 2024-09-12T16:52:14.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfaac90 con 0x55a76df98d30 2024-09-12T16:52:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94177593025488] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94177593038448] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94177593036944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa9d70 con 0x55a76df98d30 2024-09-12T16:52:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.445+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfab530 con 0x55a76df9d730 2024-09-12T16:52:14.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.449+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94177593036944] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.449+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.449+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94177593045120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfa9d70 con 0x55a76df9d730 2024-09-12T16:52:14.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.449+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfabd80 con 0x55a76df9d730 2024-09-12T16:52:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94177593045120] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94177593042848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfabd80 con 0x55a76df9d730 2024-09-12T16:52:14.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfac7a0 con 0x55a76df9d730 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94177593042848] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94177593049744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfac760 con 0x55a76df9d730 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 20 add_watcher() i=0 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 20 add_watcher() i=1 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 20 add_watcher() i=2 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 20 add_watcher() i=3 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 20 add_watcher() i=4 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 20 add_watcher() i=5 2024-09-12T16:52:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.453+0000 7f49e8d529c0 20 add_watcher() i=6 2024-09-12T16:52:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94177593049744] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49e8d529c0 20 add_watcher() i=7 2024-09-12T16:52:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49e8d529c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfafbc0 con 0x55a76df98d30 2024-09-12T16:52:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94177593047248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfad0e0 con 0x55a76df98d30 2024-09-12T16:52:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94177593047248] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f489d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49e8d529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49e8d529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.457+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb8410 con 0x55a76df98d30 2024-09-12T16:52:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.461+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.461+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb8a40 con 0x55a76df9d730 2024-09-12T16:52:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.461+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.461+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb8a20 con 0x55a76dfa21b0 2024-09-12T16:52:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.465+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.465+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb9310 con 0x55a76df98d30 2024-09-12T16:52:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.465+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.465+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb6280 con 0x7f49d80f8040 2024-09-12T16:52:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.465+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.465+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb6280 con 0x55a76dfa21b0 2024-09-12T16:52:14.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.469+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.469+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb9e70 con 0x55a76df98d30 2024-09-12T16:52:14.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.469+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.469+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb9e70 con 0x55a76df9d730 2024-09-12T16:52:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.473+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.473+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb9f80 con 0x7f49d80f8040 2024-09-12T16:52:14.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.473+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.473+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb9f80 con 0x55a76dfa21b0 2024-09-12T16:52:14.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.477+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.477+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba070 con 0x7f49d80f8040 2024-09-12T16:52:14.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.477+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.477+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba070 con 0x55a76df9d730 2024-09-12T16:52:14.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.481+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.481+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba210 con 0x7f49d80f8040 2024-09-12T16:52:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.481+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.481+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba1e0 con 0x55a76df9d730 2024-09-12T16:52:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.485+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.485+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba270 con 0x55a76df98d30 2024-09-12T16:52:14.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.489+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.489+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba270 con 0x55a76dfa21b0 2024-09-12T16:52:14.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.489+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.489+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x7f49d80f8040 2024-09-12T16:52:14.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.493+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.493+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x55a76dfa21b0 2024-09-12T16:52:14.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.497+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.497+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x55a76df98d30 2024-09-12T16:52:14.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.497+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.497+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x55a76df98d30 2024-09-12T16:52:14.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.501+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.501+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x55a76dfa21b0 2024-09-12T16:52:14.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.501+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.501+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x7f49d80f8040 2024-09-12T16:52:14.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.505+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.505+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x55a76dfa21b0 2024-09-12T16:52:14.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.505+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.505+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x55a76dfa21b0 2024-09-12T16:52:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.509+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.509+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x55a76dfa21b0 2024-09-12T16:52:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.509+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.509+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba440 con 0x55a76dfa21b0 2024-09-12T16:52:14.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.513+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.513+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba490 con 0x55a76df9d730 2024-09-12T16:52:14.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.513+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.513+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba4d0 con 0x55a76dfa21b0 2024-09-12T16:52:14.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.513+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.513+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba500 con 0x55a76df9d730 2024-09-12T16:52:14.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.517+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.517+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba500 con 0x55a76dfa21b0 2024-09-12T16:52:14.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.521+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.521+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba500 con 0x55a76df9d730 2024-09-12T16:52:14.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.521+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.521+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfba500 con 0x7f49d80f8040 2024-09-12T16:52:14.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f4817fff640 20 reqs_thread_entry: start 2024-09-12T16:52:14.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e8d529c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:14.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e8d529c0 20 Filter name: none 2024-09-12T16:52:14.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f4815ffb640 20 reqs_thread_entry: start 2024-09-12T16:52:14.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e8d529c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T16:52:14.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e8d529c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x55a76df9d730 2024-09-12T16:52:14.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e8d529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e8d529c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-12T16:52:14.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f49e8d529c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T16:52:14.531 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T16:52:14.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.525+0000 7f489d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:14.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.529+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94177593047248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x55a76df98d30 2024-09-12T16:52:14.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.529+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94177593047248] v32'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.529+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94177593028000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x7f49d80f8040 2024-09-12T16:52:14.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.529+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94177593028000] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.529+0000 7f49e8d529c0 20 remove_watcher() i=0 2024-09-12T16:52:14.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.529+0000 7f49e8d529c0 2 removed watcher, disabling cache 2024-09-12T16:52:14.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.529+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94177593032048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x55a76df98d30 2024-09-12T16:52:14.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.533+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94177593032048] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.533+0000 7f49e8d529c0 20 remove_watcher() i=1 2024-09-12T16:52:14.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.533+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94177593025488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x55a76dfa21b0 2024-09-12T16:52:14.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.533+0000 7f49e6858640 1 -- 172.21.15.151:0/2938144329 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94177593025488] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d80be070 con 0x55a76dfa21b0 2024-09-12T16:52:14.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.533+0000 7f49e8d529c0 20 remove_watcher() i=2 2024-09-12T16:52:14.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.533+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94177593038448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x7f49d80f8040 2024-09-12T16:52:14.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.537+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94177593038448] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x7f49d80f8040 2024-09-12T16:52:14.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.537+0000 7f49e8d529c0 20 remove_watcher() i=3 2024-09-12T16:52:14.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.537+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94177593036944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x55a76df98d30 2024-09-12T16:52:14.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.537+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94177593036944] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d002b040 con 0x55a76df98d30 2024-09-12T16:52:14.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.537+0000 7f49e8d529c0 20 remove_watcher() i=4 2024-09-12T16:52:14.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.537+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94177593045120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x55a76df9d730 2024-09-12T16:52:14.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.541+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94177593045120] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.541+0000 7f49e8d529c0 20 remove_watcher() i=5 2024-09-12T16:52:14.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.541+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94177593042848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x55a76df9d730 2024-09-12T16:52:14.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.541+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94177593042848] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.541+0000 7f49e8d529c0 20 remove_watcher() i=6 2024-09-12T16:52:14.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.541+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94177593049744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a76dfb5910 con 0x55a76df9d730 2024-09-12T16:52:14.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e7059640 1 -- 172.21.15.151:0/2938144329 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94177593049744] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49e0033030 con 0x55a76df9d730 2024-09-12T16:52:14.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 20 remove_watcher() i=7 2024-09-12T16:52:14.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df9d730 msgr2=0x55a76df9fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df9d730 0x55a76df9fb20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76df98d30 msgr2=0x55a76df9b1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76df98d30 0x55a76df9b1f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f49d80f8040 msgr2=0x7f49d80065b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f49d80f8040 0x7f49d80065b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a76dfa21b0 msgr2=0x55a76dfa45c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a76dfa21b0 0x55a76dfa45c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48b0039a70 msgr2=0x7f48b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48b0039a70 0x7f48b003bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f49d80b5500 tx=0x7f49d80df000 comp rx=0 tx=0).stop 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 msgr2=0x55a76df8d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76df8d850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f49e0022bf0 tx=0x7f49e00504e0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49de057640 1 -- 172.21.15.151:0/2938144329 reap_dead start 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 shutdown_connections 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2938144329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76de68bf0 0x55a76df8d850 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 >> 172.21.15.151:0/2938144329 conn(0x55a76df80590 msgr2=0x55a76df7e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 shutdown_connections 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2938144329 wait complete. 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/946838273 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48c0039ac0 msgr2=0x7f48c003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/946838273 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48c0039ac0 0x7f48c003bf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55a76df64880 tx=0x7f49d80d3da0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/946838273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76df778a0 msgr2=0x55a76df77cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/946838273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76df778a0 0x55a76df77cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55a76df5d840 tx=0x7f49e0018830 comp rx=0 tx=0).stop 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/946838273 shutdown_connections 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/946838273 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48c0039ac0 0x7f48c003bf80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/946838273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76df778a0 0x55a76df77cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/946838273 >> 172.21.15.151:0/946838273 conn(0x55a76df6d250 msgr2=0x55a76df6d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/946838273 shutdown_connections 2024-09-12T16:52:14.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/946838273 wait complete. 2024-09-12T16:52:14.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df66750 msgr2=0x55a76df68b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df66750 0x55a76df68b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76de6d170 msgr2=0x55a76df63f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76de6d170 0x55a76df63f70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48cc039a70 msgr2=0x7f48cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48cc039a70 0x7f48cc03bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f49d0001e40 tx=0x7f49d00013a0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 msgr2=0x55a76df5ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df5ce00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f49d801b820 tx=0x7f49d80180e0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 shutdown_connections 2024-09-12T16:52:14.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a76df66750 0x55a76df68b40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a76de6d170 0x55a76df63f70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f48cc039a70 0x7f48cc03bf30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 --2- 172.21.15.151:0/2374598696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a76ddde200 0x55a76df5ce00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 >> 172.21.15.151:0/2374598696 conn(0x55a76de64920 msgr2=0x55a76df4fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 shutdown_connections 2024-09-12T16:52:14.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.545+0000 7f49e8d529c0 1 -- 172.21.15.151:0/2374598696 wait complete. 2024-09-12T16:52:14.559 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T16:52:14.560 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T16:52:14.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T16:52:14.561 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T16:52:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f462aefa9c0 1 Processor -- start 2024-09-12T16:52:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f462aefa9c0 1 -- start start 2024-09-12T16:52:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f462aefa9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55635d2bd5e0 0x55635d351760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f462aefa9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55635d1fd9c0 con 0x55635d2bd200 2024-09-12T16:52:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f462aefa9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55635d24d6d0 con 0x55635d2bd5e0 2024-09-12T16:52:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f46281ff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55635d2bd5e0 0x55635d351760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f4628a00640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55635d2bd200 0x55635d34e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37942/0 (socket says 172.21.15.151:37942) 2024-09-12T16:52:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f4628a00640 1 -- 172.21.15.151:0/256345606 learned_addr learned my addr 172.21.15.151:0/256345606 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f46281ff640 1 -- 172.21.15.151:0/256345606 >> v1:172.21.15.122:6789/0 conn(0x55635d2bd200 legacy=0x55635d34e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.649+0000 7f46281ff640 1 -- 172.21.15.151:0/256345606 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635d1f1ca0 con 0x55635d2bd5e0 2024-09-12T16:52:14.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f46281ff640 1 --2- 172.21.15.151:0/256345606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd5e0 0x55635d351760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f461c00a480 tx=0x7f461c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339373a75ccedd1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f46279fe640 1 -- 172.21.15.151:0/256345606 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f461c0b0070 con 0x55635d2bd5e0 2024-09-12T16:52:14.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f46279fe640 1 -- 172.21.15.151:0/256345606 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f461c0ab540 con 0x55635d2bd5e0 2024-09-12T16:52:14.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f46279fe640 1 -- 172.21.15.151:0/256345606 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f461c0ab840 con 0x55635d2bd5e0 2024-09-12T16:52:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f462aefa9c0 1 -- 172.21.15.151:0/256345606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd5e0 msgr2=0x55635d351760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/256345606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd5e0 0x55635d351760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f461c00a480 tx=0x7f461c01b280 comp rx=0 tx=0).stop 2024-09-12T16:52:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f462aefa9c0 1 -- 172.21.15.151:0/256345606 shutdown_connections 2024-09-12T16:52:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/256345606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd5e0 0x55635d351760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f462aefa9c0 1 -- 172.21.15.151:0/256345606 >> 172.21.15.151:0/256345606 conn(0x55635d343920 msgr2=0x55635d345d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f462aefa9c0 1 -- 172.21.15.151:0/256345606 shutdown_connections 2024-09-12T16:52:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.653+0000 7f462aefa9c0 1 -- 172.21.15.151:0/256345606 wait complete. 2024-09-12T16:52:14.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f462aefa9c0 1 Processor -- start 2024-09-12T16:52:14.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f462aefa9c0 1 -- start start 2024-09-12T16:52:14.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f462aefa9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d436940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f462aefa9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55635d251680 con 0x55635d2bd200 2024-09-12T16:52:14.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f4628a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d436940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f4628a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d436940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33332/0 (socket says 172.21.15.151:33332) 2024-09-12T16:52:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f4628a00640 1 -- 172.21.15.151:0/7937149 learned_addr learned my addr 172.21.15.151:0/7937149 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f4628a00640 1 -- 172.21.15.151:0/7937149 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635d1ccda0 con 0x55635d2bd200 2024-09-12T16:52:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f4628a00640 1 --2- 172.21.15.151:0/7937149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d436940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4618001810 tx=0x7f4618001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837cba08d542725f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f4516e0d640 1 -- 172.21.15.151:0/7937149 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4618004530 con 0x55635d2bd200 2024-09-12T16:52:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f4516e0d640 1 -- 172.21.15.151:0/7937149 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46180046d0 con 0x55635d2bd200 2024-09-12T16:52:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.669+0000 7f4516e0d640 1 -- 172.21.15.151:0/7937149 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46180049f0 con 0x55635d2bd200 2024-09-12T16:52:14.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- 172.21.15.151:0/7937149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 msgr2=0x55635d436940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/7937149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d436940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4618001810 tx=0x7f4618001cd0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- 172.21.15.151:0/7937149 shutdown_connections 2024-09-12T16:52:14.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/7937149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d436940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- 172.21.15.151:0/7937149 >> 172.21.15.151:0/7937149 conn(0x55635d343920 msgr2=0x55635d432580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- 172.21.15.151:0/7937149 shutdown_connections 2024-09-12T16:52:14.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- 172.21.15.151:0/7937149 wait complete. 2024-09-12T16:52:14.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 Processor -- start 2024-09-12T16:52:14.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- start start 2024-09-12T16:52:14.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d43dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55635d1f3a50 con 0x55635d2bd200 2024-09-12T16:52:14.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f4628a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d43dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f4628a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d43dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33340/0 (socket says 172.21.15.151:33340) 2024-09-12T16:52:14.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f4628a00640 1 -- 172.21.15.151:0/964178230 learned_addr learned my addr 172.21.15.151:0/964178230 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f4628a00640 1 -- 172.21.15.151:0/964178230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635d43e520 con 0x55635d2bd200 2024-09-12T16:52:14.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f4628a00640 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d43dfc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4618000f90 tx=0x7f4618001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f451560a640 1 -- 172.21.15.151:0/964178230 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4618013820 con 0x55635d2bd200 2024-09-12T16:52:14.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f451560a640 1 -- 172.21.15.151:0/964178230 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46180139c0 con 0x55635d2bd200 2024-09-12T16:52:14.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55635d43e7b0 con 0x55635d2bd200 2024-09-12T16:52:14.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f451560a640 1 -- 172.21.15.151:0/964178230 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4618013ce0 con 0x55635d2bd200 2024-09-12T16:52:14.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.673+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55635d43f160 con 0x55635d2bd200 2024-09-12T16:52:14.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f451560a640 1 -- 172.21.15.151:0/964178230 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4618010070 con 0x55635d2bd200 2024-09-12T16:52:14.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f451560a640 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4510039a70 0x7f451003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f451560a640 1 -- 172.21.15.151:0/964178230 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4618018070 con 0x55635d2bd200 2024-09-12T16:52:14.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f46281ff640 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4510039a70 0x7f451003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d2bd5e0 0x55635d445130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d445670 con 0x55635d2bd5e0 2024-09-12T16:52:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f4629201640 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d2bd5e0 0x55635d445130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f46281ff640 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4510039a70 0x7f451003bf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f461c0ad000 tx=0x7f461c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f4629201640 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d2bd5e0 0x55635d445130 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f4629201640 1 -- 172.21.15.151:0/964178230 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46200083f0 con 0x55635d2bd5e0 2024-09-12T16:52:14.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d445aa0 con 0x55635d2bd5e0 2024-09-12T16:52:14.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f4629201640 1 -- 172.21.15.151:0/964178230 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46200083f0 con 0x55635d2bd5e0 2024-09-12T16:52:14.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d4478b0 0x55635d449ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d44a370 con 0x55635d4478b0 2024-09-12T16:52:14.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f4628a00640 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d4478b0 0x55635d449ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f4628a00640 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d4478b0 0x55635d449ca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.677+0000 7f4628a00640 1 -- 172.21.15.151:0/964178230 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f461801b030 con 0x55635d4478b0 2024-09-12T16:52:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d446750 con 0x55635d2bd5e0 2024-09-12T16:52:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f4629201640 1 -- 172.21.15.151:0/964178230 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46200083f0 con 0x55635d2bd5e0 2024-09-12T16:52:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d446bf0 con 0x55635d2bd5e0 2024-09-12T16:52:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f4629201640 1 -- 172.21.15.151:0/964178230 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46200083f0 con 0x55635d2bd5e0 2024-09-12T16:52:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f462aefa9c0 1 Processor -- start 2024-09-12T16:52:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f462aefa9c0 1 -- start start 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f462aefa9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4589e0 0x55635d458e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f462aefa9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55635d25e450 con 0x55635d4589e0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f4629201640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4589e0 0x55635d458e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f4629201640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4589e0 0x55635d458e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33350/0 (socket says 172.21.15.151:33350) 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f4629201640 1 -- 172.21.15.151:0/3481878897 learned_addr learned my addr 172.21.15.151:0/3481878897 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f4629201640 1 -- 172.21.15.151:0/3481878897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635d459440 con 0x55635d4589e0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f4629201640 1 --2- 172.21.15.151:0/3481878897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4589e0 0x55635d458e00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55635d4400c0 tx=0x7f462000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f450e7fc640 1 -- 172.21.15.151:0/3481878897 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4620007e00 con 0x55635d4589e0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f450e7fc640 1 -- 172.21.15.151:0/3481878897 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462001e020 con 0x55635d4589e0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f450e7fc640 1 -- 172.21.15.151:0/3481878897 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4620019590 con 0x55635d4589e0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3481878897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55635d459ca0 con 0x55635d4589e0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.681+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3481878897 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55635d45a210 con 0x55635d4589e0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f450e7fc640 1 -- 172.21.15.151:0/3481878897 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4620016040 con 0x55635d4589e0 2024-09-12T16:52:14.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f450e7fc640 1 --2- 172.21.15.151:0/3481878897 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4500039ac0 0x7f450003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f450e7fc640 1 -- 172.21.15.151:0/3481878897 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f462001f030 con 0x55635d4589e0 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f4628a00640 1 --2- 172.21.15.151:0/3481878897 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4500039ac0 0x7f450003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 Processor -- start 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 -- start start 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f4628a00640 1 --2- 172.21.15.151:0/3481878897 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4500039ac0 0x7f450003bf80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55635d43f450 tx=0x7f461804e9d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d4666b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55635d437190 con 0x55635d4662d0 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f4629201640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d4666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f4629201640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d4666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33364/0 (socket says 172.21.15.151:33364) 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f4629201640 1 -- 172.21.15.151:0/3783474222 learned_addr learned my addr 172.21.15.151:0/3783474222 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f4629201640 1 -- 172.21.15.151:0/3783474222 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635d466c80 con 0x55635d4662d0 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f4629201640 1 --2- 172.21.15.151:0/3783474222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d4666b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4620023fb0 tx=0x7f4620023970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8987bcdab6e2bf46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f44fffff640 1 -- 172.21.15.151:0/3783474222 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f462001d040 con 0x55635d4662d0 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f44fffff640 1 -- 172.21.15.151:0/3783474222 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620017470 con 0x55635d4662d0 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f44fffff640 1 -- 172.21.15.151:0/3783474222 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4620019d80 con 0x55635d4662d0 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3783474222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 msgr2=0x55635d4666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/3783474222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d4666b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4620023fb0 tx=0x7f4620023970 comp rx=0 tx=0).stop 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3783474222 shutdown_connections 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/3783474222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d4666b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3783474222 >> 172.21.15.151:0/3783474222 conn(0x55635d4616f0 msgr2=0x55635d45f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3783474222 shutdown_connections 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3783474222 wait complete. 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.685+0000 7f462aefa9c0 1 Processor -- start 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f462aefa9c0 1 -- start start 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f462aefa9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d46c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f462aefa9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55635d465220 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f4629201640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d46c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f4629201640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d46c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33374/0 (socket says 172.21.15.151:33374) 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 learned_addr learned my addr 172.21.15.151:0/1091976935 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635d46cd20 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f4629201640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d46c7c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4620023fb0 tx=0x7f46200508e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f44fe7fc640 1 -- 172.21.15.151:0/1091976935 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f462001d070 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f44fe7fc640 1 -- 172.21.15.151:0/1091976935 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620049040 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f44fe7fc640 1 -- 172.21.15.151:0/1091976935 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4620017470 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55635d46cfb0 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55635d46d960 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f44fe7fc640 1 -- 172.21.15.151:0/1091976935 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f462003ed10 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f44fe7fc640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f44f4039a20 0x7f44f403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f44fe7fc640 1 -- 172.21.15.151:0/1091976935 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4620038c90 con 0x55635d4662d0 2024-09-12T16:52:14.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f4628a00640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f44f4039a20 0x7f44f403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d477a20 0x55635d479ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d47a630 con 0x55635d477a20 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f46281ff640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d477a20 0x55635d479ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.689+0000 7f4628a00640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f44f4039a20 0x7f44f403bee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f461802afd0 tx=0x7f4618039000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f46281ff640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d477a20 0x55635d479ee0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 realm 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d47aa00 con 0x55635d477a20 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d47b2d0 con 0x55635d477a20 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d47b670 con 0x55635d477a20 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d47c3d0 0x55635d47e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d47edd0 con 0x55635d47c3d0 2024-09-12T16:52:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f4629201640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d47c3d0 0x55635d47e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f4629201640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d47c3d0 0x55635d47e7c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:14.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 20 searching for the correct realm 2024-09-12T16:52:14.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55635d480d20 0x55635d483150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f4628a00640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55635d480d20 0x55635d483150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.693+0000 7f4628a00640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55635d480d20 0x55635d483150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4628a00640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f46180123c0 0x7f4618029650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x7f46180123c0 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f46180123c0 0x7f4618029650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f46180123c0 0x7f4618029650 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d477a20 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d477a20 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x7f46180123c0 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.697+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d477a20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d477a20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x7f46180123c0 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d477a20 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d477a20 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.701+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x7f46180123c0 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d477a20 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x7f46180123c0 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d480d20 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.705+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d47c3d0 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x55635d477a20 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55635d4837d0 con 0x7f46180123c0 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d47f790 con 0x55635d477a20 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d47f3d0 con 0x55635d477a20 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d4800b0 con 0x55635d477a20 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 zone default found 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 4 Realm: () 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 zonegroup default 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d4800b0 con 0x55635d47c3d0 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d485b40 con 0x55635d480d20 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d485ee0 con 0x55635d480d20 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 started sync module instance, tier type = 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.709+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d484fd0 con 0x7f46180123c0 2024-09-12T16:52:14.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.713+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.713+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93885255144656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d484fd0 con 0x7f46180123c0 2024-09-12T16:52:14.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.713+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4869f0 con 0x55635d477a20 2024-09-12T16:52:14.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.713+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93885255144656] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.713+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.713+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93885255148768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d484fd0 con 0x55635d477a20 2024-09-12T16:52:14.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.713+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d487400 con 0x55635d480d20 2024-09-12T16:52:14.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.717+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.717+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93885255151440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d487c50 con 0x55635d480d20 2024-09-12T16:52:14.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.717+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d488610 con 0x7f46180123c0 2024-09-12T16:52:14.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.717+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93885255148768] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.717+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.717+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93885255142176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d488610 con 0x7f46180123c0 2024-09-12T16:52:14.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.717+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d489020 con 0x55635d477a20 2024-09-12T16:52:14.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.717+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93885255151440] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.721+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.721+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93885255153568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d489020 con 0x55635d477a20 2024-09-12T16:52:14.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.721+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4898b0 con 0x55635d47c3d0 2024-09-12T16:52:14.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.721+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93885255142176] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.721+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.721+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93885255159840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d489440 con 0x55635d47c3d0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.721+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d48a600 con 0x55635d47c3d0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.725+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93885255153568] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.725+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.725+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93885255158640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d48a600 con 0x55635d47c3d0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.725+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d48b000 con 0x55635d47c3d0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93885255166736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d48b440 con 0x55635d47c3d0 2024-09-12T16:52:14.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 20 add_watcher() i=0 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 20 add_watcher() i=1 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 20 add_watcher() i=2 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 20 add_watcher() i=3 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 20 add_watcher() i=4 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 93885255159840] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 20 add_watcher() i=5 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93885255158640] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 20 add_watcher() i=6 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93885255166736] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 20 add_watcher() i=7 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d489ca0 con 0x55635d477a20 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93885255163040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d48a130 con 0x55635d477a20 2024-09-12T16:52:14.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93885255163040] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.729+0000 7f44df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:14.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.733+0000 7f462aefa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:14.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.733+0000 7f462aefa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:14.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.733+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d496870 con 0x55635d477a20 2024-09-12T16:52:14.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.733+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.733+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d490310 con 0x55635d47c3d0 2024-09-12T16:52:14.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.737+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.737+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d490310 con 0x55635d480d20 2024-09-12T16:52:14.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.737+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.737+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d497460 con 0x55635d477a20 2024-09-12T16:52:14.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.737+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.737+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d497910 con 0x7f46180123c0 2024-09-12T16:52:14.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.741+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.741+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d495ee0 con 0x55635d480d20 2024-09-12T16:52:14.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.741+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.741+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d495ee0 con 0x55635d477a20 2024-09-12T16:52:14.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.741+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.741+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4960b0 con 0x55635d47c3d0 2024-09-12T16:52:14.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.745+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.745+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x7f46180123c0 2024-09-12T16:52:14.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.745+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.745+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d480d20 2024-09-12T16:52:14.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.749+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.749+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x7f46180123c0 2024-09-12T16:52:14.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.749+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.749+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d47c3d0 2024-09-12T16:52:14.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.753+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.753+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x7f46180123c0 2024-09-12T16:52:14.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.753+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.753+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d47c3d0 2024-09-12T16:52:14.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.753+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.753+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d477a20 2024-09-12T16:52:14.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.757+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.757+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d480d20 2024-09-12T16:52:14.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.757+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.757+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x7f46180123c0 2024-09-12T16:52:14.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.761+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.761+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d480d20 2024-09-12T16:52:14.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.761+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.761+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d477a20 2024-09-12T16:52:14.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.761+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.761+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d477a20 2024-09-12T16:52:14.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.765+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.765+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x55635d480d20 2024-09-12T16:52:14.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.765+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.765+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982a0 con 0x7f46180123c0 2024-09-12T16:52:14.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.765+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.769+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982c0 con 0x55635d480d20 2024-09-12T16:52:14.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.769+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.769+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4982c0 con 0x55635d480d20 2024-09-12T16:52:14.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.773+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.773+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d498320 con 0x55635d480d20 2024-09-12T16:52:14.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.773+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.773+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d498320 con 0x55635d480d20 2024-09-12T16:52:14.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.773+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.773+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d498320 con 0x55635d47c3d0 2024-09-12T16:52:14.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.777+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.777+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4984f0 con 0x55635d480d20 2024-09-12T16:52:14.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.777+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.777+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4984f0 con 0x55635d47c3d0 2024-09-12T16:52:14.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.781+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.781+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4984f0 con 0x55635d480d20 2024-09-12T16:52:14.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.781+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.781+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4987d0 con 0x55635d47c3d0 2024-09-12T16:52:14.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.785+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.785+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4987d0 con 0x7f46180123c0 2024-09-12T16:52:14.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.785+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f44de7e4640 20 reqs_thread_entry: start 2024-09-12T16:52:14.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:14.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 20 Filter name: none 2024-09-12T16:52:14.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f44d77fe640 20 reqs_thread_entry: start 2024-09-12T16:52:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:52:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55635d4b3350 con 0x55635d47c3d0 2024-09-12T16:52:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T16:52:14.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:14.792 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T16:52:14.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f44df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:14.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93885255163040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4927f0 con 0x55635d477a20 2024-09-12T16:52:14.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93885255163040] v32'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.789+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93885255144656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d489ca0 con 0x7f46180123c0 2024-09-12T16:52:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.793+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93885255144656] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.793+0000 7f462aefa9c0 20 remove_watcher() i=0 2024-09-12T16:52:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.793+0000 7f462aefa9c0 2 removed watcher, disabling cache 2024-09-12T16:52:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.793+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93885255148768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d489ca0 con 0x55635d477a20 2024-09-12T16:52:14.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.793+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93885255148768] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.793+0000 7f462aefa9c0 20 remove_watcher() i=1 2024-09-12T16:52:14.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.793+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93885255151440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d489ca0 con 0x55635d480d20 2024-09-12T16:52:14.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.797+0000 7f4628a00640 1 -- 172.21.15.151:0/1091976935 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93885255151440] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461804b070 con 0x55635d480d20 2024-09-12T16:52:14.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.797+0000 7f462aefa9c0 20 remove_watcher() i=2 2024-09-12T16:52:14.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.797+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93885255142176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d486f50 con 0x7f46180123c0 2024-09-12T16:52:14.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.797+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93885255142176] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x7f46180123c0 2024-09-12T16:52:14.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.797+0000 7f462aefa9c0 20 remove_watcher() i=3 2024-09-12T16:52:14.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.797+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93885255153568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d486f50 con 0x55635d477a20 2024-09-12T16:52:14.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.801+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93885255153568] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f461c0b3040 con 0x55635d477a20 2024-09-12T16:52:14.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.801+0000 7f462aefa9c0 20 remove_watcher() i=4 2024-09-12T16:52:14.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.801+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93885255159840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d4877a0 con 0x55635d47c3d0 2024-09-12T16:52:14.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.801+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93885255159840] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.801+0000 7f462aefa9c0 20 remove_watcher() i=5 2024-09-12T16:52:14.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.801+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93885255158640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d489020 con 0x55635d47c3d0 2024-09-12T16:52:14.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93885255158640] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 20 remove_watcher() i=6 2024-09-12T16:52:14.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93885255166736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55635d489020 con 0x55635d47c3d0 2024-09-12T16:52:14.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f4629201640 1 -- 172.21.15.151:0/1091976935 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93885255166736] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f462003e070 con 0x55635d47c3d0 2024-09-12T16:52:14.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 20 remove_watcher() i=7 2024-09-12T16:52:14.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d47c3d0 msgr2=0x55635d47e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d47c3d0 0x55635d47e7c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d477a20 msgr2=0x55635d479ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d477a20 0x55635d479ee0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f46180123c0 msgr2=0x7f4618029650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f46180123c0 0x7f4618029650 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55635d480d20 msgr2=0x55635d483150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55635d480d20 0x55635d483150 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f44f4039a20 msgr2=0x7f44f403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f44f4039a20 0x7f44f403bee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f461802afd0 tx=0x7f4618039000 comp rx=0 tx=0).stop 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f46281ff640 1 -- 172.21.15.151:0/1091976935 reap_dead start 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 msgr2=0x55635d46c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d46c7c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4620023fb0 tx=0x7f46200508e0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 shutdown_connections 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/1091976935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4662d0 0x55635d46c7c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 >> 172.21.15.151:0/1091976935 conn(0x55635d4616f0 msgr2=0x55635d45f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 shutdown_connections 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/1091976935 wait complete. 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3481878897 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4500039ac0 msgr2=0x7f450003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/3481878897 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4500039ac0 0x7f450003bf80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55635d43f450 tx=0x7f461804e9d0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3481878897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4589e0 msgr2=0x55635d458e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/3481878897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4589e0 0x55635d458e00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55635d4400c0 tx=0x7f462000af40 comp rx=0 tx=0).stop 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3481878897 shutdown_connections 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/3481878897 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4500039ac0 0x7f450003bf80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/3481878897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d4589e0 0x55635d458e00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.805+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3481878897 >> 172.21.15.151:0/3481878897 conn(0x55635d44e390 msgr2=0x55635d44e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3481878897 shutdown_connections 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/3481878897 wait complete. 2024-09-12T16:52:14.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d4478b0 msgr2=0x55635d449ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d4478b0 0x55635d449ca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d2bd5e0 msgr2=0x55635d445130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d2bd5e0 0x55635d445130 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4510039a70 msgr2=0x7f451003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4510039a70 0x7f451003bf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f461c0ad000 tx=0x7f461c0a5040 comp rx=0 tx=0).stop 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 msgr2=0x55635d43dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d43dfc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4618000f90 tx=0x7f4618001260 comp rx=0 tx=0).stop 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 shutdown_connections 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55635d4478b0 0x55635d449ca0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55635d2bd5e0 0x55635d445130 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4510039a70 0x7f451003bf30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 --2- 172.21.15.151:0/964178230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55635d2bd200 0x55635d43dfc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 >> 172.21.15.151:0/964178230 conn(0x55635d343920 msgr2=0x55635d431010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 shutdown_connections 2024-09-12T16:52:14.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.809+0000 7f462aefa9c0 1 -- 172.21.15.151:0/964178230 wait complete. 2024-09-12T16:52:14.821 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T16:52:14.822 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T16:52:14.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T16:52:14.822 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T16:52:14.903 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:14.903 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:14.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9d9dd9c0 1 Processor -- start 2024-09-12T16:52:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9d9dd9c0 1 -- start start 2024-09-12T16:52:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9d9dd9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5585d94aaff0 0x5585d94ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9d9dd9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585d935c9c0 con 0x5585d94a6e00 2024-09-12T16:52:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9d9dd9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5585d93ac6d0 con 0x5585d94aaff0 2024-09-12T16:52:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9ace2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5585d94aaff0 0x5585d94ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9b4e3640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5585d94a6e00 0x5585d94a71e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37958/0 (socket says 172.21.15.151:37958) 2024-09-12T16:52:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/1609707928 learned_addr learned my addr 172.21.15.151:0/1609707928 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9ace2640 1 -- 172.21.15.151:0/1609707928 >> v1:172.21.15.122:6789/0 conn(0x5585d94a6e00 legacy=0x5585d94a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.901+0000 7f8f9ace2640 1 -- 172.21.15.151:0/1609707928 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d9350ca0 con 0x5585d94aaff0 2024-09-12T16:52:14.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9ace2640 1 --2- 172.21.15.151:0/1609707928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94aaff0 0x5585d94ad3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00a420 tx=0x7f8f8c01b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e805c5fd05ff7244 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9a4e1640 1 -- 172.21.15.151:0/1609707928 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8c0af070 con 0x5585d94aaff0 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9a4e1640 1 -- 172.21.15.151:0/1609707928 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c0aa530 con 0x5585d94aaff0 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9a4e1640 1 -- 172.21.15.151:0/1609707928 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8c0aa850 con 0x5585d94aaff0 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1609707928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94aaff0 msgr2=0x5585d94ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1609707928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94aaff0 0x5585d94ad3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00a420 tx=0x7f8f8c01b060 comp rx=0 tx=0).stop 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1609707928 shutdown_connections 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1609707928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94aaff0 0x5585d94ad3e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1609707928 >> 172.21.15.151:0/1609707928 conn(0x5585d94a2920 msgr2=0x5585d94a4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1609707928 shutdown_connections 2024-09-12T16:52:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.905+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1609707928 wait complete. 2024-09-12T16:52:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.921+0000 7f8f9d9dd9c0 1 Processor -- start 2024-09-12T16:52:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.921+0000 7f8f9d9dd9c0 1 -- start start 2024-09-12T16:52:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.921+0000 7f8f9d9dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d941bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.921+0000 7f8f9d9dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5585d93b0680 con 0x5585d94a6e00 2024-09-12T16:52:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.921+0000 7f8f9b4e3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d941bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.921+0000 7f8f9b4e3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d941bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33396/0 (socket says 172.21.15.151:33396) 2024-09-12T16:52:14.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.921+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3971810609 learned_addr learned my addr 172.21.15.151:0/3971810609 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.921+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3971810609 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d932bda0 con 0x5585d94a6e00 2024-09-12T16:52:14.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/3971810609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d941bd50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8f84001e00 tx=0x7f8f8400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40445c530f027183 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8e8960a640 1 -- 172.21.15.151:0/3971810609 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f84012020 con 0x5585d94a6e00 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8e8960a640 1 -- 172.21.15.151:0/3971810609 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8400e690 con 0x5585d94a6e00 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8e8960a640 1 -- 172.21.15.151:0/3971810609 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8400ea10 con 0x5585d94a6e00 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3971810609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 msgr2=0x5585d941bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3971810609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d941bd50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8f84001e00 tx=0x7f8f8400b6d0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3971810609 shutdown_connections 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3971810609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d941bd50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3971810609 >> 172.21.15.151:0/3971810609 conn(0x5585d94a2920 msgr2=0x5585d958e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3971810609 shutdown_connections 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3971810609 wait complete. 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 Processor -- start 2024-09-12T16:52:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- start start 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d959add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5585d9352a50 con 0x5585d94a6e00 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9b4e3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d959add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9b4e3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d959add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33402/0 (socket says 172.21.15.151:33402) 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/1900878003 learned_addr learned my addr 172.21.15.151:0/1900878003 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/1900878003 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d959b330 con 0x5585d94a6e00 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d959add0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5585d95946c0 tx=0x7f8f84000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8e87e07640 1 -- 172.21.15.151:0/1900878003 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f84012030 con 0x5585d94a6e00 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8e87e07640 1 -- 172.21.15.151:0/1900878003 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8401a750 con 0x5585d94a6e00 2024-09-12T16:52:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585d959b5c0 con 0x5585d94a6e00 2024-09-12T16:52:14.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8e87e07640 1 -- 172.21.15.151:0/1900878003 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8401aa50 con 0x5585d94a6e00 2024-09-12T16:52:14.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.925+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d959bf70 con 0x5585d94a6e00 2024-09-12T16:52:14.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8e87e07640 1 -- 172.21.15.151:0/1900878003 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f84015020 con 0x5585d94a6e00 2024-09-12T16:52:14.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8e87e07640 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e80039a70 0x7f8e8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8e87e07640 1 -- 172.21.15.151:0/1900878003 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f84020030 con 0x5585d94a6e00 2024-09-12T16:52:14.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9ace2640 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e80039a70 0x7f8e8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d94aaff0 0x5585d95a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95a2480 con 0x5585d94aaff0 2024-09-12T16:52:14.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9bce4640 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d94aaff0 0x5585d95a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9ace2640 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e80039a70 0x7f8e8003bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0ac000 tx=0x7f8f8c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9bce4640 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d94aaff0 0x5585d95a1f40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9bce4640 1 -- 172.21.15.151:0/1900878003 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d94aaff0 2024-09-12T16:52:14.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95a28d0 con 0x5585d94aaff0 2024-09-12T16:52:14.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9bce4640 1 -- 172.21.15.151:0/1900878003 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d94aaff0 2024-09-12T16:52:14.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95a46e0 0x5585d95a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95a71a0 con 0x5585d95a46e0 2024-09-12T16:52:14.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95a46e0 0x5585d95a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.929+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95a46e0 0x5585d95a6ad0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/1900878003 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95a46e0 2024-09-12T16:52:14.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95a3580 con 0x5585d94aaff0 2024-09-12T16:52:14.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9bce4640 1 -- 172.21.15.151:0/1900878003 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d94aaff0 2024-09-12T16:52:14.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95a3a20 con 0x5585d94aaff0 2024-09-12T16:52:14.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9bce4640 1 -- 172.21.15.151:0/1900878003 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d94aaff0 2024-09-12T16:52:14.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9d9dd9c0 1 Processor -- start 2024-09-12T16:52:14.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9d9dd9c0 1 -- start start 2024-09-12T16:52:14.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9d9dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95b5810 0x5585d95b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9d9dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5585d93bd450 con 0x5585d95b5810 2024-09-12T16:52:14.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9bce4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95b5810 0x5585d95b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9bce4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95b5810 0x5585d95b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33410/0 (socket says 172.21.15.151:33410) 2024-09-12T16:52:14.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9bce4640 1 -- 172.21.15.151:0/2908150532 learned_addr learned my addr 172.21.15.151:0/2908150532 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9bce4640 1 -- 172.21.15.151:0/2908150532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d95b6270 con 0x5585d95b5810 2024-09-12T16:52:14.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9bce4640 1 --2- 172.21.15.151:0/2908150532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95b5810 0x5585d95b5c30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5585d959cef0 tx=0x7f8f9400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8e85602640 1 -- 172.21.15.151:0/2908150532 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f94007e00 con 0x5585d95b5810 2024-09-12T16:52:14.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/2908150532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585d95b6ad0 con 0x5585d95b5810 2024-09-12T16:52:14.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8e85602640 1 -- 172.21.15.151:0/2908150532 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9401e020 con 0x5585d95b5810 2024-09-12T16:52:14.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8e85602640 1 -- 172.21.15.151:0/2908150532 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f94019550 con 0x5585d95b5810 2024-09-12T16:52:14.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.933+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/2908150532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d95b7040 con 0x5585d95b5810 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8e85602640 1 -- 172.21.15.151:0/2908150532 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f94016040 con 0x5585d95b5810 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8e85602640 1 --2- 172.21.15.151:0/2908150532 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e74039a70 0x7f8e7403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8e85602640 1 -- 172.21.15.151:0/2908150532 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f9401f030 con 0x5585d95b5810 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/2908150532 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e74039a70 0x7f8e7403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 Processor -- start 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 -- start start 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95928a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5585d941c5a0 con 0x5585d95924a0 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/2908150532 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e74039a70 0x7f8e7403bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5585d959c260 tx=0x7f8f8402c950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9bce4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95928a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9bce4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95928a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33418/0 (socket says 172.21.15.151:33418) 2024-09-12T16:52:14.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3556777144 learned_addr learned my addr 172.21.15.151:0/3556777144 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3556777144 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d9592de0 con 0x5585d95924a0 2024-09-12T16:52:14.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9bce4640 1 --2- 172.21.15.151:0/3556777144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95928a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f94014480 tx=0x7f8f94014820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12131f8582a8c148 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8e7effd640 1 -- 172.21.15.151:0/3556777144 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9401d070 con 0x5585d95924a0 2024-09-12T16:52:14.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8e7effd640 1 -- 172.21.15.151:0/3556777144 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f94014d50 con 0x5585d95924a0 2024-09-12T16:52:14.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8e7effd640 1 -- 172.21.15.151:0/3556777144 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f940224f0 con 0x5585d95924a0 2024-09-12T16:52:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3556777144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 msgr2=0x5585d95928a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3556777144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95928a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f94014480 tx=0x7f8f94014820 comp rx=0 tx=0).stop 2024-09-12T16:52:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3556777144 shutdown_connections 2024-09-12T16:52:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3556777144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95928a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:14.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3556777144 >> 172.21.15.151:0/3556777144 conn(0x5585d95be600 msgr2=0x5585d95bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3556777144 shutdown_connections 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.937+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3556777144 wait complete. 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 1 Processor -- start 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 1 -- start start 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5585d9593360 con 0x5585d95924a0 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9bce4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9bce4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33430/0 (socket says 172.21.15.151:33430) 2024-09-12T16:52:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 learned_addr learned my addr 172.21.15.151:0/3390474761 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d95cbe90 con 0x5585d95924a0 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9bce4640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95cb930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8f9404f5a0 tx=0x7f8f94050610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8e7d7fa640 1 -- 172.21.15.151:0/3390474761 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f94018b00 con 0x5585d95924a0 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8e7d7fa640 1 -- 172.21.15.151:0/3390474761 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f94031070 con 0x5585d95924a0 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585d95cc120 con 0x5585d95924a0 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8e7d7fa640 1 -- 172.21.15.151:0/3390474761 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f94015a80 con 0x5585d95924a0 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d95ccad0 con 0x5585d95924a0 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8e7d7fa640 1 -- 172.21.15.151:0/3390474761 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f94015c20 con 0x5585d95924a0 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8e7d7fa640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e64039a70 0x7f8e6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8e7d7fa640 1 -- 172.21.15.151:0/3390474761 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f9402dc90 con 0x5585d95924a0 2024-09-12T16:52:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e64039a70 0x7f8e6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d95d6c00 0x5585d95d90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.941+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95d9810 con 0x5585d95d6c00 2024-09-12T16:52:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e64039a70 0x7f8e6403bf30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f8404ece0 tx=0x7f8f8402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9ace2640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d95d6c00 0x5585d95d90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9ace2640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d95d6c00 0x5585d95d90c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 realm 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95d9be0 con 0x5585d95d6c00 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95da4b0 con 0x5585d95d6c00 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95da850 con 0x5585d95d6c00 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95db5b0 0x5585d95dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95ddfb0 con 0x5585d95db5b0 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9bce4640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95db5b0 0x5585d95dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9bce4640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95db5b0 0x5585d95dd9a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 20 searching for the correct realm 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5585d95dff00 0x5585d95e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.945+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5585d95dff00 0x5585d95e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5585d95dff00 0x5585d95e2330 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9b4e3640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f84017050 0x7f8f8404d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x7f8f84017050 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9ace2640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f84017050 0x7f8f8404d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9ace2640 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f84017050 0x7f8f8404d3b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95d6c00 2024-09-12T16:52:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95d6c00 2024-09-12T16:52:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.949+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x7f8f84017050 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95d6c00 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95d6c00 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x7f8f84017050 2024-09-12T16:52:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95d6c00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.953+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95d6c00 2024-09-12T16:52:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x7f8f84017050 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95d6c00 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x7f8f84017050 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.957+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95dff00 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95db5b0 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x5585d95d6c00 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e29b0 con 0x7f8f84017050 2024-09-12T16:52:14.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95de970 con 0x5585d95d6c00 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95de5b0 con 0x5585d95d6c00 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95df290 con 0x5585d95d6c00 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 zone default found 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 4 Realm: () 2024-09-12T16:52:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 zonegroup default 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95df290 con 0x5585d95db5b0 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e4d50 con 0x5585d95dff00 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e5140 con 0x5585d95dff00 2024-09-12T16:52:14.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:14.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 started sync module instance, tier type = 2024-09-12T16:52:14.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:14.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.961+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e41e0 con 0x7f8f84017050 2024-09-12T16:52:14.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.965+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.965+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94033365845760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e41e0 con 0x7f8f84017050 2024-09-12T16:52:14.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.965+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e5bc0 con 0x5585d95d6c00 2024-09-12T16:52:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.965+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94033365845760] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.965+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.965+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94033365850144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e41e0 con 0x5585d95d6c00 2024-09-12T16:52:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.965+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e65d0 con 0x5585d95dff00 2024-09-12T16:52:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.969+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94033365850144] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.969+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.969+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94033365843248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e4150 con 0x5585d95dff00 2024-09-12T16:52:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.969+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e72d0 con 0x7f8f84017050 2024-09-12T16:52:14.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.969+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.969+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94033365856048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e7b70 con 0x7f8f84017050 2024-09-12T16:52:14.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.969+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e8530 con 0x5585d95d6c00 2024-09-12T16:52:14.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.969+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94033365843248] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.973+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94033365856048] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.973+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.973+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94033365860480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e7ac0 con 0x5585d95d6c00 2024-09-12T16:52:14.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.973+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e84a0 con 0x5585d95db5b0 2024-09-12T16:52:14.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.973+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.973+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94033365862736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e9220 con 0x5585d95db5b0 2024-09-12T16:52:14.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.973+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e9be0 con 0x5585d95db5b0 2024-09-12T16:52:14.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.973+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94033365860480] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94033365862736] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94033365863792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e9190 con 0x5585d95db5b0 2024-09-12T16:52:14.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95ea090 con 0x5585d95db5b0 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94033365867488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95ea4b0 con 0x5585d95db5b0 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 20 add_watcher() i=0 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 20 add_watcher() i=1 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 20 add_watcher() i=2 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 20 add_watcher() i=3 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 20 add_watcher() i=4 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 20 add_watcher() i=5 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94033365863792] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.977+0000 7f8f9d9dd9c0 20 add_watcher() i=6 2024-09-12T16:52:14.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94033365867488] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9d9dd9c0 20 add_watcher() i=7 2024-09-12T16:52:14.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9d9dd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:14.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e9780 con 0x5585d95d6c00 2024-09-12T16:52:14.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94033365868544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e9780 con 0x5585d95d6c00 2024-09-12T16:52:14.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94033365868544] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8e51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:14.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9d9dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:14.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9d9dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:14.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.981+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f5be0 con 0x5585d95d6c00 2024-09-12T16:52:14.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.985+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.985+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f6290 con 0x5585d95db5b0 2024-09-12T16:52:14.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.985+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.985+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f6290 con 0x5585d95dff00 2024-09-12T16:52:14.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.989+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.989+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f6790 con 0x5585d95d6c00 2024-09-12T16:52:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.989+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.989+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f3d90 con 0x7f8f84017050 2024-09-12T16:52:14.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.989+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:14.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.989+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f3d90 con 0x5585d95dff00 2024-09-12T16:52:14.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.993+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:14.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.993+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f72f0 con 0x5585d95d6c00 2024-09-12T16:52:14.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.993+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:14.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.993+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f72f0 con 0x5585d95db5b0 2024-09-12T16:52:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.997+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.997+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f72f0 con 0x7f8f84017050 2024-09-12T16:52:15.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.997+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:15.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:14.997+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f72f0 con 0x5585d95dff00 2024-09-12T16:52:15.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.001+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.001+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f72f0 con 0x7f8f84017050 2024-09-12T16:52:15.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.005+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:15.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.005+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f72f0 con 0x5585d95db5b0 2024-09-12T16:52:15.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.005+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.005+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7380 con 0x7f8f84017050 2024-09-12T16:52:15.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.009+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:15.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.009+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7380 con 0x5585d95db5b0 2024-09-12T16:52:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.009+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.009+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7380 con 0x5585d95d6c00 2024-09-12T16:52:15.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.013+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:15.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.013+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7380 con 0x5585d95dff00 2024-09-12T16:52:15.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.017+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.017+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7470 con 0x7f8f84017050 2024-09-12T16:52:15.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.017+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:15.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.017+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7470 con 0x5585d95dff00 2024-09-12T16:52:15.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.021+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.021+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7410 con 0x5585d95d6c00 2024-09-12T16:52:15.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.021+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:15.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.021+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7410 con 0x5585d95d6c00 2024-09-12T16:52:15.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.025+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:15.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.025+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f7410 con 0x5585d95dff00 2024-09-12T16:52:15.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.025+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.025+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x7f8f84017050 2024-09-12T16:52:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.029+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.029+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95dff00 2024-09-12T16:52:15.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.029+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.029+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95dff00 2024-09-12T16:52:15.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.033+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.033+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95dff00 2024-09-12T16:52:15.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.037+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.037+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95dff00 2024-09-12T16:52:15.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.037+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.037+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95db5b0 2024-09-12T16:52:15.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.041+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.041+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95dff00 2024-09-12T16:52:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.041+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.041+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95db5b0 2024-09-12T16:52:15.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.045+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.045+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95dff00 2024-09-12T16:52:15.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.049+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.049+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x5585d95db5b0 2024-09-12T16:52:15.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.049+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.049+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f74b0 con 0x7f8f84017050 2024-09-12T16:52:15.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:15.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8e50fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:15.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9d9dd9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:15.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9d9dd9c0 20 Filter name: none 2024-09-12T16:52:15.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9d9dd9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:15.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9d9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8dca7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585d95f2f80 con 0x5585d95d6c00 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9d9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9d9dd9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8f9d9dd9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.053+0000 7f8e51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.057+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94033365868544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95d40e0 con 0x5585d95d6c00 2024-09-12T16:52:15.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.057+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94033365868544] v32'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:15.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.057+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94033365845760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95ea000 con 0x7f8f84017050 2024-09-12T16:52:15.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.057+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94033365845760] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:15.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.057+0000 7f8f9d9dd9c0 20 remove_watcher() i=0 2024-09-12T16:52:15.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.057+0000 7f8f9d9dd9c0 2 removed watcher, disabling cache 2024-09-12T16:52:15.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.057+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94033365850144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95ea000 con 0x5585d95d6c00 2024-09-12T16:52:15.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.061+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94033365850144] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:15.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.061+0000 7f8f9d9dd9c0 20 remove_watcher() i=1 2024-09-12T16:52:15.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.061+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94033365843248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95ea000 con 0x5585d95dff00 2024-09-12T16:52:15.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.061+0000 7f8f9b4e3640 1 -- 172.21.15.151:0/3390474761 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94033365843248] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f84008030 con 0x5585d95dff00 2024-09-12T16:52:15.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.061+0000 7f8f9d9dd9c0 20 remove_watcher() i=2 2024-09-12T16:52:15.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.061+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94033365856048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e3d30 con 0x7f8f84017050 2024-09-12T16:52:15.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.065+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94033365856048] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x7f8f84017050 2024-09-12T16:52:15.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.065+0000 7f8f9d9dd9c0 20 remove_watcher() i=3 2024-09-12T16:52:15.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.065+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94033365860480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e6f30 con 0x5585d95d6c00 2024-09-12T16:52:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.065+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94033365860480] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8c0b2040 con 0x5585d95d6c00 2024-09-12T16:52:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.065+0000 7f8f9d9dd9c0 20 remove_watcher() i=4 2024-09-12T16:52:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.065+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94033365862736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e3d30 con 0x5585d95db5b0 2024-09-12T16:52:15.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.069+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94033365862736] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.069+0000 7f8f9d9dd9c0 20 remove_watcher() i=5 2024-09-12T16:52:15.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.069+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94033365863792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e8080 con 0x5585d95db5b0 2024-09-12T16:52:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.069+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94033365863792] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.069+0000 7f8f9d9dd9c0 20 remove_watcher() i=6 2024-09-12T16:52:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.069+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94033365867488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585d95e6f30 con 0x5585d95db5b0 2024-09-12T16:52:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9bce4640 1 -- 172.21.15.151:0/3390474761 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94033365867488] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f940083f0 con 0x5585d95db5b0 2024-09-12T16:52:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 20 remove_watcher() i=7 2024-09-12T16:52:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95db5b0 msgr2=0x5585d95dd9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95db5b0 0x5585d95dd9a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d95d6c00 msgr2=0x5585d95d90c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d95d6c00 0x5585d95d90c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f84017050 msgr2=0x7f8f8404d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f84017050 0x7f8f8404d3b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5585d95dff00 msgr2=0x5585d95e2330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5585d95dff00 0x5585d95e2330 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e64039a70 msgr2=0x7f8e6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e64039a70 0x7f8e6403bf30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f8404ece0 tx=0x7f8f8402f000 comp rx=0 tx=0).stop 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 msgr2=0x5585d95cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9ace2640 1 -- 172.21.15.151:0/3390474761 reap_dead start 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95cb930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8f9404f5a0 tx=0x7f8f94050610 comp rx=0 tx=0).stop 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 shutdown_connections 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/3390474761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95924a0 0x5585d95cb930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 >> 172.21.15.151:0/3390474761 conn(0x5585d95be600 msgr2=0x5585d95bc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 shutdown_connections 2024-09-12T16:52:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/3390474761 wait complete. 2024-09-12T16:52:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/2908150532 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e74039a70 msgr2=0x7f8e7403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/2908150532 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e74039a70 0x7f8e7403bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5585d959c260 tx=0x7f8f8402c950 comp rx=0 tx=0).stop 2024-09-12T16:52:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/2908150532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95b5810 msgr2=0x5585d95b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/2908150532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95b5810 0x5585d95b5c30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5585d959cef0 tx=0x7f8f9400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/2908150532 shutdown_connections 2024-09-12T16:52:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/2908150532 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e74039a70 0x7f8e7403bf30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/2908150532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d95b5810 0x5585d95b5c30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/2908150532 >> 172.21.15.151:0/2908150532 conn(0x5585d95ab1c0 msgr2=0x5585d95ab5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/2908150532 shutdown_connections 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/2908150532 wait complete. 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95a46e0 msgr2=0x5585d95a6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95a46e0 0x5585d95a6ad0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d94aaff0 msgr2=0x5585d95a1f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d94aaff0 0x5585d95a1f40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e80039a70 msgr2=0x7f8e8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e80039a70 0x7f8e8003bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0ac000 tx=0x7f8f8c0a5000 comp rx=0 tx=0).stop 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 msgr2=0x5585d959add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d959add0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5585d95946c0 tx=0x7f8f84000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 shutdown_connections 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5585d95a46e0 0x5585d95a6ad0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5585d94aaff0 0x5585d95a1f40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e80039a70 0x7f8e8003bf30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 --2- 172.21.15.151:0/1900878003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5585d94a6e00 0x5585d959add0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 >> 172.21.15.151:0/1900878003 conn(0x5585d94a2920 msgr2=0x5585d958cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 shutdown_connections 2024-09-12T16:52:15.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.073+0000 7f8f9d9dd9c0 1 -- 172.21.15.151:0/1900878003 wait complete. 2024-09-12T16:52:15.088 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T16:52:15.089 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T16:52:15.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T16:52:15.089 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-12T16:52:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3f028f9c0 1 Processor -- start 2024-09-12T16:52:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3f028f9c0 1 -- start start 2024-09-12T16:52:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3f028f9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56526437d330 0x56526437f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3f028f9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56526422b9c0 con 0x565264379230 2024-09-12T16:52:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3f028f9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56526427b6d0 con 0x56526437d330 2024-09-12T16:52:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3ed594640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56526437d330 0x56526437f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3edd95640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x565264379230 0x565264379610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37972/0 (socket says 172.21.15.151:37972) 2024-09-12T16:52:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3edd95640 1 -- 172.21.15.151:0/3829083942 learned_addr learned my addr 172.21.15.151:0/3829083942 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3ed594640 1 -- 172.21.15.151:0/3829083942 >> v1:172.21.15.122:6789/0 conn(0x565264379230 legacy=0x565264379610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3ed594640 1 -- 172.21.15.151:0/3829083942 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56526421fca0 con 0x56526437d330 2024-09-12T16:52:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.165+0000 7fe3ecd93640 1 -- 172.21.15.151:0/3829083942 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240239928 0 0) 0x56526422b9c0 con 0x565264379230 2024-09-12T16:52:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3ed594640 1 --2- 172.21.15.151:0/3829083942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56526437d330 0x56526437f720 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800a480 tx=0x7fe3d801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db996adf7c0cb4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3ecd93640 1 -- 172.21.15.151:0/3829083942 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80aa570 con 0x56526437d330 2024-09-12T16:52:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3ecd93640 1 -- 172.21.15.151:0/3829083942 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d80af070 con 0x56526437d330 2024-09-12T16:52:15.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3ecd93640 1 -- 172.21.15.151:0/3829083942 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80aa860 con 0x56526437d330 2024-09-12T16:52:15.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3829083942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56526437d330 msgr2=0x56526437f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/3829083942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56526437d330 0x56526437f720 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800a480 tx=0x7fe3d801b310 comp rx=0 tx=0).stop 2024-09-12T16:52:15.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3829083942 shutdown_connections 2024-09-12T16:52:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/3829083942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56526437d330 0x56526437f720 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3829083942 >> 172.21.15.151:0/3829083942 conn(0x5652642ecae0 msgr2=0x5652642ecef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3829083942 shutdown_connections 2024-09-12T16:52:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.169+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3829083942 wait complete. 2024-09-12T16:52:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 Processor -- start 2024-09-12T16:52:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 -- start start 2024-09-12T16:52:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x5652644647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56526427f680 con 0x565264379230 2024-09-12T16:52:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3edd95640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x5652644647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3edd95640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x5652644647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33454/0 (socket says 172.21.15.151:33454) 2024-09-12T16:52:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3edd95640 1 -- 172.21.15.151:0/2422927237 learned_addr learned my addr 172.21.15.151:0/2422927237 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3edd95640 1 -- 172.21.15.151:0/2422927237 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652641fada0 con 0x565264379230 2024-09-12T16:52:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3edd95640 1 --2- 172.21.15.151:0/2422927237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x5652644647f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006fb0 tx=0x7fe3e0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c44cdf9617fec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe2dbe07640 1 -- 172.21.15.151:0/2422927237 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0003460 con 0x565264379230 2024-09-12T16:52:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe2dbe07640 1 -- 172.21.15.151:0/2422927237 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0003600 con 0x565264379230 2024-09-12T16:52:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe2dbe07640 1 -- 172.21.15.151:0/2422927237 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0003920 con 0x565264379230 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2422927237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 msgr2=0x5652644647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2422927237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x5652644647f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006fb0 tx=0x7fe3e0001b10 comp rx=0 tx=0).stop 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2422927237 shutdown_connections 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2422927237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x5652644647f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.185+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2422927237 >> 172.21.15.151:0/2422927237 conn(0x5652642ecae0 msgr2=0x565264460430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2422927237 shutdown_connections 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2422927237 wait complete. 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 Processor -- start 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 -- start start 2024-09-12T16:52:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x56526446beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565264221a50 con 0x565264379230 2024-09-12T16:52:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3edd95640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x56526446beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3edd95640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x56526446beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33456/0 (socket says 172.21.15.151:33456) 2024-09-12T16:52:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3edd95640 1 -- 172.21.15.151:0/2699060718 learned_addr learned my addr 172.21.15.151:0/2699060718 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3edd95640 1 -- 172.21.15.151:0/2699060718 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56526446c410 con 0x565264379230 2024-09-12T16:52:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3edd95640 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x56526446beb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x565264465780 tx=0x7fe3e0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe2da604640 1 -- 172.21.15.151:0/2699060718 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0025070 con 0x565264379230 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56526446c6a0 con 0x565264379230 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe2da604640 1 -- 172.21.15.151:0/2699060718 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e0019040 con 0x565264379230 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe2da604640 1 -- 172.21.15.151:0/2699060718 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e00137a0 con 0x565264379230 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56526446d050 con 0x565264379230 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 Processor -- start 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 -- start start 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264478ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3f028f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56526428c450 con 0x565264478ad0 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3ee596640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264478ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3ee596640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264478ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33468/0 (socket says 172.21.15.151:33468) 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe3ee596640 1 -- 172.21.15.151:0/2012486552 learned_addr learned my addr 172.21.15.151:0/2012486552 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe2da604640 1 -- 172.21.15.151:0/2699060718 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3e0028070 con 0x565264379230 2024-09-12T16:52:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.189+0000 7fe2da604640 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2d4039a70 0x7fe2d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3ee596640 1 -- 172.21.15.151:0/2012486552 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652644794c0 con 0x565264478ad0 2024-09-12T16:52:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe2da604640 1 -- 172.21.15.151:0/2699060718 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe3e004fde0 con 0x565264379230 2024-09-12T16:52:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3edd95640 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2d4039a70 0x7fe2d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3ee596640 1 --2- 172.21.15.151:0/2012486552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264478ed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800a440 tx=0x7fe3e800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a20cbb355b91f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3edd95640 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2d4039a70 0x7fe2d403bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0003fd0 tx=0x7fe3e004e4b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe2d3fff640 1 -- 172.21.15.151:0/2012486552 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e8008850 con 0x565264478ad0 2024-09-12T16:52:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe2d3fff640 1 -- 172.21.15.151:0/2012486552 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e8008a10 con 0x565264478ad0 2024-09-12T16:52:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe2d3fff640 1 -- 172.21.15.151:0/2012486552 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e8008d30 con 0x565264478ad0 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2012486552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 msgr2=0x565264478ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2012486552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264478ed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800a440 tx=0x7fe3e800a900 comp rx=0 tx=0).stop 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2012486552 shutdown_connections 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2012486552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264478ed0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2012486552 >> 172.21.15.151:0/2012486552 conn(0x56526437d330 msgr2=0x565264474510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2012486552 shutdown_connections 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2012486552 wait complete. 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 Processor -- start 2024-09-12T16:52:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- start start 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264480000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565264479cb0 con 0x565264478ad0 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3ee596640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264480000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3ee596640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264480000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33480/0 (socket says 172.21.15.151:33480) 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3ee596640 1 -- 172.21.15.151:0/484199480 learned_addr learned my addr 172.21.15.151:0/484199480 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3ee596640 1 -- 172.21.15.151:0/484199480 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565264480560 con 0x565264478ad0 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3ee596640 1 --2- 172.21.15.151:0/484199480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264480000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5652644799d0 tx=0x7fe3e8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe2d27fc640 1 -- 172.21.15.151:0/484199480 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e8013a70 con 0x565264478ad0 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/484199480 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652644807f0 con 0x565264478ad0 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe2d27fc640 1 -- 172.21.15.151:0/484199480 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e8023070 con 0x565264478ad0 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe2d27fc640 1 -- 172.21.15.151:0/484199480 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e8013d80 con 0x565264478ad0 2024-09-12T16:52:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.193+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/484199480 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652644811a0 con 0x565264478ad0 2024-09-12T16:52:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe2d27fc640 1 -- 172.21.15.151:0/484199480 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3e8028460 con 0x565264478ad0 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3f028f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3f028f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe2d27fc640 1 --2- 172.21.15.151:0/484199480 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2c8039a70 0x7fe2c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3f028f9c0 1 Processor -- start 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe2d27fc640 1 -- 172.21.15.151:0/484199480 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe3e8050770 con 0x565264478ad0 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3ee596640 1 --2- 172.21.15.151:0/484199480 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2c8039a70 0x7fe2c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3f028f9c0 1 -- start start 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3f028f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652644995c0 0x5652644999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3f028f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565264465040 con 0x5652644995c0 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3ee596640 1 --2- 172.21.15.151:0/484199480 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2c8039a70 0x7fe2c803bf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8028aa0 tx=0x7fe3e8028930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3edd95640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652644995c0 0x5652644999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3edd95640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652644995c0 0x5652644999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33490/0 (socket says 172.21.15.151:33490) 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3edd95640 1 -- 172.21.15.151:0/3250416308 learned_addr learned my addr 172.21.15.151:0/3250416308 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3edd95640 1 -- 172.21.15.151:0/3250416308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56526449a020 con 0x5652644995c0 2024-09-12T16:52:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3edd95640 1 --2- 172.21.15.151:0/3250416308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652644995c0 0x5652644999e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0003c40 tx=0x7fe3e00175d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe2b2fe5640 1 -- 172.21.15.151:0/3250416308 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0046070 con 0x5652644995c0 2024-09-12T16:52:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe2b2fe5640 1 -- 172.21.15.151:0/3250416308 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e003b070 con 0x5652644995c0 2024-09-12T16:52:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3250416308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56526449a820 con 0x5652644995c0 2024-09-12T16:52:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe2b2fe5640 1 -- 172.21.15.151:0/3250416308 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0011e10 con 0x5652644995c0 2024-09-12T16:52:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.197+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3250416308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56526449ad90 con 0x5652644995c0 2024-09-12T16:52:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe2b2fe5640 1 -- 172.21.15.151:0/3250416308 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3e0010070 con 0x5652644995c0 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe2b2fe5640 1 --2- 172.21.15.151:0/3250416308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe224039a70 0x7fe22403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe2b2fe5640 1 -- 172.21.15.151:0/3250416308 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe3e0041c70 con 0x5652644995c0 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3ed594640 1 --2- 172.21.15.151:0/3250416308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe224039a70 0x7fe22403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe2b0fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56526449f4b0 0x5652644a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5652644a1de0 con 0x56526449f4b0 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3ed594640 1 --2- 172.21.15.151:0/3250416308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe224039a70 0x7fe22403bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ae000 tx=0x7fe3d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3ee596640 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56526449f4b0 0x5652644a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3ee596640 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56526449f4b0 0x5652644a18a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3ee596640 1 -- 172.21.15.151:0/2699060718 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3e8011a80 con 0x56526449f4b0 2024-09-12T16:52:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5652644a3b50 0x5652644a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:2 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5652644a65e0 con 0x5652644a3b50 2024-09-12T16:52:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3edd95640 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5652644a3b50 0x5652644a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.201+0000 7fe3edd95640 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5652644a3b50 0x5652644a5f40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.205+0000 7fe3edd95640 1 -- 172.21.15.151:0/2699060718 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(2 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe3e0027030 con 0x5652644a3b50 2024-09-12T16:52:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.205+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5652644ab330 con 0x5652644a3b50 2024-09-12T16:52:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.205+0000 7fe3edd95640 1 -- 172.21.15.151:0/2699060718 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fe3e0027030 con 0x5652644a3b50 2024-09-12T16:52:15.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/484199480 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2c8039a70 msgr2=0x7fe2c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/484199480 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2c8039a70 0x7fe2c803bf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8028aa0 tx=0x7fe3e8028930 comp rx=0 tx=0).stop 2024-09-12T16:52:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/484199480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 msgr2=0x565264480000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/484199480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264480000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5652644799d0 tx=0x7fe3e8003000 comp rx=0 tx=0).stop 2024-09-12T16:52:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/484199480 shutdown_connections 2024-09-12T16:52:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/484199480 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2c8039a70 0x7fe2c803bf30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/484199480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264478ad0 0x565264480000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/484199480 >> 172.21.15.151:0/484199480 conn(0x56526437d330 msgr2=0x565264474000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/484199480 shutdown_connections 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/484199480 wait complete. 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3250416308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe224039a70 msgr2=0x7fe22403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/3250416308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe224039a70 0x7fe22403bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ae000 tx=0x7fe3d80a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3250416308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652644995c0 msgr2=0x5652644999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/3250416308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652644995c0 0x5652644999e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0003c40 tx=0x7fe3e00175d0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3250416308 shutdown_connections 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/3250416308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe224039a70 0x7fe22403bf30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/3250416308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652644995c0 0x5652644999e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3250416308 >> 172.21.15.151:0/3250416308 conn(0x56526448ec20 msgr2=0x56526448f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3250416308 shutdown_connections 2024-09-12T16:52:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/3250416308 wait complete. 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5652644a3b50 msgr2=0x5652644a5f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5652644a3b50 0x5652644a5f40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56526449f4b0 msgr2=0x5652644a18a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56526449f4b0 0x5652644a18a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2d4039a70 msgr2=0x7fe2d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2d4039a70 0x7fe2d403bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0003fd0 tx=0x7fe3e004e4b0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 msgr2=0x56526446beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x56526446beb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x565264465780 tx=0x7fe3e0001260 comp rx=0 tx=0).stop 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 shutdown_connections 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5652644a3b50 0x5652644a5f40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56526449f4b0 0x5652644a18a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe2d4039a70 0x7fe2d403bf30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 --2- 172.21.15.151:0/2699060718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565264379230 0x56526446beb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 >> 172.21.15.151:0/2699060718 conn(0x5652642ecae0 msgr2=0x56526445eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 shutdown_connections 2024-09-12T16:52:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.209+0000 7fe3f028f9c0 1 -- 172.21.15.151:0/2699060718 wait complete. 2024-09-12T16:52:15.222 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T16:52:15.222 DEBUG:tasks.util.rgw: json result: {'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T16:52:15.223 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-12T16:52:15.224 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-12T16:52:15.224 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-12T16:52:15.295 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0f8549c0 1 Processor -- start 2024-09-12T16:52:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0f8549c0 1 -- start start 2024-09-12T16:52:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0f8549c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x561883a95210 0x561883b23bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0f8549c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618839d59c0 con 0x561883b24100 2024-09-12T16:52:15.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0f8549c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x561883a256d0 con 0x561883a95210 2024-09-12T16:52:15.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0d35a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x561883a95210 0x561883b23bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0cb59640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x561883b24100 0x561883b264f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37980/0 (socket says 172.21.15.151:37980) 2024-09-12T16:52:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0cb59640 1 -- 172.21.15.151:0/3698531363 learned_addr learned my addr 172.21.15.151:0/3698531363 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0d35a640 1 -- 172.21.15.151:0/3698531363 >> v1:172.21.15.122:6789/0 conn(0x561883b24100 legacy=0x561883b264f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.293+0000 7efd0d35a640 1 -- 172.21.15.151:0/3698531363 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618839c9ca0 con 0x561883a95210 2024-09-12T16:52:15.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.297+0000 7efd0d35a640 1 --2- 172.21.15.151:0/3698531363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883b23bc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd0800a420 tx=0x7efd0801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a06877f7d3a17c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.297+0000 7efd07fff640 1 -- 172.21.15.151:0/3698531363 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd080b0070 con 0x561883a95210 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.297+0000 7efd07fff640 1 -- 172.21.15.151:0/3698531363 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd080a3dc0 con 0x561883a95210 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.297+0000 7efd07fff640 1 -- 172.21.15.151:0/3698531363 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd080ab570 con 0x561883a95210 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.301+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3698531363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 msgr2=0x561883b23bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.301+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3698531363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883b23bc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd0800a420 tx=0x7efd0801afd0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.301+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3698531363 shutdown_connections 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.301+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3698531363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883b23bc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.301+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3698531363 >> 172.21.15.151:0/3698531363 conn(0x561883b1b8f0 msgr2=0x561883b1dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.301+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3698531363 shutdown_connections 2024-09-12T16:52:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.301+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3698531363 wait complete. 2024-09-12T16:52:15.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.313+0000 7efd0f8549c0 1 Processor -- start 2024-09-12T16:52:15.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- start start 2024-09-12T16:52:15.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c0c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561883a29680 con 0x561883a95210 2024-09-12T16:52:15.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0d35a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c0c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0d35a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c0c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33510/0 (socket says 172.21.15.151:33510) 2024-09-12T16:52:15.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0d35a640 1 -- 172.21.15.151:0/2880627714 learned_addr learned my addr 172.21.15.151:0/2880627714 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0d35a640 1 -- 172.21.15.151:0/2880627714 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618839a4da0 con 0x561883a95210 2024-09-12T16:52:15.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0d35a640 1 --2- 172.21.15.151:0/2880627714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c0c7d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efd08000f90 tx=0x7efd080033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b3f7245b809d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efbfb606640 1 -- 172.21.15.151:0/2880627714 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd080b0040 con 0x561883a95210 2024-09-12T16:52:15.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efbfb606640 1 -- 172.21.15.151:0/2880627714 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd080ab630 con 0x561883a95210 2024-09-12T16:52:15.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efbfb606640 1 -- 172.21.15.151:0/2880627714 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd080ab910 con 0x561883a95210 2024-09-12T16:52:15.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2880627714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 msgr2=0x561883c0c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2880627714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c0c7d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efd08000f90 tx=0x7efd080033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2880627714 shutdown_connections 2024-09-12T16:52:15.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2880627714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c0c7d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2880627714 >> 172.21.15.151:0/2880627714 conn(0x561883b1b8f0 msgr2=0x561883c08410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2880627714 shutdown_connections 2024-09-12T16:52:15.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2880627714 wait complete. 2024-09-12T16:52:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 Processor -- start 2024-09-12T16:52:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- start start 2024-09-12T16:52:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c13cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0f8549c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618839cba50 con 0x561883a95210 2024-09-12T16:52:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0d35a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c13cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0d35a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c13cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33520/0 (socket says 172.21.15.151:33520) 2024-09-12T16:52:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.317+0000 7efd0d35a640 1 -- 172.21.15.151:0/3159682114 learned_addr learned my addr 172.21.15.151:0/3159682114 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0d35a640 1 -- 172.21.15.151:0/3159682114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561883c14220 con 0x561883a95210 2024-09-12T16:52:15.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0d35a640 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c13cc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd08000f90 tx=0x7efd08017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efbf9e03640 1 -- 172.21.15.151:0/3159682114 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd080c3020 con 0x561883a95210 2024-09-12T16:52:15.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561883c144b0 con 0x561883a95210 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efbf9e03640 1 -- 172.21.15.151:0/3159682114 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd080be790 con 0x561883a95210 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efbf9e03640 1 -- 172.21.15.151:0/3159682114 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd080b0040 con 0x561883a95210 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561883c14e90 con 0x561883a95210 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efbf9e03640 1 -- 172.21.15.151:0/3159682114 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd080c6020 con 0x561883a95210 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efbf9e03640 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbf4039a70 0x7efbf403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efbf9e03640 1 -- 172.21.15.151:0/3159682114 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efd080ba040 con 0x561883a95210 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0cb59640 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbf4039a70 0x7efbf403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883b24100 0x561883c1ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c1b320 con 0x561883b24100 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0db5b640 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883b24100 0x561883c1ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0cb59640 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbf4039a70 0x7efbf403bf30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efcf8001d80 tx=0x7efcf80012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0db5b640 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883b24100 0x561883c1ade0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0db5b640 1 -- 172.21.15.151:0/3159682114 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd000083f0 con 0x561883b24100 2024-09-12T16:52:15.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.321+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c1b760 con 0x561883b24100 2024-09-12T16:52:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0db5b640 1 -- 172.21.15.151:0/3159682114 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd000083f0 con 0x561883b24100 2024-09-12T16:52:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c1d570 0x561883c1f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c20050 con 0x561883c1d570 2024-09-12T16:52:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0d35a640 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c1d570 0x561883c1f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0d35a640 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c1d570 0x561883c1f960 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0d35a640 1 -- 172.21.15.151:0/3159682114 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd080bf920 con 0x561883c1d570 2024-09-12T16:52:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c1c410 con 0x561883b24100 2024-09-12T16:52:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0db5b640 1 -- 172.21.15.151:0/3159682114 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd000083f0 con 0x561883b24100 2024-09-12T16:52:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c1c8b0 con 0x561883b24100 2024-09-12T16:52:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0db5b640 1 -- 172.21.15.151:0/3159682114 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd000083f0 con 0x561883b24100 2024-09-12T16:52:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0f8549c0 1 Processor -- start 2024-09-12T16:52:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0f8549c0 1 -- start start 2024-09-12T16:52:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0f8549c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c2e6e0 0x561883c2eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0f8549c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561883a36450 con 0x561883c2e6e0 2024-09-12T16:52:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0db5b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c2e6e0 0x561883c2eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.325+0000 7efd0db5b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c2e6e0 0x561883c2eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33524/0 (socket says 172.21.15.151:33524) 2024-09-12T16:52:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0db5b640 1 -- 172.21.15.151:0/1536717493 learned_addr learned my addr 172.21.15.151:0/1536717493 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0db5b640 1 -- 172.21.15.151:0/1536717493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561883c2f140 con 0x561883c2e6e0 2024-09-12T16:52:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0db5b640 1 --2- 172.21.15.151:0/1536717493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c2e6e0 0x561883c2eb00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x561883c14700 tx=0x7efd0000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efbf2ffd640 1 -- 172.21.15.151:0/1536717493 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00007dd0 con 0x561883c2e6e0 2024-09-12T16:52:15.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efbf2ffd640 1 -- 172.21.15.151:0/1536717493 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0001e020 con 0x561883c2e6e0 2024-09-12T16:52:15.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efbf2ffd640 1 -- 172.21.15.151:0/1536717493 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00019590 con 0x561883c2e6e0 2024-09-12T16:52:15.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0f8549c0 1 -- 172.21.15.151:0/1536717493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561883c2f9a0 con 0x561883c2e6e0 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0f8549c0 1 -- 172.21.15.151:0/1536717493 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561883c2ff10 con 0x561883c2e6e0 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efbf2ffd640 1 -- 172.21.15.151:0/1536717493 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd00016040 con 0x561883c2e6e0 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efbf2ffd640 1 --2- 172.21.15.151:0/1536717493 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbe4039ac0 0x7efbe403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efbf2ffd640 1 -- 172.21.15.151:0/1536717493 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efd0001f030 con 0x561883c2e6e0 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0d35a640 1 --2- 172.21.15.151:0/1536717493 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbe4039ac0 0x7efbe403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0f8549c0 1 Processor -- start 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0f8549c0 1 -- start start 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0d35a640 1 --2- 172.21.15.151:0/1536717493 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbe4039ac0 0x7efbe403bf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x561883c150d0 tx=0x7efd080d4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.329+0000 7efd0f8549c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c3c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561883c0cf60 con 0x561883c3bfd0 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c3c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c3c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33534/0 (socket says 172.21.15.151:33534) 2024-09-12T16:52:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 -- 172.21.15.151:0/234827715 learned_addr learned my addr 172.21.15.151:0/234827715 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 -- 172.21.15.151:0/234827715 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561883c3c980 con 0x561883c3bfd0 2024-09-12T16:52:15.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 --2- 172.21.15.151:0/234827715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c3c3b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efd000174f0 tx=0x7efd0002bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e11efc93ee7d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efbf0ff9640 1 -- 172.21.15.151:0/234827715 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0001d040 con 0x561883c3bfd0 2024-09-12T16:52:15.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efbf0ff9640 1 -- 172.21.15.151:0/234827715 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00052110 con 0x561883c3bfd0 2024-09-12T16:52:15.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efbf0ff9640 1 -- 172.21.15.151:0/234827715 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd000153e0 con 0x561883c3bfd0 2024-09-12T16:52:15.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 -- 172.21.15.151:0/234827715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 msgr2=0x561883c3c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/234827715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c3c3b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efd000174f0 tx=0x7efd0002bda0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 -- 172.21.15.151:0/234827715 shutdown_connections 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/234827715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c3c3b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 -- 172.21.15.151:0/234827715 >> 172.21.15.151:0/234827715 conn(0x561883c373f0 msgr2=0x561883c35630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 -- 172.21.15.151:0/234827715 shutdown_connections 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 -- 172.21.15.151:0/234827715 wait complete. 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 Processor -- start 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 -- start start 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c42530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0f8549c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561883c3af20 con 0x561883c3bfd0 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c42530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c42530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33536/0 (socket says 172.21.15.151:33536) 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 learned_addr learned my addr 172.21.15.151:0/2844397992 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561883c42a90 con 0x561883c3bfd0 2024-09-12T16:52:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.333+0000 7efd0db5b640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c42530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd0004b010 tx=0x7efd00050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efbe2ffd640 1 -- 172.21.15.151:0/2844397992 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0001d030 con 0x561883c3bfd0 2024-09-12T16:52:15.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efbe2ffd640 1 -- 172.21.15.151:0/2844397992 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00031030 con 0x561883c3bfd0 2024-09-12T16:52:15.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561883c42d20 con 0x561883c3bfd0 2024-09-12T16:52:15.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efbe2ffd640 1 -- 172.21.15.151:0/2844397992 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00048040 con 0x561883c3bfd0 2024-09-12T16:52:15.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561883c436d0 con 0x561883c3bfd0 2024-09-12T16:52:15.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efbe2ffd640 1 -- 172.21.15.151:0/2844397992 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efd000157c0 con 0x561883c3bfd0 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efbe2ffd640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbd8039a70 0x7efbd803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efbe2ffd640 1 -- 172.21.15.151:0/2844397992 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efd00037c80 con 0x561883c3bfd0 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0d35a640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbd8039a70 0x7efbd803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883c4d770 0x561883c4fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c50310 con 0x561883c4d770 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0cb59640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883c4d770 0x561883c4fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0d35a640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbd8039a70 0x7efbd803bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd080a3a30 tx=0x7efd080b3f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0cb59640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883c4d770 0x561883c4fbc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efcf800e5a0 con 0x561883c4d770 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 realm 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c4cb80 con 0x561883c4d770 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efcf800e5a0 con 0x561883c4d770 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c50e10 con 0x561883c4d770 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efcf800e5a0 con 0x561883c4d770 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c516e0 con 0x561883c4d770 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efcf800e5a0 con 0x561883c4d770 2024-09-12T16:52:15.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:15.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c51fe0 0x561883c543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.337+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c54b10 con 0x561883c51fe0 2024-09-12T16:52:15.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0db5b640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c51fe0 0x561883c543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0db5b640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c51fe0 0x561883c543d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0f8549c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:15.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0f8549c0 20 searching for the correct realm 2024-09-12T16:52:15.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561883c56a80 0x561883c58f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0d35a640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561883c56a80 0x561883c58f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0d35a640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561883c56a80 0x561883c58f40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0d35a640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efd080c8020 0x7efd080e71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x7efd080c8020 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0cb59640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efd080c8020 0x7efd080e71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0cb59640 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efd080c8020 0x7efd080e71e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf800e5a0 con 0x7efd080c8020 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.341+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c4d770 2024-09-12T16:52:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf800e5a0 con 0x561883c4d770 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c4d770 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x7efd080c8020 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x7efd080c8020 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c4d770 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c4d770 2024-09-12T16:52:15.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.345+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x7efd080c8020 2024-09-12T16:52:15.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efcf8029040 con 0x7efd080c8020 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c4d770 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c4d770 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x7efd080c8020 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x7efd080c8020 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c4d770 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.349+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x7efd080c8020 2024-09-12T16:52:15.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x7efd080c8020 2024-09-12T16:52:15.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c56a80 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c51fe0 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x561883c4d770 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561883c59610 con 0x7efd080c8020 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8029040 con 0x7efd080c8020 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0f8549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0f8549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0f8549c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0f8549c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0f8549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0f8549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.353+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c55460 con 0x561883c4d770 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c558e0 con 0x561883c4d770 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efcf8029040 con 0x561883c4d770 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c55d00 con 0x561883c4d770 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 zone default found 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 4 Realm: () 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 zonegroup default 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c55d00 con 0x561883c51fe0 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c5b930 con 0x561883c56a80 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c5bcd0 con 0x561883c56a80 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 started sync module instance, tier type = 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:15.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5ad70 con 0x7efd080c8020 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94663289975408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5ad70 con 0x7efd080c8020 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.357+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5c690 con 0x561883c4d770 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.361+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94663289975408] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.361+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.361+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94663289979632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5ad70 con 0x561883c4d770 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.361+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5d0a0 con 0x561883c56a80 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.361+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94663289979632] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.361+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.361+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94663289972928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5ace0 con 0x561883c56a80 2024-09-12T16:52:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.361+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5dda0 con 0x7efd080c8020 2024-09-12T16:52:15.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.365+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.365+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94663289985536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5e3d0 con 0x7efd080c8020 2024-09-12T16:52:15.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.365+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5eef0 con 0x561883c4d770 2024-09-12T16:52:15.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.365+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94663289972928] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.365+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.365+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94663289989568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5eeb0 con 0x561883c4d770 2024-09-12T16:52:15.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.365+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5f900 con 0x561883c51fe0 2024-09-12T16:52:15.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.369+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94663289985536] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.369+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94663289989568] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.369+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.369+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94663289984064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c5de20 con 0x561883c51fe0 2024-09-12T16:52:15.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.369+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c60150 con 0x561883c51fe0 2024-09-12T16:52:15.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94663289984064] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94663289992272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c60150 con 0x561883c51fe0 2024-09-12T16:52:15.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c60a00 con 0x561883c51fe0 2024-09-12T16:52:15.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94663289992272] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94663289995600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c610b0 con 0x561883c51fe0 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 20 add_watcher() i=0 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 20 add_watcher() i=1 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 20 add_watcher() i=2 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 20 add_watcher() i=3 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 20 add_watcher() i=4 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 20 add_watcher() i=5 2024-09-12T16:52:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.373+0000 7efd0f8549c0 20 add_watcher() i=6 2024-09-12T16:52:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94663289995600] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0f8549c0 20 add_watcher() i=7 2024-09-12T16:52:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0f8549c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c63fb0 con 0x561883c4d770 2024-09-12T16:52:15.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94663289998032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c613a0 con 0x561883c4d770 2024-09-12T16:52:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94663289998032] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efbc3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0f8549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0f8549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efd0f8549c0 5 note: GC not initialized 2024-09-12T16:52:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.377+0000 7efbc2fe5640 20 reqs_thread_entry: start 2024-09-12T16:52:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 20 Filter name: none 2024-09-12T16:52:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efbc0fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87750 con 0x561883c4d770 2024-09-12T16:52:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87750 con 0x7efd080c8020 2024-09-12T16:52:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87710 con 0x561883c4d770 2024-09-12T16:52:15.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87710 con 0x561883c56a80 2024-09-12T16:52:15.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87c20 con 0x561883c56a80 2024-09-12T16:52:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c88070 con 0x561883c56a80 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c88070 con 0x561883c4d770 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c88070 con 0x561883c4d770 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c88070 con 0x561883c56a80 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c88020 con 0x561883c56a80 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.381+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c88000 con 0x561883c51fe0 2024-09-12T16:52:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c88000 con 0x561883c4d770 2024-09-12T16:52:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c88000 con 0x7efd080c8020 2024-09-12T16:52:15.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c56a80 2024-09-12T16:52:15.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c56a80 2024-09-12T16:52:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.385+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c4d770 2024-09-12T16:52:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c56a80 2024-09-12T16:52:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x7efd080c8020 2024-09-12T16:52:15.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c4d770 2024-09-12T16:52:15.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c4d770 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c56a80 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c4d770 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c4d770 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c56a80 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.389+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c56a80 2024-09-12T16:52:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c56a80 2024-09-12T16:52:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efbc3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94663289998032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c4d770 2024-09-12T16:52:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94663289998032] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.393+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94663289975408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x7efd080c8020 2024-09-12T16:52:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.397+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94663289975408] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.397+0000 7efd0f8549c0 20 remove_watcher() i=0 2024-09-12T16:52:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.397+0000 7efd0f8549c0 2 removed watcher, disabling cache 2024-09-12T16:52:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.397+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94663289979632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c4d770 2024-09-12T16:52:15.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.397+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94663289979632] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.397+0000 7efd0f8549c0 20 remove_watcher() i=1 2024-09-12T16:52:15.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.397+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94663289972928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c56a80 2024-09-12T16:52:15.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0d35a640 1 -- 172.21.15.151:0/2844397992 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94663289972928] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd080bf920 con 0x561883c56a80 2024-09-12T16:52:15.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0f8549c0 20 remove_watcher() i=2 2024-09-12T16:52:15.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94663289985536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x7efd080c8020 2024-09-12T16:52:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94663289985536] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x7efd080c8020 2024-09-12T16:52:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0f8549c0 20 remove_watcher() i=3 2024-09-12T16:52:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94663289989568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c4d770 2024-09-12T16:52:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94663289989568] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf80391c0 con 0x561883c4d770 2024-09-12T16:52:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0f8549c0 20 remove_watcher() i=4 2024-09-12T16:52:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.401+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94663289984064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.405+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94663289984064] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.405+0000 7efd0f8549c0 20 remove_watcher() i=5 2024-09-12T16:52:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.405+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94663289992272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94663289992272] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 20 remove_watcher() i=6 2024-09-12T16:52:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94663289995600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561883c87fe0 con 0x561883c51fe0 2024-09-12T16:52:15.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0db5b640 1 -- 172.21.15.151:0/2844397992 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94663289995600] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0003d070 con 0x561883c51fe0 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 20 remove_watcher() i=7 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c51fe0 msgr2=0x561883c543d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c51fe0 0x561883c543d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883c4d770 msgr2=0x561883c4fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883c4d770 0x561883c4fbc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efd080c8020 msgr2=0x7efd080e71e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efd080c8020 0x7efd080e71e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561883c56a80 msgr2=0x561883c58f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561883c56a80 0x561883c58f40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbd8039a70 msgr2=0x7efbd803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbd8039a70 0x7efbd803bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd080a3a30 tx=0x7efd080b3f90 comp rx=0 tx=0).stop 2024-09-12T16:52:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 msgr2=0x561883c42530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c42530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd0004b010 tx=0x7efd00050860 comp rx=0 tx=0).stop 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0cb59640 1 -- 172.21.15.151:0/2844397992 reap_dead start 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 shutdown_connections 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/2844397992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c3bfd0 0x561883c42530 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 >> 172.21.15.151:0/2844397992 conn(0x561883c373f0 msgr2=0x561883c35600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 shutdown_connections 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/2844397992 wait complete. 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/1536717493 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbe4039ac0 msgr2=0x7efbe403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/1536717493 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbe4039ac0 0x7efbe403bf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x561883c150d0 tx=0x7efd080d4040 comp rx=0 tx=0).stop 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/1536717493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c2e6e0 msgr2=0x561883c2eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/1536717493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c2e6e0 0x561883c2eb00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x561883c14700 tx=0x7efd0000af40 comp rx=0 tx=0).stop 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/1536717493 shutdown_connections 2024-09-12T16:52:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/1536717493 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbe4039ac0 0x7efbe403bf80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/1536717493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883c2e6e0 0x561883c2eb00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/1536717493 >> 172.21.15.151:0/1536717493 conn(0x561883c24090 msgr2=0x561883c24470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/1536717493 shutdown_connections 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.409+0000 7efd0f8549c0 1 -- 172.21.15.151:0/1536717493 wait complete. 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c1d570 msgr2=0x561883c1f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c1d570 0x561883c1f960 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883b24100 msgr2=0x561883c1ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883b24100 0x561883c1ade0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbf4039a70 msgr2=0x7efbf403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbf4039a70 0x7efbf403bf30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efcf8001d80 tx=0x7efcf80012e0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 msgr2=0x561883c13cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c13cc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd08000f90 tx=0x7efd08017d70 comp rx=0 tx=0).stop 2024-09-12T16:52:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 shutdown_connections 2024-09-12T16:52:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561883c1d570 0x561883c1f960 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561883b24100 0x561883c1ade0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efbf4039a70 0x7efbf403bf30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 --2- 172.21.15.151:0/3159682114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561883a95210 0x561883c13cc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 >> 172.21.15.151:0/3159682114 conn(0x561883b1b8f0 msgr2=0x561883c06ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 shutdown_connections 2024-09-12T16:52:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.413+0000 7efd0f8549c0 1 -- 172.21.15.151:0/3159682114 wait complete. 2024-09-12T16:52:15.425 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[],"summary":[]} 2024-09-12T16:52:15.425 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-12T16:52:15.426 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:52:15.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:52:15.426 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:52:15.512 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:15.512 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:15.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.509+0000 7f319101b9c0 1 Processor -- start 2024-09-12T16:52:15.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.509+0000 7f319101b9c0 1 -- start start 2024-09-12T16:52:15.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.509+0000 7f319101b9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555a7f204200 0x555a7f292c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.509+0000 7f319101b9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a7f1449c0 con 0x555a7f293170 2024-09-12T16:52:15.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.509+0000 7f319101b9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x555a7f1946d0 con 0x555a7f204200 2024-09-12T16:52:15.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318eb21640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555a7f204200 0x555a7f292c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318e320640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x555a7f293170 0x555a7f295560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37994/0 (socket says 172.21.15.151:37994) 2024-09-12T16:52:15.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318e320640 1 -- 172.21.15.151:0/2546699334 learned_addr learned my addr 172.21.15.151:0/2546699334 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:15.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318eb21640 1 -- 172.21.15.151:0/2546699334 >> v1:172.21.15.122:6789/0 conn(0x555a7f293170 legacy=0x555a7f295560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318eb21640 1 -- 172.21.15.151:0/2546699334 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7f138ca0 con 0x555a7f204200 2024-09-12T16:52:15.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318eb21640 1 --2- 172.21.15.151:0/2546699334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f292c30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f318000a480 tx=0x7f318001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192c095e4f866c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318db1f640 1 -- 172.21.15.151:0/2546699334 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31800af070 con 0x555a7f204200 2024-09-12T16:52:15.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318db1f640 1 -- 172.21.15.151:0/2546699334 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31800aa530 con 0x555a7f204200 2024-09-12T16:52:15.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.513+0000 7f318db1f640 1 -- 172.21.15.151:0/2546699334 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31800aa830 con 0x555a7f204200 2024-09-12T16:52:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.517+0000 7f319101b9c0 1 -- 172.21.15.151:0/2546699334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 msgr2=0x555a7f292c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.517+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2546699334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f292c30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f318000a480 tx=0x7f318001b280 comp rx=0 tx=0).stop 2024-09-12T16:52:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.517+0000 7f319101b9c0 1 -- 172.21.15.151:0/2546699334 shutdown_connections 2024-09-12T16:52:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.517+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2546699334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f292c30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.517+0000 7f319101b9c0 1 -- 172.21.15.151:0/2546699334 >> 172.21.15.151:0/2546699334 conn(0x555a7f28a920 msgr2=0x555a7f28cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.517+0000 7f319101b9c0 1 -- 172.21.15.151:0/2546699334 shutdown_connections 2024-09-12T16:52:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.517+0000 7f319101b9c0 1 -- 172.21.15.151:0/2546699334 wait complete. 2024-09-12T16:52:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 Processor -- start 2024-09-12T16:52:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- start start 2024-09-12T16:52:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f37b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a7f198680 con 0x555a7f204200 2024-09-12T16:52:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f318eb21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f37b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f318eb21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f37b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33558/0 (socket says 172.21.15.151:33558) 2024-09-12T16:52:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f318eb21640 1 -- 172.21.15.151:0/3150072275 learned_addr learned my addr 172.21.15.151:0/3150072275 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f318eb21640 1 -- 172.21.15.151:0/3150072275 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7f113da0 con 0x555a7f204200 2024-09-12T16:52:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f318eb21640 1 --2- 172.21.15.151:0/3150072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f37b7b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3180017e90 tx=0x7f3180003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6317444a8cad8aec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f307ce09640 1 -- 172.21.15.151:0/3150072275 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31800af030 con 0x555a7f204200 2024-09-12T16:52:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f307ce09640 1 -- 172.21.15.151:0/3150072275 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31800aa810 con 0x555a7f204200 2024-09-12T16:52:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f307ce09640 1 -- 172.21.15.151:0/3150072275 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31800aaaf0 con 0x555a7f204200 2024-09-12T16:52:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- 172.21.15.151:0/3150072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 msgr2=0x555a7f37b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 --2- 172.21.15.151:0/3150072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f37b7b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3180017e90 tx=0x7f3180003030 comp rx=0 tx=0).stop 2024-09-12T16:52:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- 172.21.15.151:0/3150072275 shutdown_connections 2024-09-12T16:52:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 --2- 172.21.15.151:0/3150072275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f37b7b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- 172.21.15.151:0/3150072275 >> 172.21.15.151:0/3150072275 conn(0x555a7f28a920 msgr2=0x555a7f3773f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- 172.21.15.151:0/3150072275 shutdown_connections 2024-09-12T16:52:15.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- 172.21.15.151:0/3150072275 wait complete. 2024-09-12T16:52:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 Processor -- start 2024-09-12T16:52:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- start start 2024-09-12T16:52:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f382db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.533+0000 7f319101b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a7f13aa50 con 0x555a7f204200 2024-09-12T16:52:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f318eb21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f382db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f318eb21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f382db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33560/0 (socket says 172.21.15.151:33560) 2024-09-12T16:52:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f318eb21640 1 -- 172.21.15.151:0/304246227 learned_addr learned my addr 172.21.15.151:0/304246227 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f318eb21640 1 -- 172.21.15.151:0/304246227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7f383310 con 0x555a7f204200 2024-09-12T16:52:15.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f318eb21640 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f382db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3180003070 tx=0x7f3180018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f307b606640 1 -- 172.21.15.151:0/304246227 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31800c6020 con 0x555a7f204200 2024-09-12T16:52:15.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f307b606640 1 -- 172.21.15.151:0/304246227 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31800b6970 con 0x555a7f204200 2024-09-12T16:52:15.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a7f3835a0 con 0x555a7f204200 2024-09-12T16:52:15.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f307b606640 1 -- 172.21.15.151:0/304246227 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31800b6c50 con 0x555a7f204200 2024-09-12T16:52:15.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7f383f50 con 0x555a7f204200 2024-09-12T16:52:15.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f307b606640 1 -- 172.21.15.151:0/304246227 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f31800c9020 con 0x555a7f204200 2024-09-12T16:52:15.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f307b606640 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3074039ac0 0x7f307403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f307b606640 1 -- 172.21.15.151:0/304246227 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f31800bb070 con 0x555a7f204200 2024-09-12T16:52:15.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f318e320640 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3074039ac0 0x7f307403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f293170 0x555a7f389f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f38a460 con 0x555a7f293170 2024-09-12T16:52:15.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.537+0000 7f318f322640 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f293170 0x555a7f389f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318e320640 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3074039ac0 0x7f307403bf80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3184004180 tx=0x7f3184001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318f322640 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f293170 0x555a7f389f20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318f322640 1 -- 172.21.15.151:0/304246227 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f318800a4d0 con 0x555a7f293170 2024-09-12T16:52:15.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f38a860 con 0x555a7f293170 2024-09-12T16:52:15.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318f322640 1 -- 172.21.15.151:0/304246227 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f318800a4d0 con 0x555a7f293170 2024-09-12T16:52:15.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f38c670 0x555a7f38ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f38f150 con 0x555a7f38c670 2024-09-12T16:52:15.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318eb21640 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f38c670 0x555a7f38ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318eb21640 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f38c670 0x555a7f38ea60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318eb21640 1 -- 172.21.15.151:0/304246227 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f38c670 2024-09-12T16:52:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f38b4e0 con 0x555a7f293170 2024-09-12T16:52:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318f322640 1 -- 172.21.15.151:0/304246227 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f318800a4d0 con 0x555a7f293170 2024-09-12T16:52:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f38b980 con 0x555a7f293170 2024-09-12T16:52:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f318f322640 1 -- 172.21.15.151:0/304246227 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f318800a4d0 con 0x555a7f293170 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f319101b9c0 1 Processor -- start 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.541+0000 7f319101b9c0 1 -- start start 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f319101b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f39d7b0 0x555a7f39dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f319101b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a7f1a5450 con 0x555a7f39d7b0 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f318f322640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f39d7b0 0x555a7f39dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f318f322640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f39d7b0 0x555a7f39dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33576/0 (socket says 172.21.15.151:33576) 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f318f322640 1 -- 172.21.15.151:0/1242341462 learned_addr learned my addr 172.21.15.151:0/1242341462 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f318f322640 1 -- 172.21.15.151:0/1242341462 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7f39e210 con 0x555a7f39d7b0 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f318f322640 1 --2- 172.21.15.151:0/1242341462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f39d7b0 0x555a7f39dbd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x555a7f383b30 tx=0x7f3188018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f3078e01640 1 -- 172.21.15.151:0/1242341462 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188014450 con 0x555a7f39d7b0 2024-09-12T16:52:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f3078e01640 1 -- 172.21.15.151:0/1242341462 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3188014610 con 0x555a7f39d7b0 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f3078e01640 1 -- 172.21.15.151:0/1242341462 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188014930 con 0x555a7f39d7b0 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f319101b9c0 1 -- 172.21.15.151:0/1242341462 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a7f39ea70 con 0x555a7f39d7b0 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f319101b9c0 1 -- 172.21.15.151:0/1242341462 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7f39efe0 con 0x555a7f39d7b0 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f3078e01640 1 -- 172.21.15.151:0/1242341462 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3188011040 con 0x555a7f39d7b0 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f3078e01640 1 --2- 172.21.15.151:0/1242341462 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3068039ac0 0x7f306803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f3078e01640 1 -- 172.21.15.151:0/1242341462 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f318801e070 con 0x555a7f39d7b0 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.545+0000 7f318eb21640 1 --2- 172.21.15.151:0/1242341462 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3068039ac0 0x7f306803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 Processor -- start 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- start start 2024-09-12T16:52:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318eb21640 1 --2- 172.21.15.151:0/1242341462 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3068039ac0 0x7f306803bf80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f31800e9af0 tx=0x7f3180009420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f28eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a7f37bf40 con 0x555a7f28ebf0 2024-09-12T16:52:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318f322640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f28eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318f322640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f28eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33584/0 (socket says 172.21.15.151:33584) 2024-09-12T16:52:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318f322640 1 -- 172.21.15.151:0/2870495858 learned_addr learned my addr 172.21.15.151:0/2870495858 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318f322640 1 -- 172.21.15.151:0/2870495858 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7f28f5c0 con 0x555a7f28ebf0 2024-09-12T16:52:15.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318f322640 1 --2- 172.21.15.151:0/2870495858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f28eff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3188050630 tx=0x7f318802b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c368748ceff3dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f30727fc640 1 -- 172.21.15.151:0/2870495858 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31880167c0 con 0x555a7f28ebf0 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f30727fc640 1 -- 172.21.15.151:0/2870495858 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3188011330 con 0x555a7f28ebf0 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f30727fc640 1 -- 172.21.15.151:0/2870495858 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188016960 con 0x555a7f28ebf0 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- 172.21.15.151:0/2870495858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 msgr2=0x555a7f28eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2870495858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f28eff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3188050630 tx=0x7f318802b410 comp rx=0 tx=0).stop 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- 172.21.15.151:0/2870495858 shutdown_connections 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2870495858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f28eff0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- 172.21.15.151:0/2870495858 >> 172.21.15.151:0/2870495858 conn(0x555a7f3a64c0 msgr2=0x555a7f3a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- 172.21.15.151:0/2870495858 shutdown_connections 2024-09-12T16:52:15.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- 172.21.15.151:0/2870495858 wait complete. 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 Processor -- start 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- start start 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f3b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f319101b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a7f28fc80 con 0x555a7f28ebf0 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318f322640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f3b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318f322640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f3b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33600/0 (socket says 172.21.15.151:33600) 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.549+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 learned_addr learned my addr 172.21.15.151:0/2956617661 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7f3b3da0 con 0x555a7f28ebf0 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f318f322640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f3b3840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f318804b010 tx=0x7f3188050590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f3070ff9640 1 -- 172.21.15.151:0/2956617661 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318803e7b0 con 0x555a7f28ebf0 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a7f3b4030 con 0x555a7f28ebf0 2024-09-12T16:52:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f3070ff9640 1 -- 172.21.15.151:0/2956617661 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3188031030 con 0x555a7f28ebf0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f3070ff9640 1 -- 172.21.15.151:0/2956617661 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318803ea80 con 0x555a7f28ebf0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7f3b49e0 con 0x555a7f28ebf0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f3070ff9640 1 -- 172.21.15.151:0/2956617661 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f318803ec20 con 0x555a7f28ebf0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f3070ff9640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3058039ac0 0x7f305803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f3070ff9640 1 -- 172.21.15.151:0/2956617661 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f318800e040 con 0x555a7f28ebf0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f318eb21640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3058039ac0 0x7f305803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f3bea60 0x555a7f3c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3c1640 con 0x555a7f3bea60 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f318e320640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f3bea60 0x555a7f3c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f318eb21640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3058039ac0 0x7f305803bf80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31800aafd0 tx=0x7f31800dd000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f318e320640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f3bea60 0x555a7f3c0ef0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f318400e640 con 0x555a7f3bea60 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 20 realm 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.553+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3bde70 con 0x555a7f3bea60 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f318400e640 con 0x555a7f3bea60 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3c2140 con 0x555a7f3bea60 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f318400e640 con 0x555a7f3bea60 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3c2a10 con 0x555a7f3bea60 2024-09-12T16:52:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f318400e640 con 0x555a7f3bea60 2024-09-12T16:52:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f3c32c0 0x555a7f3c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3c5df0 con 0x555a7f3c32c0 2024-09-12T16:52:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318f322640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f3c32c0 0x555a7f3c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318f322640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f3c32c0 0x555a7f3c56b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 20 searching for the correct realm 2024-09-12T16:52:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a7f3c7de0 0x555a7f3ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318eb21640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a7f3c7de0 0x555a7f3ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318eb21640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a7f3c7de0 0x555a7f3ca2a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318eb21640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f31800cb020 0x7f31800eb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x7f31800cb020 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318e320640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f31800cb020 0x7f31800eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.557+0000 7f318e320640 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f31800cb020 0x7f31800eb050 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318400e640 con 0x7f31800cb020 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3bea60 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318400e640 con 0x555a7f3bea60 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3bea60 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x7f31800cb020 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x7f31800cb020 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3bea60 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.561+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3bea60 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x7f31800cb020 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3184029040 con 0x7f31800cb020 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3bea60 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3bea60 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.565+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x7f31800cb020 2024-09-12T16:52:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x7f31800cb020 2024-09-12T16:52:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3bea60 2024-09-12T16:52:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x7f31800cb020 2024-09-12T16:52:15.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x7f31800cb020 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c7de0 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3c32c0 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x555a7f3bea60 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.569+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ca970 con 0x7f31800cb020 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3184029040 con 0x7f31800cb020 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3c6800 con 0x555a7f3bea60 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3c6c80 con 0x555a7f3bea60 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3184029040 con 0x555a7f3bea60 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3c70a0 con 0x555a7f3bea60 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 zone default found 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 4 Realm: () 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 zonegroup default 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3c70a0 con 0x555a7f3c32c0 2024-09-12T16:52:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ccc90 con 0x555a7f3c7de0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cd030 con 0x555a7f3c7de0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 started sync module instance, tier type = 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cc0d0 con 0x7f31800cb020 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.573+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x7f31800cb020 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.577+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93847170106864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cc0d0 con 0x7f31800cb020 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.577+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cd9f0 con 0x555a7f3bea60 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.577+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93847170106864] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x7f31800cb020 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.577+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.577+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93847170111056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cc0d0 con 0x555a7f3bea60 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.577+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3ce290 con 0x555a7f3c7de0 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93847170111056] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93847170104352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cc040 con 0x555a7f3c7de0 2024-09-12T16:52:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cf010 con 0x7f31800cb020 2024-09-12T16:52:15.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x7f31800cb020 2024-09-12T16:52:15.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93847170116752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cf8b0 con 0x7f31800cb020 2024-09-12T16:52:15.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d0270 con 0x555a7f3bea60 2024-09-12T16:52:15.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93847170104352] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93847170116752] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x7f31800cb020 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93847170121152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cf820 con 0x555a7f3bea60 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.581+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d01e0 con 0x555a7f3c32c0 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.585+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93847170121152] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.585+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.585+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93847170118784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d0b10 con 0x555a7f3c32c0 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.585+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d1360 con 0x555a7f3c32c0 2024-09-12T16:52:15.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.589+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93847170118784] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.589+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.589+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93847170123840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d1210 con 0x555a7f3c32c0 2024-09-12T16:52:15.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.589+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d1d30 con 0x555a7f3c32c0 2024-09-12T16:52:15.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93847170127872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d21a0 con 0x555a7f3c32c0 2024-09-12T16:52:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 20 add_watcher() i=0 2024-09-12T16:52:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 20 add_watcher() i=1 2024-09-12T16:52:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 20 add_watcher() i=2 2024-09-12T16:52:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 20 add_watcher() i=3 2024-09-12T16:52:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 20 add_watcher() i=4 2024-09-12T16:52:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 20 add_watcher() i=5 2024-09-12T16:52:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93847170123840] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 20 add_watcher() i=6 2024-09-12T16:52:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93847170127872] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 20 add_watcher() i=7 2024-09-12T16:52:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d0ca0 con 0x555a7f3bea60 2024-09-12T16:52:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.593+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93847170124896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3d2720 con 0x555a7f3bea60 2024-09-12T16:52:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93847170124896] v32'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f30457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 5 note: GC not initialized 2024-09-12T16:52:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f2fbffff640 20 reqs_thread_entry: start 2024-09-12T16:52:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 20 Filter name: none 2024-09-12T16:52:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f2fbdffb640 20 reqs_thread_entry: start 2024-09-12T16:52:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3f7f30 con 0x555a7f3bea60 2024-09-12T16:52:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:could not fetch user info: no user info saved 2024-09-12T16:52:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f30457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.597+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93847170124896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3f7ef0 con 0x555a7f3bea60 2024-09-12T16:52:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93847170124896] v32'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93847170106864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3f7ef0 con 0x7f31800cb020 2024-09-12T16:52:15.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93847170106864] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x7f31800cb020 2024-09-12T16:52:15.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f319101b9c0 20 remove_watcher() i=0 2024-09-12T16:52:15.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f319101b9c0 2 removed watcher, disabling cache 2024-09-12T16:52:15.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93847170111056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3f7ef0 con 0x555a7f3bea60 2024-09-12T16:52:15.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93847170111056] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f319101b9c0 20 remove_watcher() i=1 2024-09-12T16:52:15.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.601+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93847170104352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3f7ef0 con 0x555a7f3c7de0 2024-09-12T16:52:15.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.605+0000 7f318eb21640 1 -- 172.21.15.151:0/2956617661 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93847170104352] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800a8070 con 0x555a7f3c7de0 2024-09-12T16:52:15.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.605+0000 7f319101b9c0 20 remove_watcher() i=2 2024-09-12T16:52:15.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.605+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93847170116752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cd650 con 0x7f31800cb020 2024-09-12T16:52:15.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.605+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93847170116752] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x7f31800cb020 2024-09-12T16:52:15.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.605+0000 7f319101b9c0 20 remove_watcher() i=3 2024-09-12T16:52:15.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.605+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93847170121152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cbc20 con 0x555a7f3bea60 2024-09-12T16:52:15.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.609+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93847170121152] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31840391c0 con 0x555a7f3bea60 2024-09-12T16:52:15.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.609+0000 7f319101b9c0 20 remove_watcher() i=4 2024-09-12T16:52:15.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.609+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93847170118784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cfdc0 con 0x555a7f3c32c0 2024-09-12T16:52:15.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.609+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93847170118784] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.609+0000 7f319101b9c0 20 remove_watcher() i=5 2024-09-12T16:52:15.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.609+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93847170123840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cbc20 con 0x555a7f3c32c0 2024-09-12T16:52:15.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93847170123840] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 20 remove_watcher() i=6 2024-09-12T16:52:15.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93847170127872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a7f3cf480 con 0x555a7f3c32c0 2024-09-12T16:52:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f318f322640 1 -- 172.21.15.151:0/2956617661 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93847170127872] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318803d070 con 0x555a7f3c32c0 2024-09-12T16:52:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 20 remove_watcher() i=7 2024-09-12T16:52:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f3c32c0 msgr2=0x555a7f3c56b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f3c32c0 0x555a7f3c56b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f3bea60 msgr2=0x555a7f3c0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f3bea60 0x555a7f3c0ef0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f31800cb020 msgr2=0x7f31800eb050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f31800cb020 0x7f31800eb050 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a7f3c7de0 msgr2=0x555a7f3ca2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a7f3c7de0 0x555a7f3ca2a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3058039ac0 msgr2=0x7f305803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3058039ac0 0x7f305803bf80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31800aafd0 tx=0x7f31800dd000 comp rx=0 tx=0).stop 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 msgr2=0x555a7f3b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f318e320640 1 -- 172.21.15.151:0/2956617661 reap_dead start 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f3b3840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f318804b010 tx=0x7f3188050590 comp rx=0 tx=0).stop 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 shutdown_connections 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 --2- 172.21.15.151:0/2956617661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f28ebf0 0x555a7f3b3840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.613+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 >> 172.21.15.151:0/2956617661 conn(0x555a7f3a64c0 msgr2=0x555a7f3a46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 shutdown_connections 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/2956617661 wait complete. 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/1242341462 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3068039ac0 msgr2=0x7f306803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/1242341462 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3068039ac0 0x7f306803bf80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f31800e9af0 tx=0x7f3180009420 comp rx=0 tx=0).stop 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/1242341462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f39d7b0 msgr2=0x555a7f39dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/1242341462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f39d7b0 0x555a7f39dbd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x555a7f383b30 tx=0x7f3188018830 comp rx=0 tx=0).stop 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/1242341462 shutdown_connections 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/1242341462 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3068039ac0 0x7f306803bf80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/1242341462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f39d7b0 0x555a7f39dbd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/1242341462 >> 172.21.15.151:0/1242341462 conn(0x555a7f393160 msgr2=0x555a7f393540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/1242341462 shutdown_connections 2024-09-12T16:52:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/1242341462 wait complete. 2024-09-12T16:52:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f38c670 msgr2=0x555a7f38ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f38c670 0x555a7f38ea60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f293170 msgr2=0x555a7f389f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f293170 0x555a7f389f20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3074039ac0 msgr2=0x7f307403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3074039ac0 0x7f307403bf80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3184004180 tx=0x7f3184001340 comp rx=0 tx=0).stop 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 msgr2=0x555a7f382db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f382db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3180003070 tx=0x7f3180018020 comp rx=0 tx=0).stop 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 shutdown_connections 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a7f38c670 0x555a7f38ea60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a7f293170 0x555a7f389f20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3074039ac0 0x7f307403bf80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 --2- 172.21.15.151:0/304246227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7f204200 0x555a7f382db0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 >> 172.21.15.151:0/304246227 conn(0x555a7f28a920 msgr2=0x555a7f375e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 shutdown_connections 2024-09-12T16:52:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.617+0000 7f319101b9c0 1 -- 172.21.15.151:0/304246227 wait complete. 2024-09-12T16:52:15.630 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T16:52:15.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-12T16:52:15.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-12T16:52:15.630 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-12T16:52:15.719 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:15.720 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:15.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.717+0000 7f015acf99c0 1 Processor -- start 2024-09-12T16:52:15.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.717+0000 7f015acf99c0 1 -- start start 2024-09-12T16:52:15.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.717+0000 7f015acf99c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55f28198d1a0 0x55f28198f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.717+0000 7f015acf99c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f28183b9c0 con 0x55f281989690 2024-09-12T16:52:15.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.717+0000 7f015acf99c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55f28188b6d0 con 0x55f28198d1a0 2024-09-12T16:52:15.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.717+0000 7f0157ffe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55f28198d1a0 0x55f28198f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.717+0000 7f01587ff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55f281989690 0x55f28198ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:37998/0 (socket says 172.21.15.151:37998) 2024-09-12T16:52:15.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.717+0000 7f01587ff640 1 -- 172.21.15.151:0/2524315241 learned_addr learned my addr 172.21.15.151:0/2524315241 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:15.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f0157ffe640 1 -- 172.21.15.151:0/2524315241 >> v1:172.21.15.122:6789/0 conn(0x55f281989690 legacy=0x55f28198ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f0157ffe640 1 -- 172.21.15.151:0/2524315241 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f28182fca0 con 0x55f28198d1a0 2024-09-12T16:52:15.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f0157ffe640 1 --2- 172.21.15.151:0/2524315241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f28198f590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f014000a480 tx=0x7f014001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a89fc0e07fb3c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f01577fd640 1 -- 172.21.15.151:0/2524315241 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01400b0070 con 0x55f28198d1a0 2024-09-12T16:52:15.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f01577fd640 1 -- 172.21.15.151:0/2524315241 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01400ab540 con 0x55f28198d1a0 2024-09-12T16:52:15.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f01577fd640 1 -- 172.21.15.151:0/2524315241 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01400ab840 con 0x55f28198d1a0 2024-09-12T16:52:15.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f015acf99c0 1 -- 172.21.15.151:0/2524315241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 msgr2=0x55f28198f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2524315241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f28198f590 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f014000a480 tx=0x7f014001b280 comp rx=0 tx=0).stop 2024-09-12T16:52:15.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f015acf99c0 1 -- 172.21.15.151:0/2524315241 shutdown_connections 2024-09-12T16:52:15.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2524315241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f28198f590 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.721+0000 7f015acf99c0 1 -- 172.21.15.151:0/2524315241 >> 172.21.15.151:0/2524315241 conn(0x55f2818fca20 msgr2=0x55f2818fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.725+0000 7f015acf99c0 1 -- 172.21.15.151:0/2524315241 shutdown_connections 2024-09-12T16:52:15.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.725+0000 7f015acf99c0 1 -- 172.21.15.151:0/2524315241 wait complete. 2024-09-12T16:52:15.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.737+0000 7f015acf99c0 1 Processor -- start 2024-09-12T16:52:15.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.737+0000 7f015acf99c0 1 -- start start 2024-09-12T16:52:15.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.737+0000 7f015acf99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281989690 0x55f281a74930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.737+0000 7f015acf99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f28188f680 con 0x55f281989690 2024-09-12T16:52:15.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281989690 0x55f281a74930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281989690 0x55f281a74930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33616/0 (socket says 172.21.15.151:33616) 2024-09-12T16:52:15.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 -- 172.21.15.151:0/3095779639 learned_addr learned my addr 172.21.15.151:0/3095779639 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 -- 172.21.15.151:0/3095779639 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f28180ada0 con 0x55f281989690 2024-09-12T16:52:15.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 --2- 172.21.15.151:0/3095779639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281989690 0x55f281a74930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0148001e50 tx=0x7f0148001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fcd28e52d47f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f004660c640 1 -- 172.21.15.151:0/3095779639 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0148012020 con 0x55f281989690 2024-09-12T16:52:15.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f004660c640 1 -- 172.21.15.151:0/3095779639 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014800e7c0 con 0x55f281989690 2024-09-12T16:52:15.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f004660c640 1 -- 172.21.15.151:0/3095779639 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f014800eaa0 con 0x55f281989690 2024-09-12T16:52:15.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 -- 172.21.15.151:0/3095779639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281989690 msgr2=0x55f281a74930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 --2- 172.21.15.151:0/3095779639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281989690 0x55f281a74930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0148001e50 tx=0x7f0148001e80 comp rx=0 tx=0).stop 2024-09-12T16:52:15.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 -- 172.21.15.151:0/3095779639 shutdown_connections 2024-09-12T16:52:15.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 --2- 172.21.15.151:0/3095779639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281989690 0x55f281a74930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 -- 172.21.15.151:0/3095779639 >> 172.21.15.151:0/3095779639 conn(0x55f2818fca20 msgr2=0x55f281a705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 -- 172.21.15.151:0/3095779639 shutdown_connections 2024-09-12T16:52:15.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 -- 172.21.15.151:0/3095779639 wait complete. 2024-09-12T16:52:15.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 Processor -- start 2024-09-12T16:52:15.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 -- start start 2024-09-12T16:52:15.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f281a7c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f015acf99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f281831a50 con 0x55f28198d1a0 2024-09-12T16:52:15.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f281a7c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f281a7c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33628/0 (socket says 172.21.15.151:33628) 2024-09-12T16:52:15.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 -- 172.21.15.151:0/2180480658 learned_addr learned my addr 172.21.15.151:0/2180480658 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 -- 172.21.15.151:0/2180480658 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f281a7c890 con 0x55f28198d1a0 2024-09-12T16:52:15.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.741+0000 7f01587ff640 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f281a7c330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f281a75920 tx=0x7f0148000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0044e09640 1 -- 172.21.15.151:0/2180480658 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0148012030 con 0x55f28198d1a0 2024-09-12T16:52:15.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f281a7cb20 con 0x55f28198d1a0 2024-09-12T16:52:15.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0044e09640 1 -- 172.21.15.151:0/2180480658 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014801a700 con 0x55f28198d1a0 2024-09-12T16:52:15.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0044e09640 1 -- 172.21.15.151:0/2180480658 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f014801a8b0 con 0x55f28198d1a0 2024-09-12T16:52:15.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f281a7d390 con 0x55f28198d1a0 2024-09-12T16:52:15.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0044e09640 1 -- 172.21.15.151:0/2180480658 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0148015020 con 0x55f28198d1a0 2024-09-12T16:52:15.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0044e09640 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0040039a70 0x7f004003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0044e09640 1 -- 172.21.15.151:0/2180480658 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0148020070 con 0x55f28198d1a0 2024-09-12T16:52:15.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0157ffe640 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0040039a70 0x7f004003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281a81350 0x55f281a83740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281a83c80 con 0x55f281a81350 2024-09-12T16:52:15.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0159000640 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281a81350 0x55f281a83740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0157ffe640 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0040039a70 0x7f004003bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01400ad000 tx=0x7f01400a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0159000640 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281a81350 0x55f281a83740 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0159000640 1 -- 172.21.15.151:0/2180480658 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f015000a4d0 con 0x55f281a81350 2024-09-12T16:52:15.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281a84020 con 0x55f281a81350 2024-09-12T16:52:15.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f0159000640 1 -- 172.21.15.151:0/2180480658 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f015000a4d0 con 0x55f281a81350 2024-09-12T16:52:15.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281a85de0 0x55f281a881d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281a888a0 con 0x55f281a85de0 2024-09-12T16:52:15.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.745+0000 7f01587ff640 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281a85de0 0x55f281a881d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f01587ff640 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281a85de0 0x55f281a881d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f01587ff640 1 -- 172.21.15.151:0/2180480658 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0148008030 con 0x55f281a85de0 2024-09-12T16:52:15.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281a84c80 con 0x55f281a81350 2024-09-12T16:52:15.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f0159000640 1 -- 172.21.15.151:0/2180480658 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f015000a4d0 con 0x55f281a81350 2024-09-12T16:52:15.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281a85100 con 0x55f281a81350 2024-09-12T16:52:15.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f0159000640 1 -- 172.21.15.151:0/2180480658 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f015000a4d0 con 0x55f281a81350 2024-09-12T16:52:15.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f015acf99c0 1 Processor -- start 2024-09-12T16:52:15.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f015acf99c0 1 -- start start 2024-09-12T16:52:15.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f015acf99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281a96ef0 0x55f281a97310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f015acf99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f28189c450 con 0x55f281a96ef0 2024-09-12T16:52:15.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f0159000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281a96ef0 0x55f281a97310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f0159000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281a96ef0 0x55f281a97310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33632/0 (socket says 172.21.15.151:33632) 2024-09-12T16:52:15.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f0159000640 1 -- 172.21.15.151:0/3472303713 learned_addr learned my addr 172.21.15.151:0/3472303713 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f0159000640 1 -- 172.21.15.151:0/3472303713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f281a97950 con 0x55f281a96ef0 2024-09-12T16:52:15.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f0159000640 1 --2- 172.21.15.151:0/3472303713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281a96ef0 0x55f281a97310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55f281a7e210 tx=0x7f0150018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f003dffb640 1 -- 172.21.15.151:0/3472303713 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0150014450 con 0x55f281a96ef0 2024-09-12T16:52:15.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f003dffb640 1 -- 172.21.15.151:0/3472303713 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01500145f0 con 0x55f281a96ef0 2024-09-12T16:52:15.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f015acf99c0 1 -- 172.21.15.151:0/3472303713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f281a981b0 con 0x55f281a96ef0 2024-09-12T16:52:15.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f003dffb640 1 -- 172.21.15.151:0/3472303713 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0150014910 con 0x55f281a96ef0 2024-09-12T16:52:15.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.749+0000 7f015acf99c0 1 -- 172.21.15.151:0/3472303713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f281a98720 con 0x55f281a96ef0 2024-09-12T16:52:15.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f003dffb640 1 -- 172.21.15.151:0/3472303713 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0150011040 con 0x55f281a96ef0 2024-09-12T16:52:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f003dffb640 1 --2- 172.21.15.151:0/3472303713 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0030039ac0 0x7f003003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f003dffb640 1 -- 172.21.15.151:0/3472303713 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f015001e070 con 0x55f281a96ef0 2024-09-12T16:52:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f01587ff640 1 --2- 172.21.15.151:0/3472303713 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0030039ac0 0x7f003003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f015acf99c0 1 Processor -- start 2024-09-12T16:52:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f015acf99c0 1 -- start start 2024-09-12T16:52:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f01587ff640 1 --2- 172.21.15.151:0/3472303713 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0030039ac0 0x7f003003bf80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55f281a7d680 tx=0x7f014804ec60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f015acf99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aa3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f015acf99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f281a75180 con 0x55f281aa3810 2024-09-12T16:52:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f0159000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aa3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f0159000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aa3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33648/0 (socket says 172.21.15.151:33648) 2024-09-12T16:52:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f0159000640 1 -- 172.21.15.151:0/2666961392 learned_addr learned my addr 172.21.15.151:0/2666961392 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f0159000640 1 -- 172.21.15.151:0/2666961392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f281aa41e0 con 0x55f281aa3810 2024-09-12T16:52:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f0159000640 1 --2- 172.21.15.151:0/2666961392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aa3bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0150016fd0 tx=0x7f0150011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149f51ab7cd8b4e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f00377fe640 1 -- 172.21.15.151:0/2666961392 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0150028070 con 0x55f281aa3810 2024-09-12T16:52:15.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f00377fe640 1 -- 172.21.15.151:0/2666961392 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015004f280 con 0x55f281aa3810 2024-09-12T16:52:15.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.753+0000 7f00377fe640 1 -- 172.21.15.151:0/2666961392 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0150052200 con 0x55f281aa3810 2024-09-12T16:52:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- 172.21.15.151:0/2666961392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 msgr2=0x55f281aa3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2666961392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aa3bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0150016fd0 tx=0x7f0150011a80 comp rx=0 tx=0).stop 2024-09-12T16:52:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- 172.21.15.151:0/2666961392 shutdown_connections 2024-09-12T16:52:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2666961392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aa3bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- 172.21.15.151:0/2666961392 >> 172.21.15.151:0/2666961392 conn(0x55f281a9fc40 msgr2=0x55f281a9de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- 172.21.15.151:0/2666961392 shutdown_connections 2024-09-12T16:52:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- 172.21.15.151:0/2666961392 wait complete. 2024-09-12T16:52:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 Processor -- start 2024-09-12T16:52:15.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- start start 2024-09-12T16:52:15.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aaad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f281aa4820 con 0x55f281aa3810 2024-09-12T16:52:15.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0159000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aaad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0159000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aaad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33650/0 (socket says 172.21.15.151:33650) 2024-09-12T16:52:15.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 learned_addr learned my addr 172.21.15.151:0/1079006584 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f281aab290 con 0x55f281aa3810 2024-09-12T16:52:15.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0159000640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aaad30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0150022ff0 tx=0x7f01500506c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0035ffb640 1 -- 172.21.15.151:0/1079006584 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0150016440 con 0x55f281aa3810 2024-09-12T16:52:15.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f281aab520 con 0x55f281aa3810 2024-09-12T16:52:15.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0035ffb640 1 -- 172.21.15.151:0/1079006584 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015004f280 con 0x55f281aa3810 2024-09-12T16:52:15.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0035ffb640 1 -- 172.21.15.151:0/1079006584 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0150050870 con 0x55f281aa3810 2024-09-12T16:52:15.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f281aabed0 con 0x55f281aa3810 2024-09-12T16:52:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.757+0000 7f0035ffb640 1 -- 172.21.15.151:0/1079006584 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0150034020 con 0x55f281aa3810 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0035ffb640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0028039a70 0x7f002803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0035ffb640 1 -- 172.21.15.151:0/1079006584 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0150032020 con 0x55f281aa3810 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f01587ff640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0028039a70 0x7f002803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281ab6220 0x55f281ab86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281ab8e30 con 0x55f281ab6220 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0157ffe640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281ab6220 0x55f281ab86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f01587ff640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0028039a70 0x7f002803bf30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01480017c0 tx=0x7f014801aea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0157ffe640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281ab6220 0x55f281ab86e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 realm 2024-09-12T16:52:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281ab9200 con 0x55f281ab6220 2024-09-12T16:52:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281ab9ad0 con 0x55f281ab6220 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281ab9e70 con 0x55f281ab6220 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281ababd0 0x55f281abcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281abd5d0 con 0x55f281ababd0 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0159000640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281ababd0 0x55f281abcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0159000640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281ababd0 0x55f281abcfc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.761+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f015acf99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f015acf99c0 20 searching for the correct realm 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f281abf520 0x55f281ac1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f01587ff640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f281abf520 0x55f281ac1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f01587ff640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f281abf520 0x55f281ac1950 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f01587ff640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0148017050 0x7f0148047910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x7f0148017050 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0157ffe640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0148017050 0x7f0148047910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0157ffe640 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0148017050 0x7f0148047910 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ab6220 2024-09-12T16:52:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ab6220 2024-09-12T16:52:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.765+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x7f0148017050 2024-09-12T16:52:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ab6220 2024-09-12T16:52:15.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ab6220 2024-09-12T16:52:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x7f0148017050 2024-09-12T16:52:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.769+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ab6220 2024-09-12T16:52:15.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ab6220 2024-09-12T16:52:15.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x7f0148017050 2024-09-12T16:52:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ab6220 2024-09-12T16:52:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.773+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x7f0148017050 2024-09-12T16:52:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281abf520 2024-09-12T16:52:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ababd0 2024-09-12T16:52:15.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x55f281ab6220 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac1fd0 con 0x7f0148017050 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281abdf90 con 0x55f281ab6220 2024-09-12T16:52:15.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281abdba0 con 0x55f281ab6220 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281abe880 con 0x55f281ab6220 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 zone default found 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 4 Realm: () 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:15.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:15.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 zonegroup default 2024-09-12T16:52:15.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.777+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281abe880 con 0x55f281ababd0 2024-09-12T16:52:15.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac4370 con 0x55f281abf520 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac4760 con 0x55f281abf520 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 20 started sync module instance, tier type = 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac3800 con 0x7f0148017050 2024-09-12T16:52:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94500045995264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac3800 con 0x7f0148017050 2024-09-12T16:52:15.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac5220 con 0x55f281ab6220 2024-09-12T16:52:15.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.781+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94500045995264] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.785+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.785+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94500045999408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac3800 con 0x55f281ab6220 2024-09-12T16:52:15.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.785+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac5c60 con 0x55f281abf520 2024-09-12T16:52:15.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.785+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94500045999408] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.785+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.785+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94500045992784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac3770 con 0x55f281abf520 2024-09-12T16:52:15.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.785+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac6960 con 0x7f0148017050 2024-09-12T16:52:15.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.789+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.789+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94500046005728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac7230 con 0x7f0148017050 2024-09-12T16:52:15.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.789+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac7bf0 con 0x55f281ab6220 2024-09-12T16:52:15.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.789+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94500045992784] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.789+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.789+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94500046004224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac7bf0 con 0x55f281ab6220 2024-09-12T16:52:15.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.789+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac84f0 con 0x55f281ababd0 2024-09-12T16:52:15.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.789+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94500046005728] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.793+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94500046004224] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.793+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.793+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94500046012384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac7740 con 0x55f281ababd0 2024-09-12T16:52:15.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.793+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac8d90 con 0x55f281ababd0 2024-09-12T16:52:15.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.793+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.793+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94500046014224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac8fe0 con 0x55f281ababd0 2024-09-12T16:52:15.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.793+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac9890 con 0x55f281ababd0 2024-09-12T16:52:15.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.793+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94500046012384] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94500046007616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac9490 con 0x55f281ababd0 2024-09-12T16:52:15.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 20 add_watcher() i=0 2024-09-12T16:52:15.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 20 add_watcher() i=1 2024-09-12T16:52:15.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 20 add_watcher() i=2 2024-09-12T16:52:15.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 20 add_watcher() i=3 2024-09-12T16:52:15.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 20 add_watcher() i=4 2024-09-12T16:52:15.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 20 add_watcher() i=5 2024-09-12T16:52:15.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94500046014224] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 20 add_watcher() i=6 2024-09-12T16:52:15.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94500046007616] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 20 add_watcher() i=7 2024-09-12T16:52:15.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:15.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac92e0 con 0x55f281ab6220 2024-09-12T16:52:15.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.797+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94500046017200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281ac9cb0 con 0x55f281ab6220 2024-09-12T16:52:15.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94500046017200] v32'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f000efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:15.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:15.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 5 note: GC not initialized 2024-09-12T16:52:15.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f000dfe3640 20 reqs_thread_entry: start 2024-09-12T16:52:15.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:15.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 Filter name: none 2024-09-12T16:52:15.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f0006ffd640 20 reqs_thread_entry: start 2024-09-12T16:52:15.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:15.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281aefa00 con 0x55f281ab6220 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281aee0a0 con 0x55f281ab6220 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281aee0a0 con 0x55f281ababd0 2024-09-12T16:52:15.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-12T16:52:15.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T16:52:15.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-12T16:52:15.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-12T16:52:15.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.801+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aee9c0 con 0x55f281ab6220 2024-09-12T16:52:15.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:15.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:15.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:15.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94500046169312 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281af34a0 con 0x55f281ab6220 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify (1) cookie 94500046004224 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55f281aeed60 con 0x55f281ab6220 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f00377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94500046004224 notifier 4292 bl.length()=567 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f00377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f00377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f00377fe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f001c003eb0 con 0x55f281ab6220 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 notify.4 [notify cookie 94500046169312 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== watch-notify(notify_complete (2) cookie 94500046169312 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f281aef540 con 0x55f281ab6220 2024-09-12T16:52:15.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aee4e0 con 0x55f281ab6220 2024-09-12T16:52:15.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94500046169312 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281af3640 con 0x7f0148017050 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== watch-notify(notify (1) cookie 94500046005728 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55f281aef540 con 0x7f0148017050 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0036ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94500046005728 notifier 4292 bl.length()=169 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0036ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0036ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0036ffd640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7eff80003410 con 0x7f0148017050 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.805+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(69 notify.3 [notify cookie 94500046169312 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== watch-notify(notify_complete (2) cookie 94500046169312 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f28182fca0 con 0x7f0148017050 2024-09-12T16:52:15.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aee4e0 con 0x55f281ababd0 2024-09-12T16:52:15.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f015acf99c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-12T16:52:15.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f015acf99c0 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T16:52:15.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f015acf99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-12T16:52:15.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94500046169312 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f281af2750 con 0x7f0148017050 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== watch-notify(notify (1) cookie 94500046005728 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f28182fca0 con 0x7f0148017050 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f00377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94500046005728 notifier 4292 bl.length()=177 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f00377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f00377fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f00377fe640 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f001c003eb0 con 0x7f0148017050 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(72 notify.3 [notify cookie 94500046169312 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.809+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== watch-notify(notify_complete (2) cookie 94500046169312 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f01400b7420 con 0x7f0148017050 2024-09-12T16:52:15.814 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:15.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.813+0000 7f000efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.813+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94500046017200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x55f281ab6220 2024-09-12T16:52:15.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.813+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94500046017200] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.813+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94500045995264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x7f0148017050 2024-09-12T16:52:15.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.813+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94500045995264] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.813+0000 7f015acf99c0 20 remove_watcher() i=0 2024-09-12T16:52:15.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.813+0000 7f015acf99c0 2 removed watcher, disabling cache 2024-09-12T16:52:15.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.813+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94500045999408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x55f281ab6220 2024-09-12T16:52:15.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.817+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94500045999408] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.817+0000 7f015acf99c0 20 remove_watcher() i=1 2024-09-12T16:52:15.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.817+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94500045992784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x55f281abf520 2024-09-12T16:52:15.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.817+0000 7f01587ff640 1 -- 172.21.15.151:0/1079006584 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94500045992784] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148008030 con 0x55f281abf520 2024-09-12T16:52:15.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.817+0000 7f015acf99c0 20 remove_watcher() i=2 2024-09-12T16:52:15.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.817+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94500046005728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x7f0148017050 2024-09-12T16:52:15.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.821+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94500046005728] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x7f0148017050 2024-09-12T16:52:15.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.821+0000 7f015acf99c0 20 remove_watcher() i=3 2024-09-12T16:52:15.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.821+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94500046004224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x55f281ab6220 2024-09-12T16:52:15.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.821+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94500046004224] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01400b3040 con 0x55f281ab6220 2024-09-12T16:52:15.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.821+0000 7f015acf99c0 20 remove_watcher() i=4 2024-09-12T16:52:15.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.821+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94500046012384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x55f281ababd0 2024-09-12T16:52:15.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.825+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94500046012384] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.825+0000 7f015acf99c0 20 remove_watcher() i=5 2024-09-12T16:52:15.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.825+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94500046014224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x55f281ababd0 2024-09-12T16:52:15.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.825+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94500046014224] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.825+0000 7f015acf99c0 20 remove_watcher() i=6 2024-09-12T16:52:15.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.825+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94500046007616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f281aed780 con 0x55f281ababd0 2024-09-12T16:52:15.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f0159000640 1 -- 172.21.15.151:0/1079006584 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94500046007616] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f015002a070 con 0x55f281ababd0 2024-09-12T16:52:15.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 20 remove_watcher() i=7 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281ababd0 msgr2=0x55f281abcfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281ababd0 0x55f281abcfc0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281ab6220 msgr2=0x55f281ab86e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281ab6220 0x55f281ab86e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0148017050 msgr2=0x7f0148047910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0148017050 0x7f0148047910 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f281abf520 msgr2=0x55f281ac1950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f281abf520 0x55f281ac1950 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0028039a70 msgr2=0x7f002803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0028039a70 0x7f002803bf30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01480017c0 tx=0x7f014801aea0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 msgr2=0x55f281aaad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f0157ffe640 1 -- 172.21.15.151:0/1079006584 reap_dead start 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aaad30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0150022ff0 tx=0x7f01500506c0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 shutdown_connections 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/1079006584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281aa3810 0x55f281aaad30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 >> 172.21.15.151:0/1079006584 conn(0x55f281a9fc40 msgr2=0x55f281a9de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 shutdown_connections 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/1079006584 wait complete. 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/3472303713 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0030039ac0 msgr2=0x7f003003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/3472303713 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0030039ac0 0x7f003003bf80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55f281a7d680 tx=0x7f014804ec60 comp rx=0 tx=0).stop 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/3472303713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281a96ef0 msgr2=0x55f281a97310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/3472303713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281a96ef0 0x55f281a97310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55f281a7e210 tx=0x7f0150018830 comp rx=0 tx=0).stop 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/3472303713 shutdown_connections 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/3472303713 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0030039ac0 0x7f003003bf80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/3472303713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f281a96ef0 0x55f281a97310 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/3472303713 >> 172.21.15.151:0/3472303713 conn(0x55f281a8c8a0 msgr2=0x55f281a8cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/3472303713 shutdown_connections 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/3472303713 wait complete. 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281a85de0 msgr2=0x55f281a881d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281a85de0 0x55f281a881d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281a81350 msgr2=0x55f281a83740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281a81350 0x55f281a83740 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0040039a70 msgr2=0x7f004003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0040039a70 0x7f004003bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01400ad000 tx=0x7f01400a5040 comp rx=0 tx=0).stop 2024-09-12T16:52:15.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 msgr2=0x55f281a7c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f281a7c330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f281a75920 tx=0x7f0148000ee0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 shutdown_connections 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f281a85de0 0x55f281a881d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f281a81350 0x55f281a83740 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0040039a70 0x7f004003bf30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 --2- 172.21.15.151:0/2180480658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f28198d1a0 0x55f281a7c330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 >> 172.21.15.151:0/2180480658 conn(0x55f2818fca20 msgr2=0x55f281a6f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 shutdown_connections 2024-09-12T16:52:15.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.829+0000 7f015acf99c0 1 -- 172.21.15.151:0/2180480658 wait complete. 2024-09-12T16:52:15.843 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:15.843 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-12T16:52:15.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-12T16:52:15.844 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-12T16:52:15.879 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:15.879 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:15.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c57539c0 1 Processor -- start 2024-09-12T16:52:15.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c57539c0 1 -- start start 2024-09-12T16:52:15.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c57539c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5588b34aba70 0x5588b34abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c57539c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5588b33e99c0 con 0x5588b34aa470 2024-09-12T16:52:15.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c57539c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5588b34396d0 con 0x5588b34aba70 2024-09-12T16:52:15.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c3259640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5588b34aba70 0x5588b34abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c2a58640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5588b34aa470 0x5588b34aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38014/0 (socket says 172.21.15.151:38014) 2024-09-12T16:52:15.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c2a58640 1 -- 172.21.15.151:0/2178483464 learned_addr learned my addr 172.21.15.151:0/2178483464 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:15.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c3259640 1 -- 172.21.15.151:0/2178483464 >> v1:172.21.15.122:6789/0 conn(0x5588b34aa470 legacy=0x5588b34aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.877+0000 7f90c3259640 1 -- 172.21.15.151:0/2178483464 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b33ddca0 con 0x5588b34aba70 2024-09-12T16:52:15.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c3259640 1 --2- 172.21.15.151:0/2178483464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aba70 0x5588b34abe50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f90b400a480 tx=0x7f90b401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afe6858dcf20ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c2257640 1 -- 172.21.15.151:0/2178483464 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b40b0070 con 0x5588b34aba70 2024-09-12T16:52:15.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c2257640 1 -- 172.21.15.151:0/2178483464 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b40ab540 con 0x5588b34aba70 2024-09-12T16:52:15.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c2257640 1 -- 172.21.15.151:0/2178483464 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b40ab840 con 0x5588b34aba70 2024-09-12T16:52:15.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c57539c0 1 -- 172.21.15.151:0/2178483464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aba70 msgr2=0x5588b34abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2178483464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aba70 0x5588b34abe50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f90b400a480 tx=0x7f90b401b280 comp rx=0 tx=0).stop 2024-09-12T16:52:15.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c57539c0 1 -- 172.21.15.151:0/2178483464 shutdown_connections 2024-09-12T16:52:15.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2178483464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aba70 0x5588b34abe50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c57539c0 1 -- 172.21.15.151:0/2178483464 >> 172.21.15.151:0/2178483464 conn(0x5588b3530a50 msgr2=0x5588b3532e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c57539c0 1 -- 172.21.15.151:0/2178483464 shutdown_connections 2024-09-12T16:52:15.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.881+0000 7f90c57539c0 1 -- 172.21.15.151:0/2178483464 wait complete. 2024-09-12T16:52:15.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c57539c0 1 Processor -- start 2024-09-12T16:52:15.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c57539c0 1 -- start start 2024-09-12T16:52:15.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c57539c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b3622b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c57539c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588b343d680 con 0x5588b34aa470 2024-09-12T16:52:15.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c3259640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b3622b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c3259640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b3622b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33672/0 (socket says 172.21.15.151:33672) 2024-09-12T16:52:15.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c3259640 1 -- 172.21.15.151:0/431776126 learned_addr learned my addr 172.21.15.151:0/431776126 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c3259640 1 -- 172.21.15.151:0/431776126 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b33b8da0 con 0x5588b34aa470 2024-09-12T16:52:15.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f90c3259640 1 --2- 172.21.15.151:0/431776126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b3622b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f90b4018eb0 tx=0x7f90b4002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3a659696de0f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f8fb160a640 1 -- 172.21.15.151:0/431776126 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b40b0040 con 0x5588b34aa470 2024-09-12T16:52:15.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f8fb160a640 1 -- 172.21.15.151:0/431776126 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b40bb070 con 0x5588b34aa470 2024-09-12T16:52:15.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.897+0000 7f8fb160a640 1 -- 172.21.15.151:0/431776126 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b40ab6f0 con 0x5588b34aa470 2024-09-12T16:52:15.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- 172.21.15.151:0/431776126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 msgr2=0x5588b3622b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 --2- 172.21.15.151:0/431776126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b3622b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f90b4018eb0 tx=0x7f90b4002fc0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- 172.21.15.151:0/431776126 shutdown_connections 2024-09-12T16:52:15.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 --2- 172.21.15.151:0/431776126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b3622b20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- 172.21.15.151:0/431776126 >> 172.21.15.151:0/431776126 conn(0x5588b3530a50 msgr2=0x5588b361e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- 172.21.15.151:0/431776126 shutdown_connections 2024-09-12T16:52:15.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- 172.21.15.151:0/431776126 wait complete. 2024-09-12T16:52:15.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 Processor -- start 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- start start 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b362a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588b33dfa50 con 0x5588b34aa470 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c3259640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b362a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c3259640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b362a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33678/0 (socket says 172.21.15.151:33678) 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c3259640 1 -- 172.21.15.151:0/2724558311 learned_addr learned my addr 172.21.15.151:0/2724558311 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c3259640 1 -- 172.21.15.151:0/2724558311 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b362a5b0 con 0x5588b34aa470 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c3259640 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b362a050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90b40b8040 tx=0x5588b34ab3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f8fafe07640 1 -- 172.21.15.151:0/2724558311 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b40b0030 con 0x5588b34aa470 2024-09-12T16:52:15.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588b362a840 con 0x5588b34aa470 2024-09-12T16:52:15.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f8fafe07640 1 -- 172.21.15.151:0/2724558311 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b40bb070 con 0x5588b34aa470 2024-09-12T16:52:15.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f8fafe07640 1 -- 172.21.15.151:0/2724558311 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b40b66d0 con 0x5588b34aa470 2024-09-12T16:52:15.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b362b1f0 con 0x5588b34aa470 2024-09-12T16:52:15.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.901+0000 7f8fafe07640 1 -- 172.21.15.151:0/2724558311 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90b40b6870 con 0x5588b34aa470 2024-09-12T16:52:15.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f8fafe07640 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fa8039a70 0x7f8fa803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f8fafe07640 1 -- 172.21.15.151:0/2724558311 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f90b40a8070 con 0x5588b34aa470 2024-09-12T16:52:15.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c2a58640 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fa8039a70 0x7f8fa803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b34aba70 0x5588b36311c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b3631700 con 0x5588b34aba70 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3a5a640 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b34aba70 0x5588b36311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c2a58640 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fa8039a70 0x7f8fa803bf30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f90b8004180 tx=0x7f90b8001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3a5a640 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b34aba70 0x5588b36311c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3a5a640 1 -- 172.21.15.151:0/2724558311 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90bc00a4d0 con 0x5588b34aba70 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b362b5f0 con 0x5588b34aba70 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3a5a640 1 -- 172.21.15.151:0/2724558311 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90bc00a4d0 con 0x5588b34aba70 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b3633970 0x5588b3635d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b3636450 con 0x5588b3633970 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3259640 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b3633970 0x5588b3635d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3259640 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b3633970 0x5588b3635d60 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3259640 1 -- 172.21.15.151:0/2724558311 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b3633970 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b3632810 con 0x5588b34aba70 2024-09-12T16:52:15.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3a5a640 1 -- 172.21.15.151:0/2724558311 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90bc00a4d0 con 0x5588b34aba70 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b3632cb0 con 0x5588b34aba70 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.905+0000 7f90c3a5a640 1 -- 172.21.15.151:0/2724558311 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90bc00a4d0 con 0x5588b34aba70 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c57539c0 1 Processor -- start 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c57539c0 1 -- start start 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c57539c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3644ae0 0x5588b3644f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c57539c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588b344a450 con 0x5588b3644ae0 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c3a5a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3644ae0 0x5588b3644f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c3a5a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3644ae0 0x5588b3644f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33686/0 (socket says 172.21.15.151:33686) 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c3a5a640 1 -- 172.21.15.151:0/975604632 learned_addr learned my addr 172.21.15.151:0/975604632 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c3a5a640 1 -- 172.21.15.151:0/975604632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b3645540 con 0x5588b3644ae0 2024-09-12T16:52:15.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c3a5a640 1 --2- 172.21.15.151:0/975604632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3644ae0 0x5588b3644f00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5588b362b3e0 tx=0x7f90bc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f8fad602640 1 -- 172.21.15.151:0/975604632 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc014450 con 0x5588b3644ae0 2024-09-12T16:52:15.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f8fad602640 1 -- 172.21.15.151:0/975604632 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc018e50 con 0x5588b3644ae0 2024-09-12T16:52:15.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c57539c0 1 -- 172.21.15.151:0/975604632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588b3645da0 con 0x5588b3644ae0 2024-09-12T16:52:15.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f8fad602640 1 -- 172.21.15.151:0/975604632 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc014780 con 0x5588b3644ae0 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c57539c0 1 -- 172.21.15.151:0/975604632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b3646310 con 0x5588b3644ae0 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f8fad602640 1 -- 172.21.15.151:0/975604632 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90bc011040 con 0x5588b3644ae0 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f8fad602640 1 --2- 172.21.15.151:0/975604632 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f9c039a70 0x7f8f9c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f8fad602640 1 -- 172.21.15.151:0/975604632 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f90bc01e070 con 0x5588b3644ae0 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.909+0000 7f90c3259640 1 --2- 172.21.15.151:0/975604632 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f9c039a70 0x7f8f9c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 Processor -- start 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- start start 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3259640 1 --2- 172.21.15.151:0/975604632 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f9c039a70 0x7f8f9c03bf30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x5588b3631b10 tx=0x7f90b40b4580 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3652830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588b3623290 con 0x5588b3652450 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3a5a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3652830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3a5a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3652830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33694/0 (socket says 172.21.15.151:33694) 2024-09-12T16:52:15.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3a5a640 1 -- 172.21.15.151:0/2213005216 learned_addr learned my addr 172.21.15.151:0/2213005216 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3a5a640 1 -- 172.21.15.151:0/2213005216 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b3652e20 con 0x5588b3652450 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3a5a640 1 --2- 172.21.15.151:0/2213005216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3652830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00b010 tx=0x7f90bc016710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf9528dcb540996 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f8fa6ffd640 1 -- 172.21.15.151:0/2213005216 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc02bc70 con 0x5588b3652450 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f8fa6ffd640 1 -- 172.21.15.151:0/2213005216 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc02be10 con 0x5588b3652450 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f8fa6ffd640 1 -- 172.21.15.151:0/2213005216 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc014a50 con 0x5588b3652450 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- 172.21.15.151:0/2213005216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 msgr2=0x5588b3652830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2213005216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3652830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00b010 tx=0x7f90bc016710 comp rx=0 tx=0).stop 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- 172.21.15.151:0/2213005216 shutdown_connections 2024-09-12T16:52:15.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2213005216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3652830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- 172.21.15.151:0/2213005216 >> 172.21.15.151:0/2213005216 conn(0x5588b364d810 msgr2=0x5588b364ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- 172.21.15.151:0/2213005216 shutdown_connections 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- 172.21.15.151:0/2213005216 wait complete. 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 Processor -- start 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- start start 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3658870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c57539c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588b3651340 con 0x5588b3652450 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3a5a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3658870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3a5a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3658870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33706/0 (socket says 172.21.15.151:33706) 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.913+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 learned_addr learned my addr 172.21.15.151:0/1597209137 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b3658dd0 con 0x5588b3652450 2024-09-12T16:52:15.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c3a5a640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3658870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90bc04f350 tx=0x7f90bc050460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f8fa57fa640 1 -- 172.21.15.151:0/1597209137 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc031070 con 0x5588b3652450 2024-09-12T16:52:15.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588b3659060 con 0x5588b3652450 2024-09-12T16:52:15.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f8fa57fa640 1 -- 172.21.15.151:0/1597209137 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc02b350 con 0x5588b3652450 2024-09-12T16:52:15.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f8fa57fa640 1 -- 172.21.15.151:0/1597209137 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc02b630 con 0x5588b3652450 2024-09-12T16:52:15.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b3659a10 con 0x5588b3652450 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f8fa57fa640 1 -- 172.21.15.151:0/1597209137 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90bc034070 con 0x5588b3652450 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f8fa57fa640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f8c039a70 0x7f8f8c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f8fa57fa640 1 -- 172.21.15.151:0/1597209137 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f90bc00e040 con 0x5588b3652450 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c3259640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f8c039a70 0x7f8f8c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b3663de0 0x5588b3666270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b36669c0 con 0x5588b3663de0 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c2a58640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b3663de0 0x5588b3666270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c3259640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f8c039a70 0x7f8f8c03bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90b40b6fb0 tx=0x7f90b40dc000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c2a58640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b3663de0 0x5588b3666270 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b800e640 con 0x5588b3663de0 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 20 realm 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b3663190 con 0x5588b3663de0 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b800e640 con 0x5588b3663de0 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.917+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b36674c0 con 0x5588b3663de0 2024-09-12T16:52:15.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b800e640 con 0x5588b3663de0 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b3667d90 con 0x5588b3663de0 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90b800e640 con 0x5588b3663de0 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b36687b0 0x5588b366aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b366b270 con 0x5588b36687b0 2024-09-12T16:52:15.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c3a5a640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b36687b0 0x5588b366aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c3a5a640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b36687b0 0x5588b366aba0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 20 searching for the correct realm 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588b366d1c0 0x5588b366f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c3259640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588b366d1c0 0x5588b366f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c3259640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588b366d1c0 0x5588b366f5f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c3259640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f90b40f8040 0x7f90b4009640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:15.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x7f90b40f8040 2024-09-12T16:52:15.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c2a58640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f90b40f8040 0x7f90b4009640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:15.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c2a58640 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f90b40f8040 0x7f90b4009640 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:15.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b800e640 con 0x7f90b40f8040 2024-09-12T16:52:15.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.921+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b3663de0 2024-09-12T16:52:15.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b800e640 con 0x5588b3663de0 2024-09-12T16:52:15.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b3663de0 2024-09-12T16:52:15.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x7f90b40f8040 2024-09-12T16:52:15.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x7f90b40f8040 2024-09-12T16:52:15.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b3663de0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.925+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b3663de0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x7f90b40f8040 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90b8029040 con 0x7f90b40f8040 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b3663de0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b3663de0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x7f90b40f8040 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.929+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x7f90b40f8040 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b3663de0 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x7f90b40f8040 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x7f90b40f8040 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b366d1c0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b36687b0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x5588b3663de0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5588b366fcc0 con 0x7f90b40f8040 2024-09-12T16:52:15.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b8029040 con 0x7f90b40f8040 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b366bc30 con 0x5588b3663de0 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.933+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b366c4d0 con 0x5588b3663de0 2024-09-12T16:52:15.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90b8029040 con 0x5588b3663de0 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b366b870 con 0x5588b3663de0 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 zone default found 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 4 Realm: () 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:15.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 zonegroup default 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b366c4d0 con 0x5588b36687b0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b3672060 con 0x5588b366d1c0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b3672400 con 0x5588b366d1c0 2024-09-12T16:52:15.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 started sync module instance, tier type = 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36714f0 con 0x7f90b40f8040 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x7f90b40f8040 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94045613791760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36714f0 con 0x7f90b40f8040 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.937+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3672ee0 con 0x5588b3663de0 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.941+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94045613791760] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x7f90b40f8040 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.941+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.941+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94045613795792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36714f0 con 0x5588b3663de0 2024-09-12T16:52:15.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.941+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36738f0 con 0x5588b366d1c0 2024-09-12T16:52:15.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.941+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.941+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94045613795792] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.941+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94045613798464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3673ce0 con 0x5588b366d1c0 2024-09-12T16:52:15.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.941+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36746a0 con 0x7f90b40f8040 2024-09-12T16:52:15.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.945+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x7f90b40f8040 2024-09-12T16:52:15.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.945+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94045613802240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3674d90 con 0x7f90b40f8040 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.945+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36758b0 con 0x5588b3663de0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.945+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94045613798464] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.945+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94045613802240] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x7f90b40f8040 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.945+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.945+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94045613806464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3675870 con 0x5588b3663de0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.945+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3675ca0 con 0x5588b36687b0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.949+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94045613806464] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.949+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.949+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94045613803488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3676040 con 0x5588b36687b0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.949+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3676a00 con 0x5588b36687b0 2024-09-12T16:52:15.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.949+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94045613803488] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.949+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.949+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94045613789248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3676a00 con 0x5588b36687b0 2024-09-12T16:52:15.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.949+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3676a00 con 0x5588b36687b0 2024-09-12T16:52:15.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94045613789248] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94045613811504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36773c0 con 0x5588b36687b0 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 20 add_watcher() i=0 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 20 add_watcher() i=1 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 20 add_watcher() i=2 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 20 add_watcher() i=3 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 20 add_watcher() i=4 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 20 add_watcher() i=5 2024-09-12T16:52:15.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 20 add_watcher() i=6 2024-09-12T16:52:15.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94045613811504] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 20 add_watcher() i=7 2024-09-12T16:52:15.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:15.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.953+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b367a7c0 con 0x5588b3663de0 2024-09-12T16:52:15.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94045613813984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3677d10 con 0x5588b3663de0 2024-09-12T16:52:15.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94045613813984] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f8f79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:15.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:15.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 5 note: GC not initialized 2024-09-12T16:52:15.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f8f78fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:15.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:15.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 Filter name: none 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f8ef27fc640 20 reqs_thread_entry: start 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b369da50 con 0x5588b36687b0 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b369c0f0 con 0x5588b3663de0 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 rados_obj.operate() r=0 bl.length=7 2024-09-12T16:52:15.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5588b369c4e0 con 0x5588b3663de0 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.957+0000 7f90c57539c0 20 get_user_info_from_index found 0 xattrs 2024-09-12T16:52:15.964 INFO:teuthology.orchestra.run.smithi151.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-12T16:52:15.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.961+0000 7f8f79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:15.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.961+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94045613813984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b365e310 con 0x5588b3663de0 2024-09-12T16:52:15.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.961+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94045613813984] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.961+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94045613791760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36770b0 con 0x7f90b40f8040 2024-09-12T16:52:15.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.961+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94045613791760] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x7f90b40f8040 2024-09-12T16:52:15.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.961+0000 7f90c57539c0 20 remove_watcher() i=0 2024-09-12T16:52:15.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.961+0000 7f90c57539c0 2 removed watcher, disabling cache 2024-09-12T16:52:15.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.961+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94045613795792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36719f0 con 0x5588b3663de0 2024-09-12T16:52:15.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.965+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94045613795792] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.965+0000 7f90c57539c0 20 remove_watcher() i=1 2024-09-12T16:52:15.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.965+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94045613798464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b36729d0 con 0x5588b366d1c0 2024-09-12T16:52:15.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.965+0000 7f90c3259640 1 -- 172.21.15.151:0/1597209137 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94045613798464] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b40b3040 con 0x5588b366d1c0 2024-09-12T16:52:15.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.965+0000 7f90c57539c0 20 remove_watcher() i=2 2024-09-12T16:52:15.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.965+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94045613802240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3673440 con 0x7f90b40f8040 2024-09-12T16:52:15.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.969+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94045613802240] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x7f90b40f8040 2024-09-12T16:52:15.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.969+0000 7f90c57539c0 20 remove_watcher() i=3 2024-09-12T16:52:15.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.969+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94045613806464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3673440 con 0x5588b3663de0 2024-09-12T16:52:15.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.969+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94045613806464] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b80391c0 con 0x5588b3663de0 2024-09-12T16:52:15.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.969+0000 7f90c57539c0 20 remove_watcher() i=4 2024-09-12T16:52:15.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.969+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94045613803488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3673440 con 0x5588b36687b0 2024-09-12T16:52:15.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.973+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94045613803488] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.973+0000 7f90c57539c0 20 remove_watcher() i=5 2024-09-12T16:52:15.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.973+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94045613789248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3673440 con 0x5588b36687b0 2024-09-12T16:52:15.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.973+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94045613789248] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.973+0000 7f90c57539c0 20 remove_watcher() i=6 2024-09-12T16:52:15.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.973+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94045613811504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5588b3671040 con 0x5588b36687b0 2024-09-12T16:52:15.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c3a5a640 1 -- 172.21.15.151:0/1597209137 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94045613811504] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc03d070 con 0x5588b36687b0 2024-09-12T16:52:15.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 20 remove_watcher() i=7 2024-09-12T16:52:15.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b36687b0 msgr2=0x5588b366aba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b36687b0 0x5588b366aba0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b3663de0 msgr2=0x5588b3666270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b3663de0 0x5588b3666270 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f90b40f8040 msgr2=0x7f90b4009640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f90b40f8040 0x7f90b4009640 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588b366d1c0 msgr2=0x5588b366f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588b366d1c0 0x5588b366f5f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f8c039a70 msgr2=0x7f8f8c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f8c039a70 0x7f8f8c03bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90b40b6fb0 tx=0x7f90b40dc000 comp rx=0 tx=0).stop 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 msgr2=0x5588b3658870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c2a58640 1 -- 172.21.15.151:0/1597209137 reap_dead start 2024-09-12T16:52:15.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3658870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90bc04f350 tx=0x7f90bc050460 comp rx=0 tx=0).stop 2024-09-12T16:52:15.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 shutdown_connections 2024-09-12T16:52:15.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/1597209137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3652450 0x5588b3658870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 >> 172.21.15.151:0/1597209137 conn(0x5588b364d810 msgr2=0x5588b364ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 shutdown_connections 2024-09-12T16:52:15.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/1597209137 wait complete. 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/975604632 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f9c039a70 msgr2=0x7f8f9c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/975604632 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f9c039a70 0x7f8f9c03bf30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x5588b3631b10 tx=0x7f90b40b4580 comp rx=0 tx=0).stop 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/975604632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3644ae0 msgr2=0x5588b3644f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/975604632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3644ae0 0x5588b3644f00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5588b362b3e0 tx=0x7f90bc018830 comp rx=0 tx=0).stop 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/975604632 shutdown_connections 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/975604632 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f9c039a70 0x7f8f9c03bf30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/975604632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b3644ae0 0x5588b3644f00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/975604632 >> 172.21.15.151:0/975604632 conn(0x5588b363a490 msgr2=0x5588b363a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/975604632 shutdown_connections 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/975604632 wait complete. 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b3633970 msgr2=0x5588b3635d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b3633970 0x5588b3635d60 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b34aba70 msgr2=0x5588b36311c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b34aba70 0x5588b36311c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fa8039a70 msgr2=0x7f8fa803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fa8039a70 0x7f8fa803bf30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f90b8004180 tx=0x7f90b8001340 comp rx=0 tx=0).stop 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 msgr2=0x5588b362a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:15.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b362a050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90b40b8040 tx=0x5588b34ab3b0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 shutdown_connections 2024-09-12T16:52:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588b3633970 0x5588b3635d60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588b34aba70 0x5588b36311c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fa8039a70 0x7f8fa803bf30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 --2- 172.21.15.151:0/2724558311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588b34aa470 0x5588b362a050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 >> 172.21.15.151:0/2724558311 conn(0x5588b3530a50 msgr2=0x5588b361d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 shutdown_connections 2024-09-12T16:52:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:15.977+0000 7f90c57539c0 1 -- 172.21.15.151:0/2724558311 wait complete. 2024-09-12T16:52:15.991 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-12T16:52:15.992 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:52:15.992 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:52:15.992 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:52:16.066 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:16.066 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:16.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f661a4149c0 1 Processor -- start 2024-09-12T16:52:16.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f661a4149c0 1 -- start start 2024-09-12T16:52:16.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f661a4149c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55f81d274200 0x55f81d2745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f661a4149c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f81d1269c0 con 0x55f81d277340 2024-09-12T16:52:16.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f661a4149c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55f81d1766d0 con 0x55f81d274200 2024-09-12T16:52:16.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f6617f1a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55f81d274200 0x55f81d2745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f6617719640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55f81d277340 0x55f81d279730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38026/0 (socket says 172.21.15.151:38026) 2024-09-12T16:52:16.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f6617719640 1 -- 172.21.15.151:0/1300487735 learned_addr learned my addr 172.21.15.151:0/1300487735 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:16.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f6617f1a640 1 -- 172.21.15.151:0/1300487735 >> v1:172.21.15.122:6789/0 conn(0x55f81d277340 legacy=0x55f81d279730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.065+0000 7f6617f1a640 1 -- 172.21.15.151:0/1300487735 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81d11aca0 con 0x55f81d274200 2024-09-12T16:52:16.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f6617f1a640 1 --2- 172.21.15.151:0/1300487735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d2745e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f660800a480 tx=0x7f660801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d681f438018cacb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f6616f18640 1 -- 172.21.15.151:0/1300487735 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66080b0070 con 0x55f81d274200 2024-09-12T16:52:16.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f6616f18640 1 -- 172.21.15.151:0/1300487735 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66080ab540 con 0x55f81d274200 2024-09-12T16:52:16.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f6616f18640 1 -- 172.21.15.151:0/1300487735 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66080ab840 con 0x55f81d274200 2024-09-12T16:52:16.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f661a4149c0 1 -- 172.21.15.151:0/1300487735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 msgr2=0x55f81d2745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f661a4149c0 1 --2- 172.21.15.151:0/1300487735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d2745e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f660800a480 tx=0x7f660801b280 comp rx=0 tx=0).stop 2024-09-12T16:52:16.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f661a4149c0 1 -- 172.21.15.151:0/1300487735 shutdown_connections 2024-09-12T16:52:16.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f661a4149c0 1 --2- 172.21.15.151:0/1300487735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d2745e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f661a4149c0 1 -- 172.21.15.151:0/1300487735 >> 172.21.15.151:0/1300487735 conn(0x55f81d1e7b10 msgr2=0x55f81d1e7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f661a4149c0 1 -- 172.21.15.151:0/1300487735 shutdown_connections 2024-09-12T16:52:16.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.069+0000 7f661a4149c0 1 -- 172.21.15.151:0/1300487735 wait complete. 2024-09-12T16:52:16.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f661a4149c0 1 Processor -- start 2024-09-12T16:52:16.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f661a4149c0 1 -- start start 2024-09-12T16:52:16.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f661a4149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d35f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f661a4149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f81d17a680 con 0x55f81d274200 2024-09-12T16:52:16.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f6617f1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d35f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f6617f1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d35f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33718/0 (socket says 172.21.15.151:33718) 2024-09-12T16:52:16.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f6617f1a640 1 -- 172.21.15.151:0/3133846025 learned_addr learned my addr 172.21.15.151:0/3133846025 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f6617f1a640 1 -- 172.21.15.151:0/3133846025 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81d0f5da0 con 0x55f81d274200 2024-09-12T16:52:16.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.085+0000 7f6617f1a640 1 --2- 172.21.15.151:0/3133846025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d35f810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f66080ae040 tx=0x7f6608003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b69eda88157685 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f6505e0b640 1 -- 172.21.15.151:0/3133846025 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66080b0070 con 0x55f81d274200 2024-09-12T16:52:16.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f6505e0b640 1 -- 172.21.15.151:0/3133846025 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66080b1040 con 0x55f81d274200 2024-09-12T16:52:16.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f6505e0b640 1 -- 172.21.15.151:0/3133846025 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66080ab6f0 con 0x55f81d274200 2024-09-12T16:52:16.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- 172.21.15.151:0/3133846025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 msgr2=0x55f81d35f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3133846025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d35f810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f66080ae040 tx=0x7f6608003030 comp rx=0 tx=0).stop 2024-09-12T16:52:16.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- 172.21.15.151:0/3133846025 shutdown_connections 2024-09-12T16:52:16.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3133846025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d35f810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- 172.21.15.151:0/3133846025 >> 172.21.15.151:0/3133846025 conn(0x55f81d1e7b10 msgr2=0x55f81d35b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- 172.21.15.151:0/3133846025 shutdown_connections 2024-09-12T16:52:16.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- 172.21.15.151:0/3133846025 wait complete. 2024-09-12T16:52:16.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 Processor -- start 2024-09-12T16:52:16.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- start start 2024-09-12T16:52:16.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d366d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f81d11ca50 con 0x55f81d274200 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f6617f1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d366d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f6617f1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d366d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33726/0 (socket says 172.21.15.151:33726) 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f6617f1a640 1 -- 172.21.15.151:0/205448307 learned_addr learned my addr 172.21.15.151:0/205448307 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f6617f1a640 1 -- 172.21.15.151:0/205448307 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81d3672d0 con 0x55f81d274200 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f6617f1a640 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d366d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f66080ab510 tx=0x7f6608018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f64fffff640 1 -- 172.21.15.151:0/205448307 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66080b75b0 con 0x55f81d274200 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f64fffff640 1 -- 172.21.15.151:0/205448307 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66080b7750 con 0x55f81d274200 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f81d367560 con 0x55f81d274200 2024-09-12T16:52:16.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f64fffff640 1 -- 172.21.15.151:0/205448307 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66080b7a30 con 0x55f81d274200 2024-09-12T16:52:16.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.089+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f81d367f10 con 0x55f81d274200 2024-09-12T16:52:16.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f64fffff640 1 -- 172.21.15.151:0/205448307 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f66080b7bd0 con 0x55f81d274200 2024-09-12T16:52:16.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f64fffff640 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6500039ac0 0x7f650003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f64fffff640 1 -- 172.21.15.151:0/205448307 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f66080bc070 con 0x55f81d274200 2024-09-12T16:52:16.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f6617719640 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6500039ac0 0x7f650003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d277340 0x55f81d36dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d36e420 con 0x55f81d277340 2024-09-12T16:52:16.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661871b640 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d277340 0x55f81d36dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f6617719640 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6500039ac0 0x7f650003bf80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f660c004500 tx=0x7f660c006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661871b640 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d277340 0x55f81d36dee0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661871b640 1 -- 172.21.15.151:0/205448307 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66100083f0 con 0x55f81d277340 2024-09-12T16:52:16.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d36e800 con 0x55f81d277340 2024-09-12T16:52:16.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661871b640 1 -- 172.21.15.151:0/205448307 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66100083f0 con 0x55f81d277340 2024-09-12T16:52:16.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d370610 0x55f81d372a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3730d0 con 0x55f81d370610 2024-09-12T16:52:16.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f6617f1a640 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d370610 0x55f81d372a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.093+0000 7f6617f1a640 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d370610 0x55f81d372a00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f6617f1a640 1 -- 172.21.15.151:0/205448307 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d370610 2024-09-12T16:52:16.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d36f4b0 con 0x55f81d277340 2024-09-12T16:52:16.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661871b640 1 -- 172.21.15.151:0/205448307 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66100083f0 con 0x55f81d277340 2024-09-12T16:52:16.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d36f950 con 0x55f81d277340 2024-09-12T16:52:16.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661871b640 1 -- 172.21.15.151:0/205448307 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f66100083f0 con 0x55f81d277340 2024-09-12T16:52:16.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661a4149c0 1 Processor -- start 2024-09-12T16:52:16.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661a4149c0 1 -- start start 2024-09-12T16:52:16.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661a4149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d381740 0x55f81d381b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661a4149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f81d187450 con 0x55f81d381740 2024-09-12T16:52:16.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661871b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d381740 0x55f81d381b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661871b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d381740 0x55f81d381b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33740/0 (socket says 172.21.15.151:33740) 2024-09-12T16:52:16.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661871b640 1 -- 172.21.15.151:0/3064743690 learned_addr learned my addr 172.21.15.151:0/3064743690 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661871b640 1 -- 172.21.15.151:0/3064743690 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81d3821a0 con 0x55f81d381740 2024-09-12T16:52:16.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661871b640 1 --2- 172.21.15.151:0/3064743690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d381740 0x55f81d381b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55f81d368e00 tx=0x7f661000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f64fd7fa640 1 -- 172.21.15.151:0/3064743690 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610007e00 con 0x55f81d381740 2024-09-12T16:52:16.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f64fd7fa640 1 -- 172.21.15.151:0/3064743690 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661001e020 con 0x55f81d381740 2024-09-12T16:52:16.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661a4149c0 1 -- 172.21.15.151:0/3064743690 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f81d382a00 con 0x55f81d381740 2024-09-12T16:52:16.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f64fd7fa640 1 -- 172.21.15.151:0/3064743690 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610019590 con 0x55f81d381740 2024-09-12T16:52:16.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.097+0000 7f661a4149c0 1 -- 172.21.15.151:0/3064743690 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f81d382f70 con 0x55f81d381740 2024-09-12T16:52:16.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f64fd7fa640 1 -- 172.21.15.151:0/3064743690 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6610016040 con 0x55f81d381740 2024-09-12T16:52:16.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f64fd7fa640 1 --2- 172.21.15.151:0/3064743690 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64f0039a70 0x7f64f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f64fd7fa640 1 -- 172.21.15.151:0/3064743690 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f661001f030 con 0x55f81d381740 2024-09-12T16:52:16.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f6617f1a640 1 --2- 172.21.15.151:0/3064743690 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64f0039a70 0x7f64f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 Processor -- start 2024-09-12T16:52:16.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- start start 2024-09-12T16:52:16.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f6617f1a640 1 --2- 172.21.15.151:0/3064743690 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64f0039a70 0x7f64f003bf30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55f81d368200 tx=0x7f66080d6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d38f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f81d35ffa0 con 0x55f81d38f110 2024-09-12T16:52:16.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661871b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d38f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661871b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d38f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33756/0 (socket says 172.21.15.151:33756) 2024-09-12T16:52:16.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661871b640 1 -- 172.21.15.151:0/2229963735 learned_addr learned my addr 172.21.15.151:0/2229963735 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661871b640 1 -- 172.21.15.151:0/2229963735 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81d38fb00 con 0x55f81d38f110 2024-09-12T16:52:16.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661871b640 1 --2- 172.21.15.151:0/2229963735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d38f510 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6610017e00 tx=0x7f6610017b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352ea1f03c599adf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f64f6ffd640 1 -- 172.21.15.151:0/2229963735 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661001d070 con 0x55f81d38f110 2024-09-12T16:52:16.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f64f6ffd640 1 -- 172.21.15.151:0/2229963735 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6610022c60 con 0x55f81d38f110 2024-09-12T16:52:16.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f64f6ffd640 1 -- 172.21.15.151:0/2229963735 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66100520d0 con 0x55f81d38f110 2024-09-12T16:52:16.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- 172.21.15.151:0/2229963735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 msgr2=0x55f81d38f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 --2- 172.21.15.151:0/2229963735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d38f510 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6610017e00 tx=0x7f6610017b20 comp rx=0 tx=0).stop 2024-09-12T16:52:16.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- 172.21.15.151:0/2229963735 shutdown_connections 2024-09-12T16:52:16.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 --2- 172.21.15.151:0/2229963735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d38f510 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- 172.21.15.151:0/2229963735 >> 172.21.15.151:0/2229963735 conn(0x55f81d38a530 msgr2=0x55f81d388770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- 172.21.15.151:0/2229963735 shutdown_connections 2024-09-12T16:52:16.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- 172.21.15.151:0/2229963735 wait complete. 2024-09-12T16:52:16.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 Processor -- start 2024-09-12T16:52:16.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- start start 2024-09-12T16:52:16.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d395570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.101+0000 7f661a4149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f81d38e060 con 0x55f81d38f110 2024-09-12T16:52:16.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661871b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d395570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661871b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d395570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33758/0 (socket says 172.21.15.151:33758) 2024-09-12T16:52:16.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 learned_addr learned my addr 172.21.15.151:0/3508481588 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f81d395ad0 con 0x55f81d38f110 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661871b640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d395570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6610023810 tx=0x7f66100508e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f64f57fa640 1 -- 172.21.15.151:0/3508481588 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661003ed10 con 0x55f81d38f110 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f81d395d60 con 0x55f81d38f110 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f64f57fa640 1 -- 172.21.15.151:0/3508481588 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6610032020 con 0x55f81d38f110 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f64f57fa640 1 -- 172.21.15.151:0/3508481588 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610015830 con 0x55f81d38f110 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f81d395d60 con 0x55f81d38f110 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f64f57fa640 1 -- 172.21.15.151:0/3508481588 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6610015a20 con 0x55f81d38f110 2024-09-12T16:52:16.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f64f57fa640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64e0039a70 0x7f64e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f64f57fa640 1 -- 172.21.15.151:0/3508481588 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6610033030 con 0x55f81d38f110 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f6617f1a640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64e0039a70 0x7f64e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d3a06d0 0x55f81d3a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3a32b0 con 0x55f81d3a06d0 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f6617719640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d3a06d0 0x55f81d3a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f6617f1a640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64e0039a70 0x7f64e003bf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f66080aa7a0 tx=0x7f66080abf50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.105+0000 7f6617719640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d3a06d0 0x55f81d3a2b60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 realm 2024-09-12T16:52:16.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d39fa80 con 0x55f81d3a06d0 2024-09-12T16:52:16.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3a3db0 con 0x55f81d3a06d0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3a4680 con 0x55f81d3a06d0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d3a4f30 0x55f81d3a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3a7a80 con 0x55f81d3a4f30 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661871b640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d3a4f30 0x55f81d3a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661871b640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d3a4f30 0x55f81d3a7320 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f661002a070 con 0x55f81d3a4f30 2024-09-12T16:52:16.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:16.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 20 searching for the correct realm 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f81d3a9a70 0x55f81d3abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617f1a640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f81d3a9a70 0x55f81d3abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617f1a640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f81d3a9a70 0x55f81d3abf30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617f1a640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66080ab030 0x7f66080e9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x7f66080ab030 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.109+0000 7f6617719640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66080ab030 0x7f66080e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66080ab030 0x7f66080e9790 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a06d0 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a06d0 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x7f66080ab030 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a06d0 2024-09-12T16:52:16.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.113+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a06d0 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x7f66080ab030 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a06d0 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a06d0 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.117+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x7f66080ab030 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a06d0 2024-09-12T16:52:16.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x7f66080ab030 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a9a70 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a4f30 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.121+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x55f81d3a06d0 2024-09-12T16:52:16.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ac600 con 0x7f66080ab030 2024-09-12T16:52:16.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:16.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:16.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:16.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:16.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3a8490 con 0x55f81d3a06d0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3a88e0 con 0x55f81d3a06d0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3a8dc0 con 0x55f81d3a06d0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:16.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 zone default found 2024-09-12T16:52:16.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 4 Realm: () 2024-09-12T16:52:16.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:16.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:16.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:16.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 zonegroup default 2024-09-12T16:52:16.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3aca80 con 0x55f81d3a4f30 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ae9a0 con 0x55f81d3a9a70 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3aee60 con 0x55f81d3a9a70 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 started sync module instance, tier type = 2024-09-12T16:52:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.125+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3adcb0 con 0x7f66080ab030 2024-09-12T16:52:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.129+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.129+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94524130648496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3adcb0 con 0x7f66080ab030 2024-09-12T16:52:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.129+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3af970 con 0x55f81d3a06d0 2024-09-12T16:52:16.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.129+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94524130648496] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.129+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.129+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94524130653280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3adcb0 con 0x55f81d3a06d0 2024-09-12T16:52:16.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.129+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b03b0 con 0x55f81d3a9a70 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94524130653280] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94524130646016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3adc20 con 0x55f81d3a9a70 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b10b0 con 0x7f66080ab030 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94524130659600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b1950 con 0x7f66080ab030 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b2310 con 0x55f81d3a06d0 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94524130646016] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94524130659600] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94524130664032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b18c0 con 0x55f81d3a06d0 2024-09-12T16:52:16.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.133+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b2280 con 0x55f81d3a4f30 2024-09-12T16:52:16.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.137+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94524130664032] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.137+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.137+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94524130661392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b1830 con 0x55f81d3a4f30 2024-09-12T16:52:16.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.137+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b31d0 con 0x55f81d3a4f30 2024-09-12T16:52:16.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94524130661392] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94524130666240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b31d0 con 0x55f81d3a4f30 2024-09-12T16:52:16.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b3b90 con 0x55f81d3a4f30 2024-09-12T16:52:16.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94524130670304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b3fb0 con 0x55f81d3a4f30 2024-09-12T16:52:16.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 20 add_watcher() i=0 2024-09-12T16:52:16.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 20 add_watcher() i=1 2024-09-12T16:52:16.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 20 add_watcher() i=2 2024-09-12T16:52:16.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 20 add_watcher() i=3 2024-09-12T16:52:16.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 20 add_watcher() i=4 2024-09-12T16:52:16.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 20 add_watcher() i=5 2024-09-12T16:52:16.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94524130666240] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.141+0000 7f661a4149c0 20 add_watcher() i=6 2024-09-12T16:52:16.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94524130670304] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 20 add_watcher() i=7 2024-09-12T16:52:16.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:16.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b2d20 con 0x55f81d3a06d0 2024-09-12T16:52:16.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94524130667808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b44c0 con 0x55f81d3a06d0 2024-09-12T16:52:16.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94524130667808] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f64cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:16.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:16.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:16.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 5 note: GC not initialized 2024-09-12T16:52:16.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f64ccfe1640 20 reqs_thread_entry: start 2024-09-12T16:52:16.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:16.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 20 Filter name: none 2024-09-12T16:52:16.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f64467fc640 20 reqs_thread_entry: start 2024-09-12T16:52:16.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3d9d00 con 0x55f81d3a06d0 2024-09-12T16:52:16.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.145+0000 7f661a4149c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:16.150 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:16.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.149+0000 7f64cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:16.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.149+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94524130667808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3d8b50 con 0x55f81d3a06d0 2024-09-12T16:52:16.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.149+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94524130667808] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.149+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94524130648496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b2d20 con 0x7f66080ab030 2024-09-12T16:52:16.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.149+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94524130648496] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.149+0000 7f661a4149c0 20 remove_watcher() i=0 2024-09-12T16:52:16.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.149+0000 7f661a4149c0 2 removed watcher, disabling cache 2024-09-12T16:52:16.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.149+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94524130653280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ae1b0 con 0x55f81d3a06d0 2024-09-12T16:52:16.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.153+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94524130653280] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.153+0000 7f661a4149c0 20 remove_watcher() i=1 2024-09-12T16:52:16.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.153+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94524130646016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ae1b0 con 0x55f81d3a9a70 2024-09-12T16:52:16.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.153+0000 7f6617f1a640 1 -- 172.21.15.151:0/3508481588 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94524130646016] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66080cf070 con 0x55f81d3a9a70 2024-09-12T16:52:16.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.153+0000 7f661a4149c0 20 remove_watcher() i=2 2024-09-12T16:52:16.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.153+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94524130659600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ad800 con 0x7f66080ab030 2024-09-12T16:52:16.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.157+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94524130659600] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x7f66080ab030 2024-09-12T16:52:16.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.157+0000 7f661a4149c0 20 remove_watcher() i=3 2024-09-12T16:52:16.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.157+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94524130664032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ad800 con 0x55f81d3a06d0 2024-09-12T16:52:16.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.157+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94524130664032] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660c00f070 con 0x55f81d3a06d0 2024-09-12T16:52:16.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.157+0000 7f661a4149c0 20 remove_watcher() i=4 2024-09-12T16:52:16.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.157+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94524130661392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b1e60 con 0x55f81d3a4f30 2024-09-12T16:52:16.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.161+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94524130661392] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.161+0000 7f661a4149c0 20 remove_watcher() i=5 2024-09-12T16:52:16.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.161+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94524130666240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3ad800 con 0x55f81d3a4f30 2024-09-12T16:52:16.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.161+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94524130666240] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.161+0000 7f661a4149c0 20 remove_watcher() i=6 2024-09-12T16:52:16.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.161+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94524130670304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f81d3b1410 con 0x55f81d3a4f30 2024-09-12T16:52:16.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661871b640 1 -- 172.21.15.151:0/3508481588 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94524130670304] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f661005c040 con 0x55f81d3a4f30 2024-09-12T16:52:16.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 20 remove_watcher() i=7 2024-09-12T16:52:16.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d3a4f30 msgr2=0x55f81d3a7320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d3a4f30 0x55f81d3a7320 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d3a06d0 msgr2=0x55f81d3a2b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d3a06d0 0x55f81d3a2b60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66080ab030 msgr2=0x7f66080e9790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66080ab030 0x7f66080e9790 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f81d3a9a70 msgr2=0x55f81d3abf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f81d3a9a70 0x55f81d3abf30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64e0039a70 msgr2=0x7f64e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64e0039a70 0x7f64e003bf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f66080aa7a0 tx=0x7f66080abf50 comp rx=0 tx=0).stop 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f6617719640 1 -- 172.21.15.151:0/3508481588 reap_dead start 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 msgr2=0x55f81d395570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d395570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6610023810 tx=0x7f66100508e0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 shutdown_connections 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3508481588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d38f110 0x55f81d395570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 >> 172.21.15.151:0/3508481588 conn(0x55f81d38a530 msgr2=0x55f81d388740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 shutdown_connections 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3508481588 wait complete. 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3064743690 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64f0039a70 msgr2=0x7f64f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3064743690 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64f0039a70 0x7f64f003bf30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55f81d368200 tx=0x7f66080d6040 comp rx=0 tx=0).stop 2024-09-12T16:52:16.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3064743690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d381740 msgr2=0x55f81d381b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3064743690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d381740 0x55f81d381b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55f81d368e00 tx=0x7f661000af40 comp rx=0 tx=0).stop 2024-09-12T16:52:16.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3064743690 shutdown_connections 2024-09-12T16:52:16.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3064743690 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64f0039a70 0x7f64f003bf30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/3064743690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d381740 0x55f81d381b60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3064743690 >> 172.21.15.151:0/3064743690 conn(0x55f81d3770f0 msgr2=0x55f81d3774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3064743690 shutdown_connections 2024-09-12T16:52:16.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/3064743690 wait complete. 2024-09-12T16:52:16.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d370610 msgr2=0x55f81d372a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d370610 0x55f81d372a00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d277340 msgr2=0x55f81d36dee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d277340 0x55f81d36dee0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6500039ac0 msgr2=0x7f650003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6500039ac0 0x7f650003bf80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f660c004500 tx=0x7f660c006720 comp rx=0 tx=0).stop 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 msgr2=0x55f81d366d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d366d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f66080ab510 tx=0x7f6608018020 comp rx=0 tx=0).stop 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 shutdown_connections 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f81d370610 0x55f81d372a00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f81d277340 0x55f81d36dee0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6500039ac0 0x7f650003bf80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 --2- 172.21.15.151:0/205448307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f81d274200 0x55f81d366d70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 >> 172.21.15.151:0/205448307 conn(0x55f81d1e7b10 msgr2=0x55f81d359f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 shutdown_connections 2024-09-12T16:52:16.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.165+0000 7f661a4149c0 1 -- 172.21.15.151:0/205448307 wait complete. 2024-09-12T16:52:16.180 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:16.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-12T16:52:16.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-12T16:52:16.181 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-12T16:52:16.258 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:16.258 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:16.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b89c519c0 1 Processor -- start 2024-09-12T16:52:16.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b89c519c0 1 -- start start 2024-09-12T16:52:16.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b89c519c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d60fa3ff0 0x564d60fa63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b89c519c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d60e559c0 con 0x564d60f9fe00 2024-09-12T16:52:16.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b89c519c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x564d60ea56d0 con 0x564d60fa3ff0 2024-09-12T16:52:16.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b86f56640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d60fa3ff0 0x564d60fa63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b87757640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x564d60f9fe00 0x564d60fa01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38036/0 (socket says 172.21.15.151:38036) 2024-09-12T16:52:16.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b87757640 1 -- 172.21.15.151:0/121459132 learned_addr learned my addr 172.21.15.151:0/121459132 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:16.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b86f56640 1 -- 172.21.15.151:0/121459132 >> v1:172.21.15.122:6789/0 conn(0x564d60f9fe00 legacy=0x564d60fa01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b86f56640 1 -- 172.21.15.151:0/121459132 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d60e49ca0 con 0x564d60fa3ff0 2024-09-12T16:52:16.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.253+0000 7f6b86755640 1 -- 172.21.15.151:0/121459132 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562587504 0 0) 0x564d60e559c0 con 0x564d60f9fe00 2024-09-12T16:52:16.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b86f56640 1 --2- 172.21.15.151:0/121459132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60fa3ff0 0x564d60fa63e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00c6d0 tx=0x7f6b7c01d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b79a3bd3020cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b86755640 1 -- 172.21.15.151:0/121459132 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b7c0a6830 con 0x564d60fa3ff0 2024-09-12T16:52:16.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b86755640 1 -- 172.21.15.151:0/121459132 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b7c0aa070 con 0x564d60fa3ff0 2024-09-12T16:52:16.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b86755640 1 -- 172.21.15.151:0/121459132 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b7c0a6b40 con 0x564d60fa3ff0 2024-09-12T16:52:16.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b89c519c0 1 -- 172.21.15.151:0/121459132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60fa3ff0 msgr2=0x564d60fa63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/121459132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60fa3ff0 0x564d60fa63e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00c6d0 tx=0x7f6b7c01d750 comp rx=0 tx=0).stop 2024-09-12T16:52:16.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b89c519c0 1 -- 172.21.15.151:0/121459132 shutdown_connections 2024-09-12T16:52:16.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/121459132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60fa3ff0 0x564d60fa63e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b89c519c0 1 -- 172.21.15.151:0/121459132 >> 172.21.15.151:0/121459132 conn(0x564d60f9b920 msgr2=0x564d60f9dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b89c519c0 1 -- 172.21.15.151:0/121459132 shutdown_connections 2024-09-12T16:52:16.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.257+0000 7f6b89c519c0 1 -- 172.21.15.151:0/121459132 wait complete. 2024-09-12T16:52:16.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b89c519c0 1 Processor -- start 2024-09-12T16:52:16.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b89c519c0 1 -- start start 2024-09-12T16:52:16.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b89c519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d6108a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b89c519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d60ea9680 con 0x564d60f9fe00 2024-09-12T16:52:16.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b87757640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d6108a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b87757640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d6108a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33764/0 (socket says 172.21.15.151:33764) 2024-09-12T16:52:16.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b87757640 1 -- 172.21.15.151:0/3796624756 learned_addr learned my addr 172.21.15.151:0/3796624756 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b87757640 1 -- 172.21.15.151:0/3796624756 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d60e24da0 con 0x564d60f9fe00 2024-09-12T16:52:16.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6b87757640 1 --2- 172.21.15.151:0/3796624756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d6108a2e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b78001eb0 tx=0x7f6b7800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2935aabcdfe2bf34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6a7560a640 1 -- 172.21.15.151:0/3796624756 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b7800d640 con 0x564d60f9fe00 2024-09-12T16:52:16.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6a7560a640 1 -- 172.21.15.151:0/3796624756 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b78008070 con 0x564d60f9fe00 2024-09-12T16:52:16.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.273+0000 7f6a7560a640 1 -- 172.21.15.151:0/3796624756 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b7800d970 con 0x564d60f9fe00 2024-09-12T16:52:16.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3796624756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 msgr2=0x564d6108a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3796624756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d6108a2e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b78001eb0 tx=0x7f6b7800b6b0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3796624756 shutdown_connections 2024-09-12T16:52:16.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3796624756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d6108a2e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3796624756 >> 172.21.15.151:0/3796624756 conn(0x564d60f9b920 msgr2=0x564d61085f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3796624756 shutdown_connections 2024-09-12T16:52:16.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3796624756 wait complete. 2024-09-12T16:52:16.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 Processor -- start 2024-09-12T16:52:16.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- start start 2024-09-12T16:52:16.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d610919e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d60e4ba50 con 0x564d60f9fe00 2024-09-12T16:52:16.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b87757640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d610919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b87757640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d610919e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33766/0 (socket says 172.21.15.151:33766) 2024-09-12T16:52:16.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b87757640 1 -- 172.21.15.151:0/3745648376 learned_addr learned my addr 172.21.15.151:0/3745648376 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b87757640 1 -- 172.21.15.151:0/3745648376 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d61091f40 con 0x564d60f9fe00 2024-09-12T16:52:16.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b87757640 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d610919e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800bbb0 tx=0x7f6b78000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6a73e07640 1 -- 172.21.15.151:0/3745648376 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b7801a880 con 0x564d60f9fe00 2024-09-12T16:52:16.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d610921d0 con 0x564d60f9fe00 2024-09-12T16:52:16.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6a73e07640 1 -- 172.21.15.151:0/3745648376 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b7801aa20 con 0x564d60f9fe00 2024-09-12T16:52:16.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6a73e07640 1 -- 172.21.15.151:0/3745648376 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b7801ad20 con 0x564d60f9fe00 2024-09-12T16:52:16.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.277+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d61092b80 con 0x564d60f9fe00 2024-09-12T16:52:16.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6a73e07640 1 -- 172.21.15.151:0/3745648376 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6b78017070 con 0x564d60f9fe00 2024-09-12T16:52:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6a73e07640 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a6c039a70 0x7f6a6c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6a73e07640 1 -- 172.21.15.151:0/3745648376 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6b78015020 con 0x564d60f9fe00 2024-09-12T16:52:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b86f56640 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a6c039a70 0x7f6a6c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d60fa3ff0 0x564d61098b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d61099090 con 0x564d60fa3ff0 2024-09-12T16:52:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b87f58640 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d60fa3ff0 0x564d61098b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b86f56640 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a6c039a70 0x7f6a6c03bf30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x564d60f9fa10 tx=0x7f6b7c0a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b87f58640 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d60fa3ff0 0x564d61098b50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b87f58640 1 -- 172.21.15.151:0/3745648376 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d60fa3ff0 2024-09-12T16:52:16.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d61092ee0 con 0x564d60fa3ff0 2024-09-12T16:52:16.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b87f58640 1 -- 172.21.15.151:0/3745648376 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b800083f0 con 0x564d60fa3ff0 2024-09-12T16:52:16.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d6109b380 0x564d6109d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d6109deb0 con 0x564d6109b380 2024-09-12T16:52:16.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b87757640 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d6109b380 0x564d6109d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b87757640 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d6109b380 0x564d6109d770 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b87757640 1 -- 172.21.15.151:0/3745648376 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b7802e070 con 0x564d6109b380 2024-09-12T16:52:16.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d6109a1f0 con 0x564d60fa3ff0 2024-09-12T16:52:16.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b87f58640 1 -- 172.21.15.151:0/3745648376 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b800083f0 con 0x564d60fa3ff0 2024-09-12T16:52:16.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.281+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d6109a5e0 con 0x564d60fa3ff0 2024-09-12T16:52:16.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b87f58640 1 -- 172.21.15.151:0/3745648376 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b800083f0 con 0x564d60fa3ff0 2024-09-12T16:52:16.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b89c519c0 1 Processor -- start 2024-09-12T16:52:16.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b89c519c0 1 -- start start 2024-09-12T16:52:16.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b89c519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610ac480 0x564d610ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b89c519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d60eb6450 con 0x564d610ac480 2024-09-12T16:52:16.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b87f58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610ac480 0x564d610ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b87f58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610ac480 0x564d610ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33776/0 (socket says 172.21.15.151:33776) 2024-09-12T16:52:16.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b87f58640 1 -- 172.21.15.151:0/3672126164 learned_addr learned my addr 172.21.15.151:0/3672126164 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b87f58640 1 -- 172.21.15.151:0/3672126164 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d610acee0 con 0x564d610ac480 2024-09-12T16:52:16.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b87f58640 1 --2- 172.21.15.151:0/3672126164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610ac480 0x564d610ac8a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x564d61092760 tx=0x7f6b8000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6a71602640 1 -- 172.21.15.151:0/3672126164 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b80010db0 con 0x564d610ac480 2024-09-12T16:52:16.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6a71602640 1 -- 172.21.15.151:0/3672126164 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8001f020 con 0x564d610ac480 2024-09-12T16:52:16.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3672126164 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d610ad740 con 0x564d610ac480 2024-09-12T16:52:16.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6a71602640 1 -- 172.21.15.151:0/3672126164 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b8001a5a0 con 0x564d610ac480 2024-09-12T16:52:16.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.285+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3672126164 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d610adcb0 con 0x564d610ac480 2024-09-12T16:52:16.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6a71602640 1 -- 172.21.15.151:0/3672126164 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6b80013030 con 0x564d610ac480 2024-09-12T16:52:16.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6a71602640 1 --2- 172.21.15.151:0/3672126164 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a60039ac0 0x7f6a6003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6a71602640 1 -- 172.21.15.151:0/3672126164 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6b80020030 con 0x564d610ac480 2024-09-12T16:52:16.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b87757640 1 --2- 172.21.15.151:0/3672126164 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a60039ac0 0x7f6a6003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 Processor -- start 2024-09-12T16:52:16.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- start start 2024-09-12T16:52:16.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b87757640 1 --2- 172.21.15.151:0/3672126164 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a60039ac0 0x7f6a6003bf80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800ecf0 tx=0x7f6b78045040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d6108ab30 con 0x564d610b9dd0 2024-09-12T16:52:16.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b87f58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b87f58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610ba1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33788/0 (socket says 172.21.15.151:33788) 2024-09-12T16:52:16.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b87f58640 1 -- 172.21.15.151:0/49854826 learned_addr learned my addr 172.21.15.151:0/49854826 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b87f58640 1 -- 172.21.15.151:0/49854826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d610ba7c0 con 0x564d610b9dd0 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b87f58640 1 --2- 172.21.15.151:0/49854826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610ba1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6b80019fd0 tx=0x7f6b80023fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e01844e332633b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6a6affd640 1 -- 172.21.15.151:0/49854826 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b8004f3d0 con 0x564d610b9dd0 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6a6affd640 1 -- 172.21.15.151:0/49854826 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b80007a70 con 0x564d610b9dd0 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6a6affd640 1 -- 172.21.15.151:0/49854826 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b8003fba0 con 0x564d610b9dd0 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- 172.21.15.151:0/49854826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 msgr2=0x564d610ba1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/49854826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610ba1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6b80019fd0 tx=0x7f6b80023fb0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- 172.21.15.151:0/49854826 shutdown_connections 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/49854826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610ba1d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- 172.21.15.151:0/49854826 >> 172.21.15.151:0/49854826 conn(0x564d610b51f0 msgr2=0x564d610b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- 172.21.15.151:0/49854826 shutdown_connections 2024-09-12T16:52:16.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- 172.21.15.151:0/49854826 wait complete. 2024-09-12T16:52:16.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 Processor -- start 2024-09-12T16:52:16.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- start start 2024-09-12T16:52:16.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610c0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.289+0000 7f6b89c519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d610b8d20 con 0x564d610b9dd0 2024-09-12T16:52:16.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b87f58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b87f58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610c0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33792/0 (socket says 172.21.15.151:33792) 2024-09-12T16:52:16.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 learned_addr learned my addr 172.21.15.151:0/2806018309 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d610c07a0 con 0x564d610b9dd0 2024-09-12T16:52:16.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b87f58640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610c0240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6b80041040 tx=0x7f6b80050730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6a697fa640 1 -- 172.21.15.151:0/2806018309 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b80031070 con 0x564d610b9dd0 2024-09-12T16:52:16.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6a697fa640 1 -- 172.21.15.151:0/2806018309 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b80018cc0 con 0x564d610b9dd0 2024-09-12T16:52:16.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d610c0a30 con 0x564d610b9dd0 2024-09-12T16:52:16.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6a697fa640 1 -- 172.21.15.151:0/2806018309 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b80048040 con 0x564d610b9dd0 2024-09-12T16:52:16.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d610c0a30 con 0x564d610b9dd0 2024-09-12T16:52:16.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6a697fa640 1 -- 172.21.15.151:0/2806018309 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6b80041d10 con 0x564d610b9dd0 2024-09-12T16:52:16.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6a697fa640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a50039a70 0x7f6a5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6a697fa640 1 -- 172.21.15.151:0/2806018309 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6b80036c60 con 0x564d610b9dd0 2024-09-12T16:52:16.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b87757640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a50039a70 0x7f6a5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d610cb3f0 0x564d610cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610ce000 con 0x564d610cb3f0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b86f56640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d610cb3f0 0x564d610cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b87757640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a50039a70 0x7f6a5003bf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800da90 tx=0x7f6b78033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.293+0000 7f6b86f56640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d610cb3f0 0x564d610cd8b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 realm 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610ce3d0 con 0x564d610cb3f0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610ceca0 con 0x564d610cb3f0 2024-09-12T16:52:16.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610cf040 con 0x564d610cb3f0 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d610cfda0 0x564d610d2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610d27a0 con 0x564d610cfda0 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b87f58640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d610cfda0 0x564d610d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b87f58640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d610cfda0 0x564d610d2190 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 20 searching for the correct realm 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d610d46f0 0x564d610d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610d46f0 2024-09-12T16:52:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b87757640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d610d46f0 0x564d610d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b87757640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d610d46f0 0x564d610d6b20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b87757640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6b7804f640 0x7f6b7804fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x7f6b7804f640 2024-09-12T16:52:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.297+0000 7f6b86f56640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6b7804f640 0x7f6b7804fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6b7804f640 0x7f6b7804fa60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610cfda0 2024-09-12T16:52:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610cb3f0 2024-09-12T16:52:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610cb3f0 2024-09-12T16:52:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610cfda0 2024-09-12T16:52:16.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610cfda0 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x7f6b7804f640 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.301+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610d46f0 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610cb3f0 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610cfda0 2024-09-12T16:52:16.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x564d610cb3f0 2024-09-12T16:52:16.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d610d71a0 con 0x7f6b7804f640 2024-09-12T16:52:16.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610d46f0 2024-09-12T16:52:16.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610d46f0 2024-09-12T16:52:16.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cfda0 2024-09-12T16:52:16.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610d46f0 2024-09-12T16:52:16.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610d46f0 2024-09-12T16:52:16.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cb3f0 2024-09-12T16:52:16.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.305+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cb3f0 2024-09-12T16:52:16.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cfda0 2024-09-12T16:52:16.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610d46f0 2024-09-12T16:52:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x7f6b7804f640 2024-09-12T16:52:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cb3f0 2024-09-12T16:52:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cfda0 2024-09-12T16:52:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610d46f0 2024-09-12T16:52:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cfda0 2024-09-12T16:52:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x7f6b7804f640 2024-09-12T16:52:16.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.309+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610d46f0 2024-09-12T16:52:16.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cfda0 2024-09-12T16:52:16.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x564d610cb3f0 2024-09-12T16:52:16.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6b7c0d5060 con 0x7f6b7804f640 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610d3190 con 0x564d610cb3f0 2024-09-12T16:52:16.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610d3a30 con 0x564d610cb3f0 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610d2dd0 con 0x564d610cb3f0 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 zone default found 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 4 Realm: () 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 zonegroup default 2024-09-12T16:52:16.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610d7620 con 0x564d610cfda0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610d94b0 con 0x564d610d46f0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610d9900 con 0x564d610d46f0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 started sync module instance, tier type = 2024-09-12T16:52:16.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:16.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.313+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610d8850 con 0x7f6b7804f640 2024-09-12T16:52:16.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.317+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.317+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94890340748704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610d8850 con 0x7f6b7804f640 2024-09-12T16:52:16.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.317+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610da400 con 0x564d610cb3f0 2024-09-12T16:52:16.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.317+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94890340748704] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.317+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.317+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94890340753104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610d8850 con 0x564d610cb3f0 2024-09-12T16:52:16.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.317+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610dae10 con 0x564d610d46f0 2024-09-12T16:52:16.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.321+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.321+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94890340755808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610db6b0 con 0x564d610d46f0 2024-09-12T16:52:16.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.321+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610dc070 con 0x7f6b7804f640 2024-09-12T16:52:16.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.321+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94890340753104] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.321+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.321+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94890340760512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610dbfe0 con 0x7f6b7804f640 2024-09-12T16:52:16.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.321+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610dcdc0 con 0x564d610cb3f0 2024-09-12T16:52:16.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.321+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94890340755808] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.325+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94890340760512] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.325+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.325+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94890340758016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610dc880 con 0x564d610cb3f0 2024-09-12T16:52:16.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.325+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610dd110 con 0x564d610cfda0 2024-09-12T16:52:16.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.325+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94890340758016] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.325+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.325+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94890340762848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610dd500 con 0x564d610cfda0 2024-09-12T16:52:16.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.325+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610ddec0 con 0x564d610cfda0 2024-09-12T16:52:16.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94890340762848] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94890340764000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610ddec0 con 0x564d610cfda0 2024-09-12T16:52:16.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610de8c0 con 0x564d610cfda0 2024-09-12T16:52:16.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94890340764000] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94890340770768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610deaa0 con 0x564d610cfda0 2024-09-12T16:52:16.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 20 add_watcher() i=0 2024-09-12T16:52:16.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 20 add_watcher() i=1 2024-09-12T16:52:16.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 20 add_watcher() i=2 2024-09-12T16:52:16.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 20 add_watcher() i=3 2024-09-12T16:52:16.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 20 add_watcher() i=4 2024-09-12T16:52:16.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 20 add_watcher() i=5 2024-09-12T16:52:16.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.329+0000 7f6b89c519c0 20 add_watcher() i=6 2024-09-12T16:52:16.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94890340770768] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 20 add_watcher() i=7 2024-09-12T16:52:16.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:16.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d610e1e70 con 0x564d610cb3f0 2024-09-12T16:52:16.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94890340772240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610df260 con 0x564d610cb3f0 2024-09-12T16:52:16.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94890340772240] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:16.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:16.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:16.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 5 note: GC not initialized 2024-09-12T16:52:16.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6a3cfe1640 20 reqs_thread_entry: start 2024-09-12T16:52:16.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:16.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 20 Filter name: none 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f69b67fc640 20 reqs_thread_entry: start 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.333+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d61104f30 con 0x564d610cb3f0 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:16.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d611079c0 con 0x7f6b7804f640 2024-09-12T16:52:16.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d6110b010 con 0x564d610cb3f0 2024-09-12T16:52:16.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:16.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:16.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:16.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94890340952720 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d611069b0 con 0x564d610cb3f0 2024-09-12T16:52:16.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94890340758016 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f6b7c0d0040 con 0x564d610cb3f0 2024-09-12T16:52:16.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94890340758016 notifier 4313 bl.length()=567 2024-09-12T16:52:16.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6a6affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:16.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6a6affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:16.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(65 notify.4 [notify cookie 94890340952720 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6a6affd640 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6a4c003eb0 con 0x564d610cb3f0 2024-09-12T16:52:16.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.337+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94890340952720 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564d60e49ca0 con 0x564d610cb3f0 2024-09-12T16:52:16.344 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.341+0000 7f6a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.341+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94890340772240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d61102d10 con 0x564d610cb3f0 2024-09-12T16:52:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.341+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94890340772240] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.341+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94890340748704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d61102d10 con 0x7f6b7804f640 2024-09-12T16:52:16.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.341+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94890340748704] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.341+0000 7f6b89c519c0 20 remove_watcher() i=0 2024-09-12T16:52:16.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.341+0000 7f6b89c519c0 2 removed watcher, disabling cache 2024-09-12T16:52:16.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.341+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94890340753104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d61102d10 con 0x564d610cb3f0 2024-09-12T16:52:16.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94890340753104] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b89c519c0 20 remove_watcher() i=1 2024-09-12T16:52:16.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94890340755808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d61102d10 con 0x564d610d46f0 2024-09-12T16:52:16.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b87757640 1 -- 172.21.15.151:0/2806018309 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94890340755808] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7802e070 con 0x564d610d46f0 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b89c519c0 20 remove_watcher() i=2 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94890340760512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610de990 con 0x7f6b7804f640 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94890340760512] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x7f6b7804f640 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b89c519c0 20 remove_watcher() i=3 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.345+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94890340758016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610de990 con 0x564d610cb3f0 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.349+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94890340758016] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b7c0a7050 con 0x564d610cb3f0 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.349+0000 7f6b89c519c0 20 remove_watcher() i=4 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.349+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94890340762848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610db200 con 0x564d610cfda0 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.349+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94890340762848] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b89c519c0 20 remove_watcher() i=5 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94890340764000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610de990 con 0x564d610cfda0 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94890340764000] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b89c519c0 20 remove_watcher() i=6 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94890340770768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d610dc4e0 con 0x564d610cfda0 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b87f58640 1 -- 172.21.15.151:0/2806018309 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94890340770768] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b800083f0 con 0x564d610cfda0 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b89c519c0 20 remove_watcher() i=7 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d610cfda0 msgr2=0x564d610d2190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.353+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d610cfda0 0x564d610d2190 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d610cb3f0 msgr2=0x564d610cd8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d610cb3f0 0x564d610cd8b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6b7804f640 msgr2=0x7f6b7804fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6b7804f640 0x7f6b7804fa60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d610d46f0 msgr2=0x564d610d6b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d610d46f0 0x564d610d6b20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a50039a70 msgr2=0x7f6a5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a50039a70 0x7f6a5003bf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800da90 tx=0x7f6b78033000 comp rx=0 tx=0).stop 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 msgr2=0x564d610c0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b86f56640 1 -- 172.21.15.151:0/2806018309 reap_dead start 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610c0240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6b80041040 tx=0x7f6b80050730 comp rx=0 tx=0).stop 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 shutdown_connections 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/2806018309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610b9dd0 0x564d610c0240 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 >> 172.21.15.151:0/2806018309 conn(0x564d610b51f0 msgr2=0x564d610b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 shutdown_connections 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/2806018309 wait complete. 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3672126164 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a60039ac0 msgr2=0x7f6a6003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3672126164 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a60039ac0 0x7f6a6003bf80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800ecf0 tx=0x7f6b78045040 comp rx=0 tx=0).stop 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3672126164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610ac480 msgr2=0x564d610ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3672126164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610ac480 0x564d610ac8a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x564d61092760 tx=0x7f6b8000af40 comp rx=0 tx=0).stop 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3672126164 shutdown_connections 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3672126164 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a60039ac0 0x7f6a6003bf80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3672126164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d610ac480 0x564d610ac8a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3672126164 >> 172.21.15.151:0/3672126164 conn(0x564d610a1e30 msgr2=0x564d610a2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3672126164 shutdown_connections 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3672126164 wait complete. 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d6109b380 msgr2=0x564d6109d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d6109b380 0x564d6109d770 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d60fa3ff0 msgr2=0x564d61098b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d60fa3ff0 0x564d61098b50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a6c039a70 msgr2=0x7f6a6c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a6c039a70 0x7f6a6c03bf30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x564d60f9fa10 tx=0x7f6b7c0a8070 comp rx=0 tx=0).stop 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 msgr2=0x564d610919e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d610919e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800bbb0 tx=0x7f6b78000ee0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 shutdown_connections 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d6109b380 0x564d6109d770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d60fa3ff0 0x564d61098b50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6a6c039a70 0x7f6a6c03bf30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 --2- 172.21.15.151:0/3745648376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d60f9fe00 0x564d610919e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 >> 172.21.15.151:0/3745648376 conn(0x564d60f9b920 msgr2=0x564d610849b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 shutdown_connections 2024-09-12T16:52:16.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.357+0000 7f6b89c519c0 1 -- 172.21.15.151:0/3745648376 wait complete. 2024-09-12T16:52:16.792 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:16.793 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:52:16.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:52:16.793 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:52:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.865+0000 7f382f9329c0 1 Processor -- start 2024-09-12T16:52:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.865+0000 7f382f9329c0 1 -- start start 2024-09-12T16:52:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.865+0000 7f382f9329c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55ac80eb17b0 0x55ac80eb0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.865+0000 7f382f9329c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac80def9c0 con 0x55ac80eb1280 2024-09-12T16:52:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.865+0000 7f382f9329c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55ac80e3f6d0 con 0x55ac80eb17b0 2024-09-12T16:52:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.865+0000 7f382cc37640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55ac80eb17b0 0x55ac80eb0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382d438640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55ac80eb1280 0x55ac80eafc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38050/0 (socket says 172.21.15.151:38050) 2024-09-12T16:52:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382d438640 1 -- 172.21.15.151:0/4029864558 learned_addr learned my addr 172.21.15.151:0/4029864558 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382cc37640 1 -- 172.21.15.151:0/4029864558 >> v1:172.21.15.122:6789/0 conn(0x55ac80eb1280 legacy=0x55ac80eafc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382cc37640 1 -- 172.21.15.151:0/4029864558 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac80de3ca0 con 0x55ac80eb17b0 2024-09-12T16:52:16.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382cc37640 1 --2- 172.21.15.151:0/4029864558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb17b0 0x55ac80eb0380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f381800a480 tx=0x7f381801b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7429d1f2faba4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f3827fff640 1 -- 172.21.15.151:0/4029864558 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38180af070 con 0x55ac80eb17b0 2024-09-12T16:52:16.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f3827fff640 1 -- 172.21.15.151:0/4029864558 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38180aa530 con 0x55ac80eb17b0 2024-09-12T16:52:16.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f3827fff640 1 -- 172.21.15.151:0/4029864558 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38180aa830 con 0x55ac80eb17b0 2024-09-12T16:52:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382f9329c0 1 -- 172.21.15.151:0/4029864558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb17b0 msgr2=0x55ac80eb0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382f9329c0 1 --2- 172.21.15.151:0/4029864558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb17b0 0x55ac80eb0380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f381800a480 tx=0x7f381801b1c0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382f9329c0 1 -- 172.21.15.151:0/4029864558 shutdown_connections 2024-09-12T16:52:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382f9329c0 1 --2- 172.21.15.151:0/4029864558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb17b0 0x55ac80eb0380 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382f9329c0 1 -- 172.21.15.151:0/4029864558 >> 172.21.15.151:0/4029864558 conn(0x55ac80f36aa0 msgr2=0x55ac80f38ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382f9329c0 1 -- 172.21.15.151:0/4029864558 shutdown_connections 2024-09-12T16:52:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.869+0000 7f382f9329c0 1 -- 172.21.15.151:0/4029864558 wait complete. 2024-09-12T16:52:16.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.885+0000 7f382f9329c0 1 Processor -- start 2024-09-12T16:52:16.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.885+0000 7f382f9329c0 1 -- start start 2024-09-12T16:52:16.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.885+0000 7f382f9329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81028bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.885+0000 7f382f9329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ac80e43680 con 0x55ac80eb1280 2024-09-12T16:52:16.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81028bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81028bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33804/0 (socket says 172.21.15.151:33804) 2024-09-12T16:52:16.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 -- 172.21.15.151:0/3136824890 learned_addr learned my addr 172.21.15.151:0/3136824890 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 -- 172.21.15.151:0/3136824890 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac80dbeda0 con 0x55ac80eb1280 2024-09-12T16:52:16.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 --2- 172.21.15.151:0/3136824890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81028bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38280017b0 tx=0x7f3828001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3286cc371577e406 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f371b606640 1 -- 172.21.15.151:0/3136824890 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38280044f0 con 0x55ac80eb1280 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f371b606640 1 -- 172.21.15.151:0/3136824890 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38280046b0 con 0x55ac80eb1280 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f371b606640 1 -- 172.21.15.151:0/3136824890 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3828004a10 con 0x55ac80eb1280 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 -- 172.21.15.151:0/3136824890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 msgr2=0x55ac81028bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 --2- 172.21.15.151:0/3136824890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81028bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38280017b0 tx=0x7f3828001c70 comp rx=0 tx=0).stop 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 -- 172.21.15.151:0/3136824890 shutdown_connections 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 --2- 172.21.15.151:0/3136824890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81028bc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 -- 172.21.15.151:0/3136824890 >> 172.21.15.151:0/3136824890 conn(0x55ac80f36aa0 msgr2=0x55ac81024800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 -- 172.21.15.151:0/3136824890 shutdown_connections 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 -- 172.21.15.151:0/3136824890 wait complete. 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 Processor -- start 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 -- start start 2024-09-12T16:52:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81030260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382f9329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ac80de5a50 con 0x55ac80eb1280 2024-09-12T16:52:16.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81030260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81030260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33812/0 (socket says 172.21.15.151:33812) 2024-09-12T16:52:16.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 -- 172.21.15.151:0/928336313 learned_addr learned my addr 172.21.15.151:0/928336313 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 -- 172.21.15.151:0/928336313 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac810307c0 con 0x55ac80eb1280 2024-09-12T16:52:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.889+0000 7f382d438640 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81030260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38280012f0 tx=0x7f3828000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f3719e03640 1 -- 172.21.15.151:0/928336313 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3828013820 con 0x55ac80eb1280 2024-09-12T16:52:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f3719e03640 1 -- 172.21.15.151:0/928336313 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38280139c0 con 0x55ac80eb1280 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac81030a50 con 0x55ac80eb1280 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f3719e03640 1 -- 172.21.15.151:0/928336313 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3828013ca0 con 0x55ac80eb1280 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac81031400 con 0x55ac80eb1280 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f3719e03640 1 -- 172.21.15.151:0/928336313 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3828010070 con 0x55ac80eb1280 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f3719e03640 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3714039ac0 0x7f371403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f3719e03640 1 -- 172.21.15.151:0/928336313 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3828018070 con 0x55ac80eb1280 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382cc37640 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3714039ac0 0x7f371403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac80eb17b0 0x55ac810373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81037910 con 0x55ac80eb17b0 2024-09-12T16:52:16.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382dc39640 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac80eb17b0 0x55ac810373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382cc37640 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3714039ac0 0x7f371403bf80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38180ac000 tx=0x7f38180a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382dc39640 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac80eb17b0 0x55ac810373d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382dc39640 1 -- 172.21.15.151:0/928336313 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38200083f0 con 0x55ac80eb17b0 2024-09-12T16:52:16.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81031770 con 0x55ac80eb17b0 2024-09-12T16:52:16.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382dc39640 1 -- 172.21.15.151:0/928336313 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f38200083f0 con 0x55ac80eb17b0 2024-09-12T16:52:16.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac81039bb0 0x55ac8103bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac8103c670 con 0x55ac81039bb0 2024-09-12T16:52:16.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.893+0000 7f382d438640 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac81039bb0 0x55ac8103bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382d438640 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac81039bb0 0x55ac8103bfa0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382d438640 1 -- 172.21.15.151:0/928336313 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f382801b030 con 0x55ac81039bb0 2024-09-12T16:52:16.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81038a50 con 0x55ac80eb17b0 2024-09-12T16:52:16.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382dc39640 1 -- 172.21.15.151:0/928336313 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f38200083f0 con 0x55ac80eb17b0 2024-09-12T16:52:16.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81038ef0 con 0x55ac80eb17b0 2024-09-12T16:52:16.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382dc39640 1 -- 172.21.15.151:0/928336313 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f38200083f0 con 0x55ac80eb17b0 2024-09-12T16:52:16.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382f9329c0 1 Processor -- start 2024-09-12T16:52:16.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382f9329c0 1 -- start start 2024-09-12T16:52:16.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382f9329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac8104ace0 0x55ac8104b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382f9329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ac80e50450 con 0x55ac8104ace0 2024-09-12T16:52:16.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382dc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac8104ace0 0x55ac8104b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382dc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac8104ace0 0x55ac8104b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33820/0 (socket says 172.21.15.151:33820) 2024-09-12T16:52:16.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382dc39640 1 -- 172.21.15.151:0/2815865829 learned_addr learned my addr 172.21.15.151:0/2815865829 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382dc39640 1 -- 172.21.15.151:0/2815865829 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac8104b740 con 0x55ac8104ace0 2024-09-12T16:52:16.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382dc39640 1 --2- 172.21.15.151:0/2815865829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac8104ace0 0x55ac8104b100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55ac810323c0 tx=0x7f382000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f3712ffd640 1 -- 172.21.15.151:0/2815865829 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3820007e00 con 0x55ac8104ace0 2024-09-12T16:52:16.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f3712ffd640 1 -- 172.21.15.151:0/2815865829 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382001e020 con 0x55ac8104ace0 2024-09-12T16:52:16.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382f9329c0 1 -- 172.21.15.151:0/2815865829 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac8104bfa0 con 0x55ac8104ace0 2024-09-12T16:52:16.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f3712ffd640 1 -- 172.21.15.151:0/2815865829 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3820019590 con 0x55ac8104ace0 2024-09-12T16:52:16.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.897+0000 7f382f9329c0 1 -- 172.21.15.151:0/2815865829 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac8104c510 con 0x55ac8104ace0 2024-09-12T16:52:16.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f3712ffd640 1 -- 172.21.15.151:0/2815865829 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3820016040 con 0x55ac8104ace0 2024-09-12T16:52:16.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f3712ffd640 1 --2- 172.21.15.151:0/2815865829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3704039ac0 0x7f370403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f3712ffd640 1 -- 172.21.15.151:0/2815865829 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f382001f030 con 0x55ac8104ace0 2024-09-12T16:52:16.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382d438640 1 --2- 172.21.15.151:0/2815865829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3704039ac0 0x7f370403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382f9329c0 1 Processor -- start 2024-09-12T16:52:16.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382f9329c0 1 -- start start 2024-09-12T16:52:16.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382d438640 1 --2- 172.21.15.151:0/2815865829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3704039ac0 0x7f370403bf80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55ac81037d20 tx=0x7f382801e680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382f9329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac81057920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382f9329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ac81029410 con 0x55ac81057540 2024-09-12T16:52:16.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382dc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac81057920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382dc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac81057920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33822/0 (socket says 172.21.15.151:33822) 2024-09-12T16:52:16.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382dc39640 1 -- 172.21.15.151:0/1434241611 learned_addr learned my addr 172.21.15.151:0/1434241611 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382dc39640 1 -- 172.21.15.151:0/1434241611 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac81057ef0 con 0x55ac81057540 2024-09-12T16:52:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f382dc39640 1 --2- 172.21.15.151:0/1434241611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac81057920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3820050940 tx=0x7f3820019b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1126d791d5c5964 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f3710ff9640 1 -- 172.21.15.151:0/1434241611 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f382001d040 con 0x55ac81057540 2024-09-12T16:52:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f3710ff9640 1 -- 172.21.15.151:0/1434241611 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3820022cc0 con 0x55ac81057540 2024-09-12T16:52:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.901+0000 7f3710ff9640 1 -- 172.21.15.151:0/1434241611 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3820019da0 con 0x55ac81057540 2024-09-12T16:52:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- 172.21.15.151:0/1434241611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 msgr2=0x55ac81057920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 --2- 172.21.15.151:0/1434241611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac81057920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3820050940 tx=0x7f3820019b00 comp rx=0 tx=0).stop 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- 172.21.15.151:0/1434241611 shutdown_connections 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 --2- 172.21.15.151:0/1434241611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac81057920 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- 172.21.15.151:0/1434241611 >> 172.21.15.151:0/1434241611 conn(0x55ac81053970 msgr2=0x55ac81051bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- 172.21.15.151:0/1434241611 shutdown_connections 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- 172.21.15.151:0/1434241611 wait complete. 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 Processor -- start 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- start start 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac8105ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ac81058550 con 0x55ac81057540 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382dc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac8105ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382dc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac8105ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33836/0 (socket says 172.21.15.151:33836) 2024-09-12T16:52:16.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 learned_addr learned my addr 172.21.15.151:0/2739646568 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:16.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac8105efd0 con 0x55ac81057540 2024-09-12T16:52:16.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382dc39640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac8105ea70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3820005710 tx=0x7f38200508d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f3702ffd640 1 -- 172.21.15.151:0/2739646568 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f382001d070 con 0x55ac81057540 2024-09-12T16:52:16.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac8105f260 con 0x55ac81057540 2024-09-12T16:52:16.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f3702ffd640 1 -- 172.21.15.151:0/2739646568 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3820031030 con 0x55ac81057540 2024-09-12T16:52:16.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f3702ffd640 1 -- 172.21.15.151:0/2739646568 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3820048040 con 0x55ac81057540 2024-09-12T16:52:16.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac8105fc10 con 0x55ac81057540 2024-09-12T16:52:16.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.905+0000 7f3702ffd640 1 -- 172.21.15.151:0/2739646568 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f382004f210 con 0x55ac81057540 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f3702ffd640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f36f8039ac0 0x7f36f803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f3702ffd640 1 -- 172.21.15.151:0/2739646568 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3820037c80 con 0x55ac81057540 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382d438640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f36f8039ac0 0x7f36f803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac81069d70 0x55ac8106c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac8106c910 con 0x55ac81069d70 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382cc37640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac81069d70 0x55ac8106c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382d438640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f36f8039ac0 0x7f36f803bf80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f382804ebe0 tx=0x7f3828037000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382cc37640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac81069d70 0x55ac8106c1c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 realm 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac8106cce0 con 0x55ac81069d70 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac8106d5b0 con 0x55ac81069d70 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac8106d950 con 0x55ac81069d70 2024-09-12T16:52:16.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:16.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac8106e400 0x55ac810707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81070f50 con 0x55ac8106e400 2024-09-12T16:52:16.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382dc39640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac8106e400 0x55ac810707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382dc39640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac8106e400 0x55ac810707f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 20 searching for the correct realm 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ac81072ef0 0x55ac810753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.909+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382d438640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ac81072ef0 0x55ac810753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382d438640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ac81072ef0 0x55ac810753b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382d438640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f38280283d0 0x7f3828029470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x7f38280283d0 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382cc37640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f38280283d0 0x7f3828029470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382cc37640 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f38280283d0 0x7f3828029470 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:16.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81069d70 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81069d70 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.913+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x7f38280283d0 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81069d70 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81069d70 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x7f38280283d0 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.917+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81069d70 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81069d70 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x7f38280283d0 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81069d70 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x7f38280283d0 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81072ef0 2024-09-12T16:52:16.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.921+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac8106e400 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x55ac81069d70 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac81075a80 con 0x7f38280283d0 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:16.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81071910 con 0x55ac81069d70 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81071d90 con 0x55ac81069d70 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac810721b0 con 0x55ac81069d70 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 zone default found 2024-09-12T16:52:16.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 4 Realm: () 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 zonegroup default 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac810721b0 con 0x55ac8106e400 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81077da0 con 0x55ac81072ef0 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac81078140 con 0x55ac81072ef0 2024-09-12T16:52:16.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:16.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 started sync module instance, tier type = 2024-09-12T16:52:16.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:16.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.925+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac810771e0 con 0x7f38280283d0 2024-09-12T16:52:16.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.929+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.929+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94199387486000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac810771e0 con 0x7f38280283d0 2024-09-12T16:52:16.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.929+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac81078b40 con 0x55ac81069d70 2024-09-12T16:52:16.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.929+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94199387486000] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.929+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.929+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94199387489872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac810771e0 con 0x55ac81069d70 2024-09-12T16:52:16.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.929+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac81079460 con 0x55ac81072ef0 2024-09-12T16:52:16.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94199387492144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac81079d00 con 0x55ac81072ef0 2024-09-12T16:52:16.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107a6c0 con 0x7f38280283d0 2024-09-12T16:52:16.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94199387489872] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94199387496976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107a630 con 0x7f38280283d0 2024-09-12T16:52:16.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107b450 con 0x55ac81069d70 2024-09-12T16:52:16.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94199387492144] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94199387496976] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94199387494480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107af10 con 0x55ac81069d70 2024-09-12T16:52:16.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.933+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107b7c0 con 0x55ac8106e400 2024-09-12T16:52:16.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.937+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94199387494480] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.937+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.937+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94199387499376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107bbb0 con 0x55ac8106e400 2024-09-12T16:52:16.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.937+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107c570 con 0x55ac8106e400 2024-09-12T16:52:16.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94199387499376] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94199387500496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107c570 con 0x55ac8106e400 2024-09-12T16:52:16.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107cf30 con 0x55ac8106e400 2024-09-12T16:52:16.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94199387500496] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94199387504832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107d110 con 0x55ac8106e400 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 20 add_watcher() i=0 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 20 add_watcher() i=1 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 20 add_watcher() i=2 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 20 add_watcher() i=3 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 20 add_watcher() i=4 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 20 add_watcher() i=5 2024-09-12T16:52:16.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.941+0000 7f382f9329c0 20 add_watcher() i=6 2024-09-12T16:52:16.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94199387504832] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 20 add_watcher() i=7 2024-09-12T16:52:16.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:16.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac810802f0 con 0x55ac81069d70 2024-09-12T16:52:16.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94199387520160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107d0b0 con 0x55ac81069d70 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94199387520160] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f36e3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 5 note: GC not initialized 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f36e2fe5640 20 reqs_thread_entry: start 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 20 Filter name: none 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f36e0fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:16.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac810a3130 con 0x55ac81069d70 2024-09-12T16:52:16.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.945+0000 7f382f9329c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:16.950 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:16.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.949+0000 7f36e3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:16.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.949+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94199387520160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac810a1f80 con 0x55ac81069d70 2024-09-12T16:52:16.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.949+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94199387520160] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.949+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94199387486000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107fca0 con 0x7f38280283d0 2024-09-12T16:52:16.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.949+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94199387486000] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.949+0000 7f382f9329c0 20 remove_watcher() i=0 2024-09-12T16:52:16.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.949+0000 7f382f9329c0 2 removed watcher, disabling cache 2024-09-12T16:52:16.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.949+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94199387489872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac81077730 con 0x55ac81069d70 2024-09-12T16:52:16.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94199387489872] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382f9329c0 20 remove_watcher() i=1 2024-09-12T16:52:16.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94199387492144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac81077730 con 0x55ac81072ef0 2024-09-12T16:52:16.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382d438640 1 -- 172.21.15.151:0/2739646568 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94199387492144] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382804c070 con 0x55ac81072ef0 2024-09-12T16:52:16.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382f9329c0 20 remove_watcher() i=2 2024-09-12T16:52:16.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94199387496976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac81077730 con 0x7f38280283d0 2024-09-12T16:52:16.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94199387496976] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x7f38280283d0 2024-09-12T16:52:16.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382f9329c0 20 remove_watcher() i=3 2024-09-12T16:52:16.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.953+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94199387494480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107a210 con 0x55ac81069d70 2024-09-12T16:52:16.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.957+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94199387494480] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38180b2040 con 0x55ac81069d70 2024-09-12T16:52:16.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.957+0000 7f382f9329c0 20 remove_watcher() i=4 2024-09-12T16:52:16.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.957+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94199387499376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac81077730 con 0x55ac8106e400 2024-09-12T16:52:16.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.957+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94199387499376] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.957+0000 7f382f9329c0 20 remove_watcher() i=5 2024-09-12T16:52:16.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.957+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94199387500496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac81079850 con 0x55ac8106e400 2024-09-12T16:52:16.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.961+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94199387500496] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.961+0000 7f382f9329c0 20 remove_watcher() i=6 2024-09-12T16:52:16.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.961+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94199387504832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac8107b020 con 0x55ac8106e400 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382dc39640 1 -- 172.21.15.151:0/2739646568 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94199387504832] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382003d070 con 0x55ac8106e400 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 20 remove_watcher() i=7 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac8106e400 msgr2=0x55ac810707f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac8106e400 0x55ac810707f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac81069d70 msgr2=0x55ac8106c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac81069d70 0x55ac8106c1c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f38280283d0 msgr2=0x7f3828029470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f38280283d0 0x7f3828029470 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ac81072ef0 msgr2=0x55ac810753b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ac81072ef0 0x55ac810753b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f36f8039ac0 msgr2=0x7f36f803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f36f8039ac0 0x7f36f803bf80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f382804ebe0 tx=0x7f3828037000 comp rx=0 tx=0).stop 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 msgr2=0x55ac8105ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382cc37640 1 -- 172.21.15.151:0/2739646568 reap_dead start 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac8105ea70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3820005710 tx=0x7f38200508d0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 shutdown_connections 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2739646568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac81057540 0x55ac8105ea70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 >> 172.21.15.151:0/2739646568 conn(0x55ac81053970 msgr2=0x55ac81051b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 shutdown_connections 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2739646568 wait complete. 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2815865829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3704039ac0 msgr2=0x7f370403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2815865829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3704039ac0 0x7f370403bf80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55ac81037d20 tx=0x7f382801e680 comp rx=0 tx=0).stop 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2815865829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac8104ace0 msgr2=0x55ac8104b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2815865829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac8104ace0 0x55ac8104b100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55ac810323c0 tx=0x7f382000af40 comp rx=0 tx=0).stop 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2815865829 shutdown_connections 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2815865829 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3704039ac0 0x7f370403bf80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/2815865829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac8104ace0 0x55ac8104b100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2815865829 >> 172.21.15.151:0/2815865829 conn(0x55ac81040690 msgr2=0x55ac81040a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2815865829 shutdown_connections 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/2815865829 wait complete. 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac81039bb0 msgr2=0x55ac8103bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac81039bb0 0x55ac8103bfa0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac80eb17b0 msgr2=0x55ac810373d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac80eb17b0 0x55ac810373d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3714039ac0 msgr2=0x7f371403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3714039ac0 0x7f371403bf80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38180ac000 tx=0x7f38180a5000 comp rx=0 tx=0).stop 2024-09-12T16:52:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 msgr2=0x55ac81030260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81030260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38280012f0 tx=0x7f3828000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 shutdown_connections 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ac81039bb0 0x55ac8103bfa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ac80eb17b0 0x55ac810373d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3714039ac0 0x7f371403bf80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 --2- 172.21.15.151:0/928336313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ac80eb1280 0x55ac81030260 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 >> 172.21.15.151:0/928336313 conn(0x55ac80f36aa0 msgr2=0x55ac81023290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 shutdown_connections 2024-09-12T16:52:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:16.965+0000 7f382f9329c0 1 -- 172.21.15.151:0/928336313 wait complete. 2024-09-12T16:52:16.977 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:16.977 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-12T16:52:16.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-12T16:52:16.977 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-12T16:52:17.053 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:17.053 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:17.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3d7409c0 1 Processor -- start 2024-09-12T16:52:17.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3d7409c0 1 -- start start 2024-09-12T16:52:17.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3d7409c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55f2eb521200 0x55f2eb5b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3d7409c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f2eb4619c0 con 0x55f2eb5215e0 2024-09-12T16:52:17.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3d7409c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55f2eb4b16d0 con 0x55f2eb521200 2024-09-12T16:52:17.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3b246640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55f2eb521200 0x55f2eb5b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3aa45640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55f2eb5215e0 0x55f2eb5b4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38062/0 (socket says 172.21.15.151:38062) 2024-09-12T16:52:17.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3aa45640 1 -- 172.21.15.151:0/3048563600 learned_addr learned my addr 172.21.15.151:0/3048563600 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:17.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3b246640 1 -- 172.21.15.151:0/3048563600 >> v1:172.21.15.122:6789/0 conn(0x55f2eb5215e0 legacy=0x55f2eb5b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3b246640 1 -- 172.21.15.151:0/3048563600 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2eb455ca0 con 0x55f2eb521200 2024-09-12T16:52:17.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3b246640 1 --2- 172.21.15.151:0/3048563600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb5b2030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00a480 tx=0x7f8f2c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdbc1582979a332 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.053+0000 7f8f3a244640 1 -- 172.21.15.151:0/3048563600 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c0b0070 con 0x55f2eb521200 2024-09-12T16:52:17.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3a244640 1 -- 172.21.15.151:0/3048563600 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c0ab540 con 0x55f2eb521200 2024-09-12T16:52:17.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3a244640 1 -- 172.21.15.151:0/3048563600 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c0ab840 con 0x55f2eb521200 2024-09-12T16:52:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/3048563600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 msgr2=0x55f2eb5b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/3048563600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb5b2030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00a480 tx=0x7f8f2c01b280 comp rx=0 tx=0).stop 2024-09-12T16:52:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/3048563600 shutdown_connections 2024-09-12T16:52:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/3048563600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb5b2030 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/3048563600 >> 172.21.15.151:0/3048563600 conn(0x55f2eb5a7920 msgr2=0x55f2eb5a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/3048563600 shutdown_connections 2024-09-12T16:52:17.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.057+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/3048563600 wait complete. 2024-09-12T16:52:17.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.069+0000 7f8f3d7409c0 1 Processor -- start 2024-09-12T16:52:17.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.069+0000 7f8f3d7409c0 1 -- start start 2024-09-12T16:52:17.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.069+0000 7f8f3d7409c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb69a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.069+0000 7f8f3d7409c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f2eb4b5680 con 0x55f2eb521200 2024-09-12T16:52:17.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.069+0000 7f8f3b246640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb69a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.069+0000 7f8f3b246640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb69a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33848/0 (socket says 172.21.15.151:33848) 2024-09-12T16:52:17.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.069+0000 7f8f3b246640 1 -- 172.21.15.151:0/1404448245 learned_addr learned my addr 172.21.15.151:0/1404448245 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.069+0000 7f8f3b246640 1 -- 172.21.15.151:0/1404448245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2eb430da0 con 0x55f2eb521200 2024-09-12T16:52:17.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3b246640 1 --2- 172.21.15.151:0/1404448245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb69a910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0ae040 tx=0x7f8f2c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798dbf422bda15a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8e2960a640 1 -- 172.21.15.151:0/1404448245 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c0b0040 con 0x55f2eb521200 2024-09-12T16:52:17.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8e2960a640 1 -- 172.21.15.151:0/1404448245 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00a300 con 0x55f2eb521200 2024-09-12T16:52:17.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8e2960a640 1 -- 172.21.15.151:0/1404448245 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c0ab820 con 0x55f2eb521200 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1404448245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 msgr2=0x55f2eb69a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/1404448245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb69a910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0ae040 tx=0x7f8f2c003030 comp rx=0 tx=0).stop 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1404448245 shutdown_connections 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/1404448245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb69a910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1404448245 >> 172.21.15.151:0/1404448245 conn(0x55f2eb5a7920 msgr2=0x55f2eb696550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1404448245 shutdown_connections 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1404448245 wait complete. 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 Processor -- start 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- start start 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb6a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f2eb457a50 con 0x55f2eb521200 2024-09-12T16:52:17.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3b246640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb6a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3b246640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb6a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33852/0 (socket says 172.21.15.151:33852) 2024-09-12T16:52:17.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3b246640 1 -- 172.21.15.151:0/2439202188 learned_addr learned my addr 172.21.15.151:0/2439202188 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3b246640 1 -- 172.21.15.151:0/2439202188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2eb6a23d0 con 0x55f2eb521200 2024-09-12T16:52:17.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3b246640 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb6a1e70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0ab510 tx=0x7f8f2c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8e27e07640 1 -- 172.21.15.151:0/2439202188 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c0b0040 con 0x55f2eb521200 2024-09-12T16:52:17.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2eb6a2660 con 0x55f2eb521200 2024-09-12T16:52:17.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8e27e07640 1 -- 172.21.15.151:0/2439202188 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c0c0680 con 0x55f2eb521200 2024-09-12T16:52:17.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8e27e07640 1 -- 172.21.15.151:0/2439202188 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c0c0960 con 0x55f2eb521200 2024-09-12T16:52:17.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.073+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2eb6a3010 con 0x55f2eb521200 2024-09-12T16:52:17.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8e27e07640 1 -- 172.21.15.151:0/2439202188 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f2c0c0b00 con 0x55f2eb521200 2024-09-12T16:52:17.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8e27e07640 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e20039a70 0x7f8e2003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8e27e07640 1 -- 172.21.15.151:0/2439202188 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f2c0bb070 con 0x55f2eb521200 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3aa45640 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e20039a70 0x7f8e2003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb5215e0 0x55f2eb6a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6a9520 con 0x55f2eb5215e0 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3ba47640 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb5215e0 0x55f2eb6a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3aa45640 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e20039a70 0x7f8e2003bf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f30001d80 tx=0x7f8f300012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3ba47640 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb5215e0 0x55f2eb6a8fe0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2439202188 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f3400a4d0 con 0x55f2eb5215e0 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6a3390 con 0x55f2eb5215e0 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2439202188 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f3400a4d0 con 0x55f2eb5215e0 2024-09-12T16:52:17.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6ab7e0 0x55f2eb6adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ae2a0 con 0x55f2eb6ab7e0 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3b246640 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6ab7e0 0x55f2eb6adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.077+0000 7f8f3b246640 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6ab7e0 0x55f2eb6adbd0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3b246640 1 -- 172.21.15.151:0/2439202188 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6ab7e0 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6aa680 con 0x55f2eb5215e0 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2439202188 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f3400a4d0 con 0x55f2eb5215e0 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6aab20 con 0x55f2eb5215e0 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2439202188 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f3400a4d0 con 0x55f2eb5215e0 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3d7409c0 1 Processor -- start 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3d7409c0 1 -- start start 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3d7409c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6bc910 0x55f2eb6bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3d7409c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f2eb4c2450 con 0x55f2eb6bc910 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3ba47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6bc910 0x55f2eb6bcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3ba47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6bc910 0x55f2eb6bcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33858/0 (socket says 172.21.15.151:33858) 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3ba47640 1 -- 172.21.15.151:0/1398783589 learned_addr learned my addr 172.21.15.151:0/1398783589 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3ba47640 1 -- 172.21.15.151:0/1398783589 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2eb6bd370 con 0x55f2eb6bc910 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3ba47640 1 --2- 172.21.15.151:0/1398783589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6bc910 0x55f2eb6bcd30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55f2eb6a3f70 tx=0x7f8f34018460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8e25602640 1 -- 172.21.15.151:0/1398783589 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f34018b90 con 0x55f2eb6bc910 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8e25602640 1 -- 172.21.15.151:0/1398783589 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f34018d30 con 0x55f2eb6bc910 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1398783589 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2eb6bdbd0 con 0x55f2eb6bc910 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8e25602640 1 -- 172.21.15.151:0/1398783589 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f340145c0 con 0x55f2eb6bc910 2024-09-12T16:52:17.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.081+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1398783589 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2eb6be140 con 0x55f2eb6bc910 2024-09-12T16:52:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8e25602640 1 -- 172.21.15.151:0/1398783589 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f34011040 con 0x55f2eb6bc910 2024-09-12T16:52:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8e25602640 1 --2- 172.21.15.151:0/1398783589 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e14039a70 0x7f8e1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8e25602640 1 -- 172.21.15.151:0/1398783589 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f3401e070 con 0x55f2eb6bc910 2024-09-12T16:52:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3b246640 1 --2- 172.21.15.151:0/1398783589 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e14039a70 0x7f8e1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 Processor -- start 2024-09-12T16:52:17.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3b246640 1 --2- 172.21.15.151:0/1398783589 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e14039a70 0x7f8e1403bf30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55f2eb6a9930 tx=0x7f8f2c0d3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- start start 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f2eb69b0a0 con 0x55f2eb6ca240 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3ba47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3ba47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33868/0 (socket says 172.21.15.151:33868) 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3ba47640 1 -- 172.21.15.151:0/4158085176 learned_addr learned my addr 172.21.15.151:0/4158085176 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3ba47640 1 -- 172.21.15.151:0/4158085176 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2eb6cac30 con 0x55f2eb6ca240 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3ba47640 1 --2- 172.21.15.151:0/4158085176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6ca640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f34013010 tx=0x7f8f34011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5d7a157e821eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8e1effd640 1 -- 172.21.15.151:0/4158085176 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f34016440 con 0x55f2eb6ca240 2024-09-12T16:52:17.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8e1effd640 1 -- 172.21.15.151:0/4158085176 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f34014760 con 0x55f2eb6ca240 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8e1effd640 1 -- 172.21.15.151:0/4158085176 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f340165e0 con 0x55f2eb6ca240 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/4158085176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 msgr2=0x55f2eb6ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/4158085176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6ca640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f34013010 tx=0x7f8f34011700 comp rx=0 tx=0).stop 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/4158085176 shutdown_connections 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/4158085176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6ca640 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/4158085176 >> 172.21.15.151:0/4158085176 conn(0x55f2eb6c5660 msgr2=0x55f2eb6c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/4158085176 shutdown_connections 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/4158085176 wait complete. 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 Processor -- start 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- start start 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.085+0000 7f8f3d7409c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f2eb6c9190 con 0x55f2eb6ca240 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3ba47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3ba47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33872/0 (socket says 172.21.15.151:33872) 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 learned_addr learned my addr 172.21.15.151:0/2273342469 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2eb6d0c50 con 0x55f2eb6ca240 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3ba47640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6d06f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f3402bfd0 tx=0x7f8f340501c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8e1d7fa640 1 -- 172.21.15.151:0/2273342469 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3402b560 con 0x55f2eb6ca240 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2eb6d0ee0 con 0x55f2eb6ca240 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8e1d7fa640 1 -- 172.21.15.151:0/2273342469 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3404a040 con 0x55f2eb6ca240 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8e1d7fa640 1 -- 172.21.15.151:0/2273342469 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f3402b830 con 0x55f2eb6ca240 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2eb6d1890 con 0x55f2eb6ca240 2024-09-12T16:52:17.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8e1d7fa640 1 -- 172.21.15.151:0/2273342469 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8f34022910 con 0x55f2eb6ca240 2024-09-12T16:52:17.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8e1d7fa640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e04039a70 0x7f8e0403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8e1d7fa640 1 -- 172.21.15.151:0/2273342469 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8f3400e040 con 0x55f2eb6ca240 2024-09-12T16:52:17.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3b246640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e04039a70 0x7f8e0403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb6dbc30 0x55f2eb6de0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6de810 con 0x55f2eb6dbc30 2024-09-12T16:52:17.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3aa45640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb6dbc30 0x55f2eb6de0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3b246640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e04039a70 0x7f8e0403bf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0bfeb0 tx=0x7f8f2c0da000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3aa45640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb6dbc30 0x55f2eb6de0c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f3000e5a0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 20 realm 2024-09-12T16:52:17.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6dafe0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f3000e5a0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.089+0000 7f8f3d7409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6df310 con 0x55f2eb6dbc30 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f3000e5a0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6dfbe0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f3000e5a0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6e0600 0x55f2eb6e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e30e0 con 0x55f2eb6e0600 2024-09-12T16:52:17.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3ba47640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6e0600 0x55f2eb6e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3ba47640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6e0600 0x55f2eb6e29f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 20 searching for the correct realm 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f2eb6e5030 0x55f2eb6e7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3b246640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f2eb6e5030 0x55f2eb6e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3b246640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f2eb6e5030 0x55f2eb6e7460 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3b246640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f2c0ab030 0x7f8f2c0e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x7f8f2c0ab030 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3aa45640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f2c0ab030 0x7f8f2c0e23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3aa45640 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f2c0ab030 0x7f8f2c0e23c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3000e5a0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.093+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6dbc30 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3000e5a0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6dbc30 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x7f8f2c0ab030 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x7f8f2c0ab030 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6dbc30 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6dbc30 2024-09-12T16:52:17.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.097+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x7f8f2c0ab030 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f30029040 con 0x7f8f2c0ab030 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6dbc30 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6dbc30 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x7f8f2c0ab030 2024-09-12T16:52:17.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x7f8f2c0ab030 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.101+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6dbc30 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x7f8f2c0ab030 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x7f8f2c0ab030 2024-09-12T16:52:17.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e5030 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6e0600 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x55f2eb6dbc30 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e7b30 con 0x7f8f2c0ab030 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f30029040 con 0x7f8f2c0ab030 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:17.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e3aa0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e36e0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f30029040 con 0x55f2eb6dbc30 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.105+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e43c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 zone default found 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 4 Realm: () 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 zonegroup default 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e43c0 con 0x55f2eb6e0600 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e9ea0 con 0x55f2eb6e5030 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ea240 con 0x55f2eb6e5030 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 started sync module instance, tier type = 2024-09-12T16:52:17.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:17.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e9330 con 0x7f8f2c0ab030 2024-09-12T16:52:17.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94501820340304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e9330 con 0x7f8f2c0ab030 2024-09-12T16:52:17.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6eacd0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.109+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94501820340304] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.113+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.113+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94501820344256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e9330 con 0x55f2eb6dbc30 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.113+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6eb710 con 0x55f2eb6e5030 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.113+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94501820344256] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.113+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.113+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94501820337792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e92a0 con 0x55f2eb6e5030 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.113+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ec4a0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.117+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.117+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94501820350384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ecd40 con 0x7f8f2c0ab030 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.117+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ed740 con 0x55f2eb6dbc30 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.117+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94501820337792] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.117+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.117+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94501820349184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ed700 con 0x55f2eb6dbc30 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.117+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ee150 con 0x55f2eb6e0600 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94501820350384] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94501820357792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ee4f0 con 0x55f2eb6e0600 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6eed40 con 0x55f2eb6e0600 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94501820349184] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94501820357792] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94501820355152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6eea20 con 0x55f2eb6e0600 2024-09-12T16:52:17.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.121+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ef270 con 0x55f2eb6e0600 2024-09-12T16:52:17.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94501820355152] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94501820360528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ef100 con 0x55f2eb6e0600 2024-09-12T16:52:17.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 20 add_watcher() i=0 2024-09-12T16:52:17.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 20 add_watcher() i=1 2024-09-12T16:52:17.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 20 add_watcher() i=2 2024-09-12T16:52:17.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 20 add_watcher() i=3 2024-09-12T16:52:17.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 20 add_watcher() i=4 2024-09-12T16:52:17.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 20 add_watcher() i=5 2024-09-12T16:52:17.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 20 add_watcher() i=6 2024-09-12T16:52:17.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94501820360528] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 20 add_watcher() i=7 2024-09-12T16:52:17.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:17.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6f2670 con 0x55f2eb6dbc30 2024-09-12T16:52:17.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.125+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94501820361648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6efb90 con 0x55f2eb6dbc30 2024-09-12T16:52:17.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94501820361648] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:17.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 5 note: GC not initialized 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8df0fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 20 Filter name: none 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8d6a7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb7158c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:17.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:17.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:17.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb718350 con 0x7f8f2c0ab030 2024-09-12T16:52:17.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb71b9a0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:17.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94501820544032 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb717340 con 0x55f2eb6dbc30 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94501820349184 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55f2eb4619c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8e1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94501820349184 notifier 4327 bl.length()=567 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(65 notify.4 [notify cookie 94501820544032 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8e1effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8e1effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8e1effd640 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e00003eb0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.129+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94501820544032 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8f3002fc80 con 0x55f2eb6dbc30 2024-09-12T16:52:17.137 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:17.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94501820361648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb7136d0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94501820361648] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94501820340304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb7136d0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94501820340304] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8f3d7409c0 20 remove_watcher() i=0 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8f3d7409c0 2 removed watcher, disabling cache 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.133+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94501820344256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb7136d0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.137+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94501820344256] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.137+0000 7f8f3d7409c0 20 remove_watcher() i=1 2024-09-12T16:52:17.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.137+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94501820337792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb7136d0 con 0x55f2eb6e5030 2024-09-12T16:52:17.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.137+0000 7f8f3b246640 1 -- 172.21.15.151:0/2273342469 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94501820337792] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f2c0b3040 con 0x55f2eb6e5030 2024-09-12T16:52:17.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.137+0000 7f8f3d7409c0 20 remove_watcher() i=2 2024-09-12T16:52:17.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.137+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94501820350384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e8e80 con 0x7f8f2c0ab030 2024-09-12T16:52:17.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.137+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94501820350384] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x7f8f2c0ab030 2024-09-12T16:52:17.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.137+0000 7f8f3d7409c0 20 remove_watcher() i=3 2024-09-12T16:52:17.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.141+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94501820349184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e8e80 con 0x55f2eb6dbc30 2024-09-12T16:52:17.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.141+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94501820349184] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f300391c0 con 0x55f2eb6dbc30 2024-09-12T16:52:17.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.141+0000 7f8f3d7409c0 20 remove_watcher() i=4 2024-09-12T16:52:17.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.141+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94501820357792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6e8e80 con 0x55f2eb6e0600 2024-09-12T16:52:17.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.141+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94501820357792] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.141+0000 7f8f3d7409c0 20 remove_watcher() i=5 2024-09-12T16:52:17.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.141+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94501820355152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6edca0 con 0x55f2eb6e0600 2024-09-12T16:52:17.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94501820355152] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 20 remove_watcher() i=6 2024-09-12T16:52:17.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94501820360528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2eb6ed250 con 0x55f2eb6e0600 2024-09-12T16:52:17.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3ba47640 1 -- 172.21.15.151:0/2273342469 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94501820360528] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f3403b020 con 0x55f2eb6e0600 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 20 remove_watcher() i=7 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6e0600 msgr2=0x55f2eb6e29f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6e0600 0x55f2eb6e29f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb6dbc30 msgr2=0x55f2eb6de0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb6dbc30 0x55f2eb6de0c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f2c0ab030 msgr2=0x7f8f2c0e23c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8f2c0ab030 0x7f8f2c0e23c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f2eb6e5030 msgr2=0x55f2eb6e7460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f2eb6e5030 0x55f2eb6e7460 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e04039a70 msgr2=0x7f8e0403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e04039a70 0x7f8e0403bf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0bfeb0 tx=0x7f8f2c0da000 comp rx=0 tx=0).stop 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 msgr2=0x55f2eb6d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3aa45640 1 -- 172.21.15.151:0/2273342469 reap_dead start 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.145+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6d06f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8f3402bfd0 tx=0x7f8f340501c0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 shutdown_connections 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2273342469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6ca240 0x55f2eb6d06f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 >> 172.21.15.151:0/2273342469 conn(0x55f2eb6c5660 msgr2=0x55f2eb6c3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 shutdown_connections 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2273342469 wait complete. 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1398783589 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e14039a70 msgr2=0x7f8e1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/1398783589 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e14039a70 0x7f8e1403bf30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55f2eb6a9930 tx=0x7f8f2c0d3040 comp rx=0 tx=0).stop 2024-09-12T16:52:17.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1398783589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6bc910 msgr2=0x55f2eb6bcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/1398783589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6bc910 0x55f2eb6bcd30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55f2eb6a3f70 tx=0x7f8f34018460 comp rx=0 tx=0).stop 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1398783589 shutdown_connections 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/1398783589 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e14039a70 0x7f8e1403bf30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/1398783589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb6bc910 0x55f2eb6bcd30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1398783589 >> 172.21.15.151:0/1398783589 conn(0x55f2eb6b22c0 msgr2=0x55f2eb6b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1398783589 shutdown_connections 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/1398783589 wait complete. 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6ab7e0 msgr2=0x55f2eb6adbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6ab7e0 0x55f2eb6adbd0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb5215e0 msgr2=0x55f2eb6a8fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb5215e0 0x55f2eb6a8fe0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e20039a70 msgr2=0x7f8e2003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e20039a70 0x7f8e2003bf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f30001d80 tx=0x7f8f300012e0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 msgr2=0x55f2eb6a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb6a1e70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0ab510 tx=0x7f8f2c018020 comp rx=0 tx=0).stop 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 shutdown_connections 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f2eb6ab7e0 0x55f2eb6adbd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f2eb5215e0 0x55f2eb6a8fe0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8e20039a70 0x7f8e2003bf30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 --2- 172.21.15.151:0/2439202188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f2eb521200 0x55f2eb6a1e70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 >> 172.21.15.151:0/2439202188 conn(0x55f2eb5a7920 msgr2=0x55f2eb694fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 shutdown_connections 2024-09-12T16:52:17.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.149+0000 7f8f3d7409c0 1 -- 172.21.15.151:0/2439202188 wait complete. 2024-09-12T16:52:17.160 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:17.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:52:17.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:52:17.161 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:52:17.231 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:17.231 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:17.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd7e7f9c0 1 Processor -- start 2024-09-12T16:52:17.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd7e7f9c0 1 -- start start 2024-09-12T16:52:17.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd7e7f9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x565175071ff0 0x5651750743e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd7e7f9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565174f239c0 con 0x56517506de00 2024-09-12T16:52:17.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd7e7f9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x565174f736d0 con 0x565175071ff0 2024-09-12T16:52:17.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd5184640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x565175071ff0 0x5651750743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd5184640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x565175071ff0 0x5651750743e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33876/0 (socket says 172.21.15.151:33876) 2024-09-12T16:52:17.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd5184640 1 -- 172.21.15.151:0/3638151353 learned_addr learned my addr 172.21.15.151:0/3638151353 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd5184640 1 -- 172.21.15.151:0/3638151353 >> v1:172.21.15.122:6789/0 conn(0x56517506de00 legacy=0x56517506e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.229+0000 7f2fd5184640 1 -- 172.21.15.151:0/3638151353 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565174f17ca0 con 0x565175071ff0 2024-09-12T16:52:17.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd5184640 1 --2- 172.21.15.151:0/3638151353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565175071ff0 0x5651750743e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00a750 tx=0x7f2fcc01d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bfad8ec73916df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd4983640 1 -- 172.21.15.151:0/3638151353 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fcc00a200 con 0x565175071ff0 2024-09-12T16:52:17.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd4983640 1 -- 172.21.15.151:0/3638151353 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fcc00a3a0 con 0x565175071ff0 2024-09-12T16:52:17.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd4983640 1 -- 172.21.15.151:0/3638151353 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fcc0086f0 con 0x565175071ff0 2024-09-12T16:52:17.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3638151353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565175071ff0 msgr2=0x5651750743e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3638151353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565175071ff0 0x5651750743e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00a750 tx=0x7f2fcc01d290 comp rx=0 tx=0).stop 2024-09-12T16:52:17.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3638151353 shutdown_connections 2024-09-12T16:52:17.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3638151353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565175071ff0 0x5651750743e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3638151353 >> 172.21.15.151:0/3638151353 conn(0x565175069920 msgr2=0x56517506bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3638151353 shutdown_connections 2024-09-12T16:52:17.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.233+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3638151353 wait complete. 2024-09-12T16:52:17.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.245+0000 7f2fd7e7f9c0 1 Processor -- start 2024-09-12T16:52:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.245+0000 7f2fd7e7f9c0 1 -- start start 2024-09-12T16:52:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.245+0000 7f2fd7e7f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175158490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565174f77680 con 0x56517506de00 2024-09-12T16:52:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33878/0 (socket says 172.21.15.151:33878) 2024-09-12T16:52:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 -- 172.21.15.151:0/3793852900 learned_addr learned my addr 172.21.15.151:0/3793852900 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 -- 172.21.15.151:0/3793852900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565174ef2da0 con 0x56517506de00 2024-09-12T16:52:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 --2- 172.21.15.151:0/3793852900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175158490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800b220 tx=0x7f2fc800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cf6b967004d0c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2ec3e07640 1 -- 172.21.15.151:0/3793852900 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc800a040 con 0x56517506de00 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2ec3e07640 1 -- 172.21.15.151:0/3793852900 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc800f750 con 0x56517506de00 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2ec3e07640 1 -- 172.21.15.151:0/3793852900 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc800fa70 con 0x56517506de00 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3793852900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 msgr2=0x565175158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3793852900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175158490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800b220 tx=0x7f2fc800b6e0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3793852900 shutdown_connections 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3793852900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175158490 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3793852900 >> 172.21.15.151:0/3793852900 conn(0x565175069920 msgr2=0x5651751540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3793852900 shutdown_connections 2024-09-12T16:52:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3793852900 wait complete. 2024-09-12T16:52:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 Processor -- start 2024-09-12T16:52:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 -- start start 2024-09-12T16:52:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd7e7f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565174f19a50 con 0x56517506de00 2024-09-12T16:52:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175163f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33894/0 (socket says 172.21.15.151:33894) 2024-09-12T16:52:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 -- 172.21.15.151:0/1188423114 learned_addr learned my addr 172.21.15.151:0/1188423114 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.249+0000 7f2fd5985640 1 -- 172.21.15.151:0/1188423114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565175164480 con 0x56517506de00 2024-09-12T16:52:17.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd5985640 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175163f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x565175159420 tx=0x7f2fc8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2ec2604640 1 -- 172.21.15.151:0/1188423114 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc801a880 con 0x56517506de00 2024-09-12T16:52:17.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2ec2604640 1 -- 172.21.15.151:0/1188423114 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc801aa20 con 0x56517506de00 2024-09-12T16:52:17.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565175164710 con 0x56517506de00 2024-09-12T16:52:17.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2ec2604640 1 -- 172.21.15.151:0/1188423114 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fc801ad00 con 0x56517506de00 2024-09-12T16:52:17.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651751650c0 con 0x56517506de00 2024-09-12T16:52:17.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2ec2604640 1 -- 172.21.15.151:0/1188423114 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2fc8017050 con 0x56517506de00 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2ec2604640 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ebc039a70 0x7f2ebc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2ec2604640 1 -- 172.21.15.151:0/1188423114 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2fc8015020 con 0x56517506de00 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd5184640 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ebc039a70 0x7f2ebc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x565175071ff0 0x56517516b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56517516b5d0 con 0x565175071ff0 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd6186640 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x565175071ff0 0x56517516b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd5184640 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ebc039a70 0x7f2ebc03bf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0ad000 tx=0x7f2fcc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd6186640 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x565175071ff0 0x56517516b090 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd6186640 1 -- 172.21.15.151:0/1188423114 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fd000a4d0 con 0x565175071ff0 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56517516b9f0 con 0x565175071ff0 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd6186640 1 -- 172.21.15.151:0/1188423114 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fd000a4d0 con 0x565175071ff0 2024-09-12T16:52:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56517516d800 0x56517516fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751702c0 con 0x56517516d800 2024-09-12T16:52:17.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.253+0000 7f2fd5985640 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56517516d800 0x56517516fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd5985640 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56517516d800 0x56517516fbf0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd5985640 1 -- 172.21.15.151:0/1188423114 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2fc802e070 con 0x56517516d800 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56517516c6a0 con 0x565175071ff0 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd6186640 1 -- 172.21.15.151:0/1188423114 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fd000a4d0 con 0x565175071ff0 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56517516cb40 con 0x565175071ff0 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd6186640 1 -- 172.21.15.151:0/1188423114 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2fd000a4d0 con 0x565175071ff0 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd7e7f9c0 1 Processor -- start 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd7e7f9c0 1 -- start start 2024-09-12T16:52:17.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd7e7f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517517e930 0x56517517ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd7e7f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565174f84450 con 0x56517517e930 2024-09-12T16:52:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd6186640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517517e930 0x56517517ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd6186640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517517e930 0x56517517ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33906/0 (socket says 172.21.15.151:33906) 2024-09-12T16:52:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd6186640 1 -- 172.21.15.151:0/1339846995 learned_addr learned my addr 172.21.15.151:0/1339846995 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd6186640 1 -- 172.21.15.151:0/1339846995 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56517517f390 con 0x56517517e930 2024-09-12T16:52:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd6186640 1 --2- 172.21.15.151:0/1339846995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517517e930 0x56517517ed50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x565175166010 tx=0x7f2fd0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2ebb7fe640 1 -- 172.21.15.151:0/1339846995 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fd0014450 con 0x56517517e930 2024-09-12T16:52:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2ebb7fe640 1 -- 172.21.15.151:0/1339846995 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd00145f0 con 0x56517517e930 2024-09-12T16:52:17.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1339846995 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56517517fbf0 con 0x56517517e930 2024-09-12T16:52:17.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.257+0000 7f2ebb7fe640 1 -- 172.21.15.151:0/1339846995 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fd0014910 con 0x56517517e930 2024-09-12T16:52:17.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1339846995 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565175180160 con 0x56517517e930 2024-09-12T16:52:17.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2ebb7fe640 1 -- 172.21.15.151:0/1339846995 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2fd0011040 con 0x56517517e930 2024-09-12T16:52:17.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2ebb7fe640 1 --2- 172.21.15.151:0/1339846995 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2eb0039a70 0x7f2eb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2ebb7fe640 1 -- 172.21.15.151:0/1339846995 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2fd001e070 con 0x56517517e930 2024-09-12T16:52:17.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd5985640 1 --2- 172.21.15.151:0/1339846995 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2eb0039a70 0x7f2eb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 Processor -- start 2024-09-12T16:52:17.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 -- start start 2024-09-12T16:52:17.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd5985640 1 --2- 172.21.15.151:0/1339846995 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2eb0039a70 0x7f2eb003bf30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5651751653e0 tx=0x7f2fc804ebe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x56517518c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565175158ce0 con 0x56517518c260 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd6186640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x56517518c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd6186640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x56517518c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33922/0 (socket says 172.21.15.151:33922) 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd6186640 1 -- 172.21.15.151:0/1654738300 learned_addr learned my addr 172.21.15.151:0/1654738300 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd6186640 1 -- 172.21.15.151:0/1654738300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56517518cc50 con 0x56517518c260 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd6186640 1 --2- 172.21.15.151:0/1654738300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x56517518c660 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0016fd0 tx=0x7f2fd0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a983a80fdf117fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2eb97fa640 1 -- 172.21.15.151:0/1654738300 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fd0028070 con 0x56517518c260 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2eb97fa640 1 -- 172.21.15.151:0/1654738300 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd0022dc0 con 0x56517518c260 2024-09-12T16:52:17.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2eb97fa640 1 -- 172.21.15.151:0/1654738300 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fd00167c0 con 0x56517518c260 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1654738300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 msgr2=0x56517518c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1654738300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x56517518c660 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0016fd0 tx=0x7f2fd0011a80 comp rx=0 tx=0).stop 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1654738300 shutdown_connections 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1654738300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x56517518c660 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1654738300 >> 172.21.15.151:0/1654738300 conn(0x565175187680 msgr2=0x5651751858c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1654738300 shutdown_connections 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.261+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1654738300 wait complete. 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 1 Processor -- start 2024-09-12T16:52:17.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 1 -- start start 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x565175192750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56517518b1b0 con 0x56517518c260 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd6186640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x565175192750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd6186640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x565175192750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33938/0 (socket says 172.21.15.151:33938) 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 learned_addr learned my addr 172.21.15.151:0/3787964305 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565175192cb0 con 0x56517518c260 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd6186640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x565175192750 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0011ac0 tx=0x7f2fd00506c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2ea77fe640 1 -- 172.21.15.151:0/3787964305 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fd0032030 con 0x56517518c260 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2ea77fe640 1 -- 172.21.15.151:0/3787964305 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd0016440 con 0x56517518c260 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2ea77fe640 1 -- 172.21.15.151:0/3787964305 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fd004f3b0 con 0x56517518c260 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565175192f40 con 0x56517518c260 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651751938f0 con 0x56517518c260 2024-09-12T16:52:17.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2ea77fe640 1 -- 172.21.15.151:0/3787964305 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2fd0035070 con 0x56517518c260 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2ea77fe640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ea0039ac0 0x7f2ea003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2ea77fe640 1 -- 172.21.15.151:0/3787964305 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2fd0033070 con 0x56517518c260 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd5985640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ea0039ac0 0x7f2ea003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56517519da10 0x56517519fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a05f0 con 0x56517519da10 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd5184640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56517519da10 0x56517519fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd5985640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ea0039ac0 0x7f2ea003bf80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800e9a0 tx=0x7f2fc8035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.265+0000 7f2fd5184640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56517519da10 0x56517519fea0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 realm 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a09c0 con 0x56517519da10 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a1290 con 0x56517519da10 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a1630 con 0x56517519da10 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5651751a20e0 0x5651751a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a4c30 con 0x5651751a20e0 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd6186640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5651751a20e0 0x5651751a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd6186640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5651751a20e0 0x5651751a44d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 20 searching for the correct realm 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5651751a6bd0 0x5651751a9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5985640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5651751a6bd0 0x5651751a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5985640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5651751a6bd0 0x5651751a9090 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5985640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2fc80500d0 0x7f2fc8019780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x7f2fc80500d0 2024-09-12T16:52:17.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5184640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2fc80500d0 0x7f2fc8019780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5184640 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2fc80500d0 0x7f2fc8019780 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.269+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x56517519da10 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x56517519da10 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x7f2fc80500d0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x56517519da10 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.273+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x56517519da10 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x7f2fc80500d0 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x56517519da10 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x56517519da10 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x7f2fc80500d0 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.277+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x56517519da10 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x7f2fc80500d0 2024-09-12T16:52:17.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a6bd0 2024-09-12T16:52:17.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x5651751a20e0 2024-09-12T16:52:17.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x56517519da10 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9760 con 0x7f2fc80500d0 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a55f0 con 0x56517519da10 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.281+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a5a70 con 0x56517519da10 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a5f10 con 0x56517519da10 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 zone default found 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 4 Realm: () 2024-09-12T16:52:17.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:17.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:17.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:17.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 zonegroup default 2024-09-12T16:52:17.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751a9be0 con 0x5651751a20e0 2024-09-12T16:52:17.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751abe20 con 0x5651751a6bd0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751ac1c0 con 0x5651751a6bd0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 started sync module instance, tier type = 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ab260 con 0x7f2fc80500d0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94907857024944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ab260 con 0x7f2fc80500d0 2024-09-12T16:52:17.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.285+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751acb80 con 0x56517519da10 2024-09-12T16:52:17.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.289+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.289+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94907857028816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751acaf0 con 0x56517519da10 2024-09-12T16:52:17.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.289+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ada80 con 0x5651751a6bd0 2024-09-12T16:52:17.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.289+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94907857024944] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.289+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.289+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94907857028816] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.289+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94907857031024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ad590 con 0x5651751a6bd0 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.289+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ae320 con 0x7f2fc80500d0 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94907857035136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ae970 con 0x7f2fc80500d0 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751af490 con 0x56517519da10 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94907857031024] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94907857035136] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94907857039200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751af450 con 0x56517519da10 2024-09-12T16:52:17.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751af880 con 0x5651751a20e0 2024-09-12T16:52:17.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.293+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94907857039200] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.297+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.297+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94907857022384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751afc20 con 0x5651751a20e0 2024-09-12T16:52:17.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.297+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751b05e0 con 0x5651751a20e0 2024-09-12T16:52:17.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.297+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94907857022384] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.297+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.297+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94907857036256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751b05e0 con 0x5651751a20e0 2024-09-12T16:52:17.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.297+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751b0fa0 con 0x5651751a20e0 2024-09-12T16:52:17.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94907857036256] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94907857046768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751b05e0 con 0x5651751a20e0 2024-09-12T16:52:17.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 20 add_watcher() i=0 2024-09-12T16:52:17.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 20 add_watcher() i=1 2024-09-12T16:52:17.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 20 add_watcher() i=2 2024-09-12T16:52:17.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 20 add_watcher() i=3 2024-09-12T16:52:17.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 20 add_watcher() i=4 2024-09-12T16:52:17.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 20 add_watcher() i=5 2024-09-12T16:52:17.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 20 add_watcher() i=6 2024-09-12T16:52:17.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94907857046768] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 20 add_watcher() i=7 2024-09-12T16:52:17.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:17.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751b43c0 con 0x56517519da10 2024-09-12T16:52:17.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94907857044224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751b1950 con 0x56517519da10 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94907857044224] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.301+0000 7f2e877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 5 note: GC not initialized 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2e867fc640 20 reqs_thread_entry: start 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 20 Filter name: none 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2df7fff640 20 reqs_thread_entry: start 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651751d71e0 con 0x56517519da10 2024-09-12T16:52:17.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:17.308 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:17.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2e877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94907857044224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751d6030 con 0x56517519da10 2024-09-12T16:52:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94907857044224] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94907857024944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751b02d0 con 0x7f2fc80500d0 2024-09-12T16:52:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94907857024944] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 20 remove_watcher() i=0 2024-09-12T16:52:17.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 2 removed watcher, disabling cache 2024-09-12T16:52:17.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.305+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94907857028816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ab7b0 con 0x56517519da10 2024-09-12T16:52:17.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.309+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94907857028816] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.309+0000 7f2fd7e7f9c0 20 remove_watcher() i=1 2024-09-12T16:52:17.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.309+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94907857031024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ac6d0 con 0x5651751a6bd0 2024-09-12T16:52:17.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.309+0000 7f2fd5985640 1 -- 172.21.15.151:0/3787964305 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94907857031024] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fc802e070 con 0x5651751a6bd0 2024-09-12T16:52:17.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.309+0000 7f2fd7e7f9c0 20 remove_watcher() i=2 2024-09-12T16:52:17.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.309+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94907857035136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751acf70 con 0x7f2fc80500d0 2024-09-12T16:52:17.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.313+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94907857035136] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x7f2fc80500d0 2024-09-12T16:52:17.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.313+0000 7f2fd7e7f9c0 20 remove_watcher() i=3 2024-09-12T16:52:17.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.313+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94907857039200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751acf70 con 0x56517519da10 2024-09-12T16:52:17.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.313+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94907857039200] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fcc0aa070 con 0x56517519da10 2024-09-12T16:52:17.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.313+0000 7f2fd7e7f9c0 20 remove_watcher() i=4 2024-09-12T16:52:17.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.313+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94907857022384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751aef60 con 0x5651751a20e0 2024-09-12T16:52:17.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.317+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94907857022384] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.317+0000 7f2fd7e7f9c0 20 remove_watcher() i=5 2024-09-12T16:52:17.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.317+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94907857036256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751aadb0 con 0x5651751a20e0 2024-09-12T16:52:17.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.317+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94907857036256] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.317+0000 7f2fd7e7f9c0 20 remove_watcher() i=6 2024-09-12T16:52:17.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.317+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94907857046768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651751ae430 con 0x5651751a20e0 2024-09-12T16:52:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd6186640 1 -- 172.21.15.151:0/3787964305 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94907857046768] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fd005c040 con 0x5651751a20e0 2024-09-12T16:52:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 20 remove_watcher() i=7 2024-09-12T16:52:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5651751a20e0 msgr2=0x5651751a44d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5651751a20e0 0x5651751a44d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56517519da10 msgr2=0x56517519fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56517519da10 0x56517519fea0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2fc80500d0 msgr2=0x7f2fc8019780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2fc80500d0 0x7f2fc8019780 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5651751a6bd0 msgr2=0x5651751a9090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5651751a6bd0 0x5651751a9090 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ea0039ac0 msgr2=0x7f2ea003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ea0039ac0 0x7f2ea003bf80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800e9a0 tx=0x7f2fc8035000 comp rx=0 tx=0).stop 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 msgr2=0x565175192750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd5184640 1 -- 172.21.15.151:0/3787964305 reap_dead start 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x565175192750 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0011ac0 tx=0x7f2fd00506c0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 shutdown_connections 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/3787964305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517518c260 0x565175192750 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 >> 172.21.15.151:0/3787964305 conn(0x565175187680 msgr2=0x565175185890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 shutdown_connections 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/3787964305 wait complete. 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1339846995 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2eb0039a70 msgr2=0x7f2eb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1339846995 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2eb0039a70 0x7f2eb003bf30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5651751653e0 tx=0x7f2fc804ebe0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1339846995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517517e930 msgr2=0x56517517ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1339846995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517517e930 0x56517517ed50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x565175166010 tx=0x7f2fd0018830 comp rx=0 tx=0).stop 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1339846995 shutdown_connections 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1339846995 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2eb0039a70 0x7f2eb003bf30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1339846995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517517e930 0x56517517ed50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1339846995 >> 172.21.15.151:0/1339846995 conn(0x5651751742e0 msgr2=0x5651751746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1339846995 shutdown_connections 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1339846995 wait complete. 2024-09-12T16:52:17.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56517516d800 msgr2=0x56517516fbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56517516d800 0x56517516fbf0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x565175071ff0 msgr2=0x56517516b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x565175071ff0 0x56517516b090 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ebc039a70 msgr2=0x7f2ebc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ebc039a70 0x7f2ebc03bf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0ad000 tx=0x7f2fcc0a7000 comp rx=0 tx=0).stop 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 msgr2=0x565175163f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175163f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x565175159420 tx=0x7f2fc8000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 shutdown_connections 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56517516d800 0x56517516fbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x565175071ff0 0x56517516b090 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2ebc039a70 0x7f2ebc03bf30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 --2- 172.21.15.151:0/1188423114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56517506de00 0x565175163f20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 >> 172.21.15.151:0/1188423114 conn(0x565175069920 msgr2=0x565175152b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 shutdown_connections 2024-09-12T16:52:17.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.321+0000 7f2fd7e7f9c0 1 -- 172.21.15.151:0/1188423114 wait complete. 2024-09-12T16:52:17.332 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:17.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-12T16:52:17.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-12T16:52:17.333 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-12T16:52:17.413 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:17.413 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:17.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.409+0000 7f0ff05149c0 1 Processor -- start 2024-09-12T16:52:17.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0ff05149c0 1 -- start start 2024-09-12T16:52:17.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0ff05149c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555b186aff30 0x555b186b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0ff05149c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b185649c0 con 0x555b186b30c0 2024-09-12T16:52:17.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0ff05149c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x555b185b46d0 con 0x555b186aff30 2024-09-12T16:52:17.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fee01a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555b186aff30 0x555b186b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fed819640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x555b186b30c0 0x555b186b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38090/0 (socket says 172.21.15.151:38090) 2024-09-12T16:52:17.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fed819640 1 -- 172.21.15.151:0/95814759 learned_addr learned my addr 172.21.15.151:0/95814759 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:17.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fee01a640 1 -- 172.21.15.151:0/95814759 >> v1:172.21.15.122:6789/0 conn(0x555b186b30c0 legacy=0x555b186b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fee01a640 1 -- 172.21.15.151:0/95814759 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b18558ca0 con 0x555b186aff30 2024-09-12T16:52:17.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fee01a640 1 --2- 172.21.15.151:0/95814759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b186b0310 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800a480 tx=0x7f0fe801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2495f868d177f088 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fed018640 1 -- 172.21.15.151:0/95814759 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe80b0070 con 0x555b186aff30 2024-09-12T16:52:17.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fed018640 1 -- 172.21.15.151:0/95814759 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe80ab540 con 0x555b186aff30 2024-09-12T16:52:17.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.413+0000 7f0fed018640 1 -- 172.21.15.151:0/95814759 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe80ab840 con 0x555b186aff30 2024-09-12T16:52:17.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.417+0000 7f0ff05149c0 1 -- 172.21.15.151:0/95814759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 msgr2=0x555b186b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.417+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/95814759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b186b0310 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800a480 tx=0x7f0fe801b280 comp rx=0 tx=0).stop 2024-09-12T16:52:17.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.417+0000 7f0ff05149c0 1 -- 172.21.15.151:0/95814759 shutdown_connections 2024-09-12T16:52:17.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.417+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/95814759 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b186b0310 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.417+0000 7f0ff05149c0 1 -- 172.21.15.151:0/95814759 >> 172.21.15.151:0/95814759 conn(0x555b186aba50 msgr2=0x555b186ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.417+0000 7f0ff05149c0 1 -- 172.21.15.151:0/95814759 shutdown_connections 2024-09-12T16:52:17.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.417+0000 7f0ff05149c0 1 -- 172.21.15.151:0/95814759 wait complete. 2024-09-12T16:52:17.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0ff05149c0 1 Processor -- start 2024-09-12T16:52:17.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0ff05149c0 1 -- start start 2024-09-12T16:52:17.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0ff05149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b1879b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0ff05149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b185b8680 con 0x555b186aff30 2024-09-12T16:52:17.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0fee01a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b1879b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0fee01a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b1879b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33958/0 (socket says 172.21.15.151:33958) 2024-09-12T16:52:17.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0fee01a640 1 -- 172.21.15.151:0/2141044328 learned_addr learned my addr 172.21.15.151:0/2141044328 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0fee01a640 1 -- 172.21.15.151:0/2141044328 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b18533da0 con 0x555b186aff30 2024-09-12T16:52:17.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0fee01a640 1 --2- 172.21.15.151:0/2141044328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b1879b760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80ae040 tx=0x7f0fe8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2fad4c0979c373 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0edc608640 1 -- 172.21.15.151:0/2141044328 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe80b0070 con 0x555b186aff30 2024-09-12T16:52:17.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0edc608640 1 -- 172.21.15.151:0/2141044328 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe80b1040 con 0x555b186aff30 2024-09-12T16:52:17.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.429+0000 7f0edc608640 1 -- 172.21.15.151:0/2141044328 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe80ab6f0 con 0x555b186aff30 2024-09-12T16:52:17.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- 172.21.15.151:0/2141044328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 msgr2=0x555b1879b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/2141044328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b1879b760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80ae040 tx=0x7f0fe8003030 comp rx=0 tx=0).stop 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- 172.21.15.151:0/2141044328 shutdown_connections 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/2141044328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b1879b760 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- 172.21.15.151:0/2141044328 >> 172.21.15.151:0/2141044328 conn(0x555b186aba50 msgr2=0x555b18797400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- 172.21.15.151:0/2141044328 shutdown_connections 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- 172.21.15.151:0/2141044328 wait complete. 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 Processor -- start 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- start start 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b187a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b1855aa50 con 0x555b186aff30 2024-09-12T16:52:17.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0fee01a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b187a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0fee01a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b187a2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33962/0 (socket says 172.21.15.151:33962) 2024-09-12T16:52:17.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0fee01a640 1 -- 172.21.15.151:0/3728536669 learned_addr learned my addr 172.21.15.151:0/3728536669 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0fee01a640 1 -- 172.21.15.151:0/3728536669 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b187a31f0 con 0x555b186aff30 2024-09-12T16:52:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0fee01a640 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b187a2c90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80ae040 tx=0x7f0fe8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0edae05640 1 -- 172.21.15.151:0/3728536669 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe80b7480 con 0x555b186aff30 2024-09-12T16:52:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b187a3480 con 0x555b186aff30 2024-09-12T16:52:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b187a3e30 con 0x555b186aff30 2024-09-12T16:52:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0edae05640 1 -- 172.21.15.151:0/3728536669 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe80b7620 con 0x555b186aff30 2024-09-12T16:52:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0edae05640 1 -- 172.21.15.151:0/3728536669 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe80ce060 con 0x555b186aff30 2024-09-12T16:52:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0edae05640 1 -- 172.21.15.151:0/3728536669 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0fe80b7900 con 0x555b186aff30 2024-09-12T16:52:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0edae05640 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ed4039b10 0x7f0ed403bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0edae05640 1 -- 172.21.15.151:0/3728536669 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0fe80bc070 con 0x555b186aff30 2024-09-12T16:52:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.433+0000 7f0fed819640 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ed4039b10 0x7f0ed403bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b186b30c0 0x555b187a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187aa340 con 0x555b186b30c0 2024-09-12T16:52:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee81b640 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b186b30c0 0x555b187a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fed819640 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ed4039b10 0x7f0ed403bfd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8001d80 tx=0x7f0fd80012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee81b640 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b186b30c0 0x555b187a9e00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee81b640 1 -- 172.21.15.151:0/3728536669 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe000a4d0 con 0x555b186b30c0 2024-09-12T16:52:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187aa700 con 0x555b186b30c0 2024-09-12T16:52:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee81b640 1 -- 172.21.15.151:0/3728536669 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fe000a4d0 con 0x555b186b30c0 2024-09-12T16:52:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187ac510 0x555b187ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187aeff0 con 0x555b187ac510 2024-09-12T16:52:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee01a640 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187ac510 0x555b187ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee01a640 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187ac510 0x555b187ae900 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee01a640 1 -- 172.21.15.151:0/3728536669 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187ac510 2024-09-12T16:52:17.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187ab3b0 con 0x555b186b30c0 2024-09-12T16:52:17.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee81b640 1 -- 172.21.15.151:0/3728536669 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fe000a4d0 con 0x555b186b30c0 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187ab850 con 0x555b186b30c0 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0fee81b640 1 -- 172.21.15.151:0/3728536669 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0fe000a4d0 con 0x555b186b30c0 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 Processor -- start 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 -- start start 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b187bd680 0x555b187bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.437+0000 7f0ff05149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b185c5450 con 0x555b187bd680 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee81b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b187bd680 0x555b187bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee81b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b187bd680 0x555b187bdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33966/0 (socket says 172.21.15.151:33966) 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee81b640 1 -- 172.21.15.151:0/1592558945 learned_addr learned my addr 172.21.15.151:0/1592558945 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee81b640 1 -- 172.21.15.151:0/1592558945 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b187be0e0 con 0x555b187bd680 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee81b640 1 --2- 172.21.15.151:0/1592558945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b187bd680 0x555b187bdaa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x555b187a3a10 tx=0x7f0fe0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ed3fff640 1 -- 172.21.15.151:0/1592558945 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe0014450 con 0x555b187bd680 2024-09-12T16:52:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ed3fff640 1 -- 172.21.15.151:0/1592558945 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe0014610 con 0x555b187bd680 2024-09-12T16:52:17.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1592558945 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b187be940 con 0x555b187bd680 2024-09-12T16:52:17.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ed3fff640 1 -- 172.21.15.151:0/1592558945 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe0014930 con 0x555b187bd680 2024-09-12T16:52:17.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1592558945 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b187beeb0 con 0x555b187bd680 2024-09-12T16:52:17.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ed3fff640 1 -- 172.21.15.151:0/1592558945 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0fe0011040 con 0x555b187bd680 2024-09-12T16:52:17.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ed3fff640 1 --2- 172.21.15.151:0/1592558945 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ec8039a70 0x7f0ec803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ed3fff640 1 -- 172.21.15.151:0/1592558945 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0fe001e070 con 0x555b187bd680 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee01a640 1 --2- 172.21.15.151:0/1592558945 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ec8039a70 0x7f0ec803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ff05149c0 1 Processor -- start 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ff05149c0 1 -- start start 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee01a640 1 --2- 172.21.15.151:0/1592558945 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ec8039a70 0x7f0ec803bf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x555b187a4120 tx=0x7f0fe80d5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ff05149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b18625870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0ff05149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b1879bed0 con 0x555b18625470 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee81b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b18625870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee81b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b18625870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33968/0 (socket says 172.21.15.151:33968) 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.441+0000 7f0fee81b640 1 -- 172.21.15.151:0/4189438461 learned_addr learned my addr 172.21.15.151:0/4189438461 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0fee81b640 1 -- 172.21.15.151:0/4189438461 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b18625db0 con 0x555b18625470 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0fee81b640 1 --2- 172.21.15.151:0/4189438461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b18625870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0011e90 tx=0x7f0fe0041f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40269163478cf804 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ed1ffb640 1 -- 172.21.15.151:0/4189438461 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe0016440 con 0x555b18625470 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ed1ffb640 1 -- 172.21.15.151:0/4189438461 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe00165e0 con 0x555b18625470 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ed1ffb640 1 -- 172.21.15.151:0/4189438461 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe0043200 con 0x555b18625470 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- 172.21.15.151:0/4189438461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 msgr2=0x555b18625870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/4189438461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b18625870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0011e90 tx=0x7f0fe0041f80 comp rx=0 tx=0).stop 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- 172.21.15.151:0/4189438461 shutdown_connections 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/4189438461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b18625870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- 172.21.15.151:0/4189438461 >> 172.21.15.151:0/4189438461 conn(0x555b187c6410 msgr2=0x555b187c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- 172.21.15.151:0/4189438461 shutdown_connections 2024-09-12T16:52:17.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- 172.21.15.151:0/4189438461 wait complete. 2024-09-12T16:52:17.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 Processor -- start 2024-09-12T16:52:17.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- start start 2024-09-12T16:52:17.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b187d3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b18626300 con 0x555b18625470 2024-09-12T16:52:17.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0fee81b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b187d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0fee81b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b187d3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33984/0 (socket says 172.21.15.151:33984) 2024-09-12T16:52:17.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 learned_addr learned my addr 172.21.15.151:0/1731063630 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b187d3bb0 con 0x555b18625470 2024-09-12T16:52:17.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0fee81b640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b187d3650 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0016c70 tx=0x7f0fe00505d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ebffff640 1 -- 172.21.15.151:0/1731063630 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe0031070 con 0x555b18625470 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b187d3e40 con 0x555b18625470 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ebffff640 1 -- 172.21.15.151:0/1731063630 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe004f2a0 con 0x555b18625470 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ebffff640 1 -- 172.21.15.151:0/1731063630 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe003b060 con 0x555b18625470 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.445+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b187d3e40 con 0x555b18625470 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ebffff640 1 -- 172.21.15.151:0/1731063630 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0fe0034070 con 0x555b18625470 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ebffff640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0eb8039a70 0x7f0eb803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ebffff640 1 -- 172.21.15.151:0/1731063630 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0fe0048070 con 0x555b18625470 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fee01a640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0eb8039a70 0x7f0eb803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b187de7d0 0x555b187e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187e13b0 con 0x555b187de7d0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fed819640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b187de7d0 0x555b187e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fee01a640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0eb8039a70 0x7f0eb803bf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x555b187af3f0 tx=0x7f0fe80dc000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fed819640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b187de7d0 0x555b187e0c60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fd800e5a0 con 0x555b187de7d0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 realm 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187ddb80 con 0x555b187de7d0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fd800e5a0 con 0x555b187de7d0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187e1eb0 con 0x555b187de7d0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fd800e5a0 con 0x555b187de7d0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187e2780 con 0x555b187de7d0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fd800e5a0 con 0x555b187de7d0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187e31a0 0x555b187e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187e5c80 con 0x555b187e31a0 2024-09-12T16:52:17.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fee81b640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187e31a0 0x555b187e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fee81b640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187e31a0 0x555b187e5590 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 20 searching for the correct realm 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b187e7bd0 0x555b187ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.449+0000 7f0fee01a640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b187e7bd0 0x555b187ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee01a640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b187e7bd0 0x555b187ea000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee01a640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0fe80ab030 0x7f0fe80eb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x7f0fe80ab030 2024-09-12T16:52:17.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0fe80ab030 0x7f0fe80eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0fe80ab030 0x7f0fe80eb050 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd800e5a0 con 0x7f0fe80ab030 2024-09-12T16:52:17.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187de7d0 2024-09-12T16:52:17.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd800e5a0 con 0x555b187de7d0 2024-09-12T16:52:17.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187de7d0 2024-09-12T16:52:17.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x7f0fe80ab030 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x7f0fe80ab030 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.453+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187de7d0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187de7d0 2024-09-12T16:52:17.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x7f0fe80ab030 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0fd8029040 con 0x7f0fe80ab030 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187de7d0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187de7d0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.457+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x7f0fe80ab030 2024-09-12T16:52:17.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x7f0fe80ab030 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187de7d0 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x7f0fe80ab030 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x7f0fe80ab030 2024-09-12T16:52:17.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e7bd0 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187e31a0 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x555b187de7d0 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b187ea6d0 con 0x7f0fe80ab030 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd8029040 con 0x7f0fe80ab030 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0ff05149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0ff05149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0ff05149c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0ff05149c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:17.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0ff05149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0ff05149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.461+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187e6640 con 0x555b187de7d0 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187e6ee0 con 0x555b187de7d0 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fd8029040 con 0x555b187de7d0 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187e6280 con 0x555b187de7d0 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 zone default found 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 4 Realm: () 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 zonegroup default 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187e6ee0 con 0x555b187e31a0 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187eca70 con 0x555b187e7bd0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187ece40 con 0x555b187e7bd0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 started sync module instance, tier type = 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ebf00 con 0x7f0fe80ab030 2024-09-12T16:52:17.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x7f0fe80ab030 2024-09-12T16:52:17.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93849741345824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ebf00 con 0x7f0fe80ab030 2024-09-12T16:52:17.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.465+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ed900 con 0x555b187de7d0 2024-09-12T16:52:17.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.469+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93849741345824] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x7f0fe80ab030 2024-09-12T16:52:17.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.469+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.469+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93849741349904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ebf00 con 0x555b187de7d0 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.469+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ee310 con 0x555b187e7bd0 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.469+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.469+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93849741352544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187eebb0 con 0x555b187e7bd0 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.469+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ef5b0 con 0x7f0fe80ab030 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.469+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93849741349904] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.473+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x7f0fe80ab030 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.473+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93849741343312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ef9a0 con 0x7f0fe80ab030 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.473+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187f0360 con 0x555b187de7d0 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.473+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93849741352544] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.473+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93849741343312] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x7f0fe80ab030 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.473+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.473+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93849741357248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187efeb0 con 0x555b187de7d0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.473+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187f0700 con 0x555b187e31a0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.477+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93849741357248] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.477+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.477+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93849741360816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187f02d0 con 0x555b187e31a0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.477+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187f1400 con 0x555b187e31a0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.477+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93849741360816] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.477+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.477+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93849741363872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187f1370 con 0x555b187e31a0 2024-09-12T16:52:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.477+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187f1e60 con 0x555b187e31a0 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93849741367600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187f22d0 con 0x555b187e31a0 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 20 add_watcher() i=0 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 20 add_watcher() i=1 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 20 add_watcher() i=2 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 20 add_watcher() i=3 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 20 add_watcher() i=4 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 20 add_watcher() i=5 2024-09-12T16:52:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93849741363872] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 20 add_watcher() i=6 2024-09-12T16:52:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93849741367600] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 20 add_watcher() i=7 2024-09-12T16:52:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b187f0ec0 con 0x555b187de7d0 2024-09-12T16:52:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.481+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93849741364928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187f2880 con 0x555b187de7d0 2024-09-12T16:52:17.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93849741364928] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ea4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 5 note: GC not initialized 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0e1f7fe640 20 reqs_thread_entry: start 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 20 Filter name: none 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0e1d7fa640 20 reqs_thread_entry: start 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b18818610 con 0x555b187de7d0 2024-09-12T16:52:17.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:17.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:17.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:17.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T16:52:17.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b18819080 con 0x555b187e31a0 2024-09-12T16:52:17.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b1881e9a0 con 0x555b187de7d0 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93849741550608 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b1881a0d0 con 0x555b187de7d0 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 93849741357248 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x555b185649c0 con 0x555b187de7d0 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ed1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 93849741357248 notifier 4341 bl.length()=678 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ed1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ed1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(65 notify.4 [notify cookie 93849741550608 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ed1ffb640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0eb4003eb0 con 0x555b187de7d0 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 93849741550608 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0fd802f9b0 con 0x555b187de7d0 2024-09-12T16:52:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.485+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b1881e410 con 0x555b187e31a0 2024-09-12T16:52:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ff05149c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T16:52:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ff05149c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ff05149c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T16:52:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93849741550608 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b1881a170 con 0x555b187e7bd0 2024-09-12T16:52:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== watch-notify(notify (1) cookie 93849741352544 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f0fe8100040 con 0x555b187e7bd0 2024-09-12T16:52:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ed17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 93849741352544 notifier 4341 bl.length()=177 2024-09-12T16:52:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ed17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T16:52:17.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ed17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:17.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 notify.2 [notify cookie 93849741550608 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ed17fa640 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0e24003410 con 0x555b187e7bd0 2024-09-12T16:52:17.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== watch-notify(notify_complete (2) cookie 93849741550608 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0fe80e5040 con 0x555b187e7bd0 2024-09-12T16:52:17.496 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T16:52:17.488252Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ea4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.489+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93849741364928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b18816c70 con 0x555b187de7d0 2024-09-12T16:52:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93849741364928] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93849741345824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b18816360 con 0x7f0fe80ab030 2024-09-12T16:52:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93849741345824] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x7f0fe80ab030 2024-09-12T16:52:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0ff05149c0 20 remove_watcher() i=0 2024-09-12T16:52:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0ff05149c0 2 removed watcher, disabling cache 2024-09-12T16:52:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93849741349904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b18816360 con 0x555b187de7d0 2024-09-12T16:52:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93849741349904] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0ff05149c0 20 remove_watcher() i=1 2024-09-12T16:52:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.493+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93849741352544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b18816360 con 0x555b187e7bd0 2024-09-12T16:52:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.497+0000 7f0fee01a640 1 -- 172.21.15.151:0/1731063630 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93849741352544] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe80c7070 con 0x555b187e7bd0 2024-09-12T16:52:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.497+0000 7f0ff05149c0 20 remove_watcher() i=2 2024-09-12T16:52:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.497+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93849741343312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ede60 con 0x7f0fe80ab030 2024-09-12T16:52:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.497+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93849741343312] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x7f0fe80ab030 2024-09-12T16:52:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.497+0000 7f0ff05149c0 20 remove_watcher() i=3 2024-09-12T16:52:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.497+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93849741357248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b18816360 con 0x555b187de7d0 2024-09-12T16:52:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93849741357248] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80391c0 con 0x555b187de7d0 2024-09-12T16:52:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0ff05149c0 20 remove_watcher() i=4 2024-09-12T16:52:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93849741360816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ede60 con 0x555b187e31a0 2024-09-12T16:52:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93849741360816] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0ff05149c0 20 remove_watcher() i=5 2024-09-12T16:52:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93849741363872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b187ef0c0 con 0x555b187e31a0 2024-09-12T16:52:17.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93849741363872] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0ff05149c0 20 remove_watcher() i=6 2024-09-12T16:52:17.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.501+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93849741367600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b18816360 con 0x555b187e31a0 2024-09-12T16:52:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0fee81b640 1 -- 172.21.15.151:0/1731063630 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93849741367600] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe0033030 con 0x555b187e31a0 2024-09-12T16:52:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 20 remove_watcher() i=7 2024-09-12T16:52:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187e31a0 msgr2=0x555b187e5590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187e31a0 0x555b187e5590 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b187de7d0 msgr2=0x555b187e0c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b187de7d0 0x555b187e0c60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0fe80ab030 msgr2=0x7f0fe80eb050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0fe80ab030 0x7f0fe80eb050 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b187e7bd0 msgr2=0x555b187ea000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b187e7bd0 0x555b187ea000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0eb8039a70 msgr2=0x7f0eb803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0eb8039a70 0x7f0eb803bf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x555b187af3f0 tx=0x7f0fe80dc000 comp rx=0 tx=0).stop 2024-09-12T16:52:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0fed819640 1 -- 172.21.15.151:0/1731063630 reap_dead start 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 msgr2=0x555b187d3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b187d3650 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0016c70 tx=0x7f0fe00505d0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 shutdown_connections 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1731063630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b18625470 0x555b187d3650 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 >> 172.21.15.151:0/1731063630 conn(0x555b187c6410 msgr2=0x555b187c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 shutdown_connections 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1731063630 wait complete. 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1592558945 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ec8039a70 msgr2=0x7f0ec803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1592558945 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ec8039a70 0x7f0ec803bf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x555b187a4120 tx=0x7f0fe80d5040 comp rx=0 tx=0).stop 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1592558945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b187bd680 msgr2=0x555b187bdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1592558945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b187bd680 0x555b187bdaa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x555b187a3a10 tx=0x7f0fe0018830 comp rx=0 tx=0).stop 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1592558945 shutdown_connections 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1592558945 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ec8039a70 0x7f0ec803bf30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/1592558945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b187bd680 0x555b187bdaa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1592558945 >> 172.21.15.151:0/1592558945 conn(0x555b187b3030 msgr2=0x555b187b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1592558945 shutdown_connections 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/1592558945 wait complete. 2024-09-12T16:52:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187ac510 msgr2=0x555b187ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187ac510 0x555b187ae900 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b186b30c0 msgr2=0x555b187a9e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b186b30c0 0x555b187a9e00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ed4039b10 msgr2=0x7f0ed403bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ed4039b10 0x7f0ed403bfd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8001d80 tx=0x7f0fd80012e0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 msgr2=0x555b187a2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b187a2c90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80ae040 tx=0x7f0fe8018020 comp rx=0 tx=0).stop 2024-09-12T16:52:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 shutdown_connections 2024-09-12T16:52:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b187ac510 0x555b187ae900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b186b30c0 0x555b187a9e00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ed4039b10 0x7f0ed403bfd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 --2- 172.21.15.151:0/3728536669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b186aff30 0x555b187a2c90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 >> 172.21.15.151:0/3728536669 conn(0x555b186aba50 msgr2=0x555b18795e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 shutdown_connections 2024-09-12T16:52:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.505+0000 7f0ff05149c0 1 -- 172.21.15.151:0/3728536669 wait complete. 2024-09-12T16:52:17.518 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T16:52:17.488252Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:17.518 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:52:17.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:52:17.519 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:52:17.591 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:17.591 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:17.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe58449c0 1 Processor -- start 2024-09-12T16:52:17.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe58449c0 1 -- start start 2024-09-12T16:52:17.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe58449c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x558c89a34100 0x558c89a36520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe58449c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c898e69c0 con 0x558c899a6240 2024-09-12T16:52:17.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe58449c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x558c899366d0 con 0x558c89a34100 2024-09-12T16:52:17.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe2b49640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x558c89a34100 0x558c89a36520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe334a640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x558c899a6240 0x558c89a329e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38098/0 (socket says 172.21.15.151:38098) 2024-09-12T16:52:17.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe334a640 1 -- 172.21.15.151:0/2585726597 learned_addr learned my addr 172.21.15.151:0/2585726597 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:17.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe2b49640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x558c89a34100 0x558c89a36520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33988/0 (socket says 172.21.15.151:33988) 2024-09-12T16:52:17.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe2b49640 1 -- 172.21.15.151:0/2585726597 >> v1:172.21.15.122:6789/0 conn(0x558c899a6240 legacy=0x558c89a329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.589+0000 7fbfe2b49640 1 -- 172.21.15.151:0/2585726597 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c898daca0 con 0x558c89a34100 2024-09-12T16:52:17.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe2b49640 1 --2- 172.21.15.151:0/2585726597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89a34100 0x558c89a36520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800a480 tx=0x7fbfd801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85583378ae01ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe2348640 1 -- 172.21.15.151:0/2585726597 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd80af070 con 0x558c89a34100 2024-09-12T16:52:17.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe2348640 1 -- 172.21.15.151:0/2585726597 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd80aa530 con 0x558c89a34100 2024-09-12T16:52:17.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe2348640 1 -- 172.21.15.151:0/2585726597 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd80aa830 con 0x558c89a34100 2024-09-12T16:52:17.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2585726597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89a34100 msgr2=0x558c89a36520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2585726597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89a34100 0x558c89a36520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800a480 tx=0x7fbfd801b280 comp rx=0 tx=0).stop 2024-09-12T16:52:17.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2585726597 shutdown_connections 2024-09-12T16:52:17.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2585726597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89a34100 0x558c89a36520 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2585726597 >> 172.21.15.151:0/2585726597 conn(0x558c89a2c920 msgr2=0x558c89a2ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2585726597 shutdown_connections 2024-09-12T16:52:17.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.593+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2585726597 wait complete. 2024-09-12T16:52:17.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 Processor -- start 2024-09-12T16:52:17.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- start start 2024-09-12T16:52:17.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b24390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c8993a680 con 0x558c899a6240 2024-09-12T16:52:17.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b24390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b24390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33992/0 (socket says 172.21.15.151:33992) 2024-09-12T16:52:17.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 -- 172.21.15.151:0/2459329594 learned_addr learned my addr 172.21.15.151:0/2459329594 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 -- 172.21.15.151:0/2459329594 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c898b5da0 con 0x558c899a6240 2024-09-12T16:52:17.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 --2- 172.21.15.151:0/2459329594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b24390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40017b0 tx=0x7fbfd4001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63449c2a4dc05035 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbed160a640 1 -- 172.21.15.151:0/2459329594 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd40044f0 con 0x558c899a6240 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbed160a640 1 -- 172.21.15.151:0/2459329594 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd40046b0 con 0x558c899a6240 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbed160a640 1 -- 172.21.15.151:0/2459329594 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4004a10 con 0x558c899a6240 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2459329594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 msgr2=0x558c89b24390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2459329594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b24390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40017b0 tx=0x7fbfd4001c70 comp rx=0 tx=0).stop 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2459329594 shutdown_connections 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2459329594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b24390 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2459329594 >> 172.21.15.151:0/2459329594 conn(0x558c89a2c920 msgr2=0x558c89b1ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2459329594 shutdown_connections 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2459329594 wait complete. 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 Processor -- start 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- start start 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b2ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe58449c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c898dca50 con 0x558c899a6240 2024-09-12T16:52:17.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b2ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b2ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34004/0 (socket says 172.21.15.151:34004) 2024-09-12T16:52:17.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 -- 172.21.15.151:0/2605558412 learned_addr learned my addr 172.21.15.151:0/2605558412 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.609+0000 7fbfe334a640 1 -- 172.21.15.151:0/2605558412 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c89b2bfc0 con 0x558c899a6240 2024-09-12T16:52:17.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe334a640 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b2ba60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40012f0 tx=0x7fbfd4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbecfe07640 1 -- 172.21.15.151:0/2605558412 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4013820 con 0x558c899a6240 2024-09-12T16:52:17.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c89b2c250 con 0x558c899a6240 2024-09-12T16:52:17.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbecfe07640 1 -- 172.21.15.151:0/2605558412 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd40139c0 con 0x558c899a6240 2024-09-12T16:52:17.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c89b2cc00 con 0x558c899a6240 2024-09-12T16:52:17.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbecfe07640 1 -- 172.21.15.151:0/2605558412 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd4013ca0 con 0x558c899a6240 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbecfe07640 1 -- 172.21.15.151:0/2605558412 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbfd4010070 con 0x558c899a6240 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbecfe07640 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbec8039a70 0x7fbec803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbecfe07640 1 -- 172.21.15.151:0/2605558412 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbfd4018070 con 0x558c899a6240 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe2b49640 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbec8039a70 0x7fbec803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89a34100 0x558c89b32bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b33110 con 0x558c89a34100 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe3b4b640 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89a34100 0x558c89b32bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe2b49640 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbec8039a70 0x7fbec803bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80ac000 tx=0x7fbfd80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe3b4b640 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89a34100 0x558c89b32bd0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/2605558412 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89a34100 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b2cf70 con 0x558c89a34100 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/2605558412 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89a34100 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b353b0 0x558c89b377a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b37e70 con 0x558c89b353b0 2024-09-12T16:52:17.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.613+0000 7fbfe334a640 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b353b0 0x558c89b377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe334a640 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b353b0 0x558c89b377a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe334a640 1 -- 172.21.15.151:0/2605558412 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbfd401b030 con 0x558c89b353b0 2024-09-12T16:52:17.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b34250 con 0x558c89a34100 2024-09-12T16:52:17.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/2605558412 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89a34100 2024-09-12T16:52:17.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b34700 con 0x558c89a34100 2024-09-12T16:52:17.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/2605558412 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89a34100 2024-09-12T16:52:17.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe58449c0 1 Processor -- start 2024-09-12T16:52:17.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe58449c0 1 -- start start 2024-09-12T16:52:17.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe58449c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b46540 0x558c89b46960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe58449c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c89947450 con 0x558c89b46540 2024-09-12T16:52:17.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe3b4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b46540 0x558c89b46960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe3b4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b46540 0x558c89b46960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34008/0 (socket says 172.21.15.151:34008) 2024-09-12T16:52:17.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/135633567 learned_addr learned my addr 172.21.15.151:0/135633567 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/135633567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c89b46fa0 con 0x558c89b46540 2024-09-12T16:52:17.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe3b4b640 1 --2- 172.21.15.151:0/135633567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b46540 0x558c89b46960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x558c89b2c7e0 tx=0x7fbfdc00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbecd602640 1 -- 172.21.15.151:0/135633567 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc007dd0 con 0x558c89b46540 2024-09-12T16:52:17.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe58449c0 1 -- 172.21.15.151:0/135633567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c89b47800 con 0x558c89b46540 2024-09-12T16:52:17.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbfe58449c0 1 -- 172.21.15.151:0/135633567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c89b47d70 con 0x558c89b46540 2024-09-12T16:52:17.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbecd602640 1 -- 172.21.15.151:0/135633567 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc01e020 con 0x558c89b46540 2024-09-12T16:52:17.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.617+0000 7fbecd602640 1 -- 172.21.15.151:0/135633567 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc019550 con 0x558c89b46540 2024-09-12T16:52:17.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbecd602640 1 -- 172.21.15.151:0/135633567 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbfdc016040 con 0x558c89b46540 2024-09-12T16:52:17.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbecd602640 1 --2- 172.21.15.151:0/135633567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbebc039ac0 0x7fbebc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbecd602640 1 -- 172.21.15.151:0/135633567 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbfdc01f030 con 0x558c89b46540 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe334a640 1 --2- 172.21.15.151:0/135633567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbebc039ac0 0x7fbebc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 Processor -- start 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- start start 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe334a640 1 --2- 172.21.15.151:0/135633567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbebc039ac0 0x7fbebc03bf80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x558c89b33520 tx=0x7fbfd404e860 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b54290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c89b24be0 con 0x558c89b53e90 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe3b4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b54290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe3b4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b54290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34012/0 (socket says 172.21.15.151:34012) 2024-09-12T16:52:17.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/1154150936 learned_addr learned my addr 172.21.15.151:0/1154150936 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/1154150936 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c89b54880 con 0x558c89b53e90 2024-09-12T16:52:17.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe3b4b640 1 --2- 172.21.15.151:0/1154150936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b54290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0505d0 tx=0x7fbfdc014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298559703d50d843 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbec6ffd640 1 -- 172.21.15.151:0/1154150936 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc04d020 con 0x558c89b53e90 2024-09-12T16:52:17.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbec6ffd640 1 -- 172.21.15.151:0/1154150936 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc017bd0 con 0x558c89b53e90 2024-09-12T16:52:17.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbec6ffd640 1 -- 172.21.15.151:0/1154150936 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc01d030 con 0x558c89b53e90 2024-09-12T16:52:17.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- 172.21.15.151:0/1154150936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 msgr2=0x558c89b54290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/1154150936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b54290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0505d0 tx=0x7fbfdc014f90 comp rx=0 tx=0).stop 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- 172.21.15.151:0/1154150936 shutdown_connections 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/1154150936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b54290 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- 172.21.15.151:0/1154150936 >> 172.21.15.151:0/1154150936 conn(0x558c89b4f290 msgr2=0x558c89b4d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- 172.21.15.151:0/1154150936 shutdown_connections 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- 172.21.15.151:0/1154150936 wait complete. 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 Processor -- start 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- start start 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b5a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.621+0000 7fbfe58449c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c89b52dc0 con 0x558c89b53e90 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe3b4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b5a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe3b4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b5a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34026/0 (socket says 172.21.15.151:34026) 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 learned_addr learned my addr 172.21.15.151:0/600231707 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c89b5a830 con 0x558c89b53e90 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe3b4b640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b5a2d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc04f470 tx=0x7fbfdc050530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbec57fa640 1 -- 172.21.15.151:0/600231707 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc030030 con 0x558c89b53e90 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c89b5aac0 con 0x558c89b53e90 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbec57fa640 1 -- 172.21.15.151:0/600231707 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0509b0 con 0x558c89b53e90 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbec57fa640 1 -- 172.21.15.151:0/600231707 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfdc03a060 con 0x558c89b53e90 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c89b5aac0 con 0x558c89b53e90 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbec57fa640 1 -- 172.21.15.151:0/600231707 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbfdc033030 con 0x558c89b53e90 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbec57fa640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbeac039a70 0x7fbeac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbec57fa640 1 -- 172.21.15.151:0/600231707 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbfdc031070 con 0x558c89b53e90 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe334a640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbeac039a70 0x7fbeac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89b653b0 0x558c89b67840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b67f90 con 0x558c89b653b0 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe2b49640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89b653b0 0x558c89b67840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe334a640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbeac039a70 0x7fbeac03bf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4010890 tx=0x7fbfd403a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe2b49640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89b653b0 0x558c89b67840 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 20 realm 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b68360 con 0x558c89b653b0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b68c30 con 0x558c89b653b0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.625+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b68fd0 con 0x558c89b653b0 2024-09-12T16:52:17.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe58449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b69ac0 0x558c89b6beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b6c610 con 0x558c89b69ac0 2024-09-12T16:52:17.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe3b4b640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b69ac0 0x558c89b6beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe3b4b640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b69ac0 0x558c89b6beb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe58449c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe58449c0 20 searching for the correct realm 2024-09-12T16:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x558c89b6e5b0 0x558c89b70a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe334a640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x558c89b6e5b0 0x558c89b70a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe334a640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x558c89b6e5b0 0x558c89b70a70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd404c070 con 0x558c89b6e5b0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe334a640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbfd404e480 0x7fbfd4029470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x7fbfd404e480 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe2b49640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbfd404e480 0x7fbfd4029470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe2b49640 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbfd404e480 0x7fbfd4029470 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.629+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b653b0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b653b0 2024-09-12T16:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x7fbfd404e480 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd404c070 con 0x558c89b6e5b0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b653b0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b653b0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x7fbfd404e480 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.633+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b653b0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b653b0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x7fbfd404e480 2024-09-12T16:52:17.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b653b0 2024-09-12T16:52:17.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.637+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x7fbfd404e480 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b6e5b0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b69ac0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x558c89b653b0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c89b71140 con 0x7fbfd404e480 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b6cfd0 con 0x558c89b653b0 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b6d420 con 0x558c89b653b0 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b6d840 con 0x558c89b653b0 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 zone default found 2024-09-12T16:52:17.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 4 Realm: () 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 zonegroup default 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b6d840 con 0x558c89b69ac0 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b73140 con 0x558c89b6e5b0 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.641+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b735d0 con 0x558c89b6e5b0 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe58449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe58449c0 20 started sync module instance, tier type = 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe58449c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:17.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b72450 con 0x7fbfd404e480 2024-09-12T16:52:17.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94062094264688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b72450 con 0x7fbfd404e480 2024-09-12T16:52:17.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b740e0 con 0x558c89b653b0 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94062094264688] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94062094269392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b72450 con 0x558c89b653b0 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.645+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b74b20 con 0x558c89b6e5b0 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94062094272112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b753c0 con 0x558c89b6e5b0 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b75dc0 con 0x7fbfd404e480 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94062094269392] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94062094262176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b75d80 con 0x7fbfd404e480 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b767d0 con 0x558c89b653b0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94062094272112] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94062094262176] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94062094276816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b75020 con 0x558c89b653b0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.649+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b76c80 con 0x558c89b69ac0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.653+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94062094276816] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.653+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.653+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94062094279456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b76bf0 con 0x558c89b69ac0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.653+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b774a0 con 0x558c89b69ac0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.653+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94062094279456] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94062094280512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b77680 con 0x558c89b69ac0 2024-09-12T16:52:17.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b77ed0 con 0x558c89b69ac0 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94062094280512] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94062094284416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b77f50 con 0x558c89b69ac0 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 20 add_watcher() i=0 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 20 add_watcher() i=1 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 20 add_watcher() i=2 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 20 add_watcher() i=3 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 20 add_watcher() i=4 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 20 add_watcher() i=5 2024-09-12T16:52:17.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 20 add_watcher() i=6 2024-09-12T16:52:17.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94062094284416] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 20 add_watcher() i=7 2024-09-12T16:52:17.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.657+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b7b3e0 con 0x558c89b653b0 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94062094286144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b787d0 con 0x558c89b653b0 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94062094286144] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbe99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 5 note: GC not initialized 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbe98fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:17.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:17.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 20 Filter name: none 2024-09-12T16:52:17.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbe127fc640 20 reqs_thread_entry: start 2024-09-12T16:52:17.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c89b9e150 con 0x558c89b653b0 2024-09-12T16:52:17.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-12T16:52:17.667 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T16:52:17.488252Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:17.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbe99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.661+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94062094286144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b9cc00 con 0x558c89b653b0 2024-09-12T16:52:17.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94062094286144] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94062094264688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b77d40 con 0x7fbfd404e480 2024-09-12T16:52:17.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94062094264688] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe58449c0 20 remove_watcher() i=0 2024-09-12T16:52:17.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe58449c0 2 removed watcher, disabling cache 2024-09-12T16:52:17.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94062094269392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b72970 con 0x558c89b653b0 2024-09-12T16:52:17.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94062094269392] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe58449c0 20 remove_watcher() i=1 2024-09-12T16:52:17.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.665+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94062094272112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b72970 con 0x558c89b6e5b0 2024-09-12T16:52:17.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.669+0000 7fbfe334a640 1 -- 172.21.15.151:0/600231707 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94062094272112] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd405d040 con 0x558c89b6e5b0 2024-09-12T16:52:17.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.669+0000 7fbfe58449c0 20 remove_watcher() i=2 2024-09-12T16:52:17.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.669+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94062094262176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b74670 con 0x7fbfd404e480 2024-09-12T16:52:17.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.669+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94062094262176] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x7fbfd404e480 2024-09-12T16:52:17.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.669+0000 7fbfe58449c0 20 remove_watcher() i=3 2024-09-12T16:52:17.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.669+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94062094276816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b72970 con 0x558c89b653b0 2024-09-12T16:52:17.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94062094276816] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd80b2040 con 0x558c89b653b0 2024-09-12T16:52:17.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe58449c0 20 remove_watcher() i=4 2024-09-12T16:52:17.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94062094279456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b74670 con 0x558c89b69ac0 2024-09-12T16:52:17.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94062094279456] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe58449c0 20 remove_watcher() i=5 2024-09-12T16:52:17.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94062094280512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b72970 con 0x558c89b69ac0 2024-09-12T16:52:17.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94062094280512] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe58449c0 20 remove_watcher() i=6 2024-09-12T16:52:17.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.673+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94062094284416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c89b74670 con 0x558c89b69ac0 2024-09-12T16:52:17.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe3b4b640 1 -- 172.21.15.151:0/600231707 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94062094284416] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfdc0083f0 con 0x558c89b69ac0 2024-09-12T16:52:17.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 20 remove_watcher() i=7 2024-09-12T16:52:17.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b69ac0 msgr2=0x558c89b6beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b69ac0 0x558c89b6beb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89b653b0 msgr2=0x558c89b67840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89b653b0 0x558c89b67840 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbfd404e480 msgr2=0x7fbfd4029470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbfd404e480 0x7fbfd4029470 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x558c89b6e5b0 msgr2=0x558c89b70a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x558c89b6e5b0 0x558c89b70a70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbeac039a70 msgr2=0x7fbeac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbeac039a70 0x7fbeac03bf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4010890 tx=0x7fbfd403a000 comp rx=0 tx=0).stop 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 msgr2=0x558c89b5a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/600231707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b53e90 0x558c89b5a2d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc04f470 tx=0x7fbfdc050530 comp rx=0 tx=0).stop 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe2b49640 1 -- 172.21.15.151:0/600231707 reap_dead start 2024-09-12T16:52:17.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 shutdown_connections 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 >> 172.21.15.151:0/600231707 conn(0x558c89b4f290 msgr2=0x558c89b4d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 shutdown_connections 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/600231707 wait complete. 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/135633567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbebc039ac0 msgr2=0x7fbebc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/135633567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbebc039ac0 0x7fbebc03bf80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x558c89b33520 tx=0x7fbfd404e860 comp rx=0 tx=0).stop 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/135633567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b46540 msgr2=0x558c89b46960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/135633567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b46540 0x558c89b46960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x558c89b2c7e0 tx=0x7fbfdc00af40 comp rx=0 tx=0).stop 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/135633567 shutdown_connections 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/135633567 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbebc039ac0 0x7fbebc03bf80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/135633567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c89b46540 0x558c89b46960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/135633567 >> 172.21.15.151:0/135633567 conn(0x558c89b3bef0 msgr2=0x558c89b3c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/135633567 shutdown_connections 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/135633567 wait complete. 2024-09-12T16:52:17.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b353b0 msgr2=0x558c89b377a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b353b0 0x558c89b377a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89a34100 msgr2=0x558c89b32bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89a34100 0x558c89b32bd0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbec8039a70 msgr2=0x7fbec803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbec8039a70 0x7fbec803bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80ac000 tx=0x7fbfd80a5000 comp rx=0 tx=0).stop 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 msgr2=0x558c89b2ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b2ba60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40012f0 tx=0x7fbfd4000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 shutdown_connections 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x558c89b353b0 0x558c89b377a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x558c89a34100 0x558c89b32bd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbec8039a70 0x7fbec803bf30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 --2- 172.21.15.151:0/2605558412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c899a6240 0x558c89b2ba60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 >> 172.21.15.151:0/2605558412 conn(0x558c89a2c920 msgr2=0x558c89b1ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 shutdown_connections 2024-09-12T16:52:17.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.677+0000 7fbfe58449c0 1 -- 172.21.15.151:0/2605558412 wait complete. 2024-09-12T16:52:17.690 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T16:52:17.488252Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:17.690 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-12T16:52:17.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-12T16:52:17.690 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-12T16:52:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.765+0000 7f7764ae09c0 1 Processor -- start 2024-09-12T16:52:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.765+0000 7f7764ae09c0 1 -- start start 2024-09-12T16:52:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7764ae09c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559293123340 0x559293125730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7764ae09c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559292fd19c0 con 0x55929311f1f0 2024-09-12T16:52:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7764ae09c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5592930216d0 con 0x559293123340 2024-09-12T16:52:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7761de5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559293123340 0x559293125730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7761de5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559293123340 0x559293125730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34032/0 (socket says 172.21.15.151:34032) 2024-09-12T16:52:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7761de5640 1 -- 172.21.15.151:0/1641715839 learned_addr learned my addr 172.21.15.151:0/1641715839 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f77625e6640 1 --1- 172.21.15.151:0/1641715839 >> v1:172.21.15.122:6789/0 conn(0x55929311f1f0 0x55929311f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38110/0 (socket says 172.21.15.151:38110) 2024-09-12T16:52:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7761de5640 1 -- 172.21.15.151:0/1641715839 >> v1:172.21.15.122:6789/0 conn(0x55929311f1f0 legacy=0x55929311f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7761de5640 1 -- 172.21.15.151:0/1641715839 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559292fc5ca0 con 0x559293123340 2024-09-12T16:52:17.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f7761de5640 1 --2- 172.21.15.151:0/1641715839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559293123340 0x559293125730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f775800a5c0 tx=0x7f775801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fcf83f222c115e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f77615e4640 1 -- 172.21.15.151:0/1641715839 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77580a9590 con 0x559293123340 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f77615e4640 1 -- 172.21.15.151:0/1641715839 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580ae070 con 0x559293123340 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.769+0000 7f77615e4640 1 -- 172.21.15.151:0/1641715839 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77580a9880 con 0x559293123340 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.773+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1641715839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559293123340 msgr2=0x559293125730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.773+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1641715839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559293123340 0x559293125730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f775800a5c0 tx=0x7f775801b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.773+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1641715839 shutdown_connections 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.773+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1641715839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559293123340 0x559293125730 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.773+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1641715839 >> 172.21.15.151:0/1641715839 conn(0x559293092b00 msgr2=0x559293092f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.773+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1641715839 shutdown_connections 2024-09-12T16:52:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.773+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1641715839 wait complete. 2024-09-12T16:52:17.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 Processor -- start 2024-09-12T16:52:17.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 -- start start 2024-09-12T16:52:17.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x55929320a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559293025680 con 0x55929311f1f0 2024-09-12T16:52:17.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f77625e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x55929320a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f77625e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x55929320a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34038/0 (socket says 172.21.15.151:34038) 2024-09-12T16:52:17.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f77625e6640 1 -- 172.21.15.151:0/4132254776 learned_addr learned my addr 172.21.15.151:0/4132254776 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f77625e6640 1 -- 172.21.15.151:0/4132254776 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559292fa0da0 con 0x55929311f1f0 2024-09-12T16:52:17.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f77625e6640 1 --2- 172.21.15.151:0/4132254776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x55929320a8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7754001680 tx=0x7f7754001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789ac42d0f217ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7650608640 1 -- 172.21.15.151:0/4132254776 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754013420 con 0x55929311f1f0 2024-09-12T16:52:17.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7650608640 1 -- 172.21.15.151:0/4132254776 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77540135c0 con 0x55929311f1f0 2024-09-12T16:52:17.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7650608640 1 -- 172.21.15.151:0/4132254776 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77540138e0 con 0x55929311f1f0 2024-09-12T16:52:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 -- 172.21.15.151:0/4132254776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 msgr2=0x55929320a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/4132254776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x55929320a8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7754001680 tx=0x7f7754001b40 comp rx=0 tx=0).stop 2024-09-12T16:52:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 -- 172.21.15.151:0/4132254776 shutdown_connections 2024-09-12T16:52:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/4132254776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x55929320a8f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 -- 172.21.15.151:0/4132254776 >> 172.21.15.151:0/4132254776 conn(0x559293092b00 msgr2=0x559293206530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 -- 172.21.15.151:0/4132254776 shutdown_connections 2024-09-12T16:52:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.785+0000 7f7764ae09c0 1 -- 172.21.15.151:0/4132254776 wait complete. 2024-09-12T16:52:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7764ae09c0 1 Processor -- start 2024-09-12T16:52:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7764ae09c0 1 -- start start 2024-09-12T16:52:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7764ae09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x559293211fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7764ae09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559292fc7a50 con 0x55929311f1f0 2024-09-12T16:52:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f77625e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x559293211fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f77625e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x559293211fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34046/0 (socket says 172.21.15.151:34046) 2024-09-12T16:52:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f77625e6640 1 -- 172.21.15.151:0/2361773135 learned_addr learned my addr 172.21.15.151:0/2361773135 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f77625e6640 1 -- 172.21.15.151:0/2361773135 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559293212520 con 0x55929311f1f0 2024-09-12T16:52:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f77625e6640 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x559293211fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55929320b880 tx=0x7f7754000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f764ee05640 1 -- 172.21.15.151:0/2361773135 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77540037a0 con 0x55929311f1f0 2024-09-12T16:52:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592932127b0 con 0x55929311f1f0 2024-09-12T16:52:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f764ee05640 1 -- 172.21.15.151:0/2361773135 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7754023070 con 0x55929311f1f0 2024-09-12T16:52:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559293213160 con 0x55929311f1f0 2024-09-12T16:52:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f764ee05640 1 -- 172.21.15.151:0/2361773135 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754003940 con 0x55929311f1f0 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f764ee05640 1 -- 172.21.15.151:0/2361773135 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7754010070 con 0x55929311f1f0 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f764ee05640 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7648039a70 0x7f764803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f764ee05640 1 -- 172.21.15.151:0/2361773135 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f77540500c0 con 0x55929311f1f0 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7761de5640 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7648039a70 0x7f764803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559293123340 0x559293219130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293219670 con 0x559293123340 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7762de7640 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559293123340 0x559293219130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7761de5640 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7648039a70 0x7f764803bf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f77580ad000 tx=0x7f77580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.789+0000 7f7762de7640 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559293123340 0x559293219130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7762de7640 1 -- 172.21.15.151:0/2361773135 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f775c0083f0 con 0x559293123340 2024-09-12T16:52:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293219a70 con 0x559293123340 2024-09-12T16:52:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7762de7640 1 -- 172.21.15.151:0/2361773135 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f775c0083f0 con 0x559293123340 2024-09-12T16:52:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55929321b880 0x55929321dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55929321e340 con 0x55929321b880 2024-09-12T16:52:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f77625e6640 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55929321b880 0x55929321dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f77625e6640 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55929321b880 0x55929321dc70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f77625e6640 1 -- 172.21.15.151:0/2361773135 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f775400f030 con 0x55929321b880 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55929321a720 con 0x559293123340 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7762de7640 1 -- 172.21.15.151:0/2361773135 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f775c0083f0 con 0x559293123340 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55929321abc0 con 0x559293123340 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7762de7640 1 -- 172.21.15.151:0/2361773135 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f775c0083f0 con 0x559293123340 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 Processor -- start 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 -- start start 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929322c9b0 0x55929322cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7764ae09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559293032450 con 0x55929322c9b0 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7762de7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929322c9b0 0x55929322cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7762de7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929322c9b0 0x55929322cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34050/0 (socket says 172.21.15.151:34050) 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.793+0000 7f7762de7640 1 -- 172.21.15.151:0/2243635507 learned_addr learned my addr 172.21.15.151:0/2243635507 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7762de7640 1 -- 172.21.15.151:0/2243635507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929322d410 con 0x55929322c9b0 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7762de7640 1 --2- 172.21.15.151:0/2243635507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929322c9b0 0x55929322cdd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x559293214080 tx=0x7f775c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7647fff640 1 -- 172.21.15.151:0/2243635507 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c007e00 con 0x55929322c9b0 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7647fff640 1 -- 172.21.15.151:0/2243635507 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c01e020 con 0x55929322c9b0 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7647fff640 1 -- 172.21.15.151:0/2243635507 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c019590 con 0x55929322c9b0 2024-09-12T16:52:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2243635507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55929322dc70 con 0x55929322c9b0 2024-09-12T16:52:17.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2243635507 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929322e1e0 con 0x55929322c9b0 2024-09-12T16:52:17.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7647fff640 1 -- 172.21.15.151:0/2243635507 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f775c016040 con 0x55929322c9b0 2024-09-12T16:52:17.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7647fff640 1 --2- 172.21.15.151:0/2243635507 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f763c039a70 0x7f763c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7647fff640 1 -- 172.21.15.151:0/2243635507 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f775c01f030 con 0x55929322c9b0 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f77625e6640 1 --2- 172.21.15.151:0/2243635507 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f763c039a70 0x7f763c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7764ae09c0 1 Processor -- start 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f77625e6640 1 --2- 172.21.15.151:0/2243635507 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f763c039a70 0x7f763c03bf30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x559293213450 tx=0x7f7754029f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7764ae09c0 1 -- start start 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7764ae09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x55929323a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7764ae09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55929320b140 con 0x55929323a280 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7762de7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x55929323a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7762de7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x55929323a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34052/0 (socket says 172.21.15.151:34052) 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7762de7640 1 -- 172.21.15.151:0/1859107683 learned_addr learned my addr 172.21.15.151:0/1859107683 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7762de7640 1 -- 172.21.15.151:0/1859107683 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929323ac70 con 0x55929323a280 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.797+0000 7f7762de7640 1 --2- 172.21.15.151:0/1859107683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x55929323a680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f775c023fb0 tx=0x7f775c023970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c697cece96b8cf63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7645ffb640 1 -- 172.21.15.151:0/1859107683 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c01d040 con 0x55929323a280 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7645ffb640 1 -- 172.21.15.151:0/1859107683 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c017470 con 0x55929323a280 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7645ffb640 1 -- 172.21.15.151:0/1859107683 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c019d80 con 0x55929323a280 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1859107683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 msgr2=0x55929323a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1859107683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x55929323a680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f775c023fb0 tx=0x7f775c023970 comp rx=0 tx=0).stop 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1859107683 shutdown_connections 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1859107683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x55929323a680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1859107683 >> 172.21.15.151:0/1859107683 conn(0x5592932356a0 msgr2=0x5592932338e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1859107683 shutdown_connections 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1859107683 wait complete. 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 Processor -- start 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- start start 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x559293240720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5592932391d0 con 0x55929323a280 2024-09-12T16:52:17.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7762de7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x559293240720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7762de7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x559293240720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34066/0 (socket says 172.21.15.151:34066) 2024-09-12T16:52:17.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 learned_addr learned my addr 172.21.15.151:0/1066908870 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559293240c80 con 0x55929323a280 2024-09-12T16:52:17.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7762de7640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x559293240720 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f775c023fb0 tx=0x7f775c0508e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7633fff640 1 -- 172.21.15.151:0/1066908870 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c01d070 con 0x55929323a280 2024-09-12T16:52:17.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559293240f10 con 0x55929323a280 2024-09-12T16:52:17.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7633fff640 1 -- 172.21.15.151:0/1066908870 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c049040 con 0x55929323a280 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7633fff640 1 -- 172.21.15.151:0/1066908870 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c03c060 con 0x55929323a280 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592932418c0 con 0x55929323a280 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7633fff640 1 -- 172.21.15.151:0/1066908870 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f775c03ed10 con 0x55929323a280 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.801+0000 7f7633fff640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f762c039a70 0x7f762c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7633fff640 1 -- 172.21.15.151:0/1066908870 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f775c0401d0 con 0x55929323a280 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f77625e6640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f762c039a70 0x7f762c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55929324ba40 0x55929324ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55929324e620 con 0x55929324ba40 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7761de5640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55929324ba40 0x55929324ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f77625e6640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f762c039a70 0x7f762c03bf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f775404d290 tx=0x7f775404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7761de5640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55929324ba40 0x55929324ded0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 realm 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55929324ea50 con 0x55929324ba40 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55929324f320 con 0x55929324ba40 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55929324f6c0 con 0x55929324ba40 2024-09-12T16:52:17.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559293250420 0x559293252810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293252e20 con 0x559293250420 2024-09-12T16:52:17.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7762de7640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559293250420 0x559293252810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7762de7640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559293250420 0x559293252810 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 20 searching for the correct realm 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559293254d00 0x559293257170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f77625e6640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559293254d00 0x559293257170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f77625e6640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559293254d00 0x559293257170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f77625e6640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7754041650 0x7f7754041a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.805+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x7f7754041650 2024-09-12T16:52:17.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7754041650 0x7f7754041a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7754041650 0x7f7754041a90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x55929324ba40 2024-09-12T16:52:17.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x55929324ba40 2024-09-12T16:52:17.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x7f7754041650 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x55929324ba40 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.809+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x55929324ba40 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x7f7754041650 2024-09-12T16:52:17.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x55929324ba40 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x55929324ba40 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x7f7754041650 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.813+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x55929324ba40 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x7f7754041650 2024-09-12T16:52:17.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293254d00 2024-09-12T16:52:17.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x559293250420 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x55929324ba40 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559293257840 con 0x7f7754041650 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:17.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293253770 con 0x55929324ba40 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.817+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592932533b0 con 0x55929324ba40 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293254090 con 0x55929324ba40 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 zone default found 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 4 Realm: () 2024-09-12T16:52:17.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 zonegroup default 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592932540b0 con 0x559293250420 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293259be0 con 0x559293254d00 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293259f80 con 0x559293254d00 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 started sync module instance, tier type = 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559293259070 con 0x7f7754041650 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94088022300016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559293259070 con 0x7f7754041650 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325aab0 con 0x55929324ba40 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.821+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94088022300016] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.825+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.825+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94088022304128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559293259070 con 0x55929324ba40 2024-09-12T16:52:17.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.825+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325b4c0 con 0x559293254d00 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.825+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94088022304128] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.825+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.825+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94088022297536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559293258fe0 con 0x559293254d00 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.825+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325c210 con 0x7f7754041650 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94088022310544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325cab0 con 0x7f7754041650 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325d4b0 con 0x55929324ba40 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94088022297536] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94088022310544] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94088022309040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325c590 con 0x55929324ba40 2024-09-12T16:52:17.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325dd50 con 0x559293250420 2024-09-12T16:52:17.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.829+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94088022309040] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.833+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.833+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94088022317216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325c590 con 0x559293250420 2024-09-12T16:52:17.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.833+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325e5a0 con 0x559293250420 2024-09-12T16:52:17.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.833+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.833+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94088022319344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325e9c0 con 0x559293250420 2024-09-12T16:52:17.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.833+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325f4c0 con 0x559293250420 2024-09-12T16:52:17.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.833+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94088022317216] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.833+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94088022319344] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94088022323120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325e550 con 0x559293250420 2024-09-12T16:52:17.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 20 add_watcher() i=0 2024-09-12T16:52:17.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 20 add_watcher() i=1 2024-09-12T16:52:17.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 20 add_watcher() i=2 2024-09-12T16:52:17.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 20 add_watcher() i=3 2024-09-12T16:52:17.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 20 add_watcher() i=4 2024-09-12T16:52:17.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 20 add_watcher() i=5 2024-09-12T16:52:17.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 20 add_watcher() i=6 2024-09-12T16:52:17.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94088022323120] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 20 add_watcher() i=7 2024-09-12T16:52:17.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:17.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592932625c0 con 0x55929324ba40 2024-09-12T16:52:17.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.837+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94088022314944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325fa40 con 0x55929324ba40 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94088022314944] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f76197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 5 note: GC not initialized 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f76137fe640 20 reqs_thread_entry: start 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 20 Filter name: none 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f76117fa640 20 reqs_thread_entry: start 2024-09-12T16:52:17.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:17.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293285610 con 0x55929324ba40 2024-09-12T16:52:17.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-12T16:52:17.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:17.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:17.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929328bbd0 con 0x55929324ba40 2024-09-12T16:52:17.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:17.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94088022505152 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293287320 con 0x55929324ba40 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94088022309040 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x559292fc5ca0 con 0x55929324ba40 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7645ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94088022309040 notifier 4355 bl.length()=567 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7645ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7645ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7645ffb640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7628003eb0 con 0x55929324ba40 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(64 notify.4 [notify cookie 94088022505152 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94088022505152 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f77580bfca0 con 0x55929324ba40 2024-09-12T16:52:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.841+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929328b6c0 con 0x559293250420 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f7764ae09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94088022505152 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559293286e70 con 0x559293254d00 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== watch-notify(notify (1) cookie 94088022297536 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x559293213160 con 0x559293254d00 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f76457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94088022297536 notifier 4355 bl.length()=170 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f76457fa640 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f758c0032d0 con 0x559293254d00 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 notify.2 [notify cookie 94088022505152 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== watch-notify(notify_complete (2) cookie 94088022505152 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5592932127b0 con 0x559293254d00 2024-09-12T16:52:17.849 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:17.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f76197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:17.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94088022314944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592932833a0 con 0x55929324ba40 2024-09-12T16:52:17.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94088022314944] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.845+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94088022300016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592932833a0 con 0x7f7754041650 2024-09-12T16:52:17.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.849+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94088022300016] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.849+0000 7f7764ae09c0 20 remove_watcher() i=0 2024-09-12T16:52:17.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.849+0000 7f7764ae09c0 2 removed watcher, disabling cache 2024-09-12T16:52:17.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.849+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94088022304128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592932833a0 con 0x55929324ba40 2024-09-12T16:52:17.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.849+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94088022304128] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.849+0000 7f7764ae09c0 20 remove_watcher() i=1 2024-09-12T16:52:17.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.849+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94088022297536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325a580 con 0x559293254d00 2024-09-12T16:52:17.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f77625e6640 1 -- 172.21.15.151:0/1066908870 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94088022297536] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775403b070 con 0x559293254d00 2024-09-12T16:52:17.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f7764ae09c0 20 remove_watcher() i=2 2024-09-12T16:52:17.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94088022310544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592932833a0 con 0x7f7754041650 2024-09-12T16:52:17.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94088022310544] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x7f7754041650 2024-09-12T16:52:17.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f7764ae09c0 20 remove_watcher() i=3 2024-09-12T16:52:17.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94088022309040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559293258bc0 con 0x55929324ba40 2024-09-12T16:52:17.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94088022309040] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77580a99f0 con 0x55929324ba40 2024-09-12T16:52:17.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f7764ae09c0 20 remove_watcher() i=4 2024-09-12T16:52:17.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.853+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94088022317216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325a580 con 0x559293250420 2024-09-12T16:52:17.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.857+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94088022317216] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.857+0000 7f7764ae09c0 20 remove_watcher() i=5 2024-09-12T16:52:17.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.857+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94088022319344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55929325be90 con 0x559293250420 2024-09-12T16:52:17.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.857+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94088022319344] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.857+0000 7f7764ae09c0 20 remove_watcher() i=6 2024-09-12T16:52:17.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.857+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94088022323120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592932833a0 con 0x559293250420 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7762de7640 1 -- 172.21.15.151:0/1066908870 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94088022323120] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c03e070 con 0x559293250420 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 20 remove_watcher() i=7 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559293250420 msgr2=0x559293252810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559293250420 0x559293252810 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55929324ba40 msgr2=0x55929324ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55929324ba40 0x55929324ded0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7754041650 msgr2=0x7f7754041a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7754041650 0x7f7754041a90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559293254d00 msgr2=0x559293257170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559293254d00 0x559293257170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f762c039a70 msgr2=0x7f762c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f762c039a70 0x7f762c03bf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f775404d290 tx=0x7f775404f000 comp rx=0 tx=0).stop 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7761de5640 1 -- 172.21.15.151:0/1066908870 reap_dead start 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 msgr2=0x559293240720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x559293240720 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f775c023fb0 tx=0x7f775c0508e0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 shutdown_connections 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/1066908870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929323a280 0x559293240720 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 >> 172.21.15.151:0/1066908870 conn(0x5592932356a0 msgr2=0x5592932338b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 shutdown_connections 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/1066908870 wait complete. 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2243635507 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f763c039a70 msgr2=0x7f763c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2243635507 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f763c039a70 0x7f763c03bf30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x559293213450 tx=0x7f7754029f90 comp rx=0 tx=0).stop 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2243635507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929322c9b0 msgr2=0x55929322cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2243635507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929322c9b0 0x55929322cdd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x559293214080 tx=0x7f775c00af40 comp rx=0 tx=0).stop 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2243635507 shutdown_connections 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2243635507 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f763c039a70 0x7f763c03bf30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2243635507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929322c9b0 0x55929322cdd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2243635507 >> 172.21.15.151:0/2243635507 conn(0x559293222360 msgr2=0x559293222740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2243635507 shutdown_connections 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2243635507 wait complete. 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55929321b880 msgr2=0x55929321dc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55929321b880 0x55929321dc70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559293123340 msgr2=0x559293219130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559293123340 0x559293219130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7648039a70 msgr2=0x7f764803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7648039a70 0x7f764803bf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f77580ad000 tx=0x7f77580a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:17.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 msgr2=0x559293211fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x559293211fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55929320b880 tx=0x7f7754000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 shutdown_connections 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55929321b880 0x55929321dc70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559293123340 0x559293219130 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7648039a70 0x7f764803bf30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 --2- 172.21.15.151:0/2361773135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55929311f1f0 0x559293211fc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 >> 172.21.15.151:0/2361773135 conn(0x559293092b00 msgr2=0x559293204fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 shutdown_connections 2024-09-12T16:52:17.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.861+0000 7f7764ae09c0 1 -- 172.21.15.151:0/2361773135 wait complete. 2024-09-12T16:52:17.874 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:17.874 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-12T16:52:17.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-12T16:52:17.875 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-12T16:52:17.953 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:17.953 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:17.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.949+0000 7f4680ec59c0 1 Processor -- start 2024-09-12T16:52:17.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.949+0000 7f4680ec59c0 1 -- start start 2024-09-12T16:52:17.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f4680ec59c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56446b696140 0x56446b698530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f4680ec59c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56446b5469c0 con 0x56446b691fa0 2024-09-12T16:52:17.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f4680ec59c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56446b5966d0 con 0x56446b696140 2024-09-12T16:52:17.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467e1ca640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56446b696140 0x56446b698530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467e1ca640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56446b696140 0x56446b698530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34080/0 (socket says 172.21.15.151:34080) 2024-09-12T16:52:17.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467e1ca640 1 -- 172.21.15.151:0/3506426066 learned_addr learned my addr 172.21.15.151:0/3506426066 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467e9cb640 1 --1- 172.21.15.151:0/3506426066 >> v1:172.21.15.122:6789/0 conn(0x56446b691fa0 0x56446b692380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38114/0 (socket says 172.21.15.151:38114) 2024-09-12T16:52:17.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467e1ca640 1 -- 172.21.15.151:0/3506426066 >> v1:172.21.15.122:6789/0 conn(0x56446b691fa0 legacy=0x56446b692380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467e1ca640 1 -- 172.21.15.151:0/3506426066 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446b53aca0 con 0x56446b696140 2024-09-12T16:52:17.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467e1ca640 1 --2- 172.21.15.151:0/3506426066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b696140 0x56446b698530 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f466800a5c0 tx=0x7f466801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284a9db0d4439325 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467d9c9640 1 -- 172.21.15.151:0/3506426066 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46680a9590 con 0x56446b696140 2024-09-12T16:52:17.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467d9c9640 1 -- 172.21.15.151:0/3506426066 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46680ae070 con 0x56446b696140 2024-09-12T16:52:17.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f467d9c9640 1 -- 172.21.15.151:0/3506426066 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46680a9880 con 0x56446b696140 2024-09-12T16:52:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3506426066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b696140 msgr2=0x56446b698530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.953+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/3506426066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b696140 0x56446b698530 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f466800a5c0 tx=0x7f466801b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.957+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3506426066 shutdown_connections 2024-09-12T16:52:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.957+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/3506426066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b696140 0x56446b698530 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.957+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3506426066 >> 172.21.15.151:0/3506426066 conn(0x56446b68dac0 msgr2=0x56446b68fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.957+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3506426066 shutdown_connections 2024-09-12T16:52:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.957+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3506426066 wait complete. 2024-09-12T16:52:17.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 Processor -- start 2024-09-12T16:52:17.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 -- start start 2024-09-12T16:52:17.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b77d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56446b59a680 con 0x56446b691fa0 2024-09-12T16:52:17.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f467e9cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b77d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f467e9cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b77d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34094/0 (socket says 172.21.15.151:34094) 2024-09-12T16:52:17.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f467e9cb640 1 -- 172.21.15.151:0/2103747335 learned_addr learned my addr 172.21.15.151:0/2103747335 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f467e9cb640 1 -- 172.21.15.151:0/2103747335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446b515da0 con 0x56446b691fa0 2024-09-12T16:52:17.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f467e9cb640 1 --2- 172.21.15.151:0/2103747335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b77d6d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4678001ec0 tx=0x7f467800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939ec5466ada7cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f456ce09640 1 -- 172.21.15.151:0/2103747335 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f467800e5d0 con 0x56446b691fa0 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f456ce09640 1 -- 172.21.15.151:0/2103747335 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467800e770 con 0x56446b691fa0 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f456ce09640 1 -- 172.21.15.151:0/2103747335 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f467800ea70 con 0x56446b691fa0 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 -- 172.21.15.151:0/2103747335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 msgr2=0x56446b77d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/2103747335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b77d6d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4678001ec0 tx=0x7f467800b6d0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 -- 172.21.15.151:0/2103747335 shutdown_connections 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/2103747335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b77d6d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 -- 172.21.15.151:0/2103747335 >> 172.21.15.151:0/2103747335 conn(0x56446b68dac0 msgr2=0x56446b779370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 -- 172.21.15.151:0/2103747335 shutdown_connections 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.969+0000 7f4680ec59c0 1 -- 172.21.15.151:0/2103747335 wait complete. 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f4680ec59c0 1 Processor -- start 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f4680ec59c0 1 -- start start 2024-09-12T16:52:17.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f4680ec59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b784d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f4680ec59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56446b53ca50 con 0x56446b691fa0 2024-09-12T16:52:17.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f467e9cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b784d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f467e9cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b784d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34098/0 (socket says 172.21.15.151:34098) 2024-09-12T16:52:17.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f467e9cb640 1 -- 172.21.15.151:0/791147708 learned_addr learned my addr 172.21.15.151:0/791147708 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f467e9cb640 1 -- 172.21.15.151:0/791147708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446b7852a0 con 0x56446b691fa0 2024-09-12T16:52:17.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f467e9cb640 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b784d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f467800b710 tx=0x7f4678000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f456b606640 1 -- 172.21.15.151:0/791147708 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f467800f820 con 0x56446b691fa0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f456b606640 1 -- 172.21.15.151:0/791147708 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467800f9c0 con 0x56446b691fa0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56446b785530 con 0x56446b691fa0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f456b606640 1 -- 172.21.15.151:0/791147708 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f467800fd20 con 0x56446b691fa0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446b785ee0 con 0x56446b691fa0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f456b606640 1 -- 172.21.15.151:0/791147708 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4678017070 con 0x56446b691fa0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f456b606640 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4564039a70 0x7f456403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f456b606640 1 -- 172.21.15.151:0/791147708 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4678015020 con 0x56446b691fa0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f467e1ca640 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4564039a70 0x7f456403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b696140 0x56446b78beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b78c3f0 con 0x56446b696140 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f467f1cc640 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b696140 0x56446b78beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.973+0000 7f467e1ca640 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4564039a70 0x7f456403bf30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46680ad000 tx=0x7f46680a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467f1cc640 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b696140 0x56446b78beb0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467f1cc640 1 -- 172.21.15.151:0/791147708 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f467000a4d0 con 0x56446b696140 2024-09-12T16:52:17.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b78c840 con 0x56446b696140 2024-09-12T16:52:17.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467f1cc640 1 -- 172.21.15.151:0/791147708 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f467000a4d0 con 0x56446b696140 2024-09-12T16:52:17.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b78e650 0x56446b790a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b791110 con 0x56446b78e650 2024-09-12T16:52:17.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467e9cb640 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b78e650 0x56446b790a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467e9cb640 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b78e650 0x56446b790a40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467e9cb640 1 -- 172.21.15.151:0/791147708 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f467802e070 con 0x56446b78e650 2024-09-12T16:52:17.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b78d4f0 con 0x56446b696140 2024-09-12T16:52:17.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467f1cc640 1 -- 172.21.15.151:0/791147708 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f467000a4d0 con 0x56446b696140 2024-09-12T16:52:17.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b78d990 con 0x56446b696140 2024-09-12T16:52:17.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467f1cc640 1 -- 172.21.15.151:0/791147708 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f467000a4d0 con 0x56446b696140 2024-09-12T16:52:17.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 Processor -- start 2024-09-12T16:52:17.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 -- start start 2024-09-12T16:52:17.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b79f780 0x56446b79fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f4680ec59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56446b5a7450 con 0x56446b79f780 2024-09-12T16:52:17.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467f1cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b79f780 0x56446b79fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467f1cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b79f780 0x56446b79fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34100/0 (socket says 172.21.15.151:34100) 2024-09-12T16:52:17.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.977+0000 7f467f1cc640 1 -- 172.21.15.151:0/3392006484 learned_addr learned my addr 172.21.15.151:0/3392006484 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467f1cc640 1 -- 172.21.15.151:0/3392006484 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446b7a01e0 con 0x56446b79f780 2024-09-12T16:52:17.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467f1cc640 1 --2- 172.21.15.151:0/3392006484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b79f780 0x56446b79fba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56446b786e60 tx=0x7f4670018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4568e01640 1 -- 172.21.15.151:0/3392006484 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670014450 con 0x56446b79f780 2024-09-12T16:52:17.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4568e01640 1 -- 172.21.15.151:0/3392006484 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46700145f0 con 0x56446b79f780 2024-09-12T16:52:17.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3392006484 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56446b7a0a40 con 0x56446b79f780 2024-09-12T16:52:17.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4568e01640 1 -- 172.21.15.151:0/3392006484 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670014910 con 0x56446b79f780 2024-09-12T16:52:17.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3392006484 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446b7a0fb0 con 0x56446b79f780 2024-09-12T16:52:17.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4568e01640 1 -- 172.21.15.151:0/3392006484 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4670011040 con 0x56446b79f780 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4568e01640 1 --2- 172.21.15.151:0/3392006484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4558039a70 0x7f455803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4568e01640 1 -- 172.21.15.151:0/3392006484 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f467001e070 con 0x56446b79f780 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467e9cb640 1 --2- 172.21.15.151:0/3392006484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4558039a70 0x7f455803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4680ec59c0 1 Processor -- start 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4680ec59c0 1 -- start start 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467e9cb640 1 --2- 172.21.15.151:0/3392006484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4558039a70 0x7f455803bf30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x56446b7861d0 tx=0x7f4678044040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4680ec59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b6078e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f4680ec59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56446b77df00 con 0x56446b6074e0 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467f1cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b6078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467f1cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b6078e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34110/0 (socket says 172.21.15.151:34110) 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467f1cc640 1 -- 172.21.15.151:0/3692063798 learned_addr learned my addr 172.21.15.151:0/3692063798 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467f1cc640 1 -- 172.21.15.151:0/3692063798 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446b607e20 con 0x56446b6074e0 2024-09-12T16:52:17.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.981+0000 7f467f1cc640 1 --2- 172.21.15.151:0/3692063798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b6078e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4670022e70 tx=0x7f46700118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136043e65c92e9a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f45627fc640 1 -- 172.21.15.151:0/3692063798 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670052110 con 0x56446b6074e0 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f45627fc640 1 -- 172.21.15.151:0/3692063798 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4670016940 con 0x56446b6074e0 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f45627fc640 1 -- 172.21.15.151:0/3692063798 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46700495d0 con 0x56446b6074e0 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3692063798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 msgr2=0x56446b6078e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/3692063798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b6078e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4670022e70 tx=0x7f46700118e0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3692063798 shutdown_connections 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/3692063798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b6078e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3692063798 >> 172.21.15.151:0/3692063798 conn(0x56446b7a84d0 msgr2=0x56446b7a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3692063798 shutdown_connections 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3692063798 wait complete. 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 Processor -- start 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 -- start start 2024-09-12T16:52:17.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b7b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f4680ec59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56446b6083a0 con 0x56446b6074e0 2024-09-12T16:52:17.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f467f1cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b7b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f467f1cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b7b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34120/0 (socket says 172.21.15.151:34120) 2024-09-12T16:52:17.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 learned_addr learned my addr 172.21.15.151:0/683604692 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:17.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446b7b5d10 con 0x56446b6074e0 2024-09-12T16:52:17.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.985+0000 7f467f1cc640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b7b57b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f467004b010 tx=0x7f4670050690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4560ff9640 1 -- 172.21.15.151:0/683604692 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670052110 con 0x56446b6074e0 2024-09-12T16:52:17.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4560ff9640 1 -- 172.21.15.151:0/683604692 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4670050a50 con 0x56446b6074e0 2024-09-12T16:52:17.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4560ff9640 1 -- 172.21.15.151:0/683604692 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4670011a20 con 0x56446b6074e0 2024-09-12T16:52:17.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56446b7b5fa0 con 0x56446b6074e0 2024-09-12T16:52:17.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446b7b6950 con 0x56446b6074e0 2024-09-12T16:52:17.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4560ff9640 1 -- 172.21.15.151:0/683604692 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f467003e3f0 con 0x56446b6074e0 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4560ff9640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4548039ac0 0x7f454803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4560ff9640 1 -- 172.21.15.151:0/683604692 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4670048050 con 0x56446b6074e0 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f467e9cb640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4548039ac0 0x7f454803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b7c0b30 0x56446b7c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c36f0 con 0x56446b7c0b30 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f467e1ca640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b7c0b30 0x56446b7c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.989+0000 7f467e9cb640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4548039ac0 0x7f454803bf80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4678048230 tx=0x7f4678046000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e1ca640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b7c0b30 0x56446b7c2fa0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 realm 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c3b20 con 0x56446b7c0b30 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c43f0 con 0x56446b7c0b30 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c4790 con 0x56446b7c0b30 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:17.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b7c54f0 0x56446b7c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c7ef0 con 0x56446b7c54f0 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467f1cc640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b7c54f0 0x56446b7c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467f1cc640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b7c54f0 0x56446b7c78e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 20 searching for the correct realm 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56446b7c9dd0 0x56446b7cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e9cb640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56446b7c9dd0 0x56446b7cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e9cb640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56446b7c9dd0 0x56446b7cc240 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e9cb640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f4678059040 0x7f467801d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x7f4678059040 2024-09-12T16:52:18.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e1ca640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f4678059040 0x7f467801d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.993+0000 7f467e1ca640 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f4678059040 0x7f467801d7f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c0b30 2024-09-12T16:52:18.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c0b30 2024-09-12T16:52:18.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x7f4678059040 2024-09-12T16:52:18.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c0b30 2024-09-12T16:52:18.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:17.997+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c0b30 2024-09-12T16:52:18.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x7f4678059040 2024-09-12T16:52:18.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c0b30 2024-09-12T16:52:18.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c0b30 2024-09-12T16:52:18.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x7f4678059040 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.001+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c0b30 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x7f4678059040 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c9dd0 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c54f0 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x56446b7c0b30 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cc910 con 0x7f4678059040 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c8840 con 0x56446b7c0b30 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.005+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c8480 con 0x56446b7c0b30 2024-09-12T16:52:18.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c9160 con 0x56446b7c0b30 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 zone default found 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 4 Realm: () 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:18.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 zonegroup default 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7c9160 con 0x56446b7c54f0 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cecb0 con 0x56446b7c9dd0 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cf050 con 0x56446b7c9dd0 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 started sync module instance, tier type = 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7ce140 con 0x7f4678059040 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94851861112384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7ce140 con 0x7f4678059040 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7cfb60 con 0x56446b7c0b30 2024-09-12T16:52:18.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.009+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94851861112384] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.013+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.013+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94851861116464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7ce140 con 0x56446b7c0b30 2024-09-12T16:52:18.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.013+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d0570 con 0x56446b7c9dd0 2024-09-12T16:52:18.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.013+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.013+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94851861119168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d0e10 con 0x56446b7c9dd0 2024-09-12T16:52:18.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.013+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d17d0 con 0x7f4678059040 2024-09-12T16:52:18.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.013+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94851861116464] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.017+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94851861119168] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.017+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.017+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94851861109904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d0a70 con 0x7f4678059040 2024-09-12T16:52:18.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.017+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d17d0 con 0x56446b7c0b30 2024-09-12T16:52:18.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.017+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94851861109904] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.017+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.017+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94851861126624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d17d0 con 0x56446b7c0b30 2024-09-12T16:52:18.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.017+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d2980 con 0x56446b7c54f0 2024-09-12T16:52:18.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.021+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94851861126624] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.021+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.021+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94851861123872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d1740 con 0x56446b7c54f0 2024-09-12T16:52:18.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.021+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d3680 con 0x56446b7c54f0 2024-09-12T16:52:18.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.021+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.021+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94851861131728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d3aa0 con 0x56446b7c54f0 2024-09-12T16:52:18.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.021+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d4510 con 0x56446b7c54f0 2024-09-12T16:52:18.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.021+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94851861123872] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94851861131728] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94851861135328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d35f0 con 0x56446b7c54f0 2024-09-12T16:52:18.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 add_watcher() i=0 2024-09-12T16:52:18.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 add_watcher() i=1 2024-09-12T16:52:18.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 add_watcher() i=2 2024-09-12T16:52:18.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 add_watcher() i=3 2024-09-12T16:52:18.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 add_watcher() i=4 2024-09-12T16:52:18.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 add_watcher() i=5 2024-09-12T16:52:18.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 add_watcher() i=6 2024-09-12T16:52:18.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94851861135328] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 add_watcher() i=7 2024-09-12T16:52:18.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:18.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d7610 con 0x56446b7c0b30 2024-09-12T16:52:18.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94851861130528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d4a90 con 0x56446b7c0b30 2024-09-12T16:52:18.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94851861130528] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f45357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:18.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:18.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 5 note: GC not initialized 2024-09-12T16:52:18.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f44affff640 20 reqs_thread_entry: start 2024-09-12T16:52:18.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.025+0000 7f4680ec59c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:18.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 20 Filter name: none 2024-09-12T16:52:18.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f44adffb640 20 reqs_thread_entry: start 2024-09-12T16:52:18.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:18.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7fa6b0 con 0x56446b7c0b30 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7fb120 con 0x56446b7c0b30 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b800a10 con 0x56446b7c0b30 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94851861316864 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7fc130 con 0x56446b7c0b30 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify (1) cookie 94851861126624 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x56446b53aca0 con 0x56446b7c0b30 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f45627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94851861126624 notifier 4362 bl.length()=732 2024-09-12T16:52:18.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f45627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:18.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f45627fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(65 notify.4 [notify cookie 94851861316864 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f45627fc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4544003eb0 con 0x56446b7c0b30 2024-09-12T16:52:18.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== watch-notify(notify_complete (2) cookie 94851861316864 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f46680d8400 con 0x56446b7c0b30 2024-09-12T16:52:18.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b800500 con 0x56446b7c0b30 2024-09-12T16:52:18.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.029+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94851861316864 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56446b7fbc80 con 0x7f4678059040 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== watch-notify(notify (1) cookie 94851861112384 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f46680d8400 con 0x7f4678059040 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f45627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94851861112384 notifier 4362 bl.length()=166 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f45627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f45627fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.0 [notify cookie 94851861316864 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f45627fc640 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4544003eb0 con 0x7f4678059040 2024-09-12T16:52:18.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== watch-notify(notify_complete (2) cookie 94851861316864 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f46680d87b0 con 0x7f4678059040 2024-09-12T16:52:18.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.046 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"VtIchVSOs8xcUvVLNYXsDcwqIuHIct5p4AGkFA0a","active":true,"create_date":"2024-09-12T16:52:18.031193Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f45357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94851861130528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7f8490 con 0x56446b7c0b30 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94851861130528] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94851861112384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7f8490 con 0x7f4678059040 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94851861112384] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f4680ec59c0 20 remove_watcher() i=0 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f4680ec59c0 2 removed watcher, disabling cache 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.033+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94851861116464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7ce640 con 0x56446b7c0b30 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.037+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94851861116464] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.037+0000 7f4680ec59c0 20 remove_watcher() i=1 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.037+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94851861119168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7f8490 con 0x56446b7c9dd0 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.037+0000 7f467e9cb640 1 -- 172.21.15.151:0/683604692 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94851861119168] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4678056040 con 0x56446b7c9dd0 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.037+0000 7f4680ec59c0 20 remove_watcher() i=2 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.037+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94851861109904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7ce640 con 0x7f4678059040 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.041+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94851861109904] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x7f4678059040 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.041+0000 7f4680ec59c0 20 remove_watcher() i=3 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.041+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94851861126624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d00c0 con 0x56446b7c0b30 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.041+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94851861126624] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46680a99f0 con 0x56446b7c0b30 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.041+0000 7f4680ec59c0 20 remove_watcher() i=4 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.041+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94851861123872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7ce640 con 0x56446b7c54f0 2024-09-12T16:52:18.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.045+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94851861123872] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.045+0000 7f4680ec59c0 20 remove_watcher() i=5 2024-09-12T16:52:18.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.045+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94851861131728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d00c0 con 0x56446b7c54f0 2024-09-12T16:52:18.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.045+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94851861131728] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.045+0000 7f4680ec59c0 20 remove_watcher() i=6 2024-09-12T16:52:18.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.045+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94851861135328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56446b7d1320 con 0x56446b7c54f0 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f467f1cc640 1 -- 172.21.15.151:0/683604692 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94851861135328] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f467002a070 con 0x56446b7c54f0 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 20 remove_watcher() i=7 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b7c54f0 msgr2=0x56446b7c78e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b7c54f0 0x56446b7c78e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b7c0b30 msgr2=0x56446b7c2fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b7c0b30 0x56446b7c2fa0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f4678059040 msgr2=0x7f467801d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f4678059040 0x7f467801d7f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56446b7c9dd0 msgr2=0x56446b7cc240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56446b7c9dd0 0x56446b7cc240 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4548039ac0 msgr2=0x7f454803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4548039ac0 0x7f454803bf80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4678048230 tx=0x7f4678046000 comp rx=0 tx=0).stop 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 msgr2=0x56446b7b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f467e1ca640 1 -- 172.21.15.151:0/683604692 reap_dead start 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b7b57b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f467004b010 tx=0x7f4670050690 comp rx=0 tx=0).stop 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 shutdown_connections 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/683604692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b6074e0 0x56446b7b57b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 >> 172.21.15.151:0/683604692 conn(0x56446b7a84d0 msgr2=0x56446b7a66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 shutdown_connections 2024-09-12T16:52:18.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/683604692 wait complete. 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3392006484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4558039a70 msgr2=0x7f455803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/3392006484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4558039a70 0x7f455803bf30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x56446b7861d0 tx=0x7f4678044040 comp rx=0 tx=0).stop 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3392006484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b79f780 msgr2=0x56446b79fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/3392006484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b79f780 0x56446b79fba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56446b786e60 tx=0x7f4670018830 comp rx=0 tx=0).stop 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3392006484 shutdown_connections 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/3392006484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4558039a70 0x7f455803bf30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/3392006484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b79f780 0x56446b79fba0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3392006484 >> 172.21.15.151:0/3392006484 conn(0x56446b795130 msgr2=0x56446b795510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3392006484 shutdown_connections 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/3392006484 wait complete. 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b78e650 msgr2=0x56446b790a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b78e650 0x56446b790a40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b696140 msgr2=0x56446b78beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b696140 0x56446b78beb0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4564039a70 msgr2=0x7f456403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4564039a70 0x7f456403bf30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46680ad000 tx=0x7f46680a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 msgr2=0x56446b784d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b784d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f467800b710 tx=0x7f4678000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 shutdown_connections 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56446b78e650 0x56446b790a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56446b696140 0x56446b78beb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f4564039a70 0x7f456403bf30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 --2- 172.21.15.151:0/791147708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56446b691fa0 0x56446b784d40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 >> 172.21.15.151:0/791147708 conn(0x56446b68dac0 msgr2=0x56446b777e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 shutdown_connections 2024-09-12T16:52:18.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.049+0000 7f4680ec59c0 1 -- 172.21.15.151:0/791147708 wait complete. 2024-09-12T16:52:18.061 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'VtIchVSOs8xcUvVLNYXsDcwqIuHIct5p4AGkFA0a', 'active': True, 'create_date': '2024-09-12T16:52:18.031193Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:18.062 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-12T16:52:18.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-12T16:52:18.062 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-12T16:52:18.143 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:18.144 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:18.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85ee0699c0 1 Processor -- start 2024-09-12T16:52:18.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85ee0699c0 1 -- start start 2024-09-12T16:52:18.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85ee0699c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55beb02cf1c0 0x55beb035db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85ee0699c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55beb020f9c0 con 0x55beb035e0b0 2024-09-12T16:52:18.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85ee0699c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55beb025f6d0 con 0x55beb02cf1c0 2024-09-12T16:52:18.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85ebb6f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55beb02cf1c0 0x55beb035db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85eb36e640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55beb035e0b0 0x55beb03604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38116/0 (socket says 172.21.15.151:38116) 2024-09-12T16:52:18.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85eb36e640 1 -- 172.21.15.151:0/1147112718 learned_addr learned my addr 172.21.15.151:0/1147112718 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:18.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85ebb6f640 1 -- 172.21.15.151:0/1147112718 >> v1:172.21.15.122:6789/0 conn(0x55beb035e0b0 legacy=0x55beb03604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.141+0000 7f85ebb6f640 1 -- 172.21.15.151:0/1147112718 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb0203ca0 con 0x55beb02cf1c0 2024-09-12T16:52:18.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/1147112718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb035db70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00a480 tx=0x7f85dc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7ae455525e7431 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85eab6d640 1 -- 172.21.15.151:0/1147112718 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85dc0af070 con 0x55beb02cf1c0 2024-09-12T16:52:18.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85eab6d640 1 -- 172.21.15.151:0/1147112718 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc0aa530 con 0x55beb02cf1c0 2024-09-12T16:52:18.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85eab6d640 1 -- 172.21.15.151:0/1147112718 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85dc0aa830 con 0x55beb02cf1c0 2024-09-12T16:52:18.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85ee0699c0 1 -- 172.21.15.151:0/1147112718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 msgr2=0x55beb035db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/1147112718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb035db70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00a480 tx=0x7f85dc01b280 comp rx=0 tx=0).stop 2024-09-12T16:52:18.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85ee0699c0 1 -- 172.21.15.151:0/1147112718 shutdown_connections 2024-09-12T16:52:18.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/1147112718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb035db70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85ee0699c0 1 -- 172.21.15.151:0/1147112718 >> 172.21.15.151:0/1147112718 conn(0x55beb03558a0 msgr2=0x55beb0357cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85ee0699c0 1 -- 172.21.15.151:0/1147112718 shutdown_connections 2024-09-12T16:52:18.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.145+0000 7f85ee0699c0 1 -- 172.21.15.151:0/1147112718 wait complete. 2024-09-12T16:52:18.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.157+0000 7f85ee0699c0 1 Processor -- start 2024-09-12T16:52:18.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.157+0000 7f85ee0699c0 1 -- start start 2024-09-12T16:52:18.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb0446820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55beb0263680 con 0x55beb02cf1c0 2024-09-12T16:52:18.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb0446820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb0446820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34132/0 (socket says 172.21.15.151:34132) 2024-09-12T16:52:18.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3658646954 learned_addr learned my addr 172.21.15.151:0/3658646954 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3658646954 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb01deda0 con 0x55beb02cf1c0 2024-09-12T16:52:18.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3658646954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb0446820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ad040 tx=0x7f85dc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe3d535cdf8b329 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f84d9e0b640 1 -- 172.21.15.151:0/3658646954 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85dc0af070 con 0x55beb02cf1c0 2024-09-12T16:52:18.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f84d9e0b640 1 -- 172.21.15.151:0/3658646954 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc0b0040 con 0x55beb02cf1c0 2024-09-12T16:52:18.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f84d9e0b640 1 -- 172.21.15.151:0/3658646954 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85dc0aa830 con 0x55beb02cf1c0 2024-09-12T16:52:18.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3658646954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 msgr2=0x55beb0446820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3658646954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb0446820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ad040 tx=0x7f85dc003030 comp rx=0 tx=0).stop 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3658646954 shutdown_connections 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3658646954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb0446820 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3658646954 >> 172.21.15.151:0/3658646954 conn(0x55beb03558a0 msgr2=0x55beb0442460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3658646954 shutdown_connections 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3658646954 wait complete. 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 Processor -- start 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 -- start start 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb044dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ee0699c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55beb0205a50 con 0x55beb02cf1c0 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb044dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb044dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34138/0 (socket says 172.21.15.151:34138) 2024-09-12T16:52:18.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3196718719 learned_addr learned my addr 172.21.15.151:0/3196718719 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.161+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3196718719 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb044e2b0 con 0x55beb02cf1c0 2024-09-12T16:52:18.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb044dd50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f85dc01bb20 tx=0x7f85dc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f84d3fff640 1 -- 172.21.15.151:0/3196718719 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85dc0c4020 con 0x55beb02cf1c0 2024-09-12T16:52:18.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55beb044e540 con 0x55beb02cf1c0 2024-09-12T16:52:18.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f84d3fff640 1 -- 172.21.15.151:0/3196718719 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc0b6690 con 0x55beb02cf1c0 2024-09-12T16:52:18.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beb044eef0 con 0x55beb02cf1c0 2024-09-12T16:52:18.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f84d3fff640 1 -- 172.21.15.151:0/3196718719 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85dc0b6970 con 0x55beb02cf1c0 2024-09-12T16:52:18.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f84d3fff640 1 -- 172.21.15.151:0/3196718719 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85dc0c7020 con 0x55beb02cf1c0 2024-09-12T16:52:18.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f84d3fff640 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84d4039a70 0x7f84d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f84d3fff640 1 -- 172.21.15.151:0/3196718719 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85dc0bb070 con 0x55beb02cf1c0 2024-09-12T16:52:18.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85eb36e640 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84d4039a70 0x7f84d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb035e0b0 0x55beb0454ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0455400 con 0x55beb035e0b0 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ec370640 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb035e0b0 0x55beb0454ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85eb36e640 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84d4039a70 0x7f84d403bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85e0004180 tx=0x7f85e0001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ec370640 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb035e0b0 0x55beb0454ec0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ec370640 1 -- 172.21.15.151:0/3196718719 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85e400a4d0 con 0x55beb035e0b0 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0455840 con 0x55beb035e0b0 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ec370640 1 -- 172.21.15.151:0/3196718719 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85e400a4d0 con 0x55beb035e0b0 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb0457650 0x55beb0459a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb045a0e0 con 0x55beb0457650 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.165+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb0457650 0x55beb0459a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb0457650 0x55beb0459a40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3196718719 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0457650 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0456490 con 0x55beb035e0b0 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ec370640 1 -- 172.21.15.151:0/3196718719 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85e400a4d0 con 0x55beb035e0b0 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0456980 con 0x55beb035e0b0 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ec370640 1 -- 172.21.15.151:0/3196718719 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85e400a4d0 con 0x55beb035e0b0 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ee0699c0 1 Processor -- start 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ee0699c0 1 -- start start 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ee0699c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0468750 0x55beb0468b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ee0699c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55beb0270450 con 0x55beb0468750 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ec370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0468750 0x55beb0468b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ec370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0468750 0x55beb0468b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34140/0 (socket says 172.21.15.151:34140) 2024-09-12T16:52:18.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ec370640 1 -- 172.21.15.151:0/811160615 learned_addr learned my addr 172.21.15.151:0/811160615 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ec370640 1 -- 172.21.15.151:0/811160615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb04691b0 con 0x55beb0468750 2024-09-12T16:52:18.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ec370640 1 --2- 172.21.15.151:0/811160615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0468750 0x55beb0468b70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55beb044ead0 tx=0x7f85e4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f84d17fa640 1 -- 172.21.15.151:0/811160615 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e4014450 con 0x55beb0468750 2024-09-12T16:52:18.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f84d17fa640 1 -- 172.21.15.151:0/811160615 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e40145f0 con 0x55beb0468750 2024-09-12T16:52:18.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ee0699c0 1 -- 172.21.15.151:0/811160615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55beb0469a10 con 0x55beb0468750 2024-09-12T16:52:18.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f84d17fa640 1 -- 172.21.15.151:0/811160615 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e40148f0 con 0x55beb0468750 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.169+0000 7f85ee0699c0 1 -- 172.21.15.151:0/811160615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beb0469f80 con 0x55beb0468750 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f84d17fa640 1 -- 172.21.15.151:0/811160615 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85e4011040 con 0x55beb0468750 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f84d17fa640 1 --2- 172.21.15.151:0/811160615 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84c4039a70 0x7f84c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f84d17fa640 1 -- 172.21.15.151:0/811160615 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85e401e070 con 0x55beb0468750 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/811160615 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84c4039a70 0x7f84c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 Processor -- start 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 -- start start 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/811160615 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84c4039a70 0x7f84c403bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0a9750 tx=0x7f85dc0caeb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb0359f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55beb0446fb0 con 0x55beb0359b30 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ec370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb0359f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ec370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb0359f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34146/0 (socket says 172.21.15.151:34146) 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ec370640 1 -- 172.21.15.151:0/3486297587 learned_addr learned my addr 172.21.15.151:0/3486297587 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ec370640 1 -- 172.21.15.151:0/3486297587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb035a520 con 0x55beb0359b30 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ec370640 1 --2- 172.21.15.151:0/3486297587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb0359f30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85e4050730 tx=0x7f85e40118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30d510792530785 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f84caffd640 1 -- 172.21.15.151:0/3486297587 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e4052110 con 0x55beb0359b30 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f84caffd640 1 -- 172.21.15.151:0/3486297587 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e404f2a0 con 0x55beb0359b30 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f84caffd640 1 -- 172.21.15.151:0/3486297587 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e402bda0 con 0x55beb0359b30 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3486297587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 msgr2=0x55beb0359f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3486297587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb0359f30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85e4050730 tx=0x7f85e40118e0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3486297587 shutdown_connections 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3486297587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb0359f30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3486297587 >> 172.21.15.151:0/3486297587 conn(0x55beb04714a0 msgr2=0x55beb046f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3486297587 shutdown_connections 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3486297587 wait complete. 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.173+0000 7f85ee0699c0 1 Processor -- start 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ee0699c0 1 -- start start 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ee0699c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb047e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ee0699c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55beb035abc0 con 0x55beb0359b30 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ec370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb047e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ec370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb047e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34150/0 (socket says 172.21.15.151:34150) 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 learned_addr learned my addr 172.21.15.151:0/3109683682 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb047ecc0 con 0x55beb0359b30 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ec370640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb047e760 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f85e404b010 tx=0x7f85e4050690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f84c97fa640 1 -- 172.21.15.151:0/3109683682 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e403e8b0 con 0x55beb0359b30 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55beb047ef50 con 0x55beb0359b30 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f84c97fa640 1 -- 172.21.15.151:0/3109683682 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e403ea50 con 0x55beb0359b30 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f84c97fa640 1 -- 172.21.15.151:0/3109683682 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e403ed50 con 0x55beb0359b30 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beb047f900 con 0x55beb0359b30 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f84c97fa640 1 -- 172.21.15.151:0/3109683682 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85e403e3f0 con 0x55beb0359b30 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f84c97fa640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84b4039a70 0x7f84b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f84c97fa640 1 -- 172.21.15.151:0/3109683682 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85e4048050 con 0x55beb0359b30 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84b4039a70 0x7f84b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb0489ac0 0x55beb048bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.177+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb048c6a0 con 0x55beb0489ac0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85eb36e640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb0489ac0 0x55beb048bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84b4039a70 0x7f84b403bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0a9700 tx=0x7f85dc0d2000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85eb36e640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb0489ac0 0x55beb048bf50 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85e000e640 con 0x55beb0489ac0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 realm 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0488e70 con 0x55beb0489ac0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85e000e640 con 0x55beb0489ac0 2024-09-12T16:52:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb048d1a0 con 0x55beb0489ac0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85e000e640 con 0x55beb0489ac0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb048da70 con 0x55beb0489ac0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85e000e640 con 0x55beb0489ac0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb048e490 0x55beb0490880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0490f50 con 0x55beb048e490 2024-09-12T16:52:18.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ec370640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb048e490 0x55beb0490880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ec370640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb048e490 0x55beb0490880 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 20 searching for the correct realm 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55beb0492ea0 0x55beb04952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55beb0492ea0 0x55beb04952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55beb0492ea0 0x55beb04952d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ebb6f640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f85dc0c9020 0x7f85dc0a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x7f85dc0c9020 2024-09-12T16:52:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.181+0000 7f85eb36e640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f85dc0c9020 0x7f85dc0a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f85dc0c9020 0x7f85dc0a97c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e000e640 con 0x7f85dc0c9020 2024-09-12T16:52:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0489ac0 2024-09-12T16:52:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e000e640 con 0x55beb0489ac0 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0489ac0 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x7f85dc0c9020 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x7f85dc0c9020 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0489ac0 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.185+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0489ac0 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x7f85dc0c9020 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f85e0029040 con 0x7f85dc0c9020 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0489ac0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0489ac0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x7f85dc0c9020 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x7f85dc0c9020 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.189+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0489ac0 2024-09-12T16:52:18.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x7f85dc0c9020 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x7f85dc0c9020 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0492ea0 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb048e490 2024-09-12T16:52:18.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x55beb0489ac0 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beb04959a0 con 0x7f85dc0c9020 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85e0029040 con 0x7f85dc0c9020 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0491910 con 0x55beb0489ac0 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb04921b0 con 0x55beb0489ac0 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85e0029040 con 0x55beb0489ac0 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0491550 con 0x55beb0489ac0 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 zone default found 2024-09-12T16:52:18.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 4 Realm: () 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.193+0000 7f85ee0699c0 20 zonegroup default 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb04921b0 con 0x55beb048e490 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb0497d10 con 0x55beb0492ea0 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb04980b0 con 0x55beb0492ea0 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 20 started sync module instance, tier type = 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04971a0 con 0x7f85dc0c9020 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x7f85dc0c9020 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94277489751744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04971a0 con 0x7f85dc0c9020 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb0498ba0 con 0x55beb0489ac0 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.197+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94277489751744] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x7f85dc0c9020 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.201+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.201+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94277489755792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04971a0 con 0x55beb0489ac0 2024-09-12T16:52:18.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.201+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04995b0 con 0x55beb0492ea0 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.201+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94277489755792] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.201+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.201+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94277489749232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb0497110 con 0x55beb0492ea0 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.201+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049a300 con 0x7f85dc0c9020 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.201+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x7f85dc0c9020 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.205+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94277489762176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049aba0 con 0x7f85dc0c9020 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.205+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049b560 con 0x55beb0489ac0 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.205+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94277489749232] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.205+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94277489762176] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x7f85dc0c9020 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.205+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.205+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94277489766576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049ab50 con 0x55beb0489ac0 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.205+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049b4d0 con 0x55beb048e490 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.205+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94277489766576] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.209+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.209+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94277489764272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049be00 con 0x55beb048e490 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.209+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049c650 con 0x55beb048e490 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.209+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94277489764272] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.209+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.209+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94277489769264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049c560 con 0x55beb048e490 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.209+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049d080 con 0x55beb048e490 2024-09-12T16:52:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94277489769264] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94277489773392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049d040 con 0x55beb048e490 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 20 add_watcher() i=0 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 20 add_watcher() i=1 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 20 add_watcher() i=2 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 20 add_watcher() i=3 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 20 add_watcher() i=4 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 20 add_watcher() i=5 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 20 add_watcher() i=6 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94277489773392] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 20 add_watcher() i=7 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb04a04d0 con 0x55beb0489ac0 2024-09-12T16:52:18.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94277489770416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049d990 con 0x55beb0489ac0 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94277489770416] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.213+0000 7f84a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 5 note: GC not initialized 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f84a0fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 20 Filter name: none 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f841a7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb04c3780 con 0x55beb0489ac0 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04c9e30 con 0x55beb0489ac0 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94277489957088 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beb04c55a0 con 0x55beb0489ac0 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94277489766576 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55beb020f9c0 con 0x55beb0489ac0 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f84caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94277489766576 notifier 4369 bl.length()=732 2024-09-12T16:52:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f84caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f84caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(64 notify.4 [notify cookie 94277489957088 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f84caffd640 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f84b0003eb0 con 0x55beb0489ac0 2024-09-12T16:52:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94277489957088 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f85e002fdf0 con 0x55beb0489ac0 2024-09-12T16:52:18.226 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f84a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.217+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94277489770416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04c59d0 con 0x55beb0489ac0 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94277489770416] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94277489751744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04c1550 con 0x7f85dc0c9020 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94277489751744] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x7f85dc0c9020 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85ee0699c0 20 remove_watcher() i=0 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85ee0699c0 2 removed watcher, disabling cache 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94277489755792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04c1550 con 0x55beb0489ac0 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94277489755792] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85ee0699c0 20 remove_watcher() i=1 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.221+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94277489749232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb04c1550 con 0x55beb0492ea0 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.225+0000 7f85ebb6f640 1 -- 172.21.15.151:0/3109683682 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94277489749232] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc0a8070 con 0x55beb0492ea0 2024-09-12T16:52:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.225+0000 7f85ee0699c0 20 remove_watcher() i=2 2024-09-12T16:52:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.225+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94277489762176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb0498690 con 0x7f85dc0c9020 2024-09-12T16:52:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.225+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94277489762176] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x7f85dc0c9020 2024-09-12T16:52:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.225+0000 7f85ee0699c0 20 remove_watcher() i=3 2024-09-12T16:52:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.225+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94277489766576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb0496cf0 con 0x55beb0489ac0 2024-09-12T16:52:18.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.229+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94277489766576] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e00391c0 con 0x55beb0489ac0 2024-09-12T16:52:18.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.229+0000 7f85ee0699c0 20 remove_watcher() i=4 2024-09-12T16:52:18.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.229+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94277489764272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb0498690 con 0x55beb048e490 2024-09-12T16:52:18.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.229+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94277489764272] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.229+0000 7f85ee0699c0 20 remove_watcher() i=5 2024-09-12T16:52:18.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.229+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94277489769264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb049b0b0 con 0x55beb048e490 2024-09-12T16:52:18.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94277489769264] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 20 remove_watcher() i=6 2024-09-12T16:52:18.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94277489773392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beb0496cf0 con 0x55beb048e490 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ec370640 1 -- 172.21.15.151:0/3109683682 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94277489773392] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85e402a070 con 0x55beb048e490 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 20 remove_watcher() i=7 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb048e490 msgr2=0x55beb0490880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb048e490 0x55beb0490880 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb0489ac0 msgr2=0x55beb048bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb0489ac0 0x55beb048bf50 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f85dc0c9020 msgr2=0x7f85dc0a97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f85dc0c9020 0x7f85dc0a97c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55beb0492ea0 msgr2=0x55beb04952d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55beb0492ea0 0x55beb04952d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84b4039a70 msgr2=0x7f84b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84b4039a70 0x7f84b403bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0a9700 tx=0x7f85dc0d2000 comp rx=0 tx=0).stop 2024-09-12T16:52:18.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 msgr2=0x55beb047e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3109683682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0359b30 0x55beb047e760 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f85e404b010 tx=0x7f85e4050690 comp rx=0 tx=0).stop 2024-09-12T16:52:18.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 reap_dead start 2024-09-12T16:52:18.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85eb36e640 1 -- 172.21.15.151:0/3109683682 reap_dead start 2024-09-12T16:52:18.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 shutdown_connections 2024-09-12T16:52:18.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 >> 172.21.15.151:0/3109683682 conn(0x55beb04714a0 msgr2=0x55beb046f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 shutdown_connections 2024-09-12T16:52:18.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3109683682 wait complete. 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/811160615 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84c4039a70 msgr2=0x7f84c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/811160615 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84c4039a70 0x7f84c403bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0a9750 tx=0x7f85dc0caeb0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/811160615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0468750 msgr2=0x55beb0468b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/811160615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0468750 0x55beb0468b70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55beb044ead0 tx=0x7f85e4018830 comp rx=0 tx=0).stop 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/811160615 shutdown_connections 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/811160615 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84c4039a70 0x7f84c403bf30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/811160615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb0468750 0x55beb0468b70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/811160615 >> 172.21.15.151:0/811160615 conn(0x55beb045e100 msgr2=0x55beb045e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/811160615 shutdown_connections 2024-09-12T16:52:18.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/811160615 wait complete. 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb0457650 msgr2=0x55beb0459a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb0457650 0x55beb0459a40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb035e0b0 msgr2=0x55beb0454ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb035e0b0 0x55beb0454ec0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84d4039a70 msgr2=0x7f84d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84d4039a70 0x7f84d403bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85e0004180 tx=0x7f85e0001340 comp rx=0 tx=0).stop 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 msgr2=0x55beb044dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb044dd50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f85dc01bb20 tx=0x7f85dc018020 comp rx=0 tx=0).stop 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 shutdown_connections 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55beb0457650 0x55beb0459a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55beb035e0b0 0x55beb0454ec0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f84d4039a70 0x7f84d403bf30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.233+0000 7f85ee0699c0 1 --2- 172.21.15.151:0/3196718719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beb02cf1c0 0x55beb044dd50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.237+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 >> 172.21.15.151:0/3196718719 conn(0x55beb03558a0 msgr2=0x55beb0440ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.237+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 shutdown_connections 2024-09-12T16:52:18.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.237+0000 7f85ee0699c0 1 -- 172.21.15.151:0/3196718719 wait complete. 2024-09-12T16:52:18.247 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:18.247 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:52:18.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:52:18.248 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:52:18.323 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:18.324 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:18.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f74459c0 1 Processor -- start 2024-09-12T16:52:18.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f74459c0 1 -- start start 2024-09-12T16:52:18.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f74459c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x560017d13ca0 0x560017d1b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f74459c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560017bc99c0 con 0x560017d13180 2024-09-12T16:52:18.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f74459c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x560017c196d0 con 0x560017d13ca0 2024-09-12T16:52:18.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f4f4b640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x560017d13180 0x560017d13560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38122/0 (socket says 172.21.15.151:38122) 2024-09-12T16:52:18.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/1219316622 learned_addr learned my addr 172.21.15.151:0/1219316622 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:18.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f474a640 1 --2- 172.21.15.151:0/1219316622 >> v2:172.21.15.122:3300/0 conn(0x560017d13ca0 0x560017d1b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f3f49640 1 -- 172.21.15.151:0/1219316622 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 389192812 0 0) 0x560017bc99c0 con 0x560017d13180 2024-09-12T16:52:18.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f3f49640 1 -- 172.21.15.151:0/1219316622 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9e0001e20 con 0x560017d13180 2024-09-12T16:52:18.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.321+0000 7fc9f474a640 1 -- 172.21.15.151:0/1219316622 >> v1:172.21.15.122:6789/0 conn(0x560017d13180 legacy=0x560017d13560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f474a640 1 -- 172.21.15.151:0/1219316622 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560017bbdca0 con 0x560017d13ca0 2024-09-12T16:52:18.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f474a640 1 --2- 172.21.15.151:0/1219316622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13ca0 0x560017d1b4d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00a420 tx=0x7fc9dc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f220bb5abd5983ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f3f49640 1 -- 172.21.15.151:0/1219316622 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9dc0af070 con 0x560017d13ca0 2024-09-12T16:52:18.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f3f49640 1 -- 172.21.15.151:0/1219316622 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0aa530 con 0x560017d13ca0 2024-09-12T16:52:18.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f3f49640 1 -- 172.21.15.151:0/1219316622 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9dc0aa810 con 0x560017d13ca0 2024-09-12T16:52:18.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f74459c0 1 -- 172.21.15.151:0/1219316622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13ca0 msgr2=0x560017d1b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/1219316622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13ca0 0x560017d1b4d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00a420 tx=0x7fc9dc01afd0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f74459c0 1 -- 172.21.15.151:0/1219316622 shutdown_connections 2024-09-12T16:52:18.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/1219316622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13ca0 0x560017d1b4d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f74459c0 1 -- 172.21.15.151:0/1219316622 >> 172.21.15.151:0/1219316622 conn(0x560017d0f0d0 msgr2=0x560017d114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f74459c0 1 -- 172.21.15.151:0/1219316622 shutdown_connections 2024-09-12T16:52:18.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.325+0000 7fc9f74459c0 1 -- 172.21.15.151:0/1219316622 wait complete. 2024-09-12T16:52:18.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.337+0000 7fc9f74459c0 1 Processor -- start 2024-09-12T16:52:18.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.337+0000 7fc9f74459c0 1 -- start start 2024-09-12T16:52:18.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017e00560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560017c1d680 con 0x560017d13180 2024-09-12T16:52:18.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017e00560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017e00560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34172/0 (socket says 172.21.15.151:34172) 2024-09-12T16:52:18.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/2627707465 learned_addr learned my addr 172.21.15.151:0/2627707465 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/2627707465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560017b98da0 con 0x560017d13180 2024-09-12T16:52:18.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/2627707465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017e00560 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec001e40 tx=0x7fc9ec00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdea3ed863fb37b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc8e2e0d640 1 -- 172.21.15.151:0/2627707465 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec012020 con 0x560017d13180 2024-09-12T16:52:18.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc8e2e0d640 1 -- 172.21.15.151:0/2627707465 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec00e690 con 0x560017d13180 2024-09-12T16:52:18.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc8e2e0d640 1 -- 172.21.15.151:0/2627707465 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec00e9b0 con 0x560017d13180 2024-09-12T16:52:18.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 -- 172.21.15.151:0/2627707465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 msgr2=0x560017e00560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/2627707465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017e00560 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec001e40 tx=0x7fc9ec00b790 comp rx=0 tx=0).stop 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 -- 172.21.15.151:0/2627707465 shutdown_connections 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/2627707465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017e00560 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 -- 172.21.15.151:0/2627707465 >> 172.21.15.151:0/2627707465 conn(0x560017d0f0d0 msgr2=0x560017dfc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 -- 172.21.15.151:0/2627707465 shutdown_connections 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 -- 172.21.15.151:0/2627707465 wait complete. 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 Processor -- start 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 -- start start 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017d15b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f74459c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560017bbfa50 con 0x560017d13180 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017d15b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017d15b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34178/0 (socket says 172.21.15.151:34178) 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/985272012 learned_addr learned my addr 172.21.15.151:0/985272012 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.341+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/985272012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560017d160f0 con 0x560017d13180 2024-09-12T16:52:18.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017d15b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x560017e014f0 tx=0x7fc9ec0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc8e160a640 1 -- 172.21.15.151:0/985272012 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec012030 con 0x560017d13180 2024-09-12T16:52:18.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560017d144d0 con 0x560017d13180 2024-09-12T16:52:18.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc8e160a640 1 -- 172.21.15.151:0/985272012 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec01a720 con 0x560017d13180 2024-09-12T16:52:18.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc8e160a640 1 -- 172.21.15.151:0/985272012 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec01aa60 con 0x560017d13180 2024-09-12T16:52:18.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560017d14a60 con 0x560017d13180 2024-09-12T16:52:18.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc8e160a640 1 -- 172.21.15.151:0/985272012 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc9ec015020 con 0x560017d13180 2024-09-12T16:52:18.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc8e160a640 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8dc039a70 0x7fc8dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc8e160a640 1 -- 172.21.15.151:0/985272012 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc9ec020070 con 0x560017d13180 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017d13ca0 0x560017e11010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f474a640 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8dc039a70 0x7fc8dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e11550 con 0x560017d13ca0 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f574c640 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017d13ca0 0x560017e11010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f474a640 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8dc039a70 0x7fc8dc03bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0ac000 tx=0x7fc9dc0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f574c640 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017d13ca0 0x560017e11010 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f574c640 1 -- 172.21.15.151:0/985272012 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9e40083f0 con 0x560017d13ca0 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e11950 con 0x560017d13ca0 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f574c640 1 -- 172.21.15.151:0/985272012 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9e40083f0 con 0x560017d13ca0 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e13760 0x560017e15b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e16220 con 0x560017e13760 2024-09-12T16:52:18.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.345+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e13760 0x560017e15b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e13760 0x560017e15b50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/985272012 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e13760 2024-09-12T16:52:18.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e125d0 con 0x560017d13ca0 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f574c640 1 -- 172.21.15.151:0/985272012 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9e40083f0 con 0x560017d13ca0 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e12a50 con 0x560017d13ca0 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f574c640 1 -- 172.21.15.151:0/985272012 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9e40083f0 con 0x560017d13ca0 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f74459c0 1 Processor -- start 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f74459c0 1 -- start start 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f74459c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e24890 0x560017e24cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f74459c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560017c2a450 con 0x560017e24890 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f574c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e24890 0x560017e24cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f574c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e24890 0x560017e24cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34188/0 (socket says 172.21.15.151:34188) 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f574c640 1 -- 172.21.15.151:0/3839209828 learned_addr learned my addr 172.21.15.151:0/3839209828 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f574c640 1 -- 172.21.15.151:0/3839209828 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560017e252f0 con 0x560017e24890 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f574c640 1 --2- 172.21.15.151:0/3839209828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e24890 0x560017e24cb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x560017d14c50 tx=0x7fc9e400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc8da7fc640 1 -- 172.21.15.151:0/3839209828 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e4007d70 con 0x560017e24890 2024-09-12T16:52:18.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc8da7fc640 1 -- 172.21.15.151:0/3839209828 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e401e020 con 0x560017e24890 2024-09-12T16:52:18.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc8da7fc640 1 -- 172.21.15.151:0/3839209828 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e4019590 con 0x560017e24890 2024-09-12T16:52:18.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3839209828 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560017e25b50 con 0x560017e24890 2024-09-12T16:52:18.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.349+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3839209828 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560017e260c0 con 0x560017e24890 2024-09-12T16:52:18.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc8da7fc640 1 -- 172.21.15.151:0/3839209828 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc9e4016040 con 0x560017e24890 2024-09-12T16:52:18.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc8da7fc640 1 --2- 172.21.15.151:0/3839209828 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8cc039ac0 0x7fc8cc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc8da7fc640 1 -- 172.21.15.151:0/3839209828 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc9e401f030 con 0x560017e24890 2024-09-12T16:52:18.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/3839209828 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8cc039ac0 0x7fc8cc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 Processor -- start 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 -- start start 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/3839209828 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8cc039ac0 0x7fc8cc03bf80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec022750 tx=0x7fc9ec00df00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e32540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560017e00db0 con 0x560017e32140 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f574c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e32540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f574c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e32540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34200/0 (socket says 172.21.15.151:34200) 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f574c640 1 -- 172.21.15.151:0/3278447690 learned_addr learned my addr 172.21.15.151:0/3278447690 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f574c640 1 -- 172.21.15.151:0/3278447690 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560017e32b30 con 0x560017e32140 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f574c640 1 --2- 172.21.15.151:0/3278447690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e32540 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40508a0 tx=0x7fc9e4019b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3db7df32ef9a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc8cbfff640 1 -- 172.21.15.151:0/3278447690 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e401d070 con 0x560017e32140 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc8cbfff640 1 -- 172.21.15.151:0/3278447690 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e4019c50 con 0x560017e32140 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc8cbfff640 1 -- 172.21.15.151:0/3278447690 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e40520d0 con 0x560017e32140 2024-09-12T16:52:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3278447690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 msgr2=0x560017e32540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3278447690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e32540 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40508a0 tx=0x7fc9e4019b00 comp rx=0 tx=0).stop 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3278447690 shutdown_connections 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3278447690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e32540 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3278447690 >> 172.21.15.151:0/3278447690 conn(0x560017e2d560 msgr2=0x560017e2b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3278447690 shutdown_connections 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3278447690 wait complete. 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.353+0000 7fc9f74459c0 1 Processor -- start 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 1 -- start start 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560017e31090 con 0x560017e32140 2024-09-12T16:52:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f574c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f574c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34204/0 (socket says 172.21.15.151:34204) 2024-09-12T16:52:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 learned_addr learned my addr 172.21.15.151:0/3796606309 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560017e38b40 con 0x560017e32140 2024-09-12T16:52:18.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f574c640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e385e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40508a0 tx=0x7fc9e4050830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc8ca7fc640 1 -- 172.21.15.151:0/3796606309 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e403ea50 con 0x560017e32140 2024-09-12T16:52:18.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560017e38dd0 con 0x560017e32140 2024-09-12T16:52:18.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc8ca7fc640 1 -- 172.21.15.151:0/3796606309 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e4032020 con 0x560017e32140 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc8ca7fc640 1 -- 172.21.15.151:0/3796606309 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e403ed20 con 0x560017e32140 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560017e38dd0 con 0x560017e32140 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc8ca7fc640 1 -- 172.21.15.151:0/3796606309 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc9e402ba10 con 0x560017e32140 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc8ca7fc640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8c0039a70 0x7fc8c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc8ca7fc640 1 -- 172.21.15.151:0/3796606309 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc9e4033030 con 0x560017e32140 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8c0039a70 0x7fc8c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017e43730 0x560017e45bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e46310 con 0x560017e43730 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f474a640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017e43730 0x560017e45bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8c0039a70 0x7fc8c003bf30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec04eb60 tx=0x7fc9ec045000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f474a640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017e43730 0x560017e45bc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 20 realm 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e46740 con 0x560017e43730 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.357+0000 7fc9f74459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e47010 con 0x560017e43730 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e473b0 con 0x560017e43730 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e48110 0x560017e4a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e4aa40 con 0x560017e48110 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f574c640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e48110 0x560017e4a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f574c640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e48110 0x560017e4a500 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 20 searching for the correct realm 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560017e4c9b0 0x560017e4ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e4c9b0 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560017e4c9b0 0x560017e4ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560017e4c9b0 0x560017e4ee70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f4f4b640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc9ec017050 0x7fc9ec050050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x7fc9ec017050 2024-09-12T16:52:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f474a640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc9ec017050 0x7fc9ec050050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f474a640 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc9ec017050 0x7fc9ec050050 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.361+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e48110 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e43730 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e43730 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e48110 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e48110 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x7fc9ec017050 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e4c9b0 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e43730 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e48110 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e43730 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x7fc9ec017050 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.365+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f540 con 0x560017e4c9b0 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e4c9b0 2024-09-12T16:52:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e48110 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e4c9b0 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e4c9b0 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e43730 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e43730 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e48110 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e4c9b0 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x7fc9ec017050 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e43730 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e48110 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.369+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e4c9b0 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e48110 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x7fc9ec017050 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e4c9b0 2024-09-12T16:52:18.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e48110 2024-09-12T16:52:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x560017e43730 2024-09-12T16:52:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc9ec05c040 con 0x7fc9ec017050 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e4b390 con 0x560017e43730 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e4b7e0 con 0x560017e43730 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e4bc80 con 0x560017e43730 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 zone default found 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 4 Realm: () 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 zonegroup default 2024-09-12T16:52:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e4f9c0 con 0x560017e48110 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.373+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e518e0 con 0x560017e4c9b0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e51d90 con 0x560017e4c9b0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 20 started sync module instance, tier type = 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e50bf0 con 0x7fc9ec017050 2024-09-12T16:52:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94558400876816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e50bf0 con 0x7fc9ec017050 2024-09-12T16:52:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e528a0 con 0x560017e43730 2024-09-12T16:52:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94558400876816] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94558400881552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e50bf0 con 0x560017e43730 2024-09-12T16:52:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.377+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e532e0 con 0x560017e4c9b0 2024-09-12T16:52:18.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94558400881552] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94558400874304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e50b60 con 0x560017e4c9b0 2024-09-12T16:52:18.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e53fe0 con 0x7fc9ec017050 2024-09-12T16:52:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94558400887872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e54650 con 0x7fc9ec017050 2024-09-12T16:52:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e55170 con 0x560017e43730 2024-09-12T16:52:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94558400874304] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.381+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94558400887872] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.385+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.385+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94558400891968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e55130 con 0x560017e43730 2024-09-12T16:52:18.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.385+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e55a10 con 0x560017e48110 2024-09-12T16:52:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.385+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94558400891968] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.385+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.385+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94558400894304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e55130 con 0x560017e48110 2024-09-12T16:52:18.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.385+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e56260 con 0x560017e48110 2024-09-12T16:52:18.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94558400894304] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94558400896432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e566e0 con 0x560017e48110 2024-09-12T16:52:18.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e536e0 con 0x560017e48110 2024-09-12T16:52:18.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94558400896432] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94558400886496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e56ca0 con 0x560017e48110 2024-09-12T16:52:18.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 20 add_watcher() i=0 2024-09-12T16:52:18.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 20 add_watcher() i=1 2024-09-12T16:52:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 20 add_watcher() i=2 2024-09-12T16:52:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 20 add_watcher() i=3 2024-09-12T16:52:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 20 add_watcher() i=4 2024-09-12T16:52:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 20 add_watcher() i=5 2024-09-12T16:52:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.389+0000 7fc9f74459c0 20 add_watcher() i=6 2024-09-12T16:52:18.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94558400886496] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 20 add_watcher() i=7 2024-09-12T16:52:18.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:18.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e5a0d0 con 0x560017e43730 2024-09-12T16:52:18.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94558400897488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e57620 con 0x560017e43730 2024-09-12T16:52:18.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94558400897488] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc8aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:18.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:18.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 5 note: GC not initialized 2024-09-12T16:52:18.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc8a9fe3640 20 reqs_thread_entry: start 2024-09-12T16:52:18.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:18.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 20 Filter name: none 2024-09-12T16:52:18.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc81b7fe640 20 reqs_thread_entry: start 2024-09-12T16:52:18.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.393+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560017e7ce50 con 0x560017e43730 2024-09-12T16:52:18.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f74459c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T16:52:18.400 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc8aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94558400897488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e7b940 con 0x560017e43730 2024-09-12T16:52:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94558400897488] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94558400876816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e561d0 con 0x7fc9ec017050 2024-09-12T16:52:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94558400876816] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f74459c0 20 remove_watcher() i=0 2024-09-12T16:52:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f74459c0 2 removed watcher, disabling cache 2024-09-12T16:52:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.397+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94558400881552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e51110 con 0x560017e43730 2024-09-12T16:52:18.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94558400881552] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f74459c0 20 remove_watcher() i=1 2024-09-12T16:52:18.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94558400874304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e51110 con 0x560017e4c9b0 2024-09-12T16:52:18.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f4f4b640 1 -- 172.21.15.151:0/3796606309 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94558400874304] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ec008030 con 0x560017e4c9b0 2024-09-12T16:52:18.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f74459c0 20 remove_watcher() i=2 2024-09-12T16:52:18.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94558400887872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e50740 con 0x7fc9ec017050 2024-09-12T16:52:18.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94558400887872] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x7fc9ec017050 2024-09-12T16:52:18.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f74459c0 20 remove_watcher() i=3 2024-09-12T16:52:18.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.401+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94558400891968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e53c40 con 0x560017e43730 2024-09-12T16:52:18.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.405+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94558400891968] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9dc0b2070 con 0x560017e43730 2024-09-12T16:52:18.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.405+0000 7fc9f74459c0 20 remove_watcher() i=4 2024-09-12T16:52:18.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.405+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94558400894304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e50740 con 0x560017e48110 2024-09-12T16:52:18.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.405+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94558400894304] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.405+0000 7fc9f74459c0 20 remove_watcher() i=5 2024-09-12T16:52:18.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.405+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94558400896432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e54c40 con 0x560017e48110 2024-09-12T16:52:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94558400896432] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 20 remove_watcher() i=6 2024-09-12T16:52:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94558400886496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560017e50740 con 0x560017e48110 2024-09-12T16:52:18.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f574c640 1 -- 172.21.15.151:0/3796606309 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94558400886496] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e402a070 con 0x560017e48110 2024-09-12T16:52:18.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 20 remove_watcher() i=7 2024-09-12T16:52:18.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e48110 msgr2=0x560017e4a500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e48110 0x560017e4a500 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017e43730 msgr2=0x560017e45bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017e43730 0x560017e45bc0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc9ec017050 msgr2=0x7fc9ec050050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc9ec017050 0x7fc9ec050050 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560017e4c9b0 msgr2=0x560017e4ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560017e4c9b0 0x560017e4ee70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8c0039a70 msgr2=0x7fc8c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8c0039a70 0x7fc8c003bf30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec04eb60 tx=0x7fc9ec045000 comp rx=0 tx=0).stop 2024-09-12T16:52:18.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 msgr2=0x560017e385e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f474a640 1 -- 172.21.15.151:0/3796606309 reap_dead start 2024-09-12T16:52:18.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e385e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40508a0 tx=0x7fc9e4050830 comp rx=0 tx=0).stop 2024-09-12T16:52:18.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 shutdown_connections 2024-09-12T16:52:18.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3796606309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e32140 0x560017e385e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 >> 172.21.15.151:0/3796606309 conn(0x560017e2d560 msgr2=0x560017e2b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 shutdown_connections 2024-09-12T16:52:18.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3796606309 wait complete. 2024-09-12T16:52:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3839209828 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8cc039ac0 msgr2=0x7fc8cc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3839209828 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8cc039ac0 0x7fc8cc03bf80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec022750 tx=0x7fc9ec00df00 comp rx=0 tx=0).stop 2024-09-12T16:52:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3839209828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e24890 msgr2=0x560017e24cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.409+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3839209828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e24890 0x560017e24cb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x560017d14c50 tx=0x7fc9e400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3839209828 shutdown_connections 2024-09-12T16:52:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3839209828 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8cc039ac0 0x7fc8cc03bf80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/3839209828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017e24890 0x560017e24cb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3839209828 >> 172.21.15.151:0/3839209828 conn(0x560017e1a240 msgr2=0x560017e1a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3839209828 shutdown_connections 2024-09-12T16:52:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/3839209828 wait complete. 2024-09-12T16:52:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e13760 msgr2=0x560017e15b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e13760 0x560017e15b50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017d13ca0 msgr2=0x560017e11010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017d13ca0 0x560017e11010 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8dc039a70 msgr2=0x7fc8dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8dc039a70 0x7fc8dc03bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0ac000 tx=0x7fc9dc0a5000 comp rx=0 tx=0).stop 2024-09-12T16:52:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 msgr2=0x560017d15b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017d15b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x560017e014f0 tx=0x7fc9ec0040f0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 shutdown_connections 2024-09-12T16:52:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560017e13760 0x560017e15b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560017d13ca0 0x560017e11010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc8dc039a70 0x7fc8dc03bf30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 --2- 172.21.15.151:0/985272012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560017d13180 0x560017d15b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 >> 172.21.15.151:0/985272012 conn(0x560017d0f0d0 msgr2=0x560017dfac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 shutdown_connections 2024-09-12T16:52:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.413+0000 7fc9f74459c0 1 -- 172.21.15.151:0/985272012 wait complete. 2024-09-12T16:52:18.425 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:18.425 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:52:18.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:52:18.426 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:52:18.514 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:18.514 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:18.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b31709c0 1 Processor -- start 2024-09-12T16:52:18.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b31709c0 1 -- start start 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b31709c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56465c553e00 0x56465c5541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b31709c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56465c4099c0 con 0x56465c556fe0 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b31709c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56465c4596d0 con 0x56465c553e00 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b0c76640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56465c553e00 0x56465c5541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b0c76640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56465c553e00 0x56465c5541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34218/0 (socket says 172.21.15.151:34218) 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b0c76640 1 -- 172.21.15.151:0/2026172753 learned_addr learned my addr 172.21.15.151:0/2026172753 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b0c76640 1 -- 172.21.15.151:0/2026172753 >> v1:172.21.15.122:6789/0 conn(0x56465c556fe0 legacy=0x56465c5593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3b0c76640 1 -- 172.21.15.151:0/2026172753 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465c3fdca0 con 0x56465c553e00 2024-09-12T16:52:18.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.509+0000 7fa3afc74640 1 -- 172.21.15.151:0/2026172753 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755135465 0 0) 0x56465c4099c0 con 0x56465c556fe0 2024-09-12T16:52:18.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/2026172753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c5541e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000a7a0 tx=0x7fa3a001d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ac7458836342f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3afc74640 1 -- 172.21.15.151:0/2026172753 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a00b3070 con 0x56465c553e00 2024-09-12T16:52:18.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3afc74640 1 -- 172.21.15.151:0/2026172753 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a00a6720 con 0x56465c553e00 2024-09-12T16:52:18.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3afc74640 1 -- 172.21.15.151:0/2026172753 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a00a6a20 con 0x56465c553e00 2024-09-12T16:52:18.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3b31709c0 1 -- 172.21.15.151:0/2026172753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 msgr2=0x56465c5541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/2026172753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c5541e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000a7a0 tx=0x7fa3a001d800 comp rx=0 tx=0).stop 2024-09-12T16:52:18.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3b31709c0 1 -- 172.21.15.151:0/2026172753 shutdown_connections 2024-09-12T16:52:18.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/2026172753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c5541e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3b31709c0 1 -- 172.21.15.151:0/2026172753 >> 172.21.15.151:0/2026172753 conn(0x56465c54f920 msgr2=0x56465c551d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3b31709c0 1 -- 172.21.15.151:0/2026172753 shutdown_connections 2024-09-12T16:52:18.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.513+0000 7fa3b31709c0 1 -- 172.21.15.151:0/2026172753 wait complete. 2024-09-12T16:52:18.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 Processor -- start 2024-09-12T16:52:18.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- start start 2024-09-12T16:52:18.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c6428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56465c45d680 con 0x56465c553e00 2024-09-12T16:52:18.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b0c76640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c6428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b0c76640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c6428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34226/0 (socket says 172.21.15.151:34226) 2024-09-12T16:52:18.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b0c76640 1 -- 172.21.15.151:0/590944329 learned_addr learned my addr 172.21.15.151:0/590944329 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b0c76640 1 -- 172.21.15.151:0/590944329 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465c3d8da0 con 0x56465c553e00 2024-09-12T16:52:18.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/590944329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c6428b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa3a001a410 tx=0x7fa3a00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598637b08f4cccf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa29ee0d640 1 -- 172.21.15.151:0/590944329 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a00b3040 con 0x56465c553e00 2024-09-12T16:52:18.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa29ee0d640 1 -- 172.21.15.151:0/590944329 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a00a6ac0 con 0x56465c553e00 2024-09-12T16:52:18.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa29ee0d640 1 -- 172.21.15.151:0/590944329 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a00a6de0 con 0x56465c553e00 2024-09-12T16:52:18.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- 172.21.15.151:0/590944329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 msgr2=0x56465c6428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/590944329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c6428b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa3a001a410 tx=0x7fa3a00033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- 172.21.15.151:0/590944329 shutdown_connections 2024-09-12T16:52:18.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/590944329 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c6428b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- 172.21.15.151:0/590944329 >> 172.21.15.151:0/590944329 conn(0x56465c54f920 msgr2=0x56465c63a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- 172.21.15.151:0/590944329 shutdown_connections 2024-09-12T16:52:18.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- 172.21.15.151:0/590944329 wait complete. 2024-09-12T16:52:18.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 Processor -- start 2024-09-12T16:52:18.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- start start 2024-09-12T16:52:18.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c649e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.529+0000 7fa3b31709c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56465c3ffa50 con 0x56465c553e00 2024-09-12T16:52:18.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b0c76640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c649e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b0c76640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c649e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34232/0 (socket says 172.21.15.151:34232) 2024-09-12T16:52:18.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3917301082 learned_addr learned my addr 172.21.15.151:0/3917301082 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3917301082 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465c64a370 con 0x56465c553e00 2024-09-12T16:52:18.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c649e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa3a001e0a0 tx=0x7fa3a001a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa29d60a640 1 -- 172.21.15.151:0/3917301082 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a00c4020 con 0x56465c553e00 2024-09-12T16:52:18.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56465c64a600 con 0x56465c553e00 2024-09-12T16:52:18.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa29d60a640 1 -- 172.21.15.151:0/3917301082 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a00aeb50 con 0x56465c553e00 2024-09-12T16:52:18.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa29d60a640 1 -- 172.21.15.151:0/3917301082 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a00aee30 con 0x56465c553e00 2024-09-12T16:52:18.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465c64af90 con 0x56465c553e00 2024-09-12T16:52:18.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa29d60a640 1 -- 172.21.15.151:0/3917301082 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa3a00c7020 con 0x56465c553e00 2024-09-12T16:52:18.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa29d60a640 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa298039a70 0x7fa29803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa29d60a640 1 -- 172.21.15.151:0/3917301082 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa3a00ead30 con 0x56465c553e00 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b0475640 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa298039a70 0x7fa29803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c556fe0 0x56465c650ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c651420 con 0x56465c556fe0 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b1477640 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c556fe0 0x56465c650ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b0475640 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa298039a70 0x7fa29803bf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa398000f70 tx=0x7fa398001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b1477640 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c556fe0 0x56465c650ee0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b1477640 1 -- 172.21.15.151:0/3917301082 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a80083f0 con 0x56465c556fe0 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.533+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c64b290 con 0x56465c556fe0 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b1477640 1 -- 172.21.15.151:0/3917301082 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3a80083f0 con 0x56465c556fe0 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c6536c0 0x56465c655ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c656180 con 0x56465c6536c0 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c6536c0 0x56465c655ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c6536c0 0x56465c655ab0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3917301082 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c6536c0 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c652560 con 0x56465c556fe0 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b1477640 1 -- 172.21.15.151:0/3917301082 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3a80083f0 con 0x56465c556fe0 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c652a00 con 0x56465c556fe0 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b1477640 1 -- 172.21.15.151:0/3917301082 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa3a80083f0 con 0x56465c556fe0 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b31709c0 1 Processor -- start 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b31709c0 1 -- start start 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b31709c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c664800 0x56465c664c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b31709c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56465c46a450 con 0x56465c664800 2024-09-12T16:52:18.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b1477640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c664800 0x56465c664c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b1477640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c664800 0x56465c664c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34236/0 (socket says 172.21.15.151:34236) 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b1477640 1 -- 172.21.15.151:0/1954908097 learned_addr learned my addr 172.21.15.151:0/1954908097 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.537+0000 7fa3b1477640 1 -- 172.21.15.151:0/1954908097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465c665260 con 0x56465c664800 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b1477640 1 --2- 172.21.15.151:0/1954908097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c664800 0x56465c664c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56465c64ada0 tx=0x7fa3a800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa2967fc640 1 -- 172.21.15.151:0/1954908097 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a8007d70 con 0x56465c664800 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa2967fc640 1 -- 172.21.15.151:0/1954908097 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a801e020 con 0x56465c664800 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b31709c0 1 -- 172.21.15.151:0/1954908097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56465c665ac0 con 0x56465c664800 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b31709c0 1 -- 172.21.15.151:0/1954908097 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465c666030 con 0x56465c664800 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa2967fc640 1 -- 172.21.15.151:0/1954908097 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a8019590 con 0x56465c664800 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa2967fc640 1 -- 172.21.15.151:0/1954908097 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa3a8016040 con 0x56465c664800 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa2967fc640 1 --2- 172.21.15.151:0/1954908097 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa288039a70 0x7fa28803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa2967fc640 1 -- 172.21.15.151:0/1954908097 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa3a801f030 con 0x56465c664800 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/1954908097 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa288039a70 0x7fa28803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b31709c0 1 Processor -- start 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b31709c0 1 -- start start 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/1954908097 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa288039a70 0x7fa28803bf30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56465c6517f0 tx=0x7fa3a00c0520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b31709c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c672550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b31709c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56465c643040 con 0x56465c672150 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b1477640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c672550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b1477640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c672550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34246/0 (socket says 172.21.15.151:34246) 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.541+0000 7fa3b1477640 1 -- 172.21.15.151:0/4260937477 learned_addr learned my addr 172.21.15.151:0/4260937477 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b1477640 1 -- 172.21.15.151:0/4260937477 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465c672b40 con 0x56465c672150 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b1477640 1 --2- 172.21.15.151:0/4260937477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c672550 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8023e90 tx=0x7fa3a8017780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465f1fd604cb04a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa287fff640 1 -- 172.21.15.151:0/4260937477 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a8041e60 con 0x56465c672150 2024-09-12T16:52:18.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa287fff640 1 -- 172.21.15.151:0/4260937477 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a8023590 con 0x56465c672150 2024-09-12T16:52:18.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa287fff640 1 -- 172.21.15.151:0/4260937477 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a801d040 con 0x56465c672150 2024-09-12T16:52:18.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- 172.21.15.151:0/4260937477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 msgr2=0x56465c672550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/4260937477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c672550 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8023e90 tx=0x7fa3a8017780 comp rx=0 tx=0).stop 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- 172.21.15.151:0/4260937477 shutdown_connections 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/4260937477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c672550 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- 172.21.15.151:0/4260937477 >> 172.21.15.151:0/4260937477 conn(0x56465c66d570 msgr2=0x56465c66b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- 172.21.15.151:0/4260937477 shutdown_connections 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- 172.21.15.151:0/4260937477 wait complete. 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 Processor -- start 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- start start 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c678660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56465c6710a0 con 0x56465c672150 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b1477640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c678660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b1477640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c678660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34260/0 (socket says 172.21.15.151:34260) 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 learned_addr learned my addr 172.21.15.151:0/3924305495 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465c678bc0 con 0x56465c672150 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b1477640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c678660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8017c10 tx=0x7fa3a8050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa2867fc640 1 -- 172.21.15.151:0/3924305495 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a801d070 con 0x56465c672150 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa2867fc640 1 -- 172.21.15.151:0/3924305495 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a8031030 con 0x56465c672150 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56465c678e50 con 0x56465c672150 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa2867fc640 1 -- 172.21.15.151:0/3924305495 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a8048040 con 0x56465c672150 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.545+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465c679800 con 0x56465c672150 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa2867fc640 1 -- 172.21.15.151:0/3924305495 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa3a804f340 con 0x56465c672150 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa2867fc640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa27c039ac0 0x7fa27c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa2867fc640 1 -- 172.21.15.151:0/3924305495 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa3a80400b0 con 0x56465c672150 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa27c039ac0 0x7fa27c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c6838d0 0x56465c685d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b0475640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c6838d0 0x56465c685d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c686470 con 0x56465c6838d0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa27c039ac0 0x7fa27c03bf80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00d23f0 tx=0x7fa3a00dc000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b0475640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c6838d0 0x56465c685d20 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa398010570 con 0x56465c6838d0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 realm 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c682ce0 con 0x56465c6838d0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa398010570 con 0x56465c6838d0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:18.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c686f50 con 0x56465c6838d0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa398010570 con 0x56465c6838d0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c687820 con 0x56465c6838d0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa398010570 con 0x56465c6838d0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c688160 0x56465c68a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c68ac90 con 0x56465c688160 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b1477640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c688160 0x56465c68a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b1477640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c688160 0x56465c68a550 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 20 searching for the correct realm 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56465c68cc30 0x56465c68f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.549+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56465c68cc30 0x56465c68f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56465c68cc30 0x56465c68f0f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0c76640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa3a00c9030 0x7fa3a00b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x7fa3a00c9030 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa3a00c9030 0x7fa3a00b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa3a00c9030 0x7fa3a00b7460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398010570 con 0x7fa3a00c9030 2024-09-12T16:52:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c6838d0 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398010570 con 0x56465c6838d0 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c6838d0 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x7fa3a00c9030 2024-09-12T16:52:18.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.553+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c6838d0 2024-09-12T16:52:18.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c6838d0 2024-09-12T16:52:18.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x7fa3a00c9030 2024-09-12T16:52:18.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c6838d0 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c6838d0 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.557+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x7fa3a00c9030 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c6838d0 2024-09-12T16:52:18.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x7fa3a00c9030 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c68cc30 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c688160 2024-09-12T16:52:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x56465c6838d0 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56465c68f7c0 con 0x7fa3a00c9030 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b31709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b31709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b31709c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b31709c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b31709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b31709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.561+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c68b650 con 0x56465c6838d0 2024-09-12T16:52:18.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c68baa0 con 0x56465c6838d0 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c68bf80 con 0x56465c6838d0 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 zone default found 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 4 Realm: () 2024-09-12T16:52:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 zonegroup default 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c68fc40 con 0x56465c688160 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c691b30 con 0x56465c68cc30 2024-09-12T16:52:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c692010 con 0x56465c68cc30 2024-09-12T16:52:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 started sync module instance, tier type = 2024-09-12T16:52:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c690e70 con 0x7fa3a00c9030 2024-09-12T16:52:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860198089616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c690e70 con 0x7fa3a00c9030 2024-09-12T16:52:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.565+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c692b10 con 0x56465c6838d0 2024-09-12T16:52:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.569+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860198089616] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.569+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.569+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860198094304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c690e70 con 0x56465c6838d0 2024-09-12T16:52:18.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.569+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c693520 con 0x56465c68cc30 2024-09-12T16:52:18.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.569+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.569+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860198097008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c693dc0 con 0x56465c68cc30 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.569+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c694780 con 0x7fa3a00c9030 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.569+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860198094304] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.573+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.573+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860198101712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c6946f0 con 0x7fa3a00c9030 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.573+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c6954d0 con 0x56465c6838d0 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.573+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860198097008] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.573+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860198101712] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.573+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.573+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860198099216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c694fd0 con 0x56465c6838d0 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.573+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c695d70 con 0x56465c688160 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.577+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860198099216] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.577+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.577+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860198107328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c694fd0 con 0x56465c688160 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.577+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c6965c0 con 0x56465c688160 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.577+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.577+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860198109456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c696a20 con 0x56465c688160 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.577+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c697530 con 0x56465c688160 2024-09-12T16:52:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.577+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860198107328] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860198109456] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860198113248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c696530 con 0x56465c688160 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 20 add_watcher() i=0 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 20 add_watcher() i=1 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 20 add_watcher() i=2 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 20 add_watcher() i=3 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 20 add_watcher() i=4 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 20 add_watcher() i=5 2024-09-12T16:52:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 20 add_watcher() i=6 2024-09-12T16:52:18.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860198113248] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 20 add_watcher() i=7 2024-09-12T16:52:18.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c69a520 con 0x56465c6838d0 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.581+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860198103840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c697a10 con 0x56465c6838d0 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860198103840] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa266fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 5 note: GC not initialized 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa265fe3640 20 reqs_thread_entry: start 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 20 Filter name: none 2024-09-12T16:52:18.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa1d77fe640 20 reqs_thread_entry: start 2024-09-12T16:52:18.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56465c6bd210 con 0x56465c6838d0 2024-09-12T16:52:18.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T16:52:18.591 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:18.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa266fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860198103840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c6bbcc0 con 0x56465c6838d0 2024-09-12T16:52:18.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94860198103840] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.585+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860198089616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c694b20 con 0x7fa3a00c9030 2024-09-12T16:52:18.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94860198089616] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b31709c0 20 remove_watcher() i=0 2024-09-12T16:52:18.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b31709c0 2 removed watcher, disabling cache 2024-09-12T16:52:18.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860198094304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c694b20 con 0x56465c6838d0 2024-09-12T16:52:18.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94860198094304] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b31709c0 20 remove_watcher() i=1 2024-09-12T16:52:18.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860198097008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c6925e0 con 0x56465c68cc30 2024-09-12T16:52:18.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b0c76640 1 -- 172.21.15.151:0/3924305495 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94860198097008] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a00ea040 con 0x56465c68cc30 2024-09-12T16:52:18.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b31709c0 20 remove_watcher() i=2 2024-09-12T16:52:18.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.589+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860198101712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c694b20 con 0x7fa3a00c9030 2024-09-12T16:52:18.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.593+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94860198101712] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x7fa3a00c9030 2024-09-12T16:52:18.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.593+0000 7fa3b31709c0 20 remove_watcher() i=3 2024-09-12T16:52:18.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.593+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860198099216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c6942d0 con 0x56465c6838d0 2024-09-12T16:52:18.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.593+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94860198099216] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39802a040 con 0x56465c6838d0 2024-09-12T16:52:18.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.593+0000 7fa3b31709c0 20 remove_watcher() i=4 2024-09-12T16:52:18.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.593+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860198107328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c694b20 con 0x56465c688160 2024-09-12T16:52:18.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.597+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94860198107328] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.597+0000 7fa3b31709c0 20 remove_watcher() i=5 2024-09-12T16:52:18.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.597+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860198109456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c693910 con 0x56465c688160 2024-09-12T16:52:18.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.597+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94860198109456] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.597+0000 7fa3b31709c0 20 remove_watcher() i=6 2024-09-12T16:52:18.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.597+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860198113248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56465c6942d0 con 0x56465c688160 2024-09-12T16:52:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b1477640 1 -- 172.21.15.151:0/3924305495 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94860198113248] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a802a070 con 0x56465c688160 2024-09-12T16:52:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 20 remove_watcher() i=7 2024-09-12T16:52:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c688160 msgr2=0x56465c68a550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c688160 0x56465c68a550 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c6838d0 msgr2=0x56465c685d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c6838d0 0x56465c685d20 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa3a00c9030 msgr2=0x7fa3a00b7460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa3a00c9030 0x7fa3a00b7460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56465c68cc30 msgr2=0x56465c68f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56465c68cc30 0x56465c68f0f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa27c039ac0 msgr2=0x7fa27c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa27c039ac0 0x7fa27c03bf80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00d23f0 tx=0x7fa3a00dc000 comp rx=0 tx=0).stop 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 msgr2=0x56465c678660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b0475640 1 -- 172.21.15.151:0/3924305495 reap_dead start 2024-09-12T16:52:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c678660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8017c10 tx=0x7fa3a8050880 comp rx=0 tx=0).stop 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 shutdown_connections 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3924305495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c672150 0x56465c678660 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 >> 172.21.15.151:0/3924305495 conn(0x56465c66d570 msgr2=0x56465c66b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 shutdown_connections 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3924305495 wait complete. 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/1954908097 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa288039a70 msgr2=0x7fa28803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/1954908097 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa288039a70 0x7fa28803bf30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56465c6517f0 tx=0x7fa3a00c0520 comp rx=0 tx=0).stop 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/1954908097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c664800 msgr2=0x56465c664c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/1954908097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c664800 0x56465c664c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56465c64ada0 tx=0x7fa3a800af40 comp rx=0 tx=0).stop 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/1954908097 shutdown_connections 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/1954908097 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa288039a70 0x7fa28803bf30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/1954908097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c664800 0x56465c664c20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/1954908097 >> 172.21.15.151:0/1954908097 conn(0x56465c65a1b0 msgr2=0x56465c65a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/1954908097 shutdown_connections 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/1954908097 wait complete. 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c6536c0 msgr2=0x56465c655ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c6536c0 0x56465c655ab0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c556fe0 msgr2=0x56465c650ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c556fe0 0x56465c650ee0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa298039a70 msgr2=0x7fa29803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa298039a70 0x7fa29803bf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa398000f70 tx=0x7fa398001400 comp rx=0 tx=0).stop 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 msgr2=0x56465c649e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c649e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa3a001e0a0 tx=0x7fa3a001a5a0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 shutdown_connections 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56465c6536c0 0x56465c655ab0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56465c556fe0 0x56465c650ee0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa298039a70 0x7fa29803bf30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 --2- 172.21.15.151:0/3917301082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56465c553e00 0x56465c649e10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 >> 172.21.15.151:0/3917301082 conn(0x56465c54f920 msgr2=0x56465c638b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 shutdown_connections 2024-09-12T16:52:18.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.601+0000 7fa3b31709c0 1 -- 172.21.15.151:0/3917301082 wait complete. 2024-09-12T16:52:18.613 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:18.614 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-12T16:52:18.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-12T16:52:18.614 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-12T16:52:18.692 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:18.692 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:18.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f451b9c0 1 Processor -- start 2024-09-12T16:52:18.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f451b9c0 1 -- start start 2024-09-12T16:52:18.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f451b9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c4acc19200 0x55c4acc195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f451b9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c4acb579c0 con 0x55c4acc17bf0 2024-09-12T16:52:18.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f451b9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55c4acba76d0 con 0x55c4acc19200 2024-09-12T16:52:18.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f2021640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c4acc19200 0x55c4acc195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f2021640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c4acc19200 0x55c4acc195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34266/0 (socket says 172.21.15.151:34266) 2024-09-12T16:52:18.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f1820640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55c4acc17bf0 0x55c4acc18000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38144/0 (socket says 172.21.15.151:38144) 2024-09-12T16:52:18.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f2021640 1 -- 172.21.15.151:0/2746323385 learned_addr learned my addr 172.21.15.151:0/2746323385 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f2021640 1 -- 172.21.15.151:0/2746323385 >> v1:172.21.15.122:6789/0 conn(0x55c4acc17bf0 legacy=0x55c4acc18000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.689+0000 7f72f2021640 1 -- 172.21.15.151:0/2746323385 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4acb4bca0 con 0x55c4acc19200 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f2021640 1 --2- 172.21.15.151:0/2746323385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc19200 0x55c4acc195e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f72e800a5c0 tx=0x7f72e801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b799e3a051f9b76a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f101f640 1 -- 172.21.15.151:0/2746323385 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e80a6070 con 0x55c4acc19200 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f101f640 1 -- 172.21.15.151:0/2746323385 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e80af070 con 0x55c4acc19200 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f101f640 1 -- 172.21.15.151:0/2746323385 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e80aa5c0 con 0x55c4acc19200 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2746323385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc19200 msgr2=0x55c4acc195e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/2746323385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc19200 0x55c4acc195e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f72e800a5c0 tx=0x7f72e801b340 comp rx=0 tx=0).stop 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2746323385 shutdown_connections 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/2746323385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc19200 0x55c4acc195e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2746323385 >> 172.21.15.151:0/2746323385 conn(0x55c4acc9ea20 msgr2=0x55c4acca0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2746323385 shutdown_connections 2024-09-12T16:52:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.693+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2746323385 wait complete. 2024-09-12T16:52:18.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 Processor -- start 2024-09-12T16:52:18.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- start start 2024-09-12T16:52:18.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd90c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c4acbab680 con 0x55c4acc17bf0 2024-09-12T16:52:18.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f2021640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd90c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f2021640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd90c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34270/0 (socket says 172.21.15.151:34270) 2024-09-12T16:52:18.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f2021640 1 -- 172.21.15.151:0/4171538915 learned_addr learned my addr 172.21.15.151:0/4171538915 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f2021640 1 -- 172.21.15.151:0/4171538915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4acb26da0 con 0x55c4acc17bf0 2024-09-12T16:52:18.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f2021640 1 --2- 172.21.15.151:0/4171538915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd90c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f72e8018f70 tx=0x7f72e8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8226c525764516a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f71e0608640 1 -- 172.21.15.151:0/4171538915 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e80aa9e0 con 0x55c4acc17bf0 2024-09-12T16:52:18.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f71e0608640 1 -- 172.21.15.151:0/4171538915 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e80aab80 con 0x55c4acc17bf0 2024-09-12T16:52:18.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f71e0608640 1 -- 172.21.15.151:0/4171538915 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e80aae60 con 0x55c4acc17bf0 2024-09-12T16:52:18.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- 172.21.15.151:0/4171538915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 msgr2=0x55c4acd90c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/4171538915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd90c10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f72e8018f70 tx=0x7f72e8003030 comp rx=0 tx=0).stop 2024-09-12T16:52:18.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- 172.21.15.151:0/4171538915 shutdown_connections 2024-09-12T16:52:18.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/4171538915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd90c10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- 172.21.15.151:0/4171538915 >> 172.21.15.151:0/4171538915 conn(0x55c4acc9ea20 msgr2=0x55c4acd8c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- 172.21.15.151:0/4171538915 shutdown_connections 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- 172.21.15.151:0/4171538915 wait complete. 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 Processor -- start 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- start start 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd98170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.709+0000 7f72f451b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c4acb4da50 con 0x55c4acc17bf0 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f2021640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd98170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f2021640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd98170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34276/0 (socket says 172.21.15.151:34276) 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f2021640 1 -- 172.21.15.151:0/1922584224 learned_addr learned my addr 172.21.15.151:0/1922584224 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f2021640 1 -- 172.21.15.151:0/1922584224 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4acd986d0 con 0x55c4acc17bf0 2024-09-12T16:52:18.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f2021640 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd98170 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c10 tx=0x7f72e80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f71dee05640 1 -- 172.21.15.151:0/1922584224 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e80abec0 con 0x55c4acc17bf0 2024-09-12T16:52:18.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f71dee05640 1 -- 172.21.15.151:0/1922584224 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e80c6690 con 0x55c4acc17bf0 2024-09-12T16:52:18.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4acd98960 con 0x55c4acc17bf0 2024-09-12T16:52:18.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f71dee05640 1 -- 172.21.15.151:0/1922584224 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e80c6990 con 0x55c4acc17bf0 2024-09-12T16:52:18.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4acd99310 con 0x55c4acc17bf0 2024-09-12T16:52:18.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f71dee05640 1 -- 172.21.15.151:0/1922584224 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f72e80ce030 con 0x55c4acc17bf0 2024-09-12T16:52:18.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f71dee05640 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71d8039c10 0x7f71d803c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f71dee05640 1 -- 172.21.15.151:0/1922584224 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72e80cc020 con 0x55c4acc17bf0 2024-09-12T16:52:18.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f1820640 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71d8039c10 0x7f71d803c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acc19200 0x55c4acd9f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acd9f820 con 0x55c4acc19200 2024-09-12T16:52:18.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f2822640 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acc19200 0x55c4acd9f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.713+0000 7f72f1820640 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71d8039c10 0x7f71d803c0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72e4001640 tx=0x7f72e40066a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f2822640 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acc19200 0x55c4acd9f2e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f2822640 1 -- 172.21.15.151:0/1922584224 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ec0083f0 con 0x55c4acc19200 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acd9fc00 con 0x55c4acc19200 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f2822640 1 -- 172.21.15.151:0/1922584224 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72ec0083f0 con 0x55c4acc19200 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acda1a10 0x55c4acda3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acda44d0 con 0x55c4acda1a10 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f2021640 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acda1a10 0x55c4acda3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f2021640 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acda1a10 0x55c4acda3e00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f2021640 1 -- 172.21.15.151:0/1922584224 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72e80d0930 con 0x55c4acda1a10 2024-09-12T16:52:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acda08b0 con 0x55c4acc19200 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f2822640 1 -- 172.21.15.151:0/1922584224 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72ec0083f0 con 0x55c4acc19200 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acda0d50 con 0x55c4acc19200 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f2822640 1 -- 172.21.15.151:0/1922584224 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72ec0083f0 con 0x55c4acc19200 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 Processor -- start 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 -- start start 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdb2b40 0x55c4acdb2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.717+0000 7f72f451b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c4acbb8450 con 0x55c4acdb2b40 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f2822640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdb2b40 0x55c4acdb2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f2822640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdb2b40 0x55c4acdb2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34286/0 (socket says 172.21.15.151:34286) 2024-09-12T16:52:18.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f2822640 1 -- 172.21.15.151:0/3626086490 learned_addr learned my addr 172.21.15.151:0/3626086490 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f2822640 1 -- 172.21.15.151:0/3626086490 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4acdb35a0 con 0x55c4acdb2b40 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f2822640 1 --2- 172.21.15.151:0/3626086490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdb2b40 0x55c4acdb2f60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55c4acd9a200 tx=0x7f72ec00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f71d7fff640 1 -- 172.21.15.151:0/3626086490 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec007e00 con 0x55c4acdb2b40 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f71d7fff640 1 -- 172.21.15.151:0/3626086490 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec01e020 con 0x55c4acdb2b40 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f71d7fff640 1 -- 172.21.15.151:0/3626086490 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec019590 con 0x55c4acdb2b40 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3626086490 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4acdb3e00 con 0x55c4acdb2b40 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3626086490 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4acdb4370 con 0x55c4acdb2b40 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f71d7fff640 1 -- 172.21.15.151:0/3626086490 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f72ec016040 con 0x55c4acdb2b40 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f71d7fff640 1 --2- 172.21.15.151:0/3626086490 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71cc039ac0 0x7f71cc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f71d7fff640 1 -- 172.21.15.151:0/3626086490 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72ec01f030 con 0x55c4acdb2b40 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f2021640 1 --2- 172.21.15.151:0/3626086490 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71cc039ac0 0x7f71cc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f451b9c0 1 Processor -- start 2024-09-12T16:52:18.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f2021640 1 --2- 172.21.15.151:0/3626086490 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71cc039ac0 0x7f71cc03bf80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c4acd99600 tx=0x7f72e80c5f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f451b9c0 1 -- start start 2024-09-12T16:52:18.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f451b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.721+0000 7f72f451b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c4acd913a0 con 0x55c4acdc03b0 2024-09-12T16:52:18.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34302/0 (socket says 172.21.15.151:34302) 2024-09-12T16:52:18.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 -- 172.21.15.151:0/2148160949 learned_addr learned my addr 172.21.15.151:0/2148160949 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 -- 172.21.15.151:0/2148160949 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4acdc0da0 con 0x55c4acdc03b0 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 --2- 172.21.15.151:0/2148160949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc07b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f72ec017a80 tx=0x7f72ec017760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405e9f0706bbd5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f71d5ffb640 1 -- 172.21.15.151:0/2148160949 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec01d040 con 0x55c4acdc03b0 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f71d5ffb640 1 -- 172.21.15.151:0/2148160949 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec0173b0 con 0x55c4acdc03b0 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f71d5ffb640 1 -- 172.21.15.151:0/2148160949 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec023590 con 0x55c4acdc03b0 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2148160949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 msgr2=0x55c4acdc07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/2148160949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc07b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f72ec017a80 tx=0x7f72ec017760 comp rx=0 tx=0).stop 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2148160949 shutdown_connections 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/2148160949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc07b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2148160949 >> 172.21.15.151:0/2148160949 conn(0x55c4acdbb7d0 msgr2=0x55c4acdb9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2148160949 shutdown_connections 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- 172.21.15.151:0/2148160949 wait complete. 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 Processor -- start 2024-09-12T16:52:18.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- start start 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c4acdbf300 con 0x55c4acdc03b0 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34312/0 (socket says 172.21.15.151:34312) 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 learned_addr learned my addr 172.21.15.151:0/3568803246 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4acdc6e20 con 0x55c4acdc03b0 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f2822640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc68c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72ec017a80 tx=0x7f72ec050890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f71c3fff640 1 -- 172.21.15.151:0/3568803246 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec01d070 con 0x55c4acdc03b0 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4acdc70b0 con 0x55c4acdc03b0 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f71c3fff640 1 -- 172.21.15.151:0/3568803246 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec031030 con 0x55c4acdc03b0 2024-09-12T16:52:18.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f71c3fff640 1 -- 172.21.15.151:0/3568803246 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ec03b060 con 0x55c4acdc03b0 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.725+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4acdc7a60 con 0x55c4acdc03b0 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f71c3fff640 1 -- 172.21.15.151:0/3568803246 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f72ec050d10 con 0x55c4acdc03b0 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f71c3fff640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71bc039ac0 0x7f71bc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f71c3fff640 1 -- 172.21.15.151:0/3568803246 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72ec024030 con 0x55c4acdc03b0 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f2021640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71bc039ac0 0x7f71bc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acdd1bb0 0x55c4acdd4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdd4790 con 0x55c4acdd1bb0 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f1820640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acdd1bb0 0x55c4acdd4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f2021640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71bc039ac0 0x7f71bc03bf80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72e80a4070 tx=0x7f72e80e5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f1820640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acdd1bb0 0x55c4acdd4040 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 realm 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdd0fc0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdd5290 con 0x55c4acdd1bb0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdd5b60 con 0x55c4acdd1bb0 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acdd6580 0x55c4acdd8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdd90b0 con 0x55c4acdd6580 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f2822640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acdd6580 0x55c4acdd8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.729+0000 7f72f2822640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acdd6580 0x55c4acdd8970 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f451b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:18.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f451b9c0 20 searching for the correct realm 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c4acddb000 0x55c4acddd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2021640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c4acddb000 0x55c4acddd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2021640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c4acddb000 0x55c4acddd430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2021640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f72e8009040 0x7f72e80eb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x7f72e8009040 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f1820640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f72e8009040 0x7f72e80eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f1820640 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f72e8009040 0x7f72e80eb930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.733+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x7f72e8009040 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x7f72e8009040 2024-09-12T16:52:18.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.737+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x7f72e8009040 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x7f72e8009040 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acddb000 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.741+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd6580 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddab0 con 0x7f72e8009040 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:18.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdd9a70 con 0x55c4acdd1bb0 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdd96b0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdda490 con 0x55c4acdd1bb0 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 zone default found 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 4 Realm: () 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 zonegroup default 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acdddf30 con 0x55c4acdd6580 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde01c0 con 0x55c4acddb000 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde0560 con 0x55c4acddb000 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 started sync module instance, tier type = 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.745+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acddf650 con 0x7f72e8009040 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.749+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.749+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94303202179920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acddf650 con 0x7f72e8009040 2024-09-12T16:52:18.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.749+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde1080 con 0x55c4acdd1bb0 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.749+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94303202179920] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.749+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.749+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94303202177440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde1040 con 0x55c4acdd1bb0 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.749+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde1a60 con 0x55c4acddb000 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94303202186576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde2330 con 0x55c4acddb000 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde2cf0 con 0x7f72e8009040 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94303202177440] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94303202191424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde2c60 con 0x7f72e8009040 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde3a70 con 0x55c4acdd1bb0 2024-09-12T16:52:18.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94303202186576] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94303202191424] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94303202188928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde3530 con 0x55c4acdd1bb0 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.753+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde3dc0 con 0x55c4acdd6580 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.757+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94303202188928] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.757+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.757+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94303202193808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde41e0 con 0x55c4acdd6580 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.757+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde4ba0 con 0x55c4acdd6580 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.757+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94303202193808] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94303202194960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde4ba0 con 0x55c4acdd6580 2024-09-12T16:52:18.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde5560 con 0x55c4acdd6580 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94303202194960] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94303202199280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde5740 con 0x55c4acdd6580 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 20 add_watcher() i=0 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 20 add_watcher() i=1 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 20 add_watcher() i=2 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 20 add_watcher() i=3 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 20 add_watcher() i=4 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 20 add_watcher() i=5 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 20 add_watcher() i=6 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94303202199280] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 20 add_watcher() i=7 2024-09-12T16:52:18.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:18.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.761+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde8960 con 0x55c4acdd1bb0 2024-09-12T16:52:18.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94303202202352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde5bc0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94303202202352] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f71a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:18.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:18.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 5 note: GC not initialized 2024-09-12T16:52:18.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f71237fe640 20 reqs_thread_entry: start 2024-09-12T16:52:18.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:18.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 20 Filter name: none 2024-09-12T16:52:18.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f71217fa640 20 reqs_thread_entry: start 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4ace0bc70 con 0x55c4acdd1bb0 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:18.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-12T16:52:18.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4ace0ca10 con 0x7f72e8009040 2024-09-12T16:52:18.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-12T16:52:18.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T16:52:18.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-12T16:52:18.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4ace12620 con 0x55c4acdd1bb0 2024-09-12T16:52:18.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:18.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:18.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.765+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94303202386224 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4ace0f300 con 0x55c4acdd1bb0 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94303202188928 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f72e401b040 con 0x55c4acdd1bb0 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f71d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94303202188928 notifier 4390 bl.length()=849 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f71d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f71d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(65 notify.4 [notify cookie 94303202386224 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f71d5ffb640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f71b8003eb0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94303202386224 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c4acb579c0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4ace12130 con 0x7f72e8009040 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f451b9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f451b9c0 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f451b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94303202386224 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4ace0cdb0 con 0x7f72e8009040 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== watch-notify(notify (1) cookie 94303202179920 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55c4acb579c0 con 0x7f72e8009040 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f71d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94303202179920 notifier 4390 bl.length()=166 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f71d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f71d57fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(68 notify.0 [notify cookie 94303202386224 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f71d57fa640 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7128003410 con 0x7f72e8009040 2024-09-12T16:52:18.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.769+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== watch-notify(notify_complete (2) cookie 94303202386224 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f72e4014b60 con 0x7f72e8009040 2024-09-12T16:52:18.779 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T16:52:18.768788Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:18.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.773+0000 7f71a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.773+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94303202202352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4ace0aea0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.773+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94303202202352] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.773+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94303202179920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde52f0 con 0x7f72e8009040 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.773+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94303202179920] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.773+0000 7f72f451b9c0 20 remove_watcher() i=0 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.773+0000 7f72f451b9c0 2 removed watcher, disabling cache 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.773+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94303202177440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde52f0 con 0x55c4acdd1bb0 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94303202177440] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f451b9c0 20 remove_watcher() i=1 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94303202186576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde52f0 con 0x55c4acddb000 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f2021640 1 -- 172.21.15.151:0/3568803246 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94303202186576] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e80e3030 con 0x55c4acddb000 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f451b9c0 20 remove_watcher() i=2 2024-09-12T16:52:18.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94303202191424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde1550 con 0x7f72e8009040 2024-09-12T16:52:18.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94303202191424] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x7f72e8009040 2024-09-12T16:52:18.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f451b9c0 20 remove_watcher() i=3 2024-09-12T16:52:18.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.777+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94303202188928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde2840 con 0x55c4acdd1bb0 2024-09-12T16:52:18.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.781+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94303202188928] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e400f070 con 0x55c4acdd1bb0 2024-09-12T16:52:18.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.781+0000 7f72f451b9c0 20 remove_watcher() i=4 2024-09-12T16:52:18.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.781+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94303202193808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde1550 con 0x55c4acdd6580 2024-09-12T16:52:18.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.781+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94303202193808] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.781+0000 7f72f451b9c0 20 remove_watcher() i=5 2024-09-12T16:52:18.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.781+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94303202194960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde2840 con 0x55c4acdd6580 2024-09-12T16:52:18.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94303202194960] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 20 remove_watcher() i=6 2024-09-12T16:52:18.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94303202199280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4acde3190 con 0x55c4acdd6580 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f2822640 1 -- 172.21.15.151:0/3568803246 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94303202199280] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec02a070 con 0x55c4acdd6580 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 20 remove_watcher() i=7 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acdd6580 msgr2=0x55c4acdd8970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acdd6580 0x55c4acdd8970 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acdd1bb0 msgr2=0x55c4acdd4040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acdd1bb0 0x55c4acdd4040 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f72e8009040 msgr2=0x7f72e80eb930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f72e8009040 0x7f72e80eb930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c4acddb000 msgr2=0x55c4acddd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c4acddb000 0x55c4acddd430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71bc039ac0 msgr2=0x7f71bc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71bc039ac0 0x7f71bc03bf80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72e80a4070 tx=0x7f72e80e5000 comp rx=0 tx=0).stop 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 msgr2=0x55c4acdc68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3568803246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdc03b0 0x55c4acdc68c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72ec017a80 tx=0x7f72ec050890 comp rx=0 tx=0).stop 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f1820640 1 -- 172.21.15.151:0/3568803246 reap_dead start 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 shutdown_connections 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 >> 172.21.15.151:0/3568803246 conn(0x55c4acdbb7d0 msgr2=0x55c4acdb99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 shutdown_connections 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3568803246 wait complete. 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3626086490 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71cc039ac0 msgr2=0x7f71cc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3626086490 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71cc039ac0 0x7f71cc03bf80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c4acd99600 tx=0x7f72e80c5f90 comp rx=0 tx=0).stop 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3626086490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdb2b40 msgr2=0x55c4acdb2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3626086490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdb2b40 0x55c4acdb2f60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55c4acd9a200 tx=0x7f72ec00af40 comp rx=0 tx=0).stop 2024-09-12T16:52:18.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3626086490 shutdown_connections 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3626086490 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71cc039ac0 0x7f71cc03bf80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/3626086490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acdb2b40 0x55c4acdb2f60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3626086490 >> 172.21.15.151:0/3626086490 conn(0x55c4acda84f0 msgr2=0x55c4acda88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3626086490 shutdown_connections 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.785+0000 7f72f451b9c0 1 -- 172.21.15.151:0/3626086490 wait complete. 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acda1a10 msgr2=0x55c4acda3e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acda1a10 0x55c4acda3e00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acc19200 msgr2=0x55c4acd9f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acc19200 0x55c4acd9f2e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71d8039c10 msgr2=0x7f71d803c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71d8039c10 0x7f71d803c0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72e4001640 tx=0x7f72e40066a0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 msgr2=0x55c4acd98170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd98170 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c10 tx=0x7f72e80180e0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 shutdown_connections 2024-09-12T16:52:18.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c4acda1a10 0x55c4acda3e00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c4acc19200 0x55c4acd9f2e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f71d8039c10 0x7f71d803c0d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 --2- 172.21.15.151:0/1922584224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4acc17bf0 0x55c4acd98170 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 >> 172.21.15.151:0/1922584224 conn(0x55c4acc9ea20 msgr2=0x55c4acd8b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 shutdown_connections 2024-09-12T16:52:18.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.789+0000 7f72f451b9c0 1 -- 172.21.15.151:0/1922584224 wait complete. 2024-09-12T16:52:18.800 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T16:52:18.768788Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:18.800 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:52:18.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:52:18.800 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:52:18.872 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:18.872 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:18.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf7de09c0 1 Processor -- start 2024-09-12T16:52:18.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf7de09c0 1 -- start start 2024-09-12T16:52:18.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf7de09c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56173ab4c200 0x56173abdac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf7de09c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56173aa8c9c0 con 0x56173abdb170 2024-09-12T16:52:18.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf7de09c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56173aadc6d0 con 0x56173ab4c200 2024-09-12T16:52:18.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf58e6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56173ab4c200 0x56173abdac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf50e5640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x56173abdb170 0x56173abdd560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38146/0 (socket says 172.21.15.151:38146) 2024-09-12T16:52:18.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf58e6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56173ab4c200 0x56173abdac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34324/0 (socket says 172.21.15.151:34324) 2024-09-12T16:52:18.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.869+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2948357169 learned_addr learned my addr 172.21.15.151:0/2948357169 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:18.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2948357169 >> v1:172.21.15.122:6789/0 conn(0x56173abdb170 legacy=0x56173abdd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2948357169 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173aa80ca0 con 0x56173ab4c200 2024-09-12T16:52:18.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2948357169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173abdac30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800a480 tx=0x7f8ce801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3eac4f324d4abd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf48e4640 1 -- 172.21.15.151:0/2948357169 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce80af070 con 0x56173ab4c200 2024-09-12T16:52:18.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf48e4640 1 -- 172.21.15.151:0/2948357169 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce80aa530 con 0x56173ab4c200 2024-09-12T16:52:18.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf48e4640 1 -- 172.21.15.151:0/2948357169 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce80aa830 con 0x56173ab4c200 2024-09-12T16:52:18.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2948357169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 msgr2=0x56173abdac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2948357169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173abdac30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800a480 tx=0x7f8ce801b280 comp rx=0 tx=0).stop 2024-09-12T16:52:18.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2948357169 shutdown_connections 2024-09-12T16:52:18.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2948357169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173abdac30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2948357169 >> 172.21.15.151:0/2948357169 conn(0x56173abd2920 msgr2=0x56173abd4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2948357169 shutdown_connections 2024-09-12T16:52:18.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.873+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2948357169 wait complete. 2024-09-12T16:52:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 Processor -- start 2024-09-12T16:52:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- start start 2024-09-12T16:52:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173acc3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56173aae0680 con 0x56173ab4c200 2024-09-12T16:52:18.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf58e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173acc3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf58e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173acc3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34328/0 (socket says 172.21.15.151:34328) 2024-09-12T16:52:18.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2923723978 learned_addr learned my addr 172.21.15.151:0/2923723978 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2923723978 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173aa5bda0 con 0x56173ab4c200 2024-09-12T16:52:18.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2923723978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173acc3740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80ad040 tx=0x7f8ce8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaa78e24526ae48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8be3e07640 1 -- 172.21.15.151:0/2923723978 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce80af070 con 0x56173ab4c200 2024-09-12T16:52:18.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8be3e07640 1 -- 172.21.15.151:0/2923723978 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce80b0040 con 0x56173ab4c200 2024-09-12T16:52:18.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8be3e07640 1 -- 172.21.15.151:0/2923723978 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce80aa830 con 0x56173ab4c200 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2923723978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 msgr2=0x56173acc3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2923723978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173acc3740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80ad040 tx=0x7f8ce8003030 comp rx=0 tx=0).stop 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2923723978 shutdown_connections 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2923723978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173acc3740 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2923723978 >> 172.21.15.151:0/2923723978 conn(0x56173abd2920 msgr2=0x56173acbf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2923723978 shutdown_connections 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2923723978 wait complete. 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 Processor -- start 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- start start 2024-09-12T16:52:18.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173accac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf7de09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56173aa82a50 con 0x56173ab4c200 2024-09-12T16:52:18.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf58e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173accac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf58e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173accac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34334/0 (socket says 172.21.15.151:34334) 2024-09-12T16:52:18.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.889+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2302004572 learned_addr learned my addr 172.21.15.151:0/2302004572 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2302004572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173accb1e0 con 0x56173ab4c200 2024-09-12T16:52:18.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173accac80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8ce801bb20 tx=0x7f8ce8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8be2604640 1 -- 172.21.15.151:0/2302004572 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce80c4020 con 0x56173ab4c200 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56173accb470 con 0x56173ab4c200 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8be2604640 1 -- 172.21.15.151:0/2302004572 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce80b6690 con 0x56173ab4c200 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8be2604640 1 -- 172.21.15.151:0/2302004572 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce80b6970 con 0x56173ab4c200 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56173accbe20 con 0x56173ab4c200 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8be2604640 1 -- 172.21.15.151:0/2302004572 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ce80c7020 con 0x56173ab4c200 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8be2604640 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bdc039a70 0x7f8bdc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8be2604640 1 -- 172.21.15.151:0/2302004572 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8ce80bb070 con 0x56173ab4c200 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf50e5640 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bdc039a70 0x7f8bdc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173abdb170 0x56173acd1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173acd2330 con 0x56173abdb170 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf60e7640 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173abdb170 0x56173acd1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf50e5640 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bdc039a70 0x7f8bdc03bf30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8cec004180 tx=0x7f8cec001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf60e7640 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173abdb170 0x56173acd1df0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2302004572 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cf000a4d0 con 0x56173abdb170 2024-09-12T16:52:18.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173acd2730 con 0x56173abdb170 2024-09-12T16:52:18.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2302004572 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8cf000a4d0 con 0x56173abdb170 2024-09-12T16:52:18.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173acd4540 0x56173acd6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.893+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173acd7020 con 0x56173acd4540 2024-09-12T16:52:18.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173acd4540 0x56173acd6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173acd4540 0x56173acd6930 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2302004572 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ce80a8070 con 0x56173acd4540 2024-09-12T16:52:18.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173acd33b0 con 0x56173abdb170 2024-09-12T16:52:18.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2302004572 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8cf000a4d0 con 0x56173abdb170 2024-09-12T16:52:18.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173acd3850 con 0x56173abdb170 2024-09-12T16:52:18.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2302004572 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8cf000a4d0 con 0x56173abdb170 2024-09-12T16:52:18.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf7de09c0 1 Processor -- start 2024-09-12T16:52:18.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf7de09c0 1 -- start start 2024-09-12T16:52:18.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf7de09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173abd8350 0x56173abd6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf7de09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56173aaed450 con 0x56173abd8350 2024-09-12T16:52:18.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf60e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173abd8350 0x56173abd6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf60e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173abd8350 0x56173abd6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34338/0 (socket says 172.21.15.151:34338) 2024-09-12T16:52:18.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2118320257 learned_addr learned my addr 172.21.15.151:0/2118320257 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.897+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2118320257 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173abd8870 con 0x56173abd8350 2024-09-12T16:52:18.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf60e7640 1 --2- 172.21.15.151:0/2118320257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173abd8350 0x56173abd6bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x56173accba00 tx=0x7f8cf0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bdb7fe640 1 -- 172.21.15.151:0/2118320257 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0014450 con 0x56173abd8350 2024-09-12T16:52:18.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bdb7fe640 1 -- 172.21.15.151:0/2118320257 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0014610 con 0x56173abd8350 2024-09-12T16:52:18.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bdb7fe640 1 -- 172.21.15.151:0/2118320257 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0014930 con 0x56173abd8350 2024-09-12T16:52:18.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2118320257 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56173abd7130 con 0x56173abd8350 2024-09-12T16:52:18.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2118320257 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56173abd76a0 con 0x56173abd8350 2024-09-12T16:52:18.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bdb7fe640 1 -- 172.21.15.151:0/2118320257 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8cf0011040 con 0x56173abd8350 2024-09-12T16:52:18.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bdb7fe640 1 --2- 172.21.15.151:0/2118320257 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bd0039b10 0x7f8bd003bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bdb7fe640 1 -- 172.21.15.151:0/2118320257 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8cf001e070 con 0x56173abd8350 2024-09-12T16:52:18.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2118320257 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bd0039b10 0x7f8bd003bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf7de09c0 1 Processor -- start 2024-09-12T16:52:18.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf7de09c0 1 -- start start 2024-09-12T16:52:18.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2118320257 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bd0039b10 0x7f8bd003bfd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80e9850 tx=0x7f8ce80e9720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf7de09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acf5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf7de09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56173acc3ed0 con 0x56173acf5170 2024-09-12T16:52:18.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf60e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acf5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf60e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acf5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34354/0 (socket says 172.21.15.151:34354) 2024-09-12T16:52:18.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf60e7640 1 -- 172.21.15.151:0/1755320923 learned_addr learned my addr 172.21.15.151:0/1755320923 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf60e7640 1 -- 172.21.15.151:0/1755320923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173acf5b60 con 0x56173acf5170 2024-09-12T16:52:18.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8cf60e7640 1 --2- 172.21.15.151:0/1755320923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acf5570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8cf002bfb0 tx=0x7f8cf002b350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ab62d681201779 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bd97fa640 1 -- 172.21.15.151:0/1755320923 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf00167c0 con 0x56173acf5170 2024-09-12T16:52:18.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bd97fa640 1 -- 172.21.15.151:0/1755320923 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0011330 con 0x56173acf5170 2024-09-12T16:52:18.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.901+0000 7f8bd97fa640 1 -- 172.21.15.151:0/1755320923 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0016960 con 0x56173acf5170 2024-09-12T16:52:18.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/1755320923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 msgr2=0x56173acf5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/1755320923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acf5570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8cf002bfb0 tx=0x7f8cf002b350 comp rx=0 tx=0).stop 2024-09-12T16:52:18.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/1755320923 shutdown_connections 2024-09-12T16:52:18.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/1755320923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acf5570 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/1755320923 >> 172.21.15.151:0/1755320923 conn(0x56173acf0590 msgr2=0x56173acee7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/1755320923 shutdown_connections 2024-09-12T16:52:18.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/1755320923 wait complete. 2024-09-12T16:52:18.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 Processor -- start 2024-09-12T16:52:18.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- start start 2024-09-12T16:52:18.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acfb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56173acf40c0 con 0x56173acf5170 2024-09-12T16:52:18.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf60e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acfb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf60e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acfb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34356/0 (socket says 172.21.15.151:34356) 2024-09-12T16:52:18.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 learned_addr learned my addr 172.21.15.151:0/2148822831 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:18.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56173acfbbb0 con 0x56173acf5170 2024-09-12T16:52:18.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf60e7640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acfb650 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0018430 tx=0x7f8cf0050590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8bc77fe640 1 -- 172.21.15.151:0/2148822831 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf003e7b0 con 0x56173acf5170 2024-09-12T16:52:18.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8bc77fe640 1 -- 172.21.15.151:0/2148822831 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0031030 con 0x56173acf5170 2024-09-12T16:52:18.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56173acfbe40 con 0x56173acf5170 2024-09-12T16:52:18.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8bc77fe640 1 -- 172.21.15.151:0/2148822831 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf003eae0 con 0x56173acf5170 2024-09-12T16:52:18.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56173acfc7f0 con 0x56173acf5170 2024-09-12T16:52:18.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.905+0000 7f8bc77fe640 1 -- 172.21.15.151:0/2148822831 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8cf003ec80 con 0x56173acf5170 2024-09-12T16:52:18.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8bc77fe640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bc0039a70 0x7f8bc003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8bc77fe640 1 -- 172.21.15.151:0/2148822831 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8cf000e040 con 0x56173acf5170 2024-09-12T16:52:18.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bc0039a70 0x7f8bc003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173ad06900 0x56173ad08d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad094e0 con 0x56173ad06900 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf50e5640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173ad06900 0x56173ad08d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bc0039a70 0x7f8bc003bf30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8003050 tx=0x7f8ce80d5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf50e5640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173ad06900 0x56173ad08d90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cec00e640 con 0x56173ad06900 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 realm 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad05d10 con 0x56173ad06900 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cec00e640 con 0x56173ad06900 2024-09-12T16:52:18.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad09fe0 con 0x56173ad06900 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cec00e640 con 0x56173ad06900 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad0a8b0 con 0x56173ad06900 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8cec00e640 con 0x56173ad06900 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173ad0b160 0x56173ad0d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad0dc90 con 0x56173ad0b160 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf60e7640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173ad0b160 0x56173ad0d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf60e7640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173ad0b160 0x56173ad0d550 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 20 searching for the correct realm 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56173ad0fc80 0x56173ad12140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56173ad0fc80 0x56173ad12140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56173ad0fc80 0x56173ad12140 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf58e6640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8ce80c9020 0x7f8ce80c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.909+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x7f8ce80c9020 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8ce80c9020 0x7f8ce80c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8ce80c9020 0x7f8ce80c85d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec00e640 con 0x7f8ce80c9020 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad06900 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec00e640 con 0x56173ad06900 2024-09-12T16:52:18.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad06900 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x7f8ce80c9020 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x7f8ce80c9020 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad06900 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.913+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad06900 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x7f8ce80c9020 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8cec029040 con 0x7f8ce80c9020 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad06900 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad06900 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.917+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x7f8ce80c9020 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x7f8ce80c9020 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad06900 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x7f8ce80c9020 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x7f8ce80c9020 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0fc80 2024-09-12T16:52:18.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad0b160 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x56173ad06900 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.921+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56173ad12810 con 0x7f8ce80c9020 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cec029040 con 0x7f8ce80c9020 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:18.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad0e6a0 con 0x56173ad06900 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad0eb20 con 0x56173ad06900 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8cec029040 con 0x56173ad06900 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad0ef40 con 0x56173ad06900 2024-09-12T16:52:18.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:18.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 zone default found 2024-09-12T16:52:18.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 4 Realm: () 2024-09-12T16:52:18.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:18.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:18.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:18.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 zonegroup default 2024-09-12T16:52:18.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad0ef40 con 0x56173ad0b160 2024-09-12T16:52:18.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad14b30 con 0x56173ad0fc80 2024-09-12T16:52:18.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad14ed0 con 0x56173ad0fc80 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 started sync module instance, tier type = 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad13f70 con 0x7f8ce80c9020 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x7f8ce80c9020 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94657771029616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad13f70 con 0x7f8ce80c9020 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.925+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad15890 con 0x56173ad06900 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.929+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.929+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94657771033568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad15800 con 0x56173ad06900 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.929+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad16750 con 0x56173ad0fc80 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.929+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94657771029616] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x7f8ce80c9020 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.929+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.929+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94657771037344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad16b40 con 0x56173ad0fc80 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.929+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad17500 con 0x7f8ce80c9020 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.929+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94657771033568] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x7f8ce80c9020 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94657771040848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad17470 con 0x7f8ce80c9020 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad18250 con 0x56173ad06900 2024-09-12T16:52:18.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94657771037344] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94657771040848] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x7f8ce80c9020 2024-09-12T16:52:18.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94657771027136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad17d50 con 0x56173ad06900 2024-09-12T16:52:18.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad18af0 con 0x56173ad0b160 2024-09-12T16:52:18.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.933+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94657771027136] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.937+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.937+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94657771046464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad17d50 con 0x56173ad0b160 2024-09-12T16:52:18.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.937+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad19340 con 0x56173ad0b160 2024-09-12T16:52:18.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.937+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94657771046464] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.937+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.937+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94657771043456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad19340 con 0x56173ad0b160 2024-09-12T16:52:18.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.937+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad19d60 con 0x56173ad0b160 2024-09-12T16:52:18.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94657771051088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad1a1d0 con 0x56173ad0b160 2024-09-12T16:52:18.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 add_watcher() i=0 2024-09-12T16:52:18.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 add_watcher() i=1 2024-09-12T16:52:18.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 add_watcher() i=2 2024-09-12T16:52:18.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 add_watcher() i=3 2024-09-12T16:52:18.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 add_watcher() i=4 2024-09-12T16:52:18.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 add_watcher() i=5 2024-09-12T16:52:18.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94657771043456] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 add_watcher() i=6 2024-09-12T16:52:18.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94657771051088] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 add_watcher() i=7 2024-09-12T16:52:18.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:18.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad18e90 con 0x56173ad06900 2024-09-12T16:52:18.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94657771048592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad1a750 con 0x56173ad06900 2024-09-12T16:52:18.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94657771048592] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8ba77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:18.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:18.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 5 note: GC not initialized 2024-09-12T16:52:18.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8ba67fc640 20 reqs_thread_entry: start 2024-09-12T16:52:18.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:18.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.941+0000 7f8cf7de09c0 20 Filter name: none 2024-09-12T16:52:18.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8b17fff640 20 reqs_thread_entry: start 2024-09-12T16:52:18.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf7de09c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:18.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56173ad3ff70 con 0x56173ad06900 2024-09-12T16:52:18.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf7de09c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-12T16:52:18.961 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T16:52:18.768788Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:18.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8ba77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:18.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94657771048592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad1ab70 con 0x56173ad06900 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94657771048592] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94657771029616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad18e90 con 0x7f8ce80c9020 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94657771029616] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x7f8ce80c9020 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf7de09c0 20 remove_watcher() i=0 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf7de09c0 2 removed watcher, disabling cache 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.945+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94657771033568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad14470 con 0x56173ad06900 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.949+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94657771033568] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.949+0000 7f8cf7de09c0 20 remove_watcher() i=1 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.949+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94657771037344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad153e0 con 0x56173ad0fc80 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.949+0000 7f8cf58e6640 1 -- 172.21.15.151:0/2148822831 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94657771037344] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce80db070 con 0x56173ad0fc80 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.949+0000 7f8cf7de09c0 20 remove_watcher() i=2 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.949+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94657771040848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad162a0 con 0x7f8ce80c9020 2024-09-12T16:52:18.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.953+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94657771040848] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x7f8ce80c9020 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.953+0000 7f8cf7de09c0 20 remove_watcher() i=3 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.953+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94657771027136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad162a0 con 0x56173ad06900 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.953+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94657771027136] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cec0391c0 con 0x56173ad06900 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.953+0000 7f8cf7de09c0 20 remove_watcher() i=4 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.953+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94657771046464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad162a0 con 0x56173ad0b160 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94657771046464] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 20 remove_watcher() i=5 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94657771043456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad162a0 con 0x56173ad0b160 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94657771043456] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 20 remove_watcher() i=6 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94657771051088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56173ad17a80 con 0x56173ad0b160 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf60e7640 1 -- 172.21.15.151:0/2148822831 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94657771051088] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf002a070 con 0x56173ad0b160 2024-09-12T16:52:18.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 20 remove_watcher() i=7 2024-09-12T16:52:18.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173ad0b160 msgr2=0x56173ad0d550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173ad0b160 0x56173ad0d550 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173ad06900 msgr2=0x56173ad08d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173ad06900 0x56173ad08d90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8ce80c9020 msgr2=0x7f8ce80c85d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8ce80c9020 0x7f8ce80c85d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56173ad0fc80 msgr2=0x56173ad12140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56173ad0fc80 0x56173ad12140 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bc0039a70 msgr2=0x7f8bc003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bc0039a70 0x7f8bc003bf30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8003050 tx=0x7f8ce80d5000 comp rx=0 tx=0).stop 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 msgr2=0x56173acfb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.957+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2148822831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173acf5170 0x56173acfb650 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0018430 tx=0x7f8cf0050590 comp rx=0 tx=0).stop 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf50e5640 1 -- 172.21.15.151:0/2148822831 reap_dead start 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 shutdown_connections 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 >> 172.21.15.151:0/2148822831 conn(0x56173acf0590 msgr2=0x56173acee7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 shutdown_connections 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2148822831 wait complete. 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2118320257 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bd0039b10 msgr2=0x7f8bd003bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2118320257 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bd0039b10 0x7f8bd003bfd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80e9850 tx=0x7f8ce80e9720 comp rx=0 tx=0).stop 2024-09-12T16:52:18.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2118320257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173abd8350 msgr2=0x56173abd6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2118320257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173abd8350 0x56173abd6bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x56173accba00 tx=0x7f8cf0018830 comp rx=0 tx=0).stop 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2118320257 shutdown_connections 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2118320257 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bd0039b10 0x7f8bd003bfd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2118320257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173abd8350 0x56173abd6bf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2118320257 >> 172.21.15.151:0/2118320257 conn(0x56173acdb030 msgr2=0x56173acdb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2118320257 shutdown_connections 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2118320257 wait complete. 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173acd4540 msgr2=0x56173acd6930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173acd4540 0x56173acd6930 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173abdb170 msgr2=0x56173acd1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173abdb170 0x56173acd1df0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bdc039a70 msgr2=0x7f8bdc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bdc039a70 0x7f8bdc03bf30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8cec004180 tx=0x7f8cec001340 comp rx=0 tx=0).stop 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 msgr2=0x56173accac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173accac80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8ce801bb20 tx=0x7f8ce8018020 comp rx=0 tx=0).stop 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 shutdown_connections 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56173acd4540 0x56173acd6930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56173abdb170 0x56173acd1df0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8bdc039a70 0x7f8bdc03bf30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 --2- 172.21.15.151:0/2302004572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56173ab4c200 0x56173accac80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 >> 172.21.15.151:0/2302004572 conn(0x56173abd2920 msgr2=0x56173acbde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 shutdown_connections 2024-09-12T16:52:18.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:18.961+0000 7f8cf7de09c0 1 -- 172.21.15.151:0/2302004572 wait complete. 2024-09-12T16:52:18.973 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T16:52:18.768788Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:18.973 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-12T16:52:18.973 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-12T16:52:18.974 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-12T16:52:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8e5519c0 1 Processor -- start 2024-09-12T16:52:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8e5519c0 1 -- start start 2024-09-12T16:52:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8e5519c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5608ebfc91f0 0x5608ec057c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8e5519c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5608ebf099c0 con 0x5608ec058160 2024-09-12T16:52:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8e5519c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5608ebf596d0 con 0x5608ebfc91f0 2024-09-12T16:52:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8c057640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5608ebfc91f0 0x5608ec057c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8b856640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5608ec058160 0x5608ec05a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38152/0 (socket says 172.21.15.151:38152) 2024-09-12T16:52:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8c057640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5608ebfc91f0 0x5608ec057c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34372/0 (socket says 172.21.15.151:34372) 2024-09-12T16:52:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8b856640 1 -- 172.21.15.151:0/3800378977 learned_addr learned my addr 172.21.15.151:0/3800378977 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8c057640 1 -- 172.21.15.151:0/3800378977 >> v1:172.21.15.122:6789/0 conn(0x5608ec058160 legacy=0x5608ec05a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.053+0000 7f6d8c057640 1 -- 172.21.15.151:0/3800378977 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ebefdca0 con 0x5608ebfc91f0 2024-09-12T16:52:19.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8c057640 1 --2- 172.21.15.151:0/3800378977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec057c20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400a420 tx=0x7f6d8401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5c3c9865acf2eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8b055640 1 -- 172.21.15.151:0/3800378977 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d840b0070 con 0x5608ebfc91f0 2024-09-12T16:52:19.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8b055640 1 -- 172.21.15.151:0/3800378977 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d840a3dc0 con 0x5608ebfc91f0 2024-09-12T16:52:19.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8b055640 1 -- 172.21.15.151:0/3800378977 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d840ab570 con 0x5608ebfc91f0 2024-09-12T16:52:19.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3800378977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 msgr2=0x5608ec057c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3800378977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec057c20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400a420 tx=0x7f6d8401afd0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3800378977 shutdown_connections 2024-09-12T16:52:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3800378977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec057c20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3800378977 >> 172.21.15.151:0/3800378977 conn(0x5608ec04f910 msgr2=0x5608ec051d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3800378977 shutdown_connections 2024-09-12T16:52:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.057+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3800378977 wait complete. 2024-09-12T16:52:19.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.069+0000 7f6d8e5519c0 1 Processor -- start 2024-09-12T16:52:19.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.069+0000 7f6d8e5519c0 1 -- start start 2024-09-12T16:52:19.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.069+0000 7f6d8e5519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec140760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.069+0000 7f6d8e5519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5608ebf5d680 con 0x5608ebfc91f0 2024-09-12T16:52:19.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.069+0000 7f6d8c057640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec140760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34380/0 (socket says 172.21.15.151:34380) 2024-09-12T16:52:19.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 -- 172.21.15.151:0/1719793512 learned_addr learned my addr 172.21.15.151:0/1719793512 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 -- 172.21.15.151:0/1719793512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ebed8da0 con 0x5608ebfc91f0 2024-09-12T16:52:19.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 --2- 172.21.15.151:0/1719793512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec140760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6d84017be0 tx=0x7f6d840033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337ebe173de9b16a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6c7a60c640 1 -- 172.21.15.151:0/1719793512 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d840b0040 con 0x5608ebfc91f0 2024-09-12T16:52:19.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6c7a60c640 1 -- 172.21.15.151:0/1719793512 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d840ab5f0 con 0x5608ebfc91f0 2024-09-12T16:52:19.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6c7a60c640 1 -- 172.21.15.151:0/1719793512 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d840ab910 con 0x5608ebfc91f0 2024-09-12T16:52:19.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/1719793512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 msgr2=0x5608ec140760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/1719793512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec140760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6d84017be0 tx=0x7f6d840033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/1719793512 shutdown_connections 2024-09-12T16:52:19.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/1719793512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec140760 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/1719793512 >> 172.21.15.151:0/1719793512 conn(0x5608ec04f910 msgr2=0x5608ec13c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/1719793512 shutdown_connections 2024-09-12T16:52:19.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/1719793512 wait complete. 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 Processor -- start 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- start start 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5608ebeffa50 con 0x5608ebfc91f0 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec147cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34396/0 (socket says 172.21.15.151:34396) 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 -- 172.21.15.151:0/3171557991 learned_addr learned my addr 172.21.15.151:0/3171557991 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 -- 172.21.15.151:0/3171557991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ec148220 con 0x5608ebfc91f0 2024-09-12T16:52:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8c057640 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec147cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d84017be0 tx=0x7f6d84017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6c78e09640 1 -- 172.21.15.151:0/3171557991 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d840b0040 con 0x5608ebfc91f0 2024-09-12T16:52:19.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608ec1484b0 con 0x5608ebfc91f0 2024-09-12T16:52:19.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6c78e09640 1 -- 172.21.15.151:0/3171557991 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d840b4750 con 0x5608ebfc91f0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6c78e09640 1 -- 172.21.15.151:0/3171557991 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d840b4a50 con 0x5608ebfc91f0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.073+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608ec148e60 con 0x5608ebfc91f0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6c78e09640 1 -- 172.21.15.151:0/3171557991 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d840cd060 con 0x5608ebfc91f0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6c78e09640 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c74039ac0 0x7f6c7403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6c78e09640 1 -- 172.21.15.151:0/3171557991 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6d840ea710 con 0x5608ebfc91f0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8b856640 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c74039ac0 0x7f6c7403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec058160 0x5608ec14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec14f370 con 0x5608ec058160 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8c858640 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec058160 0x5608ec14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8b856640 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c74039ac0 0x7f6c7403bf80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d74004180 tx=0x7f6d74001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8c858640 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec058160 0x5608ec14ee30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8c858640 1 -- 172.21.15.151:0/3171557991 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c0083f0 con 0x5608ec058160 2024-09-12T16:52:19.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec14f7c0 con 0x5608ec058160 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8c858640 1 -- 172.21.15.151:0/3171557991 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d7c0083f0 con 0x5608ec058160 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1515d0 0x5608ec1539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1540b0 con 0x5608ec1515d0 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8c057640 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1515d0 0x5608ec1539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.077+0000 7f6d8c057640 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1515d0 0x5608ec1539c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8c057640 1 -- 172.21.15.151:0/3171557991 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec1515d0 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec150470 con 0x5608ec058160 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8c858640 1 -- 172.21.15.151:0/3171557991 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d7c0083f0 con 0x5608ec058160 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec150910 con 0x5608ec058160 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8c858640 1 -- 172.21.15.151:0/3171557991 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d7c0083f0 con 0x5608ec058160 2024-09-12T16:52:19.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8e5519c0 1 Processor -- start 2024-09-12T16:52:19.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8e5519c0 1 -- start start 2024-09-12T16:52:19.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8e5519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec055380 0x5608ec053c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8e5519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5608ebf6a450 con 0x5608ec055380 2024-09-12T16:52:19.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8c858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec055380 0x5608ec053c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8c858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec055380 0x5608ec053c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34400/0 (socket says 172.21.15.151:34400) 2024-09-12T16:52:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8c858640 1 -- 172.21.15.151:0/2969908313 learned_addr learned my addr 172.21.15.151:0/2969908313 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8c858640 1 -- 172.21.15.151:0/2969908313 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ec0558a0 con 0x5608ec055380 2024-09-12T16:52:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8c858640 1 --2- 172.21.15.151:0/2969908313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec055380 0x5608ec053c20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5608ec149050 tx=0x7f6d7c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6c71ffb640 1 -- 172.21.15.151:0/2969908313 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c007d70 con 0x5608ec055380 2024-09-12T16:52:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2969908313 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608ec054160 con 0x5608ec055380 2024-09-12T16:52:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6c71ffb640 1 -- 172.21.15.151:0/2969908313 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c01e020 con 0x5608ec055380 2024-09-12T16:52:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6c71ffb640 1 -- 172.21.15.151:0/2969908313 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c019590 con 0x5608ec055380 2024-09-12T16:52:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.081+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2969908313 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608ec0546d0 con 0x5608ec055380 2024-09-12T16:52:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6c71ffb640 1 -- 172.21.15.151:0/2969908313 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d7c016040 con 0x5608ec055380 2024-09-12T16:52:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6c71ffb640 1 --2- 172.21.15.151:0/2969908313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c64039a70 0x7f6c6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6c71ffb640 1 -- 172.21.15.151:0/2969908313 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6d7c01f030 con 0x5608ec055380 2024-09-12T16:52:19.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8c057640 1 --2- 172.21.15.151:0/2969908313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c64039a70 0x7f6c6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 Processor -- start 2024-09-12T16:52:19.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- start start 2024-09-12T16:52:19.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8c057640 1 --2- 172.21.15.151:0/2969908313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c64039a70 0x7f6c6403bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5608ec1491b0 tx=0x7f6d840ea040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5608ec140ef0 con 0x5608ec1711e0 2024-09-12T16:52:19.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8c858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8c858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34412/0 (socket says 172.21.15.151:34412) 2024-09-12T16:52:19.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8c858640 1 -- 172.21.15.151:0/3102760254 learned_addr learned my addr 172.21.15.151:0/3102760254 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8c858640 1 -- 172.21.15.151:0/3102760254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ec171b90 con 0x5608ec1711e0 2024-09-12T16:52:19.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8c858640 1 --2- 172.21.15.151:0/3102760254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1715c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00afd0 tx=0x7f6d7c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb48b273765810e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6c6b7fe640 1 -- 172.21.15.151:0/3102760254 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c041e60 con 0x5608ec1711e0 2024-09-12T16:52:19.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6c6b7fe640 1 -- 172.21.15.151:0/3102760254 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c015e10 con 0x5608ec1711e0 2024-09-12T16:52:19.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6c6b7fe640 1 -- 172.21.15.151:0/3102760254 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c01d040 con 0x5608ec1711e0 2024-09-12T16:52:19.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3102760254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 msgr2=0x5608ec1715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3102760254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1715c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00afd0 tx=0x7f6d7c02bda0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3102760254 shutdown_connections 2024-09-12T16:52:19.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3102760254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1715c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3102760254 >> 172.21.15.151:0/3102760254 conn(0x5608ec16d610 msgr2=0x5608ec16b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3102760254 shutdown_connections 2024-09-12T16:52:19.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3102760254 wait complete. 2024-09-12T16:52:19.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 Processor -- start 2024-09-12T16:52:19.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- start start 2024-09-12T16:52:19.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1786c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.085+0000 7f6d8e5519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5608ec1721f0 con 0x5608ec1711e0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8c858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8c858640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1786c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34414/0 (socket says 172.21.15.151:34414) 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 learned_addr learned my addr 172.21.15.151:0/2471318103 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608ec178c20 con 0x5608ec1711e0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8c858640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1786c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c017570 tx=0x7f6d7c050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6c69ffb640 1 -- 172.21.15.151:0/2471318103 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c01d070 con 0x5608ec1711e0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6c69ffb640 1 -- 172.21.15.151:0/2471318103 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c031030 con 0x5608ec1711e0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608ec178eb0 con 0x5608ec1711e0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6c69ffb640 1 -- 172.21.15.151:0/2471318103 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c048040 con 0x5608ec1711e0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608ec179860 con 0x5608ec1711e0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6c69ffb640 1 -- 172.21.15.151:0/2471318103 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d7c0157c0 con 0x5608ec1711e0 2024-09-12T16:52:19.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6c69ffb640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c5c039a20 0x7f6c5c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6c69ffb640 1 -- 172.21.15.151:0/2471318103 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6d7c037c80 con 0x5608ec1711e0 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8c057640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c5c039a20 0x7f6c5c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec183a10 0x5608ec185e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1865b0 con 0x5608ec183a10 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8b856640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec183a10 0x5608ec185e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8c057640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c5c039a20 0x7f6c5c03bee0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d8401ae00 tx=0x7f6d840cfe80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8b856640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec183a10 0x5608ec185e60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7400e640 con 0x5608ec183a10 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 20 realm 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.089+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec182e20 con 0x5608ec183a10 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7400e640 con 0x5608ec183a10 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1870b0 con 0x5608ec183a10 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7400e640 con 0x5608ec183a10 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec187980 con 0x5608ec183a10 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d7400e640 con 0x5608ec183a10 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1883a0 0x5608ec18a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18ae60 con 0x5608ec1883a0 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8c858640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1883a0 0x5608ec18a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8c858640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1883a0 0x5608ec18a790 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 20 searching for the correct realm 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5608ec18cdb0 0x5608ec18f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8c057640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5608ec18cdb0 0x5608ec18f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8c057640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5608ec18cdb0 0x5608ec18f1e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8c057640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6d840cf070 0x7f6d840eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x7f6d840cf070 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8b856640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6d840cf070 0x7f6d840eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8b856640 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6d840cf070 0x7f6d840eaa20 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7400e640 con 0x7f6d840cf070 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.093+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec183a10 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7400e640 con 0x5608ec183a10 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec183a10 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x7f6d840cf070 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x7f6d840cf070 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec183a10 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec183a10 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.097+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x7f6d840cf070 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d74029040 con 0x7f6d840cf070 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec183a10 2024-09-12T16:52:19.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec183a10 2024-09-12T16:52:19.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x7f6d840cf070 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x7f6d840cf070 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec183a10 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.101+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x7f6d840cf070 2024-09-12T16:52:19.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x7f6d840cf070 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec18cdb0 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec1883a0 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x5608ec183a10 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18f8b0 con 0x7f6d840cf070 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d74029040 con 0x7f6d840cf070 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:19.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18b820 con 0x5608ec183a10 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18c0c0 con 0x5608ec183a10 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d74029040 con 0x5608ec183a10 2024-09-12T16:52:19.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18b460 con 0x5608ec183a10 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 zone default found 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 4 Realm: () 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 zonegroup default 2024-09-12T16:52:19.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.105+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec18c0c0 con 0x5608ec1883a0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec191c20 con 0x5608ec18cdb0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec191fc0 con 0x5608ec18cdb0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 20 started sync module instance, tier type = 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1910b0 con 0x7f6d840cf070 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x7f6d840cf070 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596320794112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1910b0 con 0x7f6d840cf070 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec192ac0 con 0x5608ec183a10 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.109+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596320794112] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x7f6d840cf070 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596320798096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1910b0 con 0x5608ec183a10 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1934d0 con 0x5608ec18cdb0 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596320798096] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596320791552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec191020 con 0x5608ec18cdb0 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec194220 con 0x7f6d840cf070 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x7f6d840cf070 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596320804480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1948f0 con 0x7f6d840cf070 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.113+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec195410 con 0x5608ec183a10 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.117+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596320791552] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.117+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596320804480] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x7f6d840cf070 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.117+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.117+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596320808672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1953d0 con 0x5608ec183a10 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.117+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec195800 con 0x5608ec1883a0 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.117+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596320808672] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.117+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.121+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596320805696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec195bf0 con 0x5608ec1883a0 2024-09-12T16:52:19.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.121+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1965b0 con 0x5608ec1883a0 2024-09-12T16:52:19.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.121+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596320805696] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.121+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.121+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596320803008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1965b0 con 0x5608ec1883a0 2024-09-12T16:52:19.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.121+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec196f70 con 0x5608ec1883a0 2024-09-12T16:52:19.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596320815808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec197390 con 0x5608ec1883a0 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 add_watcher() i=0 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 add_watcher() i=1 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 add_watcher() i=2 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 add_watcher() i=3 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 add_watcher() i=4 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 add_watcher() i=5 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596320803008] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 add_watcher() i=6 2024-09-12T16:52:19.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596320815808] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 add_watcher() i=7 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec196100 con 0x5608ec183a10 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596320813312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec197940 con 0x5608ec183a10 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596320813312] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6c42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.125+0000 7f6d8e5519c0 5 note: GC not initialized 2024-09-12T16:52:19.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6c41fe3640 20 reqs_thread_entry: start 2024-09-12T16:52:19.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:19.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 20 Filter name: none 2024-09-12T16:52:19.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6c3affd640 20 reqs_thread_entry: start 2024-09-12T16:52:19.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:19.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bd600 con 0x5608ec183a10 2024-09-12T16:52:19.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-12T16:52:19.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:19.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:19.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1c4120 con 0x5608ec183a10 2024-09-12T16:52:19.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:19.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94596321000464 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bf8f0 con 0x5608ec183a10 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94596320808672 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x5608ebf099c0 con 0x5608ec183a10 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6c6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94596320808672 notifier 4404 bl.length()=758 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6c6b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(64 notify.4 [notify cookie 94596321000464 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6c6b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6c6b7fe640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6c50003eb0 con 0x5608ec183a10 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94596321000464 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d7402dc90 con 0x5608ec183a10 2024-09-12T16:52:19.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1c3c10 con 0x5608ec183a10 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94596321000464 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bf440 con 0x7f6d840cf070 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== watch-notify(notify (1) cookie 94596320794112 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f6d7402dc90 con 0x7f6d840cf070 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6c6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94596320794112 notifier 4404 bl.length()=159 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.0 [notify cookie 94596321000464 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d740391c0 con 0x7f6d840cf070 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.129+0000 7f6c6b7fe640 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6c50003eb0 con 0x7f6d840cf070 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x7f6d840cf070 2024-09-12T16:52:19.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== watch-notify(notify_complete (2) cookie 94596321000464 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d7402f450 con 0x7f6d840cf070 2024-09-12T16:52:19.156 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T16:52:18.768788Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:19.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6c42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596320813312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bb3e0 con 0x5608ec183a10 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94596320813312] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596320794112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bb3e0 con 0x7f6d840cf070 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94596320794112] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x7f6d840cf070 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8e5519c0 20 remove_watcher() i=0 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8e5519c0 2 removed watcher, disabling cache 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.133+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596320798096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bb3e0 con 0x5608ec183a10 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94596320798096] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8e5519c0 20 remove_watcher() i=1 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596320791552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bb3e0 con 0x5608ec18cdb0 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8c057640 1 -- 172.21.15.151:0/2471318103 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94596320791552] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840ba070 con 0x5608ec18cdb0 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8e5519c0 20 remove_watcher() i=2 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596320804480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec190c00 con 0x7f6d840cf070 2024-09-12T16:52:19.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94596320804480] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x7f6d840cf070 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8e5519c0 20 remove_watcher() i=3 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.137+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596320808672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bb3e0 con 0x5608ec183a10 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.141+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94596320808672] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d740391c0 con 0x5608ec183a10 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.141+0000 7f6d8e5519c0 20 remove_watcher() i=4 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.141+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596320805696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec190c00 con 0x5608ec1883a0 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.141+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94596320805696] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.141+0000 7f6d8e5519c0 20 remove_watcher() i=5 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.141+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596320803008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec194ee0 con 0x5608ec1883a0 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94596320803008] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 20 remove_watcher() i=6 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596320815808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608ec1bb3e0 con 0x5608ec1883a0 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8c858640 1 -- 172.21.15.151:0/2471318103 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94596320815808] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c02a070 con 0x5608ec1883a0 2024-09-12T16:52:19.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 20 remove_watcher() i=7 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1883a0 msgr2=0x5608ec18a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1883a0 0x5608ec18a790 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec183a10 msgr2=0x5608ec185e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec183a10 0x5608ec185e60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6d840cf070 msgr2=0x7f6d840eaa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6d840cf070 0x7f6d840eaa20 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5608ec18cdb0 msgr2=0x5608ec18f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5608ec18cdb0 0x5608ec18f1e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c5c039a20 msgr2=0x7f6c5c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c5c039a20 0x7f6c5c03bee0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d8401ae00 tx=0x7f6d840cfe80 comp rx=0 tx=0).stop 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 msgr2=0x5608ec1786c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8b856640 1 -- 172.21.15.151:0/2471318103 reap_dead start 2024-09-12T16:52:19.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1786c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c017570 tx=0x7f6d7c050880 comp rx=0 tx=0).stop 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 shutdown_connections 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2471318103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec1711e0 0x5608ec1786c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 >> 172.21.15.151:0/2471318103 conn(0x5608ec16d610 msgr2=0x5608ec16b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 shutdown_connections 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2471318103 wait complete. 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2969908313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c64039a70 msgr2=0x7f6c6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2969908313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c64039a70 0x7f6c6403bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5608ec1491b0 tx=0x7f6d840ea040 comp rx=0 tx=0).stop 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2969908313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec055380 msgr2=0x5608ec053c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2969908313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec055380 0x5608ec053c20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5608ec149050 tx=0x7f6d7c00af40 comp rx=0 tx=0).stop 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2969908313 shutdown_connections 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2969908313 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c64039a70 0x7f6c6403bf30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/2969908313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ec055380 0x5608ec053c20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2969908313 >> 172.21.15.151:0/2969908313 conn(0x5608ec1580f0 msgr2=0x5608ec1584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2969908313 shutdown_connections 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.145+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/2969908313 wait complete. 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1515d0 msgr2=0x5608ec1539c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1515d0 0x5608ec1539c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec058160 msgr2=0x5608ec14ee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec058160 0x5608ec14ee30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c74039ac0 msgr2=0x7f6c7403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c74039ac0 0x7f6c7403bf80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d74004180 tx=0x7f6d74001340 comp rx=0 tx=0).stop 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 msgr2=0x5608ec147cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec147cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d84017be0 tx=0x7f6d84017d70 comp rx=0 tx=0).stop 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 shutdown_connections 2024-09-12T16:52:19.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5608ec1515d0 0x5608ec1539c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5608ec058160 0x5608ec14ee30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c74039ac0 0x7f6c7403bf80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 --2- 172.21.15.151:0/3171557991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608ebfc91f0 0x5608ec147cc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 >> 172.21.15.151:0/3171557991 conn(0x5608ec04f910 msgr2=0x5608ec13ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 shutdown_connections 2024-09-12T16:52:19.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.149+0000 7f6d8e5519c0 1 -- 172.21.15.151:0/3171557991 wait complete. 2024-09-12T16:52:19.167 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T16:52:18.768788Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:19.167 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-12T16:52:19.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-12T16:52:19.168 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-12T16:52:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:19.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc2588c9c0 1 Processor -- start 2024-09-12T16:52:19.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc2588c9c0 1 -- start start 2024-09-12T16:52:19.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc2588c9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x560356052310 0x560356054700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc2588c9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560355f029c0 con 0x560355fc2240 2024-09-12T16:52:19.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc2588c9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x560355f526d0 con 0x560356052310 2024-09-12T16:52:19.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc22b91640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x560356052310 0x560356054700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc22b91640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x560356052310 0x560356054700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34418/0 (socket says 172.21.15.151:34418) 2024-09-12T16:52:19.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc22b91640 1 -- 172.21.15.151:0/2875066317 learned_addr learned my addr 172.21.15.151:0/2875066317 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc23392640 1 --1- 172.21.15.151:0/2875066317 >> v1:172.21.15.122:6789/0 conn(0x560355fc2240 0x560356050bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38160/0 (socket says 172.21.15.151:38160) 2024-09-12T16:52:19.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc22b91640 1 -- 172.21.15.151:0/2875066317 >> v1:172.21.15.122:6789/0 conn(0x560355fc2240 legacy=0x560356050bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.233+0000 7efc22b91640 1 -- 172.21.15.151:0/2875066317 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560355ef6ca0 con 0x560356052310 2024-09-12T16:52:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc22b91640 1 --2- 172.21.15.151:0/2875066317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560356052310 0x560356054700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efc1800a5c0 tx=0x7efc1801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e9cd9c11d00d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc22390640 1 -- 172.21.15.151:0/2875066317 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc180b1070 con 0x560356052310 2024-09-12T16:52:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc22390640 1 -- 172.21.15.151:0/2875066317 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc180a8070 con 0x560356052310 2024-09-12T16:52:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc22390640 1 -- 172.21.15.151:0/2875066317 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc180ac5b0 con 0x560356052310 2024-09-12T16:52:19.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2875066317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560356052310 msgr2=0x560356054700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2875066317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560356052310 0x560356054700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efc1800a5c0 tx=0x7efc1801b340 comp rx=0 tx=0).stop 2024-09-12T16:52:19.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2875066317 shutdown_connections 2024-09-12T16:52:19.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2875066317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560356052310 0x560356054700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2875066317 >> 172.21.15.151:0/2875066317 conn(0x560356048920 msgr2=0x56035604ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2875066317 shutdown_connections 2024-09-12T16:52:19.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.237+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2875066317 wait complete. 2024-09-12T16:52:19.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 Processor -- start 2024-09-12T16:52:19.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- start start 2024-09-12T16:52:19.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356139800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560355f56680 con 0x560355fc2240 2024-09-12T16:52:19.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc23392640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc23392640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356139800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34422/0 (socket says 172.21.15.151:34422) 2024-09-12T16:52:19.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc23392640 1 -- 172.21.15.151:0/976659902 learned_addr learned my addr 172.21.15.151:0/976659902 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc23392640 1 -- 172.21.15.151:0/976659902 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560355ed1da0 con 0x560355fc2240 2024-09-12T16:52:19.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc23392640 1 --2- 172.21.15.151:0/976659902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356139800 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efc1400b270 tx=0x7efc1400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23c047dbba99108 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efb1160a640 1 -- 172.21.15.151:0/976659902 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1400e5d0 con 0x560355fc2240 2024-09-12T16:52:19.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efb1160a640 1 -- 172.21.15.151:0/976659902 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1400e770 con 0x560355fc2240 2024-09-12T16:52:19.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efb1160a640 1 -- 172.21.15.151:0/976659902 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1400ea70 con 0x560355fc2240 2024-09-12T16:52:19.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- 172.21.15.151:0/976659902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 msgr2=0x560356139800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/976659902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356139800 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efc1400b270 tx=0x7efc1400b670 comp rx=0 tx=0).stop 2024-09-12T16:52:19.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- 172.21.15.151:0/976659902 shutdown_connections 2024-09-12T16:52:19.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/976659902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356139800 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- 172.21.15.151:0/976659902 >> 172.21.15.151:0/976659902 conn(0x560356048920 msgr2=0x560356135440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- 172.21.15.151:0/976659902 shutdown_connections 2024-09-12T16:52:19.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- 172.21.15.151:0/976659902 wait complete. 2024-09-12T16:52:19.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 Processor -- start 2024-09-12T16:52:19.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- start start 2024-09-12T16:52:19.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.253+0000 7efc2588c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560355ef8a50 con 0x560355fc2240 2024-09-12T16:52:19.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc23392640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc23392640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356140ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34436/0 (socket says 172.21.15.151:34436) 2024-09-12T16:52:19.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc23392640 1 -- 172.21.15.151:0/2329750880 learned_addr learned my addr 172.21.15.151:0/2329750880 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc23392640 1 -- 172.21.15.151:0/2329750880 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560356141400 con 0x560355fc2240 2024-09-12T16:52:19.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc23392640 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356140ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x56035613a790 tx=0x7efc14000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efb0fe07640 1 -- 172.21.15.151:0/2329750880 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1400be70 con 0x560355fc2240 2024-09-12T16:52:19.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efb0fe07640 1 -- 172.21.15.151:0/2329750880 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1400f9f0 con 0x560355fc2240 2024-09-12T16:52:19.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efb0fe07640 1 -- 172.21.15.151:0/2329750880 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1400fcf0 con 0x560355fc2240 2024-09-12T16:52:19.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560356141690 con 0x560355fc2240 2024-09-12T16:52:19.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560356142040 con 0x560355fc2240 2024-09-12T16:52:19.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efb0fe07640 1 -- 172.21.15.151:0/2329750880 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efc14017070 con 0x560355fc2240 2024-09-12T16:52:19.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efb0fe07640 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efb08039a70 0x7efb0803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efb0fe07640 1 -- 172.21.15.151:0/2329750880 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efc14015020 con 0x560355fc2240 2024-09-12T16:52:19.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc22b91640 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efb08039a70 0x7efb0803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560356052310 0x560356148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356148550 con 0x560356052310 2024-09-12T16:52:19.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc23b93640 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560356052310 0x560356148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc22b91640 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efb08039a70 0x7efb0803bf30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efc180ae000 tx=0x7efc180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc23b93640 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560356052310 0x560356148010 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc23b93640 1 -- 172.21.15.151:0/2329750880 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc1c00a4d0 con 0x560356052310 2024-09-12T16:52:19.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.257+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603561489a0 con 0x560356052310 2024-09-12T16:52:19.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23b93640 1 -- 172.21.15.151:0/2329750880 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc1c00a4d0 con 0x560356052310 2024-09-12T16:52:19.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035614a7b0 0x56035614cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56035614d270 con 0x56035614a7b0 2024-09-12T16:52:19.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23392640 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035614a7b0 0x56035614cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23392640 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035614a7b0 0x56035614cba0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23392640 1 -- 172.21.15.151:0/2329750880 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc1402e070 con 0x56035614a7b0 2024-09-12T16:52:19.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356149650 con 0x560356052310 2024-09-12T16:52:19.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23b93640 1 -- 172.21.15.151:0/2329750880 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc1c00a4d0 con 0x560356052310 2024-09-12T16:52:19.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356149ab0 con 0x560356052310 2024-09-12T16:52:19.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23b93640 1 -- 172.21.15.151:0/2329750880 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc1c00a4d0 con 0x560356052310 2024-09-12T16:52:19.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc2588c9c0 1 Processor -- start 2024-09-12T16:52:19.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc2588c9c0 1 -- start start 2024-09-12T16:52:19.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc2588c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56035615b8a0 0x56035615bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc2588c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560355f63450 con 0x56035615b8a0 2024-09-12T16:52:19.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23b93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56035615b8a0 0x56035615bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23b93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56035615b8a0 0x56035615bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34452/0 (socket says 172.21.15.151:34452) 2024-09-12T16:52:19.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.261+0000 7efc23b93640 1 -- 172.21.15.151:0/3732514889 learned_addr learned my addr 172.21.15.151:0/3732514889 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23b93640 1 -- 172.21.15.151:0/3732514889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035615c300 con 0x56035615b8a0 2024-09-12T16:52:19.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23b93640 1 --2- 172.21.15.151:0/3732514889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56035615b8a0 0x56035615bcc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x560356142fc0 tx=0x7efc1c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efb0d602640 1 -- 172.21.15.151:0/3732514889 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1c014450 con 0x56035615b8a0 2024-09-12T16:52:19.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc2588c9c0 1 -- 172.21.15.151:0/3732514889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56035615cb60 con 0x56035615b8a0 2024-09-12T16:52:19.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efb0d602640 1 -- 172.21.15.151:0/3732514889 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1c0145f0 con 0x56035615b8a0 2024-09-12T16:52:19.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efb0d602640 1 -- 172.21.15.151:0/3732514889 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1c014910 con 0x56035615b8a0 2024-09-12T16:52:19.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc2588c9c0 1 -- 172.21.15.151:0/3732514889 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56035615d0d0 con 0x56035615b8a0 2024-09-12T16:52:19.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efb0d602640 1 -- 172.21.15.151:0/3732514889 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efc1c011040 con 0x56035615b8a0 2024-09-12T16:52:19.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efb0d602640 1 --2- 172.21.15.151:0/3732514889 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efafc039a70 0x7efafc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efb0d602640 1 -- 172.21.15.151:0/3732514889 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efc1c01e070 con 0x56035615b8a0 2024-09-12T16:52:19.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23392640 1 --2- 172.21.15.151:0/3732514889 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efafc039a70 0x7efafc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc2588c9c0 1 Processor -- start 2024-09-12T16:52:19.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc2588c9c0 1 -- start start 2024-09-12T16:52:19.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23392640 1 --2- 172.21.15.151:0/3732514889 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efafc039a70 0x7efafc03bf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x560356142330 tx=0x7efc1401af30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc2588c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x5603561685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc2588c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56035613a050 con 0x5603561681d0 2024-09-12T16:52:19.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23b93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x5603561685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23b93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x5603561685b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34462/0 (socket says 172.21.15.151:34462) 2024-09-12T16:52:19.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23b93640 1 -- 172.21.15.151:0/1636792799 learned_addr learned my addr 172.21.15.151:0/1636792799 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23b93640 1 -- 172.21.15.151:0/1636792799 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560356168ba0 con 0x5603561681d0 2024-09-12T16:52:19.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efc23b93640 1 --2- 172.21.15.151:0/1636792799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x5603561685b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc1c016fd0 tx=0x7efc1c001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7f56c55c36e5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.265+0000 7efb06ffd640 1 -- 172.21.15.151:0/1636792799 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1c028070 con 0x5603561681d0 2024-09-12T16:52:19.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efb06ffd640 1 -- 172.21.15.151:0/1636792799 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1c0520d0 con 0x5603561681d0 2024-09-12T16:52:19.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efb06ffd640 1 -- 172.21.15.151:0/1636792799 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1c0167c0 con 0x5603561681d0 2024-09-12T16:52:19.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1636792799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 msgr2=0x5603561685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1636792799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x5603561685b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc1c016fd0 tx=0x7efc1c001450 comp rx=0 tx=0).stop 2024-09-12T16:52:19.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1636792799 shutdown_connections 2024-09-12T16:52:19.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1636792799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x5603561685b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1636792799 >> 172.21.15.151:0/1636792799 conn(0x560356164600 msgr2=0x560356162840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1636792799 shutdown_connections 2024-09-12T16:52:19.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1636792799 wait complete. 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 Processor -- start 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- start start 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x56035616f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5603561691e0 con 0x5603561681d0 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc23b93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x56035616f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc23b93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x56035616f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34472/0 (socket says 172.21.15.151:34472) 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 learned_addr learned my addr 172.21.15.151:0/1548922679 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035616fc20 con 0x5603561681d0 2024-09-12T16:52:19.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc23b93640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x56035616f6c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc1c018430 tx=0x7efc1c0506a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efb057fa640 1 -- 172.21.15.151:0/1548922679 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1c032030 con 0x5603561681d0 2024-09-12T16:52:19.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56035616feb0 con 0x5603561681d0 2024-09-12T16:52:19.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560356170860 con 0x5603561681d0 2024-09-12T16:52:19.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efb057fa640 1 -- 172.21.15.151:0/1548922679 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1c0520d0 con 0x5603561681d0 2024-09-12T16:52:19.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efb057fa640 1 -- 172.21.15.151:0/1548922679 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc1c03ee10 con 0x5603561681d0 2024-09-12T16:52:19.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efb057fa640 1 -- 172.21.15.151:0/1548922679 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efc1c035070 con 0x5603561681d0 2024-09-12T16:52:19.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efb057fa640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efaec039a70 0x7efaec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.269+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efb057fa640 1 -- 172.21.15.151:0/1548922679 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efc1c033070 con 0x5603561681d0 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23392640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efaec039a70 0x7efaec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56035617ac40 0x56035617d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56035617d820 con 0x56035617ac40 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc22b91640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56035617ac40 0x56035617d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23392640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efaec039a70 0x7efaec03bf30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc1401bfd0 tx=0x7efc14050000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc22b91640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56035617ac40 0x56035617d0d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 realm 2024-09-12T16:52:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56035617dbf0 con 0x56035617ac40 2024-09-12T16:52:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56035617e4c0 con 0x56035617ac40 2024-09-12T16:52:19.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56035617e860 con 0x56035617ac40 2024-09-12T16:52:19.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035617f5c0 0x5603561819b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356181f70 con 0x56035617f5c0 2024-09-12T16:52:19.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23b93640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035617f5c0 0x5603561819b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23b93640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035617f5c0 0x5603561819b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:19.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 20 searching for the correct realm 2024-09-12T16:52:19.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560356183ec0 0x5603561862f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23392640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560356183ec0 0x5603561862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23392640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560356183ec0 0x5603561862f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23392640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efc1403d040 0x7efc14048300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.273+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x7efc1403d040 2024-09-12T16:52:19.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efc1403d040 0x7efc14048300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efc1403d040 0x7efc14048300 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617ac40 2024-09-12T16:52:19.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617ac40 2024-09-12T16:52:19.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x7efc1403d040 2024-09-12T16:52:19.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617ac40 2024-09-12T16:52:19.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.277+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617ac40 2024-09-12T16:52:19.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x7efc1403d040 2024-09-12T16:52:19.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617ac40 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617ac40 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.281+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x7efc1403d040 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617ac40 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x7efc1403d040 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x560356183ec0 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617f5c0 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x56035617ac40 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.285+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560356186970 con 0x7efc1403d040 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:19.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356182930 con 0x56035617ac40 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603561831d0 con 0x56035617ac40 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356182570 con 0x56035617ac40 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 zone default found 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 4 Realm: () 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 zonegroup default 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356186df0 con 0x56035617f5c0 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356189080 con 0x560356183ec0 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356189470 con 0x560356183ec0 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 started sync module instance, tier type = 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188510 con 0x7efc1403d040 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94572329339408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188510 con 0x7efc1403d040 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.289+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356189fa0 con 0x56035617ac40 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.293+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94572329339408] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.293+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.293+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94572329343600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188510 con 0x56035617ac40 2024-09-12T16:52:19.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.293+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618a9b0 con 0x560356183ec0 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.293+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94572329343600] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.293+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.293+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94572329336928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188480 con 0x560356183ec0 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.293+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618b700 con 0x7efc1403d040 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.297+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.297+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94572329349984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618be10 con 0x7efc1403d040 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.297+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618c930 con 0x56035617ac40 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.297+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94572329336928] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.297+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94572329349984] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.297+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.297+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94572329354240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618c8f0 con 0x56035617ac40 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.297+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618cd20 con 0x56035617f5c0 2024-09-12T16:52:19.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.301+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.301+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94572329351264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618d570 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.301+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618df90 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.301+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94572329354240] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.301+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94572329351264] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.301+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.301+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94572329360000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618d0c0 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.301+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618e830 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94572329362304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618ec50 con 0x56035617f5c0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 add_watcher() i=0 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 add_watcher() i=1 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 add_watcher() i=2 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 add_watcher() i=3 2024-09-12T16:52:19.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 add_watcher() i=4 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 add_watcher() i=5 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94572329360000] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 add_watcher() i=6 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94572329362304] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 add_watcher() i=7 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560356191880 con 0x56035617ac40 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94572329348512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56035618ec50 con 0x56035617ac40 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94572329348512] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efada7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:19.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 5 note: GC not initialized 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efad97e2640 20 reqs_thread_entry: start 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.305+0000 7efc2588c9c0 20 Filter name: none 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efad27fc640 20 reqs_thread_entry: start 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603561b4af0 con 0x56035617ac40 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 20 rados_obj.operate() r=0 bl.length=582 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:19.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603561bb050 con 0x56035617ac40 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94572329544448 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5603561b6ab0 con 0x56035617ac40 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94572329354240 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x560355ef6ca0 con 0x56035617ac40 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efb06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94572329354240 notifier 4411 bl.length()=732 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efb06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efb06ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efb06ffd640 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efae8003eb0 con 0x56035617ac40 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(64 notify.4 [notify cookie 94572329544448 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94572329544448 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efc180d99c0 con 0x56035617ac40 2024-09-12T16:52:19.352 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T16:52:18.768788Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:19.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efada7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.309+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94572329348512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603561b2900 con 0x56035617ac40 2024-09-12T16:52:19.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94572329348512] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94572329339408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603561b2900 con 0x7efc1403d040 2024-09-12T16:52:19.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94572329339408] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc2588c9c0 20 remove_watcher() i=0 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc2588c9c0 2 removed watcher, disabling cache 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94572329343600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603561b2900 con 0x56035617ac40 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94572329343600] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc2588c9c0 20 remove_watcher() i=1 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.313+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94572329336928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5603561b2900 con 0x560356183ec0 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.317+0000 7efc23392640 1 -- 172.21.15.151:0/1548922679 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94572329336928] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1402e070 con 0x560356183ec0 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.317+0000 7efc2588c9c0 20 remove_watcher() i=2 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.317+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94572329349984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188060 con 0x7efc1403d040 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.317+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94572329349984] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x7efc1403d040 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.317+0000 7efc2588c9c0 20 remove_watcher() i=3 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.317+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94572329354240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188060 con 0x56035617ac40 2024-09-12T16:52:19.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.321+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94572329354240] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc180b4040 con 0x56035617ac40 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.321+0000 7efc2588c9c0 20 remove_watcher() i=4 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.321+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94572329351264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188060 con 0x56035617f5c0 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.321+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94572329351264] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.321+0000 7efc2588c9c0 20 remove_watcher() i=5 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.321+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94572329360000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188060 con 0x56035617f5c0 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94572329360000] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 20 remove_watcher() i=6 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94572329362304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560356188060 con 0x56035617f5c0 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc23b93640 1 -- 172.21.15.151:0/1548922679 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94572329362304] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc1c02a070 con 0x56035617f5c0 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 20 remove_watcher() i=7 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035617f5c0 msgr2=0x5603561819b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035617f5c0 0x5603561819b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56035617ac40 msgr2=0x56035617d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56035617ac40 0x56035617d0d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efc1403d040 msgr2=0x7efc14048300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efc1403d040 0x7efc14048300 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560356183ec0 msgr2=0x5603561862f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560356183ec0 0x5603561862f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efaec039a70 msgr2=0x7efaec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efaec039a70 0x7efaec03bf30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc1401bfd0 tx=0x7efc14050000 comp rx=0 tx=0).stop 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc22b91640 1 -- 172.21.15.151:0/1548922679 reap_dead start 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 msgr2=0x56035616f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x56035616f6c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc1c018430 tx=0x7efc1c0506a0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 shutdown_connections 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/1548922679 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5603561681d0 0x56035616f6c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 >> 172.21.15.151:0/1548922679 conn(0x560356164600 msgr2=0x560356162810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 shutdown_connections 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/1548922679 wait complete. 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/3732514889 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efafc039a70 msgr2=0x7efafc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/3732514889 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efafc039a70 0x7efafc03bf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x560356142330 tx=0x7efc1401af30 comp rx=0 tx=0).stop 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/3732514889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56035615b8a0 msgr2=0x56035615bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/3732514889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56035615b8a0 0x56035615bcc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x560356142fc0 tx=0x7efc1c018830 comp rx=0 tx=0).stop 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/3732514889 shutdown_connections 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/3732514889 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efafc039a70 0x7efafc03bf30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/3732514889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56035615b8a0 0x56035615bcc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/3732514889 >> 172.21.15.151:0/3732514889 conn(0x560356151250 msgr2=0x560356151630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/3732514889 shutdown_connections 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/3732514889 wait complete. 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035614a7b0 msgr2=0x56035614cba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035614a7b0 0x56035614cba0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560356052310 msgr2=0x560356148010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560356052310 0x560356148010 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efb08039a70 msgr2=0x7efb0803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efb08039a70 0x7efb0803bf30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efc180ae000 tx=0x7efc180a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 msgr2=0x560356140ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.325+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356140ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x56035613a790 tx=0x7efc14000ee0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.329+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 shutdown_connections 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.329+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56035614a7b0 0x56035614cba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.329+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560356052310 0x560356148010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.329+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efb08039a70 0x7efb0803bf30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.329+0000 7efc2588c9c0 1 --2- 172.21.15.151:0/2329750880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560355fc2240 0x560356140ea0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.329+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 >> 172.21.15.151:0/2329750880 conn(0x560356048920 msgr2=0x560356133ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.329+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 shutdown_connections 2024-09-12T16:52:19.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.329+0000 7efc2588c9c0 1 -- 172.21.15.151:0/2329750880 wait complete. 2024-09-12T16:52:19.364 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T16:52:18.768788Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:19.364 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-12T16:52:19.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-12T16:52:19.364 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-12T16:52:19.441 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:19.441 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:19.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.437+0000 7f9d375f89c0 1 Processor -- start 2024-09-12T16:52:19.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.437+0000 7f9d375f89c0 1 -- start start 2024-09-12T16:52:19.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d375f89c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563b2b6bc0d0 0x563b2b6be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d375f89c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563b2b56c9c0 con 0x563b2b6b7f30 2024-09-12T16:52:19.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d375f89c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x563b2b5bc6d0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d348fd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563b2b6bc0d0 0x563b2b6be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d350fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x563b2b6b7f30 0x563b2b6b8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38166/0 (socket says 172.21.15.151:38166) 2024-09-12T16:52:19.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d350fe640 1 -- 172.21.15.151:0/4217441116 learned_addr learned my addr 172.21.15.151:0/4217441116 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:19.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d348fd640 1 -- 172.21.15.151:0/4217441116 >> v1:172.21.15.122:6789/0 conn(0x563b2b6b7f30 legacy=0x563b2b6b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d348fd640 1 -- 172.21.15.151:0/4217441116 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2b560ca0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d348fd640 1 --2- 172.21.15.151:0/4217441116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6bc0d0 0x563b2b6be4c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00a480 tx=0x7f9d2c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d74f006faa2af8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.441+0000 7f9d27fff640 1 -- 172.21.15.151:0/4217441116 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d2c0aa570 con 0x563b2b6bc0d0 2024-09-12T16:52:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d27fff640 1 -- 172.21.15.151:0/4217441116 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0af070 con 0x563b2b6bc0d0 2024-09-12T16:52:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d27fff640 1 -- 172.21.15.151:0/4217441116 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d2c0aa860 con 0x563b2b6bc0d0 2024-09-12T16:52:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d375f89c0 1 -- 172.21.15.151:0/4217441116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6bc0d0 msgr2=0x563b2b6be4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/4217441116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6bc0d0 0x563b2b6be4c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00a480 tx=0x7f9d2c01b310 comp rx=0 tx=0).stop 2024-09-12T16:52:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d375f89c0 1 -- 172.21.15.151:0/4217441116 shutdown_connections 2024-09-12T16:52:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/4217441116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6bc0d0 0x563b2b6be4c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d375f89c0 1 -- 172.21.15.151:0/4217441116 >> 172.21.15.151:0/4217441116 conn(0x563b2b6b3a50 msgr2=0x563b2b6b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d375f89c0 1 -- 172.21.15.151:0/4217441116 shutdown_connections 2024-09-12T16:52:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.445+0000 7f9d375f89c0 1 -- 172.21.15.151:0/4217441116 wait complete. 2024-09-12T16:52:19.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 Processor -- start 2024-09-12T16:52:19.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 -- start start 2024-09-12T16:52:19.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563b2b5c0680 con 0x563b2b6b7f30 2024-09-12T16:52:19.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d350fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d350fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7a36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34486/0 (socket says 172.21.15.151:34486) 2024-09-12T16:52:19.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d350fe640 1 -- 172.21.15.151:0/3266828584 learned_addr learned my addr 172.21.15.151:0/3266828584 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d350fe640 1 -- 172.21.15.151:0/3266828584 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2b53bda0 con 0x563b2b6b7f30 2024-09-12T16:52:19.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d350fe640 1 --2- 172.21.15.151:0/3266828584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7a36f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9d300017b0 tx=0x7f9d30001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87533acd35283c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9c23606640 1 -- 172.21.15.151:0/3266828584 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d300044f0 con 0x563b2b6b7f30 2024-09-12T16:52:19.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9c23606640 1 -- 172.21.15.151:0/3266828584 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d300046b0 con 0x563b2b6b7f30 2024-09-12T16:52:19.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9c23606640 1 -- 172.21.15.151:0/3266828584 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30004a10 con 0x563b2b6b7f30 2024-09-12T16:52:19.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3266828584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 msgr2=0x563b2b7a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3266828584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7a36f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9d300017b0 tx=0x7f9d30001c70 comp rx=0 tx=0).stop 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3266828584 shutdown_connections 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3266828584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7a36f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3266828584 >> 172.21.15.151:0/3266828584 conn(0x563b2b6b3a50 msgr2=0x563b2b79f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3266828584 shutdown_connections 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.457+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3266828584 wait complete. 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d375f89c0 1 Processor -- start 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d375f89c0 1 -- start start 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d375f89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d375f89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563b2b562a50 con 0x563b2b6b7f30 2024-09-12T16:52:19.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d350fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d350fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34490/0 (socket says 172.21.15.151:34490) 2024-09-12T16:52:19.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d350fe640 1 -- 172.21.15.151:0/3082034903 learned_addr learned my addr 172.21.15.151:0/3082034903 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d350fe640 1 -- 172.21.15.151:0/3082034903 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2b7ab290 con 0x563b2b6b7f30 2024-09-12T16:52:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d350fe640 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7aad30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9d300012f0 tx=0x7f9d30000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9c21e03640 1 -- 172.21.15.151:0/3082034903 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30013760 con 0x563b2b6b7f30 2024-09-12T16:52:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9c21e03640 1 -- 172.21.15.151:0/3082034903 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d30013900 con 0x563b2b6b7f30 2024-09-12T16:52:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9c21e03640 1 -- 172.21.15.151:0/3082034903 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d30013c20 con 0x563b2b6b7f30 2024-09-12T16:52:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b2b7ab520 con 0x563b2b6b7f30 2024-09-12T16:52:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b2b7abed0 con 0x563b2b6b7f30 2024-09-12T16:52:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.461+0000 7f9c21e03640 1 -- 172.21.15.151:0/3082034903 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9d30010070 con 0x563b2b6b7f30 2024-09-12T16:52:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9c21e03640 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c1c039ac0 0x7f9c1c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9c21e03640 1 -- 172.21.15.151:0/3082034903 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9d30018070 con 0x563b2b6b7f30 2024-09-12T16:52:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d348fd640 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c1c039ac0 0x7f9c1c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b6bc0d0 0x563b2b7b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7b23e0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d358ff640 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b6bc0d0 0x563b2b7b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d348fd640 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c1c039ac0 0x7f9c1c03bf80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0ae000 tx=0x7f9d2c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d358ff640 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b6bc0d0 0x563b2b7b1ea0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d358ff640 1 -- 172.21.15.151:0/3082034903 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7ac230 con 0x563b2b6bc0d0 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d358ff640 1 -- 172.21.15.151:0/3082034903 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7b4680 0x563b2b7b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7b71b0 con 0x563b2b7b4680 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d350fe640 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7b4680 0x563b2b7b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d350fe640 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7b4680 0x563b2b7b6a70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d350fe640 1 -- 172.21.15.151:0/3082034903 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d3001b030 con 0x563b2b7b4680 2024-09-12T16:52:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7b34c0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d358ff640 1 -- 172.21.15.151:0/3082034903 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7b38f0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.465+0000 7f9d358ff640 1 -- 172.21.15.151:0/3082034903 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b6bc0d0 2024-09-12T16:52:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d375f89c0 1 Processor -- start 2024-09-12T16:52:19.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d375f89c0 1 -- start start 2024-09-12T16:52:19.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d375f89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7c57e0 0x563b2b7c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d375f89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563b2b5cd450 con 0x563b2b7c57e0 2024-09-12T16:52:19.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d358ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7c57e0 0x563b2b7c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d358ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7c57e0 0x563b2b7c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34496/0 (socket says 172.21.15.151:34496) 2024-09-12T16:52:19.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d358ff640 1 -- 172.21.15.151:0/2881063546 learned_addr learned my addr 172.21.15.151:0/2881063546 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d358ff640 1 -- 172.21.15.151:0/2881063546 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2b7c6240 con 0x563b2b7c57e0 2024-09-12T16:52:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d358ff640 1 --2- 172.21.15.151:0/2881063546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7c57e0 0x563b2b7c5c00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x563b2b7abab0 tx=0x7f9d2800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9c1affd640 1 -- 172.21.15.151:0/2881063546 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28007d70 con 0x563b2b7c57e0 2024-09-12T16:52:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9c1affd640 1 -- 172.21.15.151:0/2881063546 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2801e020 con 0x563b2b7c57e0 2024-09-12T16:52:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9c1affd640 1 -- 172.21.15.151:0/2881063546 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28019590 con 0x563b2b7c57e0 2024-09-12T16:52:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d375f89c0 1 -- 172.21.15.151:0/2881063546 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b2b7c6aa0 con 0x563b2b7c57e0 2024-09-12T16:52:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d375f89c0 1 -- 172.21.15.151:0/2881063546 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b2b7c7010 con 0x563b2b7c57e0 2024-09-12T16:52:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9c1affd640 1 -- 172.21.15.151:0/2881063546 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9d28016040 con 0x563b2b7c57e0 2024-09-12T16:52:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9c1affd640 1 --2- 172.21.15.151:0/2881063546 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c10039a70 0x7f9c1003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9c1affd640 1 -- 172.21.15.151:0/2881063546 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9d2801f030 con 0x563b2b7c57e0 2024-09-12T16:52:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d350fe640 1 --2- 172.21.15.151:0/2881063546 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c10039a70 0x7f9c1003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d375f89c0 1 Processor -- start 2024-09-12T16:52:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d375f89c0 1 -- start start 2024-09-12T16:52:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.469+0000 7f9d350fe640 1 --2- 172.21.15.151:0/2881063546 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c10039a70 0x7f9c1003bf30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9d30010cc0 tx=0x7f9d30043040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563b2b7a3f20 con 0x563b2b7d3190 2024-09-12T16:52:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34508/0 (socket says 172.21.15.151:34508) 2024-09-12T16:52:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 -- 172.21.15.151:0/3669848849 learned_addr learned my addr 172.21.15.151:0/3669848849 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 -- 172.21.15.151:0/3669848849 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2b7d3b80 con 0x563b2b7d3190 2024-09-12T16:52:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 --2- 172.21.15.151:0/3669848849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d3590 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9d28050600 tx=0x7f9d28018680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d9dab3a3e36659 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9c18ff9640 1 -- 172.21.15.151:0/3669848849 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d2801d070 con 0x563b2b7d3190 2024-09-12T16:52:19.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9c18ff9640 1 -- 172.21.15.151:0/3669848849 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d28014340 con 0x563b2b7d3190 2024-09-12T16:52:19.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9c18ff9640 1 -- 172.21.15.151:0/3669848849 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28014620 con 0x563b2b7d3190 2024-09-12T16:52:19.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3669848849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 msgr2=0x563b2b7d3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3669848849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d3590 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9d28050600 tx=0x7f9d28018680 comp rx=0 tx=0).stop 2024-09-12T16:52:19.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3669848849 shutdown_connections 2024-09-12T16:52:19.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3669848849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d3590 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3669848849 >> 172.21.15.151:0/3669848849 conn(0x563b2b7ce5b0 msgr2=0x563b2b7cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3669848849 shutdown_connections 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3669848849 wait complete. 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 Processor -- start 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- start start 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563b2b7d20e0 con 0x563b2b7d3190 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34510/0 (socket says 172.21.15.151:34510) 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 learned_addr learned my addr 172.21.15.151:0/1383104677 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b2b7d9b80 con 0x563b2b7d3190 2024-09-12T16:52:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d358ff640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d9620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9d28014d40 tx=0x7f9d28050560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9c06ffd640 1 -- 172.21.15.151:0/1383104677 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28050bf0 con 0x563b2b7d3190 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.473+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b2b7d9e10 con 0x563b2b7d3190 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9c06ffd640 1 -- 172.21.15.151:0/1383104677 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d28031070 con 0x563b2b7d3190 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b2b7da7c0 con 0x563b2b7d3190 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9c06ffd640 1 -- 172.21.15.151:0/1383104677 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d280173b0 con 0x563b2b7d3190 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9c06ffd640 1 -- 172.21.15.151:0/1383104677 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9d28017550 con 0x563b2b7d3190 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9c06ffd640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c00039a70 0x7f9c0003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9c06ffd640 1 -- 172.21.15.151:0/1383104677 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9d28037cc0 con 0x563b2b7d3190 2024-09-12T16:52:19.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d350fe640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c00039a70 0x7f9c0003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b7e49a0 0x563b2b7e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7e7540 con 0x563b2b7e49a0 2024-09-12T16:52:19.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d348fd640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b7e49a0 0x563b2b7e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d350fe640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c00039a70 0x7f9c0003bf30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9d30050560 tx=0x7f9d30033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d348fd640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b7e49a0 0x563b2b7e6df0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 realm 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7e7970 con 0x563b2b7e49a0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7e8240 con 0x563b2b7e49a0 2024-09-12T16:52:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7e85e0 con 0x563b2b7e49a0 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7e9340 0x563b2b7eb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7ebd80 con 0x563b2b7e9340 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.477+0000 7f9d358ff640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7e9340 0x563b2b7eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d358ff640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7e9340 0x563b2b7eb730 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d375f89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d375f89c0 20 searching for the correct realm 2024-09-12T16:52:19.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563b2b7edc60 0x563b2b7f0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d350fe640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563b2b7edc60 0x563b2b7f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d350fe640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563b2b7edc60 0x563b2b7f0090 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3001b030 con 0x563b2b7edc60 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d350fe640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9d3003f070 0x7f9d3001da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x7f9d3003f070 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d348fd640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9d3003f070 0x7f9d3001da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d348fd640 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9d3003f070 0x7f9d3001da10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e49a0 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e49a0 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.481+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x7f9d3003f070 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3001b030 con 0x563b2b7edc60 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e49a0 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e49a0 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x7f9d3003f070 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.485+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e49a0 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e49a0 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x7f9d3003f070 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e49a0 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x7f9d3003f070 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.489+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7edc60 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e9340 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x563b2b7e49a0 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0710 con 0x7f9d3003f070 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:19.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7ec700 con 0x563b2b7e49a0 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7ec340 con 0x563b2b7e49a0 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7ed0e0 con 0x563b2b7e49a0 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 zone default found 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 4 Realm: () 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 zonegroup default 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f0b90 con 0x563b2b7e9340 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f2e20 con 0x563b2b7edc60 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f31c0 con 0x563b2b7edc60 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 started sync module instance, tier type = 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.493+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f22b0 con 0x7f9d3003f070 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.497+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.497+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94812132812768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f22b0 con 0x7f9d3003f070 2024-09-12T16:52:19.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.497+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f3cc0 con 0x563b2b7e49a0 2024-09-12T16:52:19.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.497+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94812132812768] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.497+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.497+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94812132816832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f22b0 con 0x563b2b7e49a0 2024-09-12T16:52:19.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.497+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f4700 con 0x563b2b7edc60 2024-09-12T16:52:19.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94812132816832] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94812132810240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f2220 con 0x563b2b7edc60 2024-09-12T16:52:19.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f5400 con 0x7f9d3003f070 2024-09-12T16:52:19.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94812132823136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f5b10 con 0x7f9d3003f070 2024-09-12T16:52:19.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f6610 con 0x563b2b7e49a0 2024-09-12T16:52:19.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94812132810240] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94812132823136] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94812132827392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f65d0 con 0x563b2b7e49a0 2024-09-12T16:52:19.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.501+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f6a30 con 0x563b2b7e9340 2024-09-12T16:52:19.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.505+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94812132827392] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.505+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.505+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94812132824416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f6dd0 con 0x563b2b7e9340 2024-09-12T16:52:19.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.505+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f7790 con 0x563b2b7e9340 2024-09-12T16:52:19.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.505+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94812132831968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f7bb0 con 0x563b2b7e9340 2024-09-12T16:52:19.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f8660 con 0x563b2b7e9340 2024-09-12T16:52:19.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94812132824416] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94812132831968] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94812132821664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f8350 con 0x563b2b7e9340 2024-09-12T16:52:19.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 20 add_watcher() i=0 2024-09-12T16:52:19.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 20 add_watcher() i=1 2024-09-12T16:52:19.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 20 add_watcher() i=2 2024-09-12T16:52:19.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 20 add_watcher() i=3 2024-09-12T16:52:19.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 20 add_watcher() i=4 2024-09-12T16:52:19.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 20 add_watcher() i=5 2024-09-12T16:52:19.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.509+0000 7f9d375f89c0 20 add_watcher() i=6 2024-09-12T16:52:19.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94812132821664] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 20 add_watcher() i=7 2024-09-12T16:52:19.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:19.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7fb720 con 0x563b2b7e49a0 2024-09-12T16:52:19.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94812132835904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f8b10 con 0x563b2b7e49a0 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94812132835904] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9beb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 5 note: GC not initialized 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9bea7e4640 20 reqs_thread_entry: start 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 20 Filter name: none 2024-09-12T16:52:19.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9b5bfff640 20 reqs_thread_entry: start 2024-09-12T16:52:19.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:19.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b81e730 con 0x563b2b7e49a0 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.513+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b824da0 con 0x563b2b7e49a0 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d375f89c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:19.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d375f89c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d375f89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:19.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94812133017744 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b820570 con 0x563b2b7e49a0 2024-09-12T16:52:19.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94812132827392 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x563b2b560ca0 con 0x563b2b7e49a0 2024-09-12T16:52:19.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9c18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94812132827392 notifier 4418 bl.length()=567 2024-09-12T16:52:19.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9c18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:19.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9c18ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:19.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(64 notify.4 [notify cookie 94812133017744 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9c18ff9640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9bf8003eb0 con 0x563b2b7e49a0 2024-09-12T16:52:19.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94812133017744 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9d2c0d7800 con 0x563b2b7e49a0 2024-09-12T16:52:19.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b824890 con 0x7f9d3003f070 2024-09-12T16:52:19.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d375f89c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-12T16:52:19.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94812133017744 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b2b8200c0 con 0x7f9d3003f070 2024-09-12T16:52:19.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== watch-notify(notify (1) cookie 94812132812768 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f9d2c0d7800 con 0x7f9d3003f070 2024-09-12T16:52:19.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9c18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94812132812768 notifier 4418 bl.length()=159 2024-09-12T16:52:19.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9c18ff9640 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9bf8003eb0 con 0x7f9d3003f070 2024-09-12T16:52:19.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(67 notify.0 [notify cookie 94812133017744 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.517+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== watch-notify(notify_complete (2) cookie 94812133017744 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9d2c0d7b70 con 0x7f9d3003f070 2024-09-12T16:52:19.523 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:19.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.521+0000 7f9beb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.521+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94812132835904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b81c510 con 0x563b2b7e49a0 2024-09-12T16:52:19.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.521+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94812132835904] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.521+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94812132812768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b81c510 con 0x7f9d3003f070 2024-09-12T16:52:19.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.521+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94812132812768] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.521+0000 7f9d375f89c0 20 remove_watcher() i=0 2024-09-12T16:52:19.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.521+0000 7f9d375f89c0 2 removed watcher, disabling cache 2024-09-12T16:52:19.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.521+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94812132816832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b81c510 con 0x563b2b7e49a0 2024-09-12T16:52:19.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94812132816832] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d375f89c0 20 remove_watcher() i=1 2024-09-12T16:52:19.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94812132810240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b81c510 con 0x563b2b7edc60 2024-09-12T16:52:19.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d350fe640 1 -- 172.21.15.151:0/1383104677 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94812132810240] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3005d040 con 0x563b2b7edc60 2024-09-12T16:52:19.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d375f89c0 20 remove_watcher() i=2 2024-09-12T16:52:19.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94812132823136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f1e00 con 0x7f9d3003f070 2024-09-12T16:52:19.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94812132823136] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x7f9d3003f070 2024-09-12T16:52:19.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d375f89c0 20 remove_watcher() i=3 2024-09-12T16:52:19.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.525+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94812132827392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b81c510 con 0x563b2b7e49a0 2024-09-12T16:52:19.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.529+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94812132827392] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d2c0a8070 con 0x563b2b7e49a0 2024-09-12T16:52:19.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.529+0000 7f9d375f89c0 20 remove_watcher() i=4 2024-09-12T16:52:19.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.529+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94812132824416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f1e00 con 0x563b2b7e9340 2024-09-12T16:52:19.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.529+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94812132824416] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.529+0000 7f9d375f89c0 20 remove_watcher() i=5 2024-09-12T16:52:19.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.529+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94812132831968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b81c510 con 0x563b2b7e9340 2024-09-12T16:52:19.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94812132831968] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 20 remove_watcher() i=6 2024-09-12T16:52:19.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94812132821664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b2b7f1e00 con 0x563b2b7e9340 2024-09-12T16:52:19.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d358ff640 1 -- 172.21.15.151:0/1383104677 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94812132821664] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d280083f0 con 0x563b2b7e9340 2024-09-12T16:52:19.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 20 remove_watcher() i=7 2024-09-12T16:52:19.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7e9340 msgr2=0x563b2b7eb730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7e9340 0x563b2b7eb730 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b7e49a0 msgr2=0x563b2b7e6df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b7e49a0 0x563b2b7e6df0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9d3003f070 msgr2=0x7f9d3001da10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9d3003f070 0x7f9d3001da10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563b2b7edc60 msgr2=0x563b2b7f0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563b2b7edc60 0x563b2b7f0090 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c00039a70 msgr2=0x7f9c0003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c00039a70 0x7f9c0003bf30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9d30050560 tx=0x7f9d30033000 comp rx=0 tx=0).stop 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 msgr2=0x563b2b7d9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/1383104677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7d3190 0x563b2b7d9620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9d28014d40 tx=0x7f9d28050560 comp rx=0 tx=0).stop 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 reap_dead start 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d348fd640 1 -- 172.21.15.151:0/1383104677 reap_dead start 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 shutdown_connections 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 >> 172.21.15.151:0/1383104677 conn(0x563b2b7ce5b0 msgr2=0x563b2b7cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 shutdown_connections 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/1383104677 wait complete. 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/2881063546 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c10039a70 msgr2=0x7f9c1003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/2881063546 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c10039a70 0x7f9c1003bf30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9d30010cc0 tx=0x7f9d30043040 comp rx=0 tx=0).stop 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/2881063546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7c57e0 msgr2=0x563b2b7c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/2881063546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7c57e0 0x563b2b7c5c00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x563b2b7abab0 tx=0x7f9d2800af40 comp rx=0 tx=0).stop 2024-09-12T16:52:19.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/2881063546 shutdown_connections 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/2881063546 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c10039a70 0x7f9c1003bf30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/2881063546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b7c57e0 0x563b2b7c5c00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/2881063546 >> 172.21.15.151:0/2881063546 conn(0x563b2b7bb190 msgr2=0x563b2b7bb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.533+0000 7f9d375f89c0 1 -- 172.21.15.151:0/2881063546 shutdown_connections 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/2881063546 wait complete. 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7b4680 msgr2=0x563b2b7b6a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7b4680 0x563b2b7b6a70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b6bc0d0 msgr2=0x563b2b7b1ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b6bc0d0 0x563b2b7b1ea0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c1c039ac0 msgr2=0x7f9c1c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c1c039ac0 0x7f9c1c03bf80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0ae000 tx=0x7f9d2c0a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:19.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 msgr2=0x563b2b7aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7aad30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9d300012f0 tx=0x7f9d30000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 shutdown_connections 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563b2b7b4680 0x563b2b7b6a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563b2b6bc0d0 0x563b2b7b1ea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9c1c039ac0 0x7f9c1c03bf80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 --2- 172.21.15.151:0/3082034903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563b2b6b7f30 0x563b2b7aad30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 >> 172.21.15.151:0/3082034903 conn(0x563b2b6b3a50 msgr2=0x563b2b79de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 shutdown_connections 2024-09-12T16:52:19.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.537+0000 7f9d375f89c0 1 -- 172.21.15.151:0/3082034903 wait complete. 2024-09-12T16:52:19.547 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:19.548 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-12T16:52:19.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-12T16:52:19.548 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-12T16:52:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:19.624 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:19.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6ed569c0 1 Processor -- start 2024-09-12T16:52:19.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6ed569c0 1 -- start start 2024-09-12T16:52:19.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6ed569c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5653f71bc0d0 0x5653f71be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6ed569c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5653f706c9c0 con 0x5653f71b7f80 2024-09-12T16:52:19.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6ed569c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5653f70bc6d0 con 0x5653f71bc0d0 2024-09-12T16:52:19.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6c05b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5653f71bc0d0 0x5653f71be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6c85c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5653f71b7f80 0x5653f71b8360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38176/0 (socket says 172.21.15.151:38176) 2024-09-12T16:52:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6c05b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5653f71bc0d0 0x5653f71be4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34518/0 (socket says 172.21.15.151:34518) 2024-09-12T16:52:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6c85c640 1 -- 172.21.15.151:0/792316376 learned_addr learned my addr 172.21.15.151:0/792316376 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6c05b640 1 -- 172.21.15.151:0/792316376 >> v1:172.21.15.122:6789/0 conn(0x5653f71b7f80 legacy=0x5653f71b8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.621+0000 7f8b6c05b640 1 -- 172.21.15.151:0/792316376 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f7060ca0 con 0x5653f71bc0d0 2024-09-12T16:52:19.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6c05b640 1 --2- 172.21.15.151:0/792316376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71bc0d0 0x5653f71be4c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000a480 tx=0x7f8b6001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8d04eee04d8e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6b85a640 1 -- 172.21.15.151:0/792316376 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b600aa570 con 0x5653f71bc0d0 2024-09-12T16:52:19.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6b85a640 1 -- 172.21.15.151:0/792316376 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b600af070 con 0x5653f71bc0d0 2024-09-12T16:52:19.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6b85a640 1 -- 172.21.15.151:0/792316376 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b600aa860 con 0x5653f71bc0d0 2024-09-12T16:52:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/792316376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71bc0d0 msgr2=0x5653f71be4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/792316376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71bc0d0 0x5653f71be4c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000a480 tx=0x7f8b6001b310 comp rx=0 tx=0).stop 2024-09-12T16:52:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/792316376 shutdown_connections 2024-09-12T16:52:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/792316376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71bc0d0 0x5653f71be4c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/792316376 >> 172.21.15.151:0/792316376 conn(0x5653f71b3aa0 msgr2=0x5653f71b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/792316376 shutdown_connections 2024-09-12T16:52:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.625+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/792316376 wait complete. 2024-09-12T16:52:19.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 Processor -- start 2024-09-12T16:52:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 -- start start 2024-09-12T16:52:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5653f70c0680 con 0x5653f71b7f80 2024-09-12T16:52:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6c85c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6c85c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72a3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34520/0 (socket says 172.21.15.151:34520) 2024-09-12T16:52:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6c85c640 1 -- 172.21.15.151:0/4272218115 learned_addr learned my addr 172.21.15.151:0/4272218115 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6c85c640 1 -- 172.21.15.151:0/4272218115 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f703bda0 con 0x5653f71b7f80 2024-09-12T16:52:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/4272218115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72a3720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c001e00 tx=0x7f8b5c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be25770e22d7e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8a5ae0d640 1 -- 172.21.15.151:0/4272218115 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5c012020 con 0x5653f71b7f80 2024-09-12T16:52:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8a5ae0d640 1 -- 172.21.15.151:0/4272218115 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c00e690 con 0x5653f71b7f80 2024-09-12T16:52:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8a5ae0d640 1 -- 172.21.15.151:0/4272218115 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5c00ea10 con 0x5653f71b7f80 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4272218115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 msgr2=0x5653f72a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/4272218115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72a3720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c001e00 tx=0x7f8b5c00b6d0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4272218115 shutdown_connections 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/4272218115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72a3720 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4272218115 >> 172.21.15.151:0/4272218115 conn(0x5653f71b3aa0 msgr2=0x5653f729f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4272218115 shutdown_connections 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4272218115 wait complete. 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 Processor -- start 2024-09-12T16:52:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 -- start start 2024-09-12T16:52:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.641+0000 7f8b6ed569c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6ed569c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5653f7062a50 con 0x5653f71b7f80 2024-09-12T16:52:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6c85c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6c85c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34522/0 (socket says 172.21.15.151:34522) 2024-09-12T16:52:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2014238059 learned_addr learned my addr 172.21.15.151:0/2014238059 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2014238059 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f72ab320 con 0x5653f71b7f80 2024-09-12T16:52:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72aadc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5653f72a46b0 tx=0x7f8b5c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8a5960a640 1 -- 172.21.15.151:0/2014238059 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5c012030 con 0x5653f71b7f80 2024-09-12T16:52:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8a5960a640 1 -- 172.21.15.151:0/2014238059 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c01a750 con 0x5653f71b7f80 2024-09-12T16:52:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653f72ab5b0 con 0x5653f71b7f80 2024-09-12T16:52:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653f72abf60 con 0x5653f71b7f80 2024-09-12T16:52:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8a5960a640 1 -- 172.21.15.151:0/2014238059 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5c01aa30 con 0x5653f71b7f80 2024-09-12T16:52:19.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8a5960a640 1 -- 172.21.15.151:0/2014238059 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b5c015020 con 0x5653f71b7f80 2024-09-12T16:52:19.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8a5960a640 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a54039a70 0x7f8a5403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8a5960a640 1 -- 172.21.15.151:0/2014238059 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8b5c020030 con 0x5653f71b7f80 2024-09-12T16:52:19.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6c05b640 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a54039a70 0x7f8a5403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f71bc0d0 0x5653f72b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72b2470 con 0x5653f71bc0d0 2024-09-12T16:52:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6d05d640 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f71bc0d0 0x5653f72b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6c05b640 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a54039a70 0x7f8a5403bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b600ae000 tx=0x7f8b600a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.645+0000 7f8b6d05d640 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f71bc0d0 0x5653f72b1f30 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2014238059 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b6400a4d0 con 0x5653f71bc0d0 2024-09-12T16:52:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72b2830 con 0x5653f71bc0d0 2024-09-12T16:52:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2014238059 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b6400a4d0 con 0x5653f71bc0d0 2024-09-12T16:52:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72b4640 0x5653f72b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72b7100 con 0x5653f72b4640 2024-09-12T16:52:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72b4640 0x5653f72b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72b4640 0x5653f72b6a30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2014238059 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72b4640 2024-09-12T16:52:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72b34e0 con 0x5653f71bc0d0 2024-09-12T16:52:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2014238059 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b6400a4d0 con 0x5653f71bc0d0 2024-09-12T16:52:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72b3980 con 0x5653f71bc0d0 2024-09-12T16:52:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2014238059 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b6400a4d0 con 0x5653f71bc0d0 2024-09-12T16:52:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 Processor -- start 2024-09-12T16:52:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 -- start start 2024-09-12T16:52:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f712e470 0x5653f712cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6ed569c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5653f70cd450 con 0x5653f712e470 2024-09-12T16:52:19.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6d05d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f712e470 0x5653f712cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6d05d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f712e470 0x5653f712cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34538/0 (socket says 172.21.15.151:34538) 2024-09-12T16:52:19.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.649+0000 7f8b6d05d640 1 -- 172.21.15.151:0/4278088344 learned_addr learned my addr 172.21.15.151:0/4278088344 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6d05d640 1 -- 172.21.15.151:0/4278088344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f712e990 con 0x5653f712e470 2024-09-12T16:52:19.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6d05d640 1 --2- 172.21.15.151:0/4278088344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f712e470 0x5653f712cd10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5653f72ace50 tx=0x7f8b64018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8a527fc640 1 -- 172.21.15.151:0/4278088344 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b64014450 con 0x5653f712e470 2024-09-12T16:52:19.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4278088344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653f712d250 con 0x5653f712e470 2024-09-12T16:52:19.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8a527fc640 1 -- 172.21.15.151:0/4278088344 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b640145f0 con 0x5653f712e470 2024-09-12T16:52:19.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8a527fc640 1 -- 172.21.15.151:0/4278088344 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b64014910 con 0x5653f712e470 2024-09-12T16:52:19.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4278088344 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653f712d7c0 con 0x5653f712e470 2024-09-12T16:52:19.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8a527fc640 1 -- 172.21.15.151:0/4278088344 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b64011040 con 0x5653f712e470 2024-09-12T16:52:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8a527fc640 1 --2- 172.21.15.151:0/4278088344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a44039a70 0x7f8a4403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8a527fc640 1 -- 172.21.15.151:0/4278088344 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8b6401e070 con 0x5653f712e470 2024-09-12T16:52:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/4278088344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a44039a70 0x7f8a4403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6ed569c0 1 Processor -- start 2024-09-12T16:52:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6ed569c0 1 -- start start 2024-09-12T16:52:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/4278088344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a44039a70 0x7f8a4403bf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5653f72ac250 tx=0x7f8b5c01aed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6ed569c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72d56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6ed569c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5653f72a3f70 con 0x5653f72d52a0 2024-09-12T16:52:19.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6d05d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72d56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6d05d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72d56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34554/0 (socket says 172.21.15.151:34554) 2024-09-12T16:52:19.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.653+0000 7f8b6d05d640 1 -- 172.21.15.151:0/601553502 learned_addr learned my addr 172.21.15.151:0/601553502 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6d05d640 1 -- 172.21.15.151:0/601553502 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f72d5c90 con 0x5653f72d52a0 2024-09-12T16:52:19.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6d05d640 1 --2- 172.21.15.151:0/601553502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72d56a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8b64016fd0 tx=0x7f8b64001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da459f5eb8b11ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8a43fff640 1 -- 172.21.15.151:0/601553502 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b64028070 con 0x5653f72d52a0 2024-09-12T16:52:19.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8a43fff640 1 -- 172.21.15.151:0/601553502 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b64022dc0 con 0x5653f72d52a0 2024-09-12T16:52:19.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8a43fff640 1 -- 172.21.15.151:0/601553502 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b640520d0 con 0x5653f72d52a0 2024-09-12T16:52:19.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/601553502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 msgr2=0x5653f72d56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/601553502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72d56a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8b64016fd0 tx=0x7f8b64001450 comp rx=0 tx=0).stop 2024-09-12T16:52:19.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/601553502 shutdown_connections 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/601553502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72d56a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/601553502 >> 172.21.15.151:0/601553502 conn(0x5653f72d06c0 msgr2=0x5653f72ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/601553502 shutdown_connections 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/601553502 wait complete. 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 Processor -- start 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- start start 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72db780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5653f72d41f0 con 0x5653f72d52a0 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6d05d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72db780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6d05d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72db780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34564/0 (socket says 172.21.15.151:34564) 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 learned_addr learned my addr 172.21.15.151:0/2900437250 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f72dbce0 con 0x5653f72d52a0 2024-09-12T16:52:19.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6d05d640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72db780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8b64018430 tx=0x7f8b640506a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8a427fc640 1 -- 172.21.15.151:0/2900437250 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b64032030 con 0x5653f72d52a0 2024-09-12T16:52:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653f72dbf70 con 0x5653f72d52a0 2024-09-12T16:52:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653f72dc920 con 0x5653f72d52a0 2024-09-12T16:52:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8a427fc640 1 -- 172.21.15.151:0/2900437250 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b64011330 con 0x5653f72d52a0 2024-09-12T16:52:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.657+0000 7f8a427fc640 1 -- 172.21.15.151:0/2900437250 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b6404f280 con 0x5653f72d52a0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8a427fc640 1 -- 172.21.15.151:0/2900437250 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b64035070 con 0x5653f72d52a0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8a427fc640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a38039a70 0x7f8a3803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8a427fc640 1 -- 172.21.15.151:0/2900437250 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8b64033070 con 0x5653f72d52a0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a38039a70 0x7f8a3803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f72e6c50 0x5653f72e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72e9830 con 0x5653f72e6c50 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6c05b640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f72e6c50 0x5653f72e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a38039a70 0x7f8a3803bf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c025ff0 tx=0x7f8b5c033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6c05b640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f72e6c50 0x5653f72e90e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 realm 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72e9c60 con 0x5653f72e6c50 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72ea530 con 0x5653f72e6c50 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72ea8d0 con 0x5653f72e6c50 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72eb630 0x5653f72eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72edf60 con 0x5653f72eb630 2024-09-12T16:52:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6d05d640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72eb630 0x5653f72eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6d05d640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72eb630 0x5653f72eda20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 20 searching for the correct realm 2024-09-12T16:52:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5653f72efeb0 0x5653f72f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.661+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5653f72efeb0 0x5653f72f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5653f72efeb0 0x5653f72f2370 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c85c640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8b5c03a040 0x7f8b5c050980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x7f8b5c03a040 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c05b640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8b5c03a040 0x7f8b5c050980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c05b640 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8b5c03a040 0x7f8b5c050980 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72e6c50 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72e6c50 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.665+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x7f8b5c03a040 2024-09-12T16:52:19.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72e6c50 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72e6c50 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x7f8b5c03a040 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72e6c50 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72e6c50 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.669+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x7f8b5c03a040 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72e6c50 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x7f8b5c03a040 2024-09-12T16:52:19.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72efeb0 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.673+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72eb630 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x5653f72e6c50 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2a40 con 0x7f8b5c03a040 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72ee8b0 con 0x5653f72e6c50 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72eecd0 con 0x5653f72e6c50 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72ef1b0 con 0x5653f72e6c50 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 zone default found 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 4 Realm: () 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 zonegroup default 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f2ec0 con 0x5653f72eb630 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f4de0 con 0x5653f72efeb0 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f52a0 con 0x5653f72efeb0 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 started sync module instance, tier type = 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f40f0 con 0x7f8b5c03a040 2024-09-12T16:52:19.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.677+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94918629344752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f40f0 con 0x7f8b5c03a040 2024-09-12T16:52:19.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.681+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f5e10 con 0x5653f72e6c50 2024-09-12T16:52:19.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.681+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94918629344752] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.681+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.681+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94918629349616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f40f0 con 0x5653f72e6c50 2024-09-12T16:52:19.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.681+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f6820 con 0x5653f72efeb0 2024-09-12T16:52:19.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.681+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.681+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94918629352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f70c0 con 0x5653f72efeb0 2024-09-12T16:52:19.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.681+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f7ac0 con 0x7f8b5c03a040 2024-09-12T16:52:19.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94918629349616] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94918629342272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f7eb0 con 0x7f8b5c03a040 2024-09-12T16:52:19.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f8870 con 0x5653f72e6c50 2024-09-12T16:52:19.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94918629352304] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94918629342272] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94918629357008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f83c0 con 0x5653f72e6c50 2024-09-12T16:52:19.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.685+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f8c10 con 0x5653f72eb630 2024-09-12T16:52:19.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.689+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94918629357008] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.689+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.689+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94918629360576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f87e0 con 0x5653f72eb630 2024-09-12T16:52:19.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.689+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f9910 con 0x5653f72eb630 2024-09-12T16:52:19.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.689+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.689+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94918629364832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f9d70 con 0x5653f72eb630 2024-09-12T16:52:19.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.689+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72fa860 con 0x5653f72eb630 2024-09-12T16:52:19.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.689+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94918629360576] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94918629368624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72fa820 con 0x5653f72eb630 2024-09-12T16:52:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 add_watcher() i=0 2024-09-12T16:52:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 add_watcher() i=1 2024-09-12T16:52:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 add_watcher() i=2 2024-09-12T16:52:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 add_watcher() i=3 2024-09-12T16:52:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 add_watcher() i=4 2024-09-12T16:52:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 add_watcher() i=5 2024-09-12T16:52:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94918629364832] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 add_watcher() i=6 2024-09-12T16:52:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94918629368624] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 add_watcher() i=7 2024-09-12T16:52:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f72f9880 con 0x5653f72e6c50 2024-09-12T16:52:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94918629365888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f72facf0 con 0x5653f72e6c50 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94918629365888] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8a22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 5 note: GC not initialized 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8a21fe3640 20 reqs_thread_entry: start 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.693+0000 7f8b6ed569c0 20 Filter name: none 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f89937fe640 20 reqs_thread_entry: start 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f7320530 con 0x5653f72e6c50 2024-09-12T16:52:19.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f7320f50 con 0x5653f72e6c50 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653f7321f60 con 0x7f8b5c03a040 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8a22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94918629365888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x5653f72e6c50 2024-09-12T16:52:19.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94918629365888] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94918629344752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x7f8b5c03a040 2024-09-12T16:52:19.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94918629344752] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 20 remove_watcher() i=0 2024-09-12T16:52:19.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 2 removed watcher, disabling cache 2024-09-12T16:52:19.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.697+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94918629349616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x5653f72e6c50 2024-09-12T16:52:19.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.701+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94918629349616] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.701+0000 7f8b6ed569c0 20 remove_watcher() i=1 2024-09-12T16:52:19.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.701+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94918629352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x5653f72efeb0 2024-09-12T16:52:19.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6c85c640 1 -- 172.21.15.151:0/2900437250 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94918629352304] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b5c008030 con 0x5653f72efeb0 2024-09-12T16:52:19.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6ed569c0 20 remove_watcher() i=2 2024-09-12T16:52:19.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94918629342272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x7f8b5c03a040 2024-09-12T16:52:19.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94918629342272] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x7f8b5c03a040 2024-09-12T16:52:19.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6ed569c0 20 remove_watcher() i=3 2024-09-12T16:52:19.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94918629357008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x5653f72e6c50 2024-09-12T16:52:19.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94918629357008] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b600a8070 con 0x5653f72e6c50 2024-09-12T16:52:19.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6ed569c0 20 remove_watcher() i=4 2024-09-12T16:52:19.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.705+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94918629360576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x5653f72eb630 2024-09-12T16:52:19.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.709+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94918629360576] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.709+0000 7f8b6ed569c0 20 remove_watcher() i=5 2024-09-12T16:52:19.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.709+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94918629364832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x5653f72eb630 2024-09-12T16:52:19.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.709+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94918629364832] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.709+0000 7f8b6ed569c0 20 remove_watcher() i=6 2024-09-12T16:52:19.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.709+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94918629368624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653f731e3c0 con 0x5653f72eb630 2024-09-12T16:52:19.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6d05d640 1 -- 172.21.15.151:0/2900437250 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94918629368624] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b6402a070 con 0x5653f72eb630 2024-09-12T16:52:19.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 20 remove_watcher() i=7 2024-09-12T16:52:19.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72eb630 msgr2=0x5653f72eda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72eb630 0x5653f72eda20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f72e6c50 msgr2=0x5653f72e90e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f72e6c50 0x5653f72e90e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8b5c03a040 msgr2=0x7f8b5c050980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8b5c03a040 0x7f8b5c050980 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5653f72efeb0 msgr2=0x5653f72f2370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5653f72efeb0 0x5653f72f2370 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a38039a70 msgr2=0x7f8a3803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a38039a70 0x7f8a3803bf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c025ff0 tx=0x7f8b5c033000 comp rx=0 tx=0).stop 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 msgr2=0x5653f72db780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6c05b640 1 -- 172.21.15.151:0/2900437250 reap_dead start 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72db780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8b64018430 tx=0x7f8b640506a0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 shutdown_connections 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2900437250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f72d52a0 0x5653f72db780 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 >> 172.21.15.151:0/2900437250 conn(0x5653f72d06c0 msgr2=0x5653f72ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 shutdown_connections 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2900437250 wait complete. 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4278088344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a44039a70 msgr2=0x7f8a4403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/4278088344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a44039a70 0x7f8a4403bf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5653f72ac250 tx=0x7f8b5c01aed0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4278088344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f712e470 msgr2=0x5653f712cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/4278088344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f712e470 0x5653f712cd10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5653f72ace50 tx=0x7f8b64018830 comp rx=0 tx=0).stop 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4278088344 shutdown_connections 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/4278088344 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a44039a70 0x7f8a4403bf30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/4278088344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f712e470 0x5653f712cd10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4278088344 >> 172.21.15.151:0/4278088344 conn(0x5653f72bb120 msgr2=0x5653f72bb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4278088344 shutdown_connections 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/4278088344 wait complete. 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72b4640 msgr2=0x5653f72b6a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72b4640 0x5653f72b6a30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f71bc0d0 msgr2=0x5653f72b1f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f71bc0d0 0x5653f72b1f30 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a54039a70 msgr2=0x7f8a5403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a54039a70 0x7f8a5403bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b600ae000 tx=0x7f8b600a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 msgr2=0x5653f72aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72aadc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5653f72a46b0 tx=0x7f8b5c000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 shutdown_connections 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5653f72b4640 0x5653f72b6a30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5653f71bc0d0 0x5653f72b1f30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8a54039a70 0x7f8a5403bf30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 --2- 172.21.15.151:0/2014238059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653f71b7f80 0x5653f72aadc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 >> 172.21.15.151:0/2014238059 conn(0x5653f71b3aa0 msgr2=0x5653f729ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 shutdown_connections 2024-09-12T16:52:19.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.713+0000 7f8b6ed569c0 1 -- 172.21.15.151:0/2014238059 wait complete. 2024-09-12T16:52:19.724 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-12T16:52:19.724 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T16:52:19.725 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-12T16:52:19.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-12T16:52:19.725 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-12T16:52:19.798 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:19.799 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:19.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615de9c9c0 1 Processor -- start 2024-09-12T16:52:19.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615de9c9c0 1 -- start start 2024-09-12T16:52:19.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615de9c9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d58b180d0 0x564d58b1a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615de9c9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d589c89c0 con 0x564d58b13f80 2024-09-12T16:52:19.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615de9c9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x564d58a186d0 con 0x564d58b180d0 2024-09-12T16:52:19.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615b1a1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d58b180d0 0x564d58b1a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615b1a1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d58b180d0 0x564d58b1a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34572/0 (socket says 172.21.15.151:34572) 2024-09-12T16:52:19.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615b1a1640 1 -- 172.21.15.151:0/2245542427 learned_addr learned my addr 172.21.15.151:0/2245542427 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615b9a2640 1 --1- 172.21.15.151:0/2245542427 >> v1:172.21.15.122:6789/0 conn(0x564d58b13f80 0x564d58b14360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38186/0 (socket says 172.21.15.151:38186) 2024-09-12T16:52:19.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615b1a1640 1 -- 172.21.15.151:0/2245542427 >> v1:172.21.15.122:6789/0 conn(0x564d58b13f80 legacy=0x564d58b14360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.797+0000 7f615b1a1640 1 -- 172.21.15.151:0/2245542427 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d589bcca0 con 0x564d58b180d0 2024-09-12T16:52:19.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615b1a1640 1 --2- 172.21.15.151:0/2245542427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b180d0 0x564d58b1a4c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f614400a5c0 tx=0x7f614401b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d43b4cd3b18e294 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615a9a0640 1 -- 172.21.15.151:0/2245542427 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61440b0070 con 0x564d58b180d0 2024-09-12T16:52:19.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615a9a0640 1 -- 172.21.15.151:0/2245542427 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61440ab570 con 0x564d58b180d0 2024-09-12T16:52:19.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615a9a0640 1 -- 172.21.15.151:0/2245542427 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61440ab870 con 0x564d58b180d0 2024-09-12T16:52:19.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615de9c9c0 1 -- 172.21.15.151:0/2245542427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b180d0 msgr2=0x564d58b1a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/2245542427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b180d0 0x564d58b1a4c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f614400a5c0 tx=0x7f614401b260 comp rx=0 tx=0).stop 2024-09-12T16:52:19.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615de9c9c0 1 -- 172.21.15.151:0/2245542427 shutdown_connections 2024-09-12T16:52:19.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/2245542427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b180d0 0x564d58b1a4c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615de9c9c0 1 -- 172.21.15.151:0/2245542427 >> 172.21.15.151:0/2245542427 conn(0x564d58b0faa0 msgr2=0x564d58b11ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615de9c9c0 1 -- 172.21.15.151:0/2245542427 shutdown_connections 2024-09-12T16:52:19.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.801+0000 7f615de9c9c0 1 -- 172.21.15.151:0/2245542427 wait complete. 2024-09-12T16:52:19.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.813+0000 7f615de9c9c0 1 Processor -- start 2024-09-12T16:52:19.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.813+0000 7f615de9c9c0 1 -- start start 2024-09-12T16:52:19.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.813+0000 7f615de9c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58bff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.813+0000 7f615de9c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d58a1c680 con 0x564d58b13f80 2024-09-12T16:52:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.813+0000 7f615b9a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58bff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.813+0000 7f615b9a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58bff700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34586/0 (socket says 172.21.15.151:34586) 2024-09-12T16:52:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.813+0000 7f615b9a2640 1 -- 172.21.15.151:0/3317306554 learned_addr learned my addr 172.21.15.151:0/3317306554 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.813+0000 7f615b9a2640 1 -- 172.21.15.151:0/3317306554 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d58997da0 con 0x564d58b13f80 2024-09-12T16:52:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615b9a2640 1 --2- 172.21.15.151:0/3317306554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58bff700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6154001850 tx=0x7f6154001d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996c1f152d2b65a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f6049e0b640 1 -- 172.21.15.151:0/3317306554 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6154003460 con 0x564d58b13f80 2024-09-12T16:52:19.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f6049e0b640 1 -- 172.21.15.151:0/3317306554 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6154003620 con 0x564d58b13f80 2024-09-12T16:52:19.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f6049e0b640 1 -- 172.21.15.151:0/3317306554 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6154003940 con 0x564d58b13f80 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- 172.21.15.151:0/3317306554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 msgr2=0x564d58bff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/3317306554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58bff700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6154001850 tx=0x7f6154001d10 comp rx=0 tx=0).stop 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- 172.21.15.151:0/3317306554 shutdown_connections 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/3317306554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58bff700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- 172.21.15.151:0/3317306554 >> 172.21.15.151:0/3317306554 conn(0x564d58b0faa0 msgr2=0x564d58bfb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- 172.21.15.151:0/3317306554 shutdown_connections 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- 172.21.15.151:0/3317306554 wait complete. 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 Processor -- start 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- start start 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58c06e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d589bea50 con 0x564d58b13f80 2024-09-12T16:52:19.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615b9a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58c06e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615b9a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58c06e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34600/0 (socket says 172.21.15.151:34600) 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615b9a2640 1 -- 172.21.15.151:0/522282728 learned_addr learned my addr 172.21.15.151:0/522282728 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615b9a2640 1 -- 172.21.15.151:0/522282728 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d58c07360 con 0x564d58b13f80 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615b9a2640 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58c06e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6154001d50 tx=0x7f6154000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f6043fff640 1 -- 172.21.15.151:0/522282728 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6154013630 con 0x564d58b13f80 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d58c075f0 con 0x564d58b13f80 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f6043fff640 1 -- 172.21.15.151:0/522282728 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6154023070 con 0x564d58b13f80 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f6043fff640 1 -- 172.21.15.151:0/522282728 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6154013960 con 0x564d58b13f80 2024-09-12T16:52:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.817+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d58c07fa0 con 0x564d58b13f80 2024-09-12T16:52:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f6043fff640 1 -- 172.21.15.151:0/522282728 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6154010070 con 0x564d58b13f80 2024-09-12T16:52:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f6043fff640 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6044039a70 0x7f604403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f6043fff640 1 -- 172.21.15.151:0/522282728 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6154050350 con 0x564d58b13f80 2024-09-12T16:52:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615b1a1640 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6044039a70 0x7f604403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58b180d0 0x564d58c0df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c0e4b0 con 0x564d58b180d0 2024-09-12T16:52:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615c1a3640 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58b180d0 0x564d58c0df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615b1a1640 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6044039a70 0x7f604403bf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61440ad000 tx=0x7f61440a5070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615c1a3640 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58b180d0 0x564d58c0df70 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615c1a3640 1 -- 172.21.15.151:0/522282728 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f614c0083f0 con 0x564d58b180d0 2024-09-12T16:52:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c082e0 con 0x564d58b180d0 2024-09-12T16:52:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615c1a3640 1 -- 172.21.15.151:0/522282728 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f614c0083f0 con 0x564d58b180d0 2024-09-12T16:52:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c10720 0x564d58c12b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c13200 con 0x564d58c10720 2024-09-12T16:52:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615b9a2640 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c10720 0x564d58c12b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.821+0000 7f615b9a2640 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c10720 0x564d58c12b10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615b9a2640 1 -- 172.21.15.151:0/522282728 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f615400f030 con 0x564d58c10720 2024-09-12T16:52:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c0f5c0 con 0x564d58b180d0 2024-09-12T16:52:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615c1a3640 1 -- 172.21.15.151:0/522282728 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f614c0083f0 con 0x564d58b180d0 2024-09-12T16:52:19.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c0fa60 con 0x564d58b180d0 2024-09-12T16:52:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615c1a3640 1 -- 172.21.15.151:0/522282728 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f614c0083f0 con 0x564d58b180d0 2024-09-12T16:52:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615de9c9c0 1 Processor -- start 2024-09-12T16:52:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615de9c9c0 1 -- start start 2024-09-12T16:52:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615de9c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c21890 0x564d58c21cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615de9c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d58a29450 con 0x564d58c21890 2024-09-12T16:52:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615c1a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c21890 0x564d58c21cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615c1a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c21890 0x564d58c21cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34616/0 (socket says 172.21.15.151:34616) 2024-09-12T16:52:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615c1a3640 1 -- 172.21.15.151:0/979532271 learned_addr learned my addr 172.21.15.151:0/979532271 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615c1a3640 1 -- 172.21.15.151:0/979532271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d58c222f0 con 0x564d58c21890 2024-09-12T16:52:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615c1a3640 1 --2- 172.21.15.151:0/979532271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c21890 0x564d58c21cb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x564d58c08190 tx=0x7f614c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f60417fa640 1 -- 172.21.15.151:0/979532271 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c007d70 con 0x564d58c21890 2024-09-12T16:52:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f60417fa640 1 -- 172.21.15.151:0/979532271 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c01e020 con 0x564d58c21890 2024-09-12T16:52:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615de9c9c0 1 -- 172.21.15.151:0/979532271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d58c22b50 con 0x564d58c21890 2024-09-12T16:52:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f60417fa640 1 -- 172.21.15.151:0/979532271 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c019590 con 0x564d58c21890 2024-09-12T16:52:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f615de9c9c0 1 -- 172.21.15.151:0/979532271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d58c230c0 con 0x564d58c21890 2024-09-12T16:52:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.825+0000 7f60417fa640 1 -- 172.21.15.151:0/979532271 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f614c016040 con 0x564d58c21890 2024-09-12T16:52:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f60417fa640 1 --2- 172.21.15.151:0/979532271 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6034039a70 0x7f603403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f60417fa640 1 -- 172.21.15.151:0/979532271 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f614c01f030 con 0x564d58c21890 2024-09-12T16:52:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615b9a2640 1 --2- 172.21.15.151:0/979532271 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6034039a70 0x7f603403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 Processor -- start 2024-09-12T16:52:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- start start 2024-09-12T16:52:19.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615b9a2640 1 --2- 172.21.15.151:0/979532271 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6034039a70 0x7f603403bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564d58c0e8c0 tx=0x7f615404e610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c2f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d58bfff50 con 0x564d58c2f160 2024-09-12T16:52:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c2f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c2f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34618/0 (socket says 172.21.15.151:34618) 2024-09-12T16:52:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 -- 172.21.15.151:0/1542273283 learned_addr learned my addr 172.21.15.151:0/1542273283 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 -- 172.21.15.151:0/1542273283 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d58c2fb50 con 0x564d58c2f160 2024-09-12T16:52:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 --2- 172.21.15.151:0/1542273283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c2f560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f614c00afd0 tx=0x7f614c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e81f0802fa25c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f603affd640 1 -- 172.21.15.151:0/1542273283 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c041e60 con 0x564d58c2f160 2024-09-12T16:52:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f603affd640 1 -- 172.21.15.151:0/1542273283 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c015e10 con 0x564d58c2f160 2024-09-12T16:52:19.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f603affd640 1 -- 172.21.15.151:0/1542273283 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c01d040 con 0x564d58c2f160 2024-09-12T16:52:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1542273283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 msgr2=0x564d58c2f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1542273283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c2f560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f614c00afd0 tx=0x7f614c02bda0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1542273283 shutdown_connections 2024-09-12T16:52:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1542273283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c2f560 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1542273283 >> 172.21.15.151:0/1542273283 conn(0x564d58c2a580 msgr2=0x564d58c287c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1542273283 shutdown_connections 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1542273283 wait complete. 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 Processor -- start 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- start start 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c355f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615de9c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d58c2e0b0 con 0x564d58c2f160 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c355f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34634/0 (socket says 172.21.15.151:34634) 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 learned_addr learned my addr 172.21.15.151:0/1293532743 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.829+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d58c35b50 con 0x564d58c2f160 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615c1a3640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c355f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f614c017570 tx=0x7f614c050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f60397fa640 1 -- 172.21.15.151:0/1293532743 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c01d030 con 0x564d58c2f160 2024-09-12T16:52:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d58c35de0 con 0x564d58c2f160 2024-09-12T16:52:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f60397fa640 1 -- 172.21.15.151:0/1293532743 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c031030 con 0x564d58c2f160 2024-09-12T16:52:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d58c36790 con 0x564d58c2f160 2024-09-12T16:52:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f60397fa640 1 -- 172.21.15.151:0/1293532743 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f614c03b060 con 0x564d58c2f160 2024-09-12T16:52:19.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f60397fa640 1 -- 172.21.15.151:0/1293532743 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f614c0157c0 con 0x564d58c2f160 2024-09-12T16:52:19.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f60397fa640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60240399d0 0x7f602403be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f60397fa640 1 -- 172.21.15.151:0/1293532743 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f614c024030 con 0x564d58c2f160 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615b9a2640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60240399d0 0x7f602403be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58c408c0 0x564d58c42d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c434a0 con 0x564d58c408c0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615b1a1640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58c408c0 0x564d58c42d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615b9a2640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60240399d0 0x7f602403be90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6154012fd0 tx=0x7f6154032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615b1a1640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58c408c0 0x564d58c42d50 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 realm 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c438d0 con 0x564d58c408c0 2024-09-12T16:52:19.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c441a0 con 0x564d58c408c0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c44540 con 0x564d58c408c0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c452a0 0x564d58c47690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.833+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c47bd0 con 0x564d58c452a0 2024-09-12T16:52:19.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615c1a3640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c452a0 0x564d58c47690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615c1a3640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c452a0 0x564d58c47690 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615de9c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615de9c9c0 20 searching for the correct realm 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d58c49b00 0x564d58c4bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c49b00 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b9a2640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d58c49b00 0x564d58c4bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b9a2640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d58c49b00 0x564d58c4bfc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b9a2640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61540275e0 0x7f615403e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x7f61540275e0 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b1a1640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61540275e0 0x7f615403e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b1a1640 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61540275e0 0x7f615403e320 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c452a0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c408c0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c408c0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.837+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c452a0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c452a0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x7f61540275e0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c49b00 2024-09-12T16:52:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c408c0 2024-09-12T16:52:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c452a0 2024-09-12T16:52:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c408c0 2024-09-12T16:52:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x7f61540275e0 2024-09-12T16:52:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4c690 con 0x564d58c49b00 2024-09-12T16:52:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c49b00 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c452a0 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c49b00 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.841+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c49b00 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c408c0 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c408c0 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c452a0 2024-09-12T16:52:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c49b00 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x7f61540275e0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c408c0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c452a0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c49b00 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c452a0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x7f61540275e0 2024-09-12T16:52:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.845+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c49b00 2024-09-12T16:52:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c452a0 2024-09-12T16:52:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x564d58c408c0 2024-09-12T16:52:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f615405e040 con 0x7f61540275e0 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c48520 con 0x564d58c408c0 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c48520 con 0x564d58c408c0 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c48990 con 0x564d58c408c0 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 zone default found 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 4 Realm: () 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 zonegroup default 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c48990 con 0x564d58c452a0 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4e500 con 0x564d58c49b00 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4e8a0 con 0x564d58c49b00 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 started sync module instance, tier type = 2024-09-12T16:52:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:19.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.849+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4d9a0 con 0x7f61540275e0 2024-09-12T16:52:19.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.853+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.853+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94890201767616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4d9a0 con 0x7f61540275e0 2024-09-12T16:52:19.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.853+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4f260 con 0x564d58c408c0 2024-09-12T16:52:19.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.853+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94890201767616] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.853+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.853+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94890201771712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4d9a0 con 0x564d58c408c0 2024-09-12T16:52:19.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.853+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4fc70 con 0x564d58c49b00 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.853+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94890201771712] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94890201765104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c4d910 con 0x564d58c49b00 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c50970 con 0x7f61540275e0 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94890201777616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c51000 con 0x7f61540275e0 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c51b20 con 0x564d58c408c0 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94890201777616] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94890201765104] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94890201776144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c51ae0 con 0x564d58c408c0 2024-09-12T16:52:19.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.857+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c51f10 con 0x564d58c452a0 2024-09-12T16:52:19.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.861+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.861+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94890201776144] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.861+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94890201781744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c52300 con 0x564d58c452a0 2024-09-12T16:52:19.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.861+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c52cc0 con 0x564d58c452a0 2024-09-12T16:52:19.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.861+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94890201781744] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.861+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.861+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94890201778768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c52cc0 con 0x564d58c452a0 2024-09-12T16:52:19.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.861+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c53680 con 0x564d58c452a0 2024-09-12T16:52:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94890201788880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c53aa0 con 0x564d58c452a0 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 20 add_watcher() i=0 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 20 add_watcher() i=1 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 20 add_watcher() i=2 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 20 add_watcher() i=3 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 20 add_watcher() i=4 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 20 add_watcher() i=5 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94890201778768] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 20 add_watcher() i=6 2024-09-12T16:52:19.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94890201788880] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 20 add_watcher() i=7 2024-09-12T16:52:19.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:19.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c52810 con 0x564d58c408c0 2024-09-12T16:52:19.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.865+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94890201789936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c52840 con 0x564d58c408c0 2024-09-12T16:52:19.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94890201789936] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f6011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:19.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:19.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 5 note: GC not initialized 2024-09-12T16:52:19.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f6010fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:19.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 20 Filter name: none 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f5f8a7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c79830 con 0x564d58c408c0 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c7a250 con 0x564d58c408c0 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d58c7b260 con 0x7f61540275e0 2024-09-12T16:52:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f6011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.869+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94890201789936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x564d58c408c0 2024-09-12T16:52:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94890201789936] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94890201767616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x7f61540275e0 2024-09-12T16:52:19.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94890201767616] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615de9c9c0 20 remove_watcher() i=0 2024-09-12T16:52:19.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615de9c9c0 2 removed watcher, disabling cache 2024-09-12T16:52:19.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94890201771712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x564d58c408c0 2024-09-12T16:52:19.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94890201771712] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615de9c9c0 20 remove_watcher() i=1 2024-09-12T16:52:19.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.873+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94890201765104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x564d58c49b00 2024-09-12T16:52:19.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.877+0000 7f615b9a2640 1 -- 172.21.15.151:0/1293532743 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94890201765104] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615400f030 con 0x564d58c49b00 2024-09-12T16:52:19.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.877+0000 7f615de9c9c0 20 remove_watcher() i=2 2024-09-12T16:52:19.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.877+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94890201777616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x7f61540275e0 2024-09-12T16:52:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.877+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94890201777616] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x7f61540275e0 2024-09-12T16:52:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.877+0000 7f615de9c9c0 20 remove_watcher() i=3 2024-09-12T16:52:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.877+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94890201776144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x564d58c408c0 2024-09-12T16:52:19.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.881+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94890201776144] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61440b3040 con 0x564d58c408c0 2024-09-12T16:52:19.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.881+0000 7f615de9c9c0 20 remove_watcher() i=4 2024-09-12T16:52:19.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.881+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94890201781744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x564d58c452a0 2024-09-12T16:52:19.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.881+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94890201781744] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.881+0000 7f615de9c9c0 20 remove_watcher() i=5 2024-09-12T16:52:19.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.881+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94890201778768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x564d58c452a0 2024-09-12T16:52:19.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94890201778768] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 20 remove_watcher() i=6 2024-09-12T16:52:19.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94890201788880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d58c776c0 con 0x564d58c452a0 2024-09-12T16:52:19.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615c1a3640 1 -- 172.21.15.151:0/1293532743 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94890201788880] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614c02a070 con 0x564d58c452a0 2024-09-12T16:52:19.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 20 remove_watcher() i=7 2024-09-12T16:52:19.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c452a0 msgr2=0x564d58c47690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c452a0 0x564d58c47690 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58c408c0 msgr2=0x564d58c42d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58c408c0 0x564d58c42d50 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61540275e0 msgr2=0x7f615403e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61540275e0 0x7f615403e320 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d58c49b00 msgr2=0x564d58c4bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d58c49b00 0x564d58c4bfc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60240399d0 msgr2=0x7f602403be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60240399d0 0x7f602403be90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6154012fd0 tx=0x7f6154032000 comp rx=0 tx=0).stop 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615b1a1640 1 -- 172.21.15.151:0/1293532743 reap_dead start 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 msgr2=0x564d58c355f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c355f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f614c017570 tx=0x7f614c050880 comp rx=0 tx=0).stop 2024-09-12T16:52:19.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 shutdown_connections 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/1293532743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c2f160 0x564d58c355f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 >> 172.21.15.151:0/1293532743 conn(0x564d58c2a580 msgr2=0x564d58c28790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 shutdown_connections 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/1293532743 wait complete. 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/979532271 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6034039a70 msgr2=0x7f603403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/979532271 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6034039a70 0x7f603403bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564d58c0e8c0 tx=0x7f615404e610 comp rx=0 tx=0).stop 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/979532271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c21890 msgr2=0x564d58c21cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/979532271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c21890 0x564d58c21cb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x564d58c08190 tx=0x7f614c00af40 comp rx=0 tx=0).stop 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/979532271 shutdown_connections 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/979532271 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6034039a70 0x7f603403bf30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/979532271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58c21890 0x564d58c21cb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/979532271 >> 172.21.15.151:0/979532271 conn(0x564d58c17240 msgr2=0x564d58c17620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/979532271 shutdown_connections 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/979532271 wait complete. 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c10720 msgr2=0x564d58c12b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c10720 0x564d58c12b10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58b180d0 msgr2=0x564d58c0df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58b180d0 0x564d58c0df70 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6044039a70 msgr2=0x7f604403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6044039a70 0x7f604403bf30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61440ad000 tx=0x7f61440a5070 comp rx=0 tx=0).stop 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 msgr2=0x564d58c06e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58c06e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6154001d50 tx=0x7f6154000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 shutdown_connections 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d58c10720 0x564d58c12b10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d58b180d0 0x564d58c0df70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6044039a70 0x7f604403bf30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 --2- 172.21.15.151:0/522282728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d58b13f80 0x564d58c06e00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.885+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 >> 172.21.15.151:0/522282728 conn(0x564d58b0faa0 msgr2=0x564d58bf9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.889+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 shutdown_connections 2024-09-12T16:52:19.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.889+0000 7f615de9c9c0 1 -- 172.21.15.151:0/522282728 wait complete. 2024-09-12T16:52:19.898 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-12T16:52:19.899 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T16:52:19.923 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:19.923 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-12T16:52:19.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-12T16:52:19.924 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-12T16:52:19.972 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:19.972 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:19.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.969+0000 7fa627ae79c0 1 Processor -- start 2024-09-12T16:52:19.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.969+0000 7fa627ae79c0 1 -- start start 2024-09-12T16:52:19.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.969+0000 7fa627ae79c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5648a6efe040 0x5648a6f00430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.969+0000 7fa627ae79c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5648a6daf9c0 con 0x5648a6ef9e50 2024-09-12T16:52:19.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.969+0000 7fa627ae79c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5648a6dff6d0 con 0x5648a6efe040 2024-09-12T16:52:19.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.969+0000 7fa624dec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5648a6efe040 0x5648a6f00430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.969+0000 7fa6255ed640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5648a6ef9e50 0x5648a6efa230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:38198/0 (socket says 172.21.15.151:38198) 2024-09-12T16:52:19.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.969+0000 7fa6255ed640 1 -- 172.21.15.151:0/3217527045 learned_addr learned my addr 172.21.15.151:0/3217527045 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:19.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa624dec640 1 -- 172.21.15.151:0/3217527045 >> v1:172.21.15.122:6789/0 conn(0x5648a6ef9e50 legacy=0x5648a6efa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa624dec640 1 -- 172.21.15.151:0/3217527045 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a6da3ca0 con 0x5648a6efe040 2024-09-12T16:52:19.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa624dec640 1 --2- 172.21.15.151:0/3217527045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6efe040 0x5648a6f00430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00a420 tx=0x7fa61c01b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c247471b2200b693 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa617fff640 1 -- 172.21.15.151:0/3217527045 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61c0af070 con 0x5648a6efe040 2024-09-12T16:52:19.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa617fff640 1 -- 172.21.15.151:0/3217527045 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c0aa530 con 0x5648a6efe040 2024-09-12T16:52:19.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa617fff640 1 -- 172.21.15.151:0/3217527045 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61c0aa850 con 0x5648a6efe040 2024-09-12T16:52:19.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3217527045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6efe040 msgr2=0x5648a6f00430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3217527045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6efe040 0x5648a6f00430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00a420 tx=0x7fa61c01b060 comp rx=0 tx=0).stop 2024-09-12T16:52:19.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3217527045 shutdown_connections 2024-09-12T16:52:19.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3217527045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6efe040 0x5648a6f00430 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3217527045 >> 172.21.15.151:0/3217527045 conn(0x5648a6ef5970 msgr2=0x5648a6ef7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3217527045 shutdown_connections 2024-09-12T16:52:19.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.973+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3217527045 wait complete. 2024-09-12T16:52:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.985+0000 7fa627ae79c0 1 Processor -- start 2024-09-12T16:52:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.989+0000 7fa627ae79c0 1 -- start start 2024-09-12T16:52:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.989+0000 7fa627ae79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6fe5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.989+0000 7fa627ae79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a6e03680 con 0x5648a6ef9e50 2024-09-12T16:52:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.989+0000 7fa6255ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6fe5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.989+0000 7fa6255ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6fe5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34656/0 (socket says 172.21.15.151:34656) 2024-09-12T16:52:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.989+0000 7fa6255ed640 1 -- 172.21.15.151:0/422623999 learned_addr learned my addr 172.21.15.151:0/422623999 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.989+0000 7fa6255ed640 1 -- 172.21.15.151:0/422623999 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a6d7eda0 con 0x5648a6ef9e50 2024-09-12T16:52:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.989+0000 7fa6255ed640 1 --2- 172.21.15.151:0/422623999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6fe5630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa618001e50 tx=0x7fa618001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ba3fcfa27e486d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:19.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa513606640 1 -- 172.21.15.151:0/422623999 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa618012020 con 0x5648a6ef9e50 2024-09-12T16:52:19.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa513606640 1 -- 172.21.15.151:0/422623999 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61800e7c0 con 0x5648a6ef9e50 2024-09-12T16:52:19.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa513606640 1 -- 172.21.15.151:0/422623999 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61800eaa0 con 0x5648a6ef9e50 2024-09-12T16:52:19.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- 172.21.15.151:0/422623999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 msgr2=0x5648a6fe5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:19.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/422623999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6fe5630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa618001e50 tx=0x7fa618001e80 comp rx=0 tx=0).stop 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- 172.21.15.151:0/422623999 shutdown_connections 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/422623999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6fe5630 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- 172.21.15.151:0/422623999 >> 172.21.15.151:0/422623999 conn(0x5648a6ef5970 msgr2=0x5648a6fe12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- 172.21.15.151:0/422623999 shutdown_connections 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- 172.21.15.151:0/422623999 wait complete. 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 Processor -- start 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- start start 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6feccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a6da5a50 con 0x5648a6ef9e50 2024-09-12T16:52:19.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa6255ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6feccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:19.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa6255ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6feccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34662/0 (socket says 172.21.15.151:34662) 2024-09-12T16:52:19.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa6255ed640 1 -- 172.21.15.151:0/2906133558 learned_addr learned my addr 172.21.15.151:0/2906133558 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa6255ed640 1 -- 172.21.15.151:0/2906133558 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a6fed220 con 0x5648a6ef9e50 2024-09-12T16:52:20.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa6255ed640 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6feccc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5648a6fe6620 tx=0x7fa618000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa511e03640 1 -- 172.21.15.151:0/2906133558 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa618012030 con 0x5648a6ef9e50 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa511e03640 1 -- 172.21.15.151:0/2906133558 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61801c410 con 0x5648a6ef9e50 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5648a6fed4b0 con 0x5648a6ef9e50 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa511e03640 1 -- 172.21.15.151:0/2906133558 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61801ca00 con 0x5648a6ef9e50 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.993+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a6fede60 con 0x5648a6ef9e50 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa511e03640 1 -- 172.21.15.151:0/2906133558 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa618015020 con 0x5648a6ef9e50 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa511e03640 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa50c039a70 0x7fa50c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa511e03640 1 -- 172.21.15.151:0/2906133558 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa618022070 con 0x5648a6ef9e50 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa624dec640 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa50c039a70 0x7fa50c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a6efe040 0x5648a6ff2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a6ff3430 con 0x5648a6efe040 2024-09-12T16:52:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa625dee640 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a6efe040 0x5648a6ff2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa624dec640 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa50c039a70 0x7fa50c03bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0ac000 tx=0x7fa61c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa625dee640 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a6efe040 0x5648a6ff2ef0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa625dee640 1 -- 172.21.15.151:0/2906133558 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6200083f0 con 0x5648a6efe040 2024-09-12T16:52:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a6ff37d0 con 0x5648a6efe040 2024-09-12T16:52:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa625dee640 1 -- 172.21.15.151:0/2906133558 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6200083f0 con 0x5648a6efe040 2024-09-12T16:52:20.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a6ff5310 0x5648a6ff7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a6ff7f10 con 0x5648a6ff5310 2024-09-12T16:52:20.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa6255ed640 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a6ff5310 0x5648a6ff7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa6255ed640 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a6ff5310 0x5648a6ff7780 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa6255ed640 1 -- 172.21.15.151:0/2906133558 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa618008030 con 0x5648a6ff5310 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a6ff4020 con 0x5648a6efe040 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa625dee640 1 -- 172.21.15.151:0/2906133558 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6200083f0 con 0x5648a6efe040 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:19.997+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a6ff4480 con 0x5648a6efe040 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa625dee640 1 -- 172.21.15.151:0/2906133558 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa6200083f0 con 0x5648a6efe040 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa627ae79c0 1 Processor -- start 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa627ae79c0 1 -- start start 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa627ae79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a700aa10 0x5648a700ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa627ae79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a6e10450 con 0x5648a700aa10 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa625dee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a700aa10 0x5648a700ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa625dee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a700aa10 0x5648a700ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34676/0 (socket says 172.21.15.151:34676) 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa625dee640 1 -- 172.21.15.151:0/4120560863 learned_addr learned my addr 172.21.15.151:0/4120560863 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa625dee640 1 -- 172.21.15.151:0/4120560863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a700b470 con 0x5648a700aa10 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa625dee640 1 --2- 172.21.15.151:0/4120560863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a700aa10 0x5648a700ae30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5648a6feda40 tx=0x7fa62000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa50affd640 1 -- 172.21.15.151:0/4120560863 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa620007dd0 con 0x5648a700aa10 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa627ae79c0 1 -- 172.21.15.151:0/4120560863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5648a700bcd0 con 0x5648a700aa10 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa50affd640 1 -- 172.21.15.151:0/4120560863 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa62001e020 con 0x5648a700aa10 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa50affd640 1 -- 172.21.15.151:0/4120560863 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa620019590 con 0x5648a700aa10 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa627ae79c0 1 -- 172.21.15.151:0/4120560863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a700c240 con 0x5648a700aa10 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa50affd640 1 -- 172.21.15.151:0/4120560863 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa620016040 con 0x5648a700aa10 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa50affd640 1 --2- 172.21.15.151:0/4120560863 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4fc039a70 0x7fa4fc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa50affd640 1 -- 172.21.15.151:0/4120560863 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa62001f030 con 0x5648a700aa10 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa6255ed640 1 --2- 172.21.15.151:0/4120560863 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4fc039a70 0x7fa4fc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa627ae79c0 1 Processor -- start 2024-09-12T16:52:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa627ae79c0 1 -- start start 2024-09-12T16:52:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.001+0000 7fa6255ed640 1 --2- 172.21.15.151:0/4120560863 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4fc039a70 0x7fa4fc03bf30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5648a6feee10 tx=0x7fa61801af70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a7018780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a6fe5e60 con 0x5648a7018380 2024-09-12T16:52:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a7018780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a7018780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34678/0 (socket says 172.21.15.151:34678) 2024-09-12T16:52:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 -- 172.21.15.151:0/2672636181 learned_addr learned my addr 172.21.15.151:0/2672636181 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 -- 172.21.15.151:0/2672636181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a7018d70 con 0x5648a7018380 2024-09-12T16:52:20.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 --2- 172.21.15.151:0/2672636181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a7018780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa62003fb20 tx=0x7fa62003fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb42b8da65e49fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa508ff9640 1 -- 172.21.15.151:0/2672636181 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa62001d040 con 0x5648a7018380 2024-09-12T16:52:20.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa508ff9640 1 -- 172.21.15.151:0/2672636181 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa620052200 con 0x5648a7018380 2024-09-12T16:52:20.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa508ff9640 1 -- 172.21.15.151:0/2672636181 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa620017bf0 con 0x5648a7018380 2024-09-12T16:52:20.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2672636181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 msgr2=0x5648a7018780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2672636181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a7018780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa62003fb20 tx=0x7fa62003fc10 comp rx=0 tx=0).stop 2024-09-12T16:52:20.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2672636181 shutdown_connections 2024-09-12T16:52:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2672636181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a7018780 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2672636181 >> 172.21.15.151:0/2672636181 conn(0x5648a70137a0 msgr2=0x5648a70119e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2672636181 shutdown_connections 2024-09-12T16:52:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2672636181 wait complete. 2024-09-12T16:52:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 Processor -- start 2024-09-12T16:52:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- start start 2024-09-12T16:52:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a701e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a70172d0 con 0x5648a7018380 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a701e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a701e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34684/0 (socket says 172.21.15.151:34684) 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 learned_addr learned my addr 172.21.15.151:0/3355608235 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a701edf0 con 0x5648a7018380 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa625dee640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a701e890 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa62004b010 tx=0x7fa620050840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa4faffd640 1 -- 172.21.15.151:0/3355608235 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa620048040 con 0x5648a7018380 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa4faffd640 1 -- 172.21.15.151:0/3355608235 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa620031070 con 0x5648a7018380 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5648a701f080 con 0x5648a7018380 2024-09-12T16:52:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa4faffd640 1 -- 172.21.15.151:0/3355608235 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa62001d040 con 0x5648a7018380 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.005+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a701fa30 con 0x5648a7018380 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa4faffd640 1 -- 172.21.15.151:0/3355608235 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa620018cc0 con 0x5648a7018380 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa4faffd640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4f0039a70 0x7fa4f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa4faffd640 1 -- 172.21.15.151:0/3355608235 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa62003fe00 con 0x5648a7018380 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa6255ed640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4f0039a70 0x7fa4f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a7029a90 0x5648a702bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a702c670 con 0x5648a7029a90 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa624dec640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a7029a90 0x5648a702bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa624dec640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a7029a90 0x5648a702bf20 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa6255ed640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4f0039a70 0x7fa4f003bf30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5648a6ff8310 tx=0x7fa618046000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 realm 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a702caf0 con 0x5648a7029a90 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a702d3c0 con 0x5648a7029a90 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a702d760 con 0x5648a7029a90 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a702e4c0 0x5648a70308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7030df0 con 0x5648a702e4c0 2024-09-12T16:52:20.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa625dee640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a702e4c0 0x5648a70308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.009+0000 7fa625dee640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a702e4c0 0x5648a70308b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa627ae79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa627ae79c0 20 searching for the correct realm 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5648a7032d60 0x5648a7035220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa6255ed640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5648a7032d60 0x5648a7035220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa6255ed640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5648a7032d60 0x5648a7035220 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa6255ed640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa618017050 0x7fa618025810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x7fa618017050 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa624dec640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa618017050 0x7fa618025810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa624dec640 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa618017050 0x7fa618025810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7029a90 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7029a90 2024-09-12T16:52:20.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.013+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x7fa618017050 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7029a90 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7029a90 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x7fa618017050 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.017+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7029a90 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7029a90 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x7fa618017050 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7029a90 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x7fa618017050 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7032d60 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.021+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a702e4c0 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x5648a7029a90 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5648a70358f0 con 0x7fa618017050 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7031740 con 0x5648a7029a90 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7031bc0 con 0x5648a7029a90 2024-09-12T16:52:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7032060 con 0x5648a7029a90 2024-09-12T16:52:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 zone default found 2024-09-12T16:52:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 4 Realm: () 2024-09-12T16:52:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 zonegroup default 2024-09-12T16:52:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7035d70 con 0x5648a702e4c0 2024-09-12T16:52:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7037c90 con 0x5648a7032d60 2024-09-12T16:52:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7038180 con 0x5648a7032d60 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 started sync module instance, tier type = 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7036fa0 con 0x7fa618017050 2024-09-12T16:52:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94870039655616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7036fa0 con 0x7fa618017050 2024-09-12T16:52:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.025+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7038ca0 con 0x5648a7029a90 2024-09-12T16:52:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.029+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94870039655616] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.029+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.029+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94870039660416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7036fa0 con 0x5648a7029a90 2024-09-12T16:52:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.029+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a70396b0 con 0x5648a7032d60 2024-09-12T16:52:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.029+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94870039660416] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94870039653104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7036f10 con 0x5648a7032d60 2024-09-12T16:52:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703a3b0 con 0x7fa618017050 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94870039666704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703aa20 con 0x7fa618017050 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703b520 con 0x5648a7029a90 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94870039653104] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94870039666704] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94870039670800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703b4e0 con 0x5648a7029a90 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.033+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703bdf0 con 0x5648a702e4c0 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.037+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94870039670800] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.037+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.037+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94870039665232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703b4e0 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.037+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703c2e0 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.037+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94870039665232] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.037+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.037+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94870039673152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703c210 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.037+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703cd00 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94870039673152] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94870039676880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703cee0 con 0x5648a702e4c0 2024-09-12T16:52:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 20 add_watcher() i=0 2024-09-12T16:52:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 20 add_watcher() i=1 2024-09-12T16:52:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 20 add_watcher() i=2 2024-09-12T16:52:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 20 add_watcher() i=3 2024-09-12T16:52:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 20 add_watcher() i=4 2024-09-12T16:52:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 20 add_watcher() i=5 2024-09-12T16:52:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 20 add_watcher() i=6 2024-09-12T16:52:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94870039676880] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 20 add_watcher() i=7 2024-09-12T16:52:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a70402b0 con 0x5648a7029a90 2024-09-12T16:52:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.041+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94870039678416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a703d6a0 con 0x5648a7029a90 2024-09-12T16:52:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94870039678416] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa4db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 5 note: GC not initialized 2024-09-12T16:52:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa4da7e4640 20 reqs_thread_entry: start 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 20 Filter name: none 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa44bfff640 20 reqs_thread_entry: start 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7062f00 con 0x5648a7029a90 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7063920 con 0x5648a7029a90 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5648a7064930 con 0x7fa618017050 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa4db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.045+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94870039678416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7060d40 con 0x5648a7029a90 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94870039678416] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94870039655616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7060d40 con 0x7fa618017050 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94870039655616] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa627ae79c0 20 remove_watcher() i=0 2024-09-12T16:52:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa627ae79c0 2 removed watcher, disabling cache 2024-09-12T16:52:20.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94870039660416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7060d40 con 0x5648a7029a90 2024-09-12T16:52:20.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94870039660416] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa627ae79c0 20 remove_watcher() i=1 2024-09-12T16:52:20.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.049+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94870039653104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7038780 con 0x5648a7032d60 2024-09-12T16:52:20.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.053+0000 7fa6255ed640 1 -- 172.21.15.151:0/3355608235 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94870039653104] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa618008030 con 0x5648a7032d60 2024-09-12T16:52:20.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.053+0000 7fa627ae79c0 20 remove_watcher() i=2 2024-09-12T16:52:20.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.053+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94870039666704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7060d40 con 0x7fa618017050 2024-09-12T16:52:20.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.053+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94870039666704] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x7fa618017050 2024-09-12T16:52:20.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.053+0000 7fa627ae79c0 20 remove_watcher() i=3 2024-09-12T16:52:20.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.053+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94870039670800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7036af0 con 0x5648a7029a90 2024-09-12T16:52:20.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94870039670800] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c0b2070 con 0x5648a7029a90 2024-09-12T16:52:20.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa627ae79c0 20 remove_watcher() i=4 2024-09-12T16:52:20.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94870039665232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7060d40 con 0x5648a702e4c0 2024-09-12T16:52:20.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94870039665232] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa627ae79c0 20 remove_watcher() i=5 2024-09-12T16:52:20.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94870039673152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7036af0 con 0x5648a702e4c0 2024-09-12T16:52:20.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94870039673152] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa627ae79c0 20 remove_watcher() i=6 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.057+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94870039676880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5648a7060d40 con 0x5648a702e4c0 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa625dee640 1 -- 172.21.15.151:0/3355608235 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94870039676880] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62005b040 con 0x5648a702e4c0 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 20 remove_watcher() i=7 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a702e4c0 msgr2=0x5648a70308b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a702e4c0 0x5648a70308b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a7029a90 msgr2=0x5648a702bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a7029a90 0x5648a702bf20 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa618017050 msgr2=0x7fa618025810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa618017050 0x7fa618025810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5648a7032d60 msgr2=0x5648a7035220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5648a7032d60 0x5648a7035220 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4f0039a70 msgr2=0x7fa4f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4f0039a70 0x7fa4f003bf30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5648a6ff8310 tx=0x7fa618046000 comp rx=0 tx=0).stop 2024-09-12T16:52:20.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 msgr2=0x5648a701e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa624dec640 1 -- 172.21.15.151:0/3355608235 reap_dead start 2024-09-12T16:52:20.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a701e890 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa62004b010 tx=0x7fa620050840 comp rx=0 tx=0).stop 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 shutdown_connections 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/3355608235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a7018380 0x5648a701e890 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 >> 172.21.15.151:0/3355608235 conn(0x5648a70137a0 msgr2=0x5648a70119b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 shutdown_connections 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/3355608235 wait complete. 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/4120560863 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4fc039a70 msgr2=0x7fa4fc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/4120560863 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4fc039a70 0x7fa4fc03bf30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5648a6feee10 tx=0x7fa61801af70 comp rx=0 tx=0).stop 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/4120560863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a700aa10 msgr2=0x5648a700ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/4120560863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a700aa10 0x5648a700ae30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5648a6feda40 tx=0x7fa62000af40 comp rx=0 tx=0).stop 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/4120560863 shutdown_connections 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/4120560863 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa4fc039a70 0x7fa4fc03bf30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/4120560863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a700aa10 0x5648a700ae30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/4120560863 >> 172.21.15.151:0/4120560863 conn(0x5648a6ffbfb0 msgr2=0x5648a6ffc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/4120560863 shutdown_connections 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/4120560863 wait complete. 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a6ff5310 msgr2=0x5648a6ff7780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a6ff5310 0x5648a6ff7780 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a6efe040 msgr2=0x5648a6ff2ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a6efe040 0x5648a6ff2ef0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa50c039a70 msgr2=0x7fa50c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa50c039a70 0x7fa50c03bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0ac000 tx=0x7fa61c0a5000 comp rx=0 tx=0).stop 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 msgr2=0x5648a6feccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6feccc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5648a6fe6620 tx=0x7fa618000ee0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 shutdown_connections 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5648a6ff5310 0x5648a6ff7780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5648a6efe040 0x5648a6ff2ef0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa50c039a70 0x7fa50c03bf30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 --2- 172.21.15.151:0/2906133558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a6ef9e50 0x5648a6feccc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 >> 172.21.15.151:0/2906133558 conn(0x5648a6ef5970 msgr2=0x5648a6fdfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 shutdown_connections 2024-09-12T16:52:20.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.061+0000 7fa627ae79c0 1 -- 172.21.15.151:0/2906133558 wait complete. 2024-09-12T16:52:20.075 INFO:teuthology.orchestra.run.smithi151.stdout:["myfoo"] 2024-09-12T16:52:20.075 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-12T16:52:20.079 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:20.079 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-12T16:52:20.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-12T16:52:20.080 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-12T16:52:20.147 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:20.147 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a9a8c9c0 1 Processor -- start 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a9a8c9c0 1 -- start start 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a9a8c9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e657046190 0x55e657046570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a9a8c9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e656efc9c0 con 0x55e657046ab0 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a9a8c9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55e656f4c6d0 con 0x55e657046190 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a7592640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e657046190 0x55e657046570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a7592640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e657046190 0x55e657046570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33206/0 (socket says 172.21.15.151:33206) 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a7592640 1 -- 172.21.15.151:0/4202587454 learned_addr learned my addr 172.21.15.151:0/4202587454 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a7592640 1 -- 172.21.15.151:0/4202587454 >> v1:172.21.15.122:6789/0 conn(0x55e657046ab0 legacy=0x55e65704d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.145+0000 7f85a7592640 1 -- 172.21.15.151:0/4202587454 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e656ef0ca0 con 0x55e657046190 2024-09-12T16:52:20.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a7592640 1 --2- 172.21.15.151:0/4202587454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657046570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f859800a5c0 tx=0x7f859801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d719c26e5bf42c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a6590640 1 -- 172.21.15.151:0/4202587454 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85980a6070 con 0x55e657046190 2024-09-12T16:52:20.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a6590640 1 -- 172.21.15.151:0/4202587454 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85980af070 con 0x55e657046190 2024-09-12T16:52:20.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a6590640 1 -- 172.21.15.151:0/4202587454 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85980aa5c0 con 0x55e657046190 2024-09-12T16:52:20.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/4202587454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 msgr2=0x55e657046570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/4202587454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657046570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f859800a5c0 tx=0x7f859801b340 comp rx=0 tx=0).stop 2024-09-12T16:52:20.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/4202587454 shutdown_connections 2024-09-12T16:52:20.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/4202587454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657046570 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/4202587454 >> 172.21.15.151:0/4202587454 conn(0x55e6570420a0 msgr2=0x55e6570444c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/4202587454 shutdown_connections 2024-09-12T16:52:20.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.149+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/4202587454 wait complete. 2024-09-12T16:52:20.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 Processor -- start 2024-09-12T16:52:20.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- start start 2024-09-12T16:52:20.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657048a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e656f50680 con 0x55e657046190 2024-09-12T16:52:20.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a7592640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657048a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a7592640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657048a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33216/0 (socket says 172.21.15.151:33216) 2024-09-12T16:52:20.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a7592640 1 -- 172.21.15.151:0/2502270531 learned_addr learned my addr 172.21.15.151:0/2502270531 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a7592640 1 -- 172.21.15.151:0/2502270531 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e656ecbda0 con 0x55e657046190 2024-09-12T16:52:20.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a7592640 1 --2- 172.21.15.151:0/2502270531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657048a40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8598018f70 tx=0x7f8598003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bcb19d63705cee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f849560a640 1 -- 172.21.15.151:0/2502270531 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85980aa8b0 con 0x55e657046190 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f849560a640 1 -- 172.21.15.151:0/2502270531 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85980aaa50 con 0x55e657046190 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f849560a640 1 -- 172.21.15.151:0/2502270531 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85980aad30 con 0x55e657046190 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2502270531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 msgr2=0x55e657048a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2502270531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657048a40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8598018f70 tx=0x7f8598003030 comp rx=0 tx=0).stop 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2502270531 shutdown_connections 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2502270531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e657048a40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2502270531 >> 172.21.15.151:0/2502270531 conn(0x55e6570420a0 msgr2=0x55e65712f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2502270531 shutdown_connections 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2502270531 wait complete. 2024-09-12T16:52:20.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 Processor -- start 2024-09-12T16:52:20.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- start start 2024-09-12T16:52:20.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e65713cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a9a8c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e656ef2a50 con 0x55e657046190 2024-09-12T16:52:20.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a7592640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e65713cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a7592640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e65713cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33228/0 (socket says 172.21.15.151:33228) 2024-09-12T16:52:20.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.169+0000 7f85a7592640 1 -- 172.21.15.151:0/3807425365 learned_addr learned my addr 172.21.15.151:0/3807425365 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a7592640 1 -- 172.21.15.151:0/3807425365 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e65713d350 con 0x55e657046190 2024-09-12T16:52:20.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a7592640 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e65713cdf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8598018f70 tx=0x7f85980180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f8493e07640 1 -- 172.21.15.151:0/3807425365 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85980c6690 con 0x55e657046190 2024-09-12T16:52:20.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f8493e07640 1 -- 172.21.15.151:0/3807425365 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85980c6830 con 0x55e657046190 2024-09-12T16:52:20.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e65713d5e0 con 0x55e657046190 2024-09-12T16:52:20.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f8493e07640 1 -- 172.21.15.151:0/3807425365 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85980c6b30 con 0x55e657046190 2024-09-12T16:52:20.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65713df90 con 0x55e657046190 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f8493e07640 1 -- 172.21.15.151:0/3807425365 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85980ce030 con 0x55e657046190 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f8493e07640 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f848c039a70 0x7f848c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f8493e07640 1 -- 172.21.15.151:0/3807425365 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85980cc020 con 0x55e657046190 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a6d91640 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f848c039a70 0x7f848c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e657046ab0 0x55e657143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6571444a0 con 0x55e657046ab0 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a7d93640 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e657046ab0 0x55e657143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a6d91640 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f848c039a70 0x7f848c03bf30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f859c001ec0 tx=0x7f859c001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a7d93640 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e657046ab0 0x55e657143f60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a7d93640 1 -- 172.21.15.151:0/3807425365 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85a000a4d0 con 0x55e657046ab0 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e657144910 con 0x55e657046ab0 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a7d93640 1 -- 172.21.15.151:0/3807425365 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85a000a4d0 con 0x55e657046ab0 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e657146720 0x55e657148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.173+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e657149200 con 0x55e657146720 2024-09-12T16:52:20.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7592640 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e657146720 0x55e657148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7592640 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e657146720 0x55e657148b10 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7592640 1 -- 172.21.15.151:0/3807425365 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85980bc600 con 0x55e657146720 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6571455c0 con 0x55e657046ab0 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7d93640 1 -- 172.21.15.151:0/3807425365 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85a000a4d0 con 0x55e657046ab0 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e657145a60 con 0x55e657046ab0 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7d93640 1 -- 172.21.15.151:0/3807425365 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85a000a4d0 con 0x55e657046ab0 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a9a8c9c0 1 Processor -- start 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a9a8c9c0 1 -- start start 2024-09-12T16:52:20.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a9a8c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657157890 0x55e657157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a9a8c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e656f5d450 con 0x55e657157890 2024-09-12T16:52:20.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7d93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657157890 0x55e657157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7d93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657157890 0x55e657157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33230/0 (socket says 172.21.15.151:33230) 2024-09-12T16:52:20.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7d93640 1 -- 172.21.15.151:0/1212645011 learned_addr learned my addr 172.21.15.151:0/1212645011 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7d93640 1 -- 172.21.15.151:0/1212645011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6571582f0 con 0x55e657157890 2024-09-12T16:52:20.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.177+0000 7f85a7d93640 1 --2- 172.21.15.151:0/1212645011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657157890 0x55e657157cb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55e65713db70 tx=0x7f85a0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f8491602640 1 -- 172.21.15.151:0/1212645011 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a0014450 con 0x55e657157890 2024-09-12T16:52:20.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/1212645011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e657158b50 con 0x55e657157890 2024-09-12T16:52:20.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f8491602640 1 -- 172.21.15.151:0/1212645011 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a0014610 con 0x55e657157890 2024-09-12T16:52:20.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f8491602640 1 -- 172.21.15.151:0/1212645011 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a0028060 con 0x55e657157890 2024-09-12T16:52:20.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/1212645011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6571590c0 con 0x55e657157890 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f8491602640 1 -- 172.21.15.151:0/1212645011 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85a0011040 con 0x55e657157890 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f8491602640 1 --2- 172.21.15.151:0/1212645011 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8480039ac0 0x7f848003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f8491602640 1 -- 172.21.15.151:0/1212645011 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85a001e070 con 0x55e657157890 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a7592640 1 --2- 172.21.15.151:0/1212645011 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8480039ac0 0x7f848003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a9a8c9c0 1 Processor -- start 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a9a8c9c0 1 -- start start 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a7592640 1 --2- 172.21.15.151:0/1212645011 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8480039ac0 0x7f848003bf80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55e65713e1d0 tx=0x7f85980e9db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a9a8c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e657165580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a9a8c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e6570491d0 con 0x55e657165180 2024-09-12T16:52:20.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a7d93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e657165580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a7d93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e657165580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33236/0 (socket says 172.21.15.151:33236) 2024-09-12T16:52:20.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a7d93640 1 -- 172.21.15.151:0/3053690453 learned_addr learned my addr 172.21.15.151:0/3053690453 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a7d93640 1 -- 172.21.15.151:0/3053690453 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e657165b70 con 0x55e657165180 2024-09-12T16:52:20.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f85a7d93640 1 --2- 172.21.15.151:0/3053690453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e657165580 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85a0050610 tx=0x7f85a0041f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f82a7bab7cc77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f848affd640 1 -- 172.21.15.151:0/3053690453 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a0016440 con 0x55e657165180 2024-09-12T16:52:20.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f848affd640 1 -- 172.21.15.151:0/3053690453 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a002b350 con 0x55e657165180 2024-09-12T16:52:20.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.181+0000 7f848affd640 1 -- 172.21.15.151:0/3053690453 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a00430d0 con 0x55e657165180 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3053690453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 msgr2=0x55e657165580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3053690453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e657165580 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85a0050610 tx=0x7f85a0041f50 comp rx=0 tx=0).stop 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3053690453 shutdown_connections 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3053690453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e657165580 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3053690453 >> 172.21.15.151:0/3053690453 conn(0x55e6571605a0 msgr2=0x55e65715e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3053690453 shutdown_connections 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3053690453 wait complete. 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 Processor -- start 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- start start 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e65716b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e6571640d0 con 0x55e657165180 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a7d93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e65716b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a7d93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e65716b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33248/0 (socket says 172.21.15.151:33248) 2024-09-12T16:52:20.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 learned_addr learned my addr 172.21.15.151:0/2291169095 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e65716bc40 con 0x55e657165180 2024-09-12T16:52:20.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a7d93640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e65716b6e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f85a004f530 tx=0x7f85a00505a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f84897fa640 1 -- 172.21.15.151:0/2291169095 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a0016440 con 0x55e657165180 2024-09-12T16:52:20.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e65716bed0 con 0x55e657165180 2024-09-12T16:52:20.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f84897fa640 1 -- 172.21.15.151:0/2291169095 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a0031070 con 0x55e657165180 2024-09-12T16:52:20.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f84897fa640 1 -- 172.21.15.151:0/2291169095 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85a00149d0 con 0x55e657165180 2024-09-12T16:52:20.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65716c880 con 0x55e657165180 2024-09-12T16:52:20.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f84897fa640 1 -- 172.21.15.151:0/2291169095 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85a003e350 con 0x55e657165180 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f84897fa640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8470039a70 0x7f847003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f84897fa640 1 -- 172.21.15.151:0/2291169095 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85a000e040 con 0x55e657165180 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a7592640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8470039a70 0x7f847003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e6571768e0 0x55e657178d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6571794c0 con 0x55e6571768e0 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.185+0000 7f85a6d91640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e6571768e0 0x55e657178d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a6d91640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e6571768e0 0x55e657178d70 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7592640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8470039a70 0x7f847003bf30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85980c57b0 tx=0x7f85980e2000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c00d040 con 0x55e6571768e0 2024-09-12T16:52:20.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 realm 2024-09-12T16:52:20.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e657175cf0 con 0x55e6571768e0 2024-09-12T16:52:20.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c00d040 con 0x55e6571768e0 2024-09-12T16:52:20.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e657179fc0 con 0x55e6571768e0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c00d040 con 0x55e6571768e0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e65717a890 con 0x55e6571768e0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f859c00d040 con 0x55e6571768e0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e65717b190 0x55e65717d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7d93640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e65717b190 0x55e65717d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7d93640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e65717b190 0x55e65717d580 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 20 searching for the correct realm 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e65717fc80 0x55e657182140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e657182810 con 0x55e65717fc80 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7592640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e65717fc80 0x55e657182140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7592640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e65717fc80 0x55e657182140 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7592640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8598009040 0x7f85980e8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e657182810 con 0x7f8598009040 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.189+0000 7f85a6d91640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8598009040 0x7f85980e8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8598009040 0x7f85980e8430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00d040 con 0x7f8598009040 2024-09-12T16:52:20.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e657182810 con 0x55e65717b190 2024-09-12T16:52:20.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e6571768e0 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c00d040 con 0x55e6571768e0 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e6571768e0 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x7f8598009040 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717fc80 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e6571768e0 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.193+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e6571768e0 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x7f8598009040 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717fc80 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717fc80 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717fc80 2024-09-12T16:52:20.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717fc80 2024-09-12T16:52:20.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e6571768e0 2024-09-12T16:52:20.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e6571768e0 2024-09-12T16:52:20.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717fc80 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x7f8598009040 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.197+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e6571768e0 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717fc80 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x7f8598009040 2024-09-12T16:52:20.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717fc80 2024-09-12T16:52:20.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e65717b190 2024-09-12T16:52:20.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x55e6571768e0 2024-09-12T16:52:20.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717dce0 con 0x7f8598009040 2024-09-12T16:52:20.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e6571768e0 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e990 con 0x55e6571768e0 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e990 con 0x55e6571768e0 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 zone default found 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 4 Realm: () 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:20.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 zonegroup default 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.201+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717b190 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e657184680 con 0x55e65717fc80 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e657184a20 con 0x55e65717fc80 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 20 started sync module instance, tier type = 2024-09-12T16:52:20.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:20.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657183b20 con 0x7f8598009040 2024-09-12T16:52:20.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94447792046112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657183b20 con 0x7f8598009040 2024-09-12T16:52:20.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657185440 con 0x55e6571768e0 2024-09-12T16:52:20.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94447792046112] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94447792049968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657183b20 con 0x55e6571768e0 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.205+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657185e50 con 0x55e65717fc80 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.209+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94447792049968] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.209+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.209+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94447792043632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657183a90 con 0x55e65717fc80 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.209+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657186b50 con 0x7f8598009040 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.209+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.209+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94447792056240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6571873f0 con 0x7f8598009040 2024-09-12T16:52:20.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.209+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657187db0 con 0x55e6571768e0 2024-09-12T16:52:20.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.209+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94447792043632] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.213+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94447792056240] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.213+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.213+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94447792060672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657187d20 con 0x55e6571768e0 2024-09-12T16:52:20.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.213+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657187320 con 0x55e65717b190 2024-09-12T16:52:20.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.213+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94447792060672] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.213+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.213+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94447792057968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657187290 con 0x55e65717b190 2024-09-12T16:52:20.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.213+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657188b00 con 0x55e65717b190 2024-09-12T16:52:20.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94447792057968] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94447792062880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657188a70 con 0x55e65717b190 2024-09-12T16:52:20.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657189540 con 0x55e65717b190 2024-09-12T16:52:20.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94447792062880] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94447792066608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657189720 con 0x55e65717b190 2024-09-12T16:52:20.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 20 add_watcher() i=0 2024-09-12T16:52:20.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 20 add_watcher() i=1 2024-09-12T16:52:20.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 20 add_watcher() i=2 2024-09-12T16:52:20.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 20 add_watcher() i=3 2024-09-12T16:52:20.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 20 add_watcher() i=4 2024-09-12T16:52:20.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 20 add_watcher() i=5 2024-09-12T16:52:20.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.217+0000 7f85a9a8c9c0 20 add_watcher() i=6 2024-09-12T16:52:20.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94447792066608] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 20 add_watcher() i=7 2024-09-12T16:52:20.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:20.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e65718caf0 con 0x55e6571768e0 2024-09-12T16:52:20.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94447792068112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657189ee0 con 0x55e6571768e0 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94447792068112] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f845dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 5 note: GC not initialized 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f845cfe1640 20 reqs_thread_entry: start 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 20 Filter name: none 2024-09-12T16:52:20.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f83d67fc640 20 reqs_thread_entry: start 2024-09-12T16:52:20.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6571af4d0 con 0x55e65717fc80 2024-09-12T16:52:20.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6571af4d0 con 0x55e65717fc80 2024-09-12T16:52:20.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e6571af4d0 con 0x55e6571768e0 2024-09-12T16:52:20.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.221+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e6571768e0 2024-09-12T16:52:20.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x7f8598009040 2024-09-12T16:52:20.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e65717fc80 2024-09-12T16:52:20.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e6571768e0 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e65717fc80 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x7f8598009040 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e65717fc80 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e6571768e0 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e65717b190 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717b190 2024-09-12T16:52:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717fc80 2024-09-12T16:52:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717b190 2024-09-12T16:52:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.225+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717b190 2024-09-12T16:52:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717b190 2024-09-12T16:52:20.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717fc80 2024-09-12T16:52:20.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x7f8598009040 2024-09-12T16:52:20.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e6571768e0 2024-09-12T16:52:20.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e6571768e0 2024-09-12T16:52:20.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717fc80 2024-09-12T16:52:20.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x7f8598009040 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717b190 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e6571768e0 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.229+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717b190 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717fc80 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x7f8598009040 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717b190 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e6571768e0 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x55e65717fc80 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e65717edb0 con 0x7f8598009040 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a9a8c9c0 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a9a8c9c0 20 RGWRados::pool_iterate: got myfoo 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f845dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:20.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94447792068112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e6571768e0 2024-09-12T16:52:20.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94447792068112] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.233+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94447792046112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x7f8598009040 2024-09-12T16:52:20.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.237+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94447792046112] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.237+0000 7f85a9a8c9c0 20 remove_watcher() i=0 2024-09-12T16:52:20.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.237+0000 7f85a9a8c9c0 2 removed watcher, disabling cache 2024-09-12T16:52:20.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.237+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94447792049968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e6571768e0 2024-09-12T16:52:20.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.237+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94447792049968] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.237+0000 7f85a9a8c9c0 20 remove_watcher() i=1 2024-09-12T16:52:20.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.237+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94447792043632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e65717e5a0 con 0x55e65717fc80 2024-09-12T16:52:20.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a7592640 1 -- 172.21.15.151:0/2291169095 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94447792043632] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85980bc600 con 0x55e65717fc80 2024-09-12T16:52:20.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a9a8c9c0 20 remove_watcher() i=2 2024-09-12T16:52:20.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94447792056240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657189610 con 0x7f8598009040 2024-09-12T16:52:20.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94447792056240] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x7f8598009040 2024-09-12T16:52:20.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a9a8c9c0 20 remove_watcher() i=3 2024-09-12T16:52:20.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94447792060672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657183670 con 0x55e6571768e0 2024-09-12T16:52:20.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94447792060672] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f859c02a040 con 0x55e6571768e0 2024-09-12T16:52:20.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a9a8c9c0 20 remove_watcher() i=4 2024-09-12T16:52:20.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.241+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94447792057968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6571867b0 con 0x55e65717b190 2024-09-12T16:52:20.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.245+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94447792057968] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.245+0000 7f85a9a8c9c0 20 remove_watcher() i=5 2024-09-12T16:52:20.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.245+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94447792062880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657189610 con 0x55e65717b190 2024-09-12T16:52:20.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.245+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94447792062880] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.245+0000 7f85a9a8c9c0 20 remove_watcher() i=6 2024-09-12T16:52:20.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.245+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94447792066608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e657187900 con 0x55e65717b190 2024-09-12T16:52:20.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a7d93640 1 -- 172.21.15.151:0/2291169095 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94447792066608] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85a002a070 con 0x55e65717b190 2024-09-12T16:52:20.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 20 remove_watcher() i=7 2024-09-12T16:52:20.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e65717b190 msgr2=0x55e65717d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e65717b190 0x55e65717d580 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e6571768e0 msgr2=0x55e657178d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e6571768e0 0x55e657178d70 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8598009040 msgr2=0x7f85980e8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8598009040 0x7f85980e8430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e65717fc80 msgr2=0x55e657182140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e65717fc80 0x55e657182140 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8470039a70 msgr2=0x7f847003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8470039a70 0x7f847003bf30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85980c57b0 tx=0x7f85980e2000 comp rx=0 tx=0).stop 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 msgr2=0x55e65716b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e65716b6e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f85a004f530 tx=0x7f85a00505a0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a6d91640 1 -- 172.21.15.151:0/2291169095 reap_dead start 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 shutdown_connections 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/2291169095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657165180 0x55e65716b6e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 >> 172.21.15.151:0/2291169095 conn(0x55e6571605a0 msgr2=0x55e65715e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 shutdown_connections 2024-09-12T16:52:20.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/2291169095 wait complete. 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/1212645011 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8480039ac0 msgr2=0x7f848003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/1212645011 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8480039ac0 0x7f848003bf80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55e65713e1d0 tx=0x7f85980e9db0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/1212645011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657157890 msgr2=0x55e657157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/1212645011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657157890 0x55e657157cb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55e65713db70 tx=0x7f85a0018830 comp rx=0 tx=0).stop 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/1212645011 shutdown_connections 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/1212645011 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8480039ac0 0x7f848003bf80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/1212645011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657157890 0x55e657157cb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/1212645011 >> 172.21.15.151:0/1212645011 conn(0x55e65714d240 msgr2=0x55e65714d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/1212645011 shutdown_connections 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/1212645011 wait complete. 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e657146720 msgr2=0x55e657148b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e657146720 0x55e657148b10 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e657046ab0 msgr2=0x55e657143f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e657046ab0 0x55e657143f60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f848c039a70 msgr2=0x7f848c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f848c039a70 0x7f848c03bf30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f859c001ec0 tx=0x7f859c001440 comp rx=0 tx=0).stop 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 msgr2=0x55e65713cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e65713cdf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8598018f70 tx=0x7f85980180e0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 shutdown_connections 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e657146720 0x55e657148b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e657046ab0 0x55e657143f60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f848c039a70 0x7f848c03bf30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 --2- 172.21.15.151:0/3807425365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657046190 0x55e65713cdf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 >> 172.21.15.151:0/3807425365 conn(0x55e6570420a0 msgr2=0x55e6570476a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 shutdown_connections 2024-09-12T16:52:20.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.249+0000 7f85a9a8c9c0 1 -- 172.21.15.151:0/3807425365 wait complete. 2024-09-12T16:52:20.261 INFO:teuthology.orchestra.run.smithi151.stdout:["myfoo"] 2024-09-12T16:52:20.261 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-12T16:52:20.276 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:20.290 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:20.307 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:20.350 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-12T16:52:20.415 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:20.484 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:20.556 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:20.557 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T16:52:20.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T16:52:20.557 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T16:52:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:20.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f18152ac9c0 1 Processor -- start 2024-09-12T16:52:20.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f18152ac9c0 1 -- start start 2024-09-12T16:52:20.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f18152ac9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55814aea25e0 0x55814af36760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f18152ac9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55814ade29c0 con 0x55814aea2200 2024-09-12T16:52:20.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f18152ac9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55814ae326d0 con 0x55814aea25e0 2024-09-12T16:52:20.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f18125b1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55814aea25e0 0x55814af36760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f1812db2640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55814aea2200 0x55814af33030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42568/0 (socket says 172.21.15.151:42568) 2024-09-12T16:52:20.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f1812db2640 1 -- 172.21.15.151:0/445950161 learned_addr learned my addr 172.21.15.151:0/445950161 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:20.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f18125b1640 1 -- 172.21.15.151:0/445950161 >> v1:172.21.15.122:6789/0 conn(0x55814aea2200 legacy=0x55814af33030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.593+0000 7f18125b1640 1 -- 172.21.15.151:0/445950161 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814add6ca0 con 0x55814aea25e0 2024-09-12T16:52:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f18125b1640 1 --2- 172.21.15.151:0/445950161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814af36760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00a480 tx=0x7f17fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b68bb1a24051357 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f1811db0640 1 -- 172.21.15.151:0/445950161 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17fc0b0070 con 0x55814aea25e0 2024-09-12T16:52:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f1811db0640 1 -- 172.21.15.151:0/445950161 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc0ab540 con 0x55814aea25e0 2024-09-12T16:52:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f1811db0640 1 -- 172.21.15.151:0/445950161 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17fc0ab840 con 0x55814aea25e0 2024-09-12T16:52:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f18152ac9c0 1 -- 172.21.15.151:0/445950161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 msgr2=0x55814af36760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/445950161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814af36760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00a480 tx=0x7f17fc01b280 comp rx=0 tx=0).stop 2024-09-12T16:52:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f18152ac9c0 1 -- 172.21.15.151:0/445950161 shutdown_connections 2024-09-12T16:52:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/445950161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814af36760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f18152ac9c0 1 -- 172.21.15.151:0/445950161 >> 172.21.15.151:0/445950161 conn(0x55814af28920 msgr2=0x55814af2ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f18152ac9c0 1 -- 172.21.15.151:0/445950161 shutdown_connections 2024-09-12T16:52:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.597+0000 7f18152ac9c0 1 -- 172.21.15.151:0/445950161 wait complete. 2024-09-12T16:52:20.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.613+0000 7f18152ac9c0 1 Processor -- start 2024-09-12T16:52:20.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.613+0000 7f18152ac9c0 1 -- start start 2024-09-12T16:52:20.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.613+0000 7f18152ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea2200 0x55814b01b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.613+0000 7f18152ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55814ae36680 con 0x55814aea2200 2024-09-12T16:52:20.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.613+0000 7f1812db2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea2200 0x55814b01b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.613+0000 7f1812db2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea2200 0x55814b01b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33258/0 (socket says 172.21.15.151:33258) 2024-09-12T16:52:20.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.613+0000 7f1812db2640 1 -- 172.21.15.151:0/1757749673 learned_addr learned my addr 172.21.15.151:0/1757749673 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.613+0000 7f1812db2640 1 -- 172.21.15.151:0/1757749673 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814adb1da0 con 0x55814aea2200 2024-09-12T16:52:20.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1812db2640 1 --2- 172.21.15.151:0/1757749673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea2200 0x55814b01b900 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f18040017b0 tx=0x7f1804001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b2ca74814b8188 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1700e09640 1 -- 172.21.15.151:0/1757749673 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18040044f0 con 0x55814aea2200 2024-09-12T16:52:20.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1700e09640 1 -- 172.21.15.151:0/1757749673 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18040046b0 con 0x55814aea2200 2024-09-12T16:52:20.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1700e09640 1 -- 172.21.15.151:0/1757749673 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1804004a10 con 0x55814aea2200 2024-09-12T16:52:20.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1757749673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea2200 msgr2=0x55814b01b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1757749673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea2200 0x55814b01b900 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f18040017b0 tx=0x7f1804001c70 comp rx=0 tx=0).stop 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1757749673 shutdown_connections 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1757749673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea2200 0x55814b01b900 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1757749673 >> 172.21.15.151:0/1757749673 conn(0x55814af28920 msgr2=0x55814b017540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1757749673 shutdown_connections 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1757749673 wait complete. 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 Processor -- start 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- start start 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814b0232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55814add8a50 con 0x55814aea25e0 2024-09-12T16:52:20.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1812db2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814b0232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1812db2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814b0232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33264/0 (socket says 172.21.15.151:33264) 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1812db2640 1 -- 172.21.15.151:0/3733536334 learned_addr learned my addr 172.21.15.151:0/3733536334 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1812db2640 1 -- 172.21.15.151:0/3733536334 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814b023800 con 0x55814aea25e0 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f1812db2640 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814b0232a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1804006a50 tx=0x7f1804000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f16ff606640 1 -- 172.21.15.151:0/3733536334 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1804013760 con 0x55814aea25e0 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55814b023a90 con 0x55814aea25e0 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f16ff606640 1 -- 172.21.15.151:0/3733536334 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1804013900 con 0x55814aea25e0 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f16ff606640 1 -- 172.21.15.151:0/3733536334 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1804013c20 con 0x55814aea25e0 2024-09-12T16:52:20.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.617+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814b024350 con 0x55814aea25e0 2024-09-12T16:52:20.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f16ff606640 1 -- 172.21.15.151:0/3733536334 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1804010070 con 0x55814aea25e0 2024-09-12T16:52:20.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f16ff606640 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16f8039a70 0x7f16f803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f16ff606640 1 -- 172.21.15.151:0/3733536334 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1804018070 con 0x55814aea25e0 2024-09-12T16:52:20.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18125b1640 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16f8039a70 0x7f16f803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b028310 0x55814b02a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b02ac40 con 0x55814b028310 2024-09-12T16:52:20.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18135b3640 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b028310 0x55814b02a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18125b1640 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16f8039a70 0x7f16f803bf30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0ad000 tx=0x7f17fc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18135b3640 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b028310 0x55814b02a700 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18135b3640 1 -- 172.21.15.151:0/3733536334 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f180c0083f0 con 0x55814b028310 2024-09-12T16:52:20.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b02b050 con 0x55814b028310 2024-09-12T16:52:20.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18135b3640 1 -- 172.21.15.151:0/3733536334 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f180c0083f0 con 0x55814b028310 2024-09-12T16:52:20.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b02ce60 0x55814b02f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b02f940 con 0x55814b02ce60 2024-09-12T16:52:20.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.621+0000 7f1812db2640 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b02ce60 0x55814b02f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f1812db2640 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b02ce60 0x55814b02f250 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f1812db2640 1 -- 172.21.15.151:0/3733536334 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f180401b030 con 0x55814b02ce60 2024-09-12T16:52:20.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b02bd00 con 0x55814b028310 2024-09-12T16:52:20.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18135b3640 1 -- 172.21.15.151:0/3733536334 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f180c0083f0 con 0x55814b028310 2024-09-12T16:52:20.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b02c1a0 con 0x55814b028310 2024-09-12T16:52:20.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18135b3640 1 -- 172.21.15.151:0/3733536334 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f180c0083f0 con 0x55814b028310 2024-09-12T16:52:20.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18152ac9c0 1 Processor -- start 2024-09-12T16:52:20.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18152ac9c0 1 -- start start 2024-09-12T16:52:20.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18152ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b03dfd0 0x55814b03e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18152ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55814ae43450 con 0x55814b03dfd0 2024-09-12T16:52:20.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18135b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b03dfd0 0x55814b03e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18135b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b03dfd0 0x55814b03e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33268/0 (socket says 172.21.15.151:33268) 2024-09-12T16:52:20.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18135b3640 1 -- 172.21.15.151:0/1098801504 learned_addr learned my addr 172.21.15.151:0/1098801504 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18135b3640 1 -- 172.21.15.151:0/1098801504 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814b03ea30 con 0x55814b03dfd0 2024-09-12T16:52:20.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.625+0000 7f18135b3640 1 --2- 172.21.15.151:0/1098801504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b03dfd0 0x55814b03e3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55814ae9f9f0 tx=0x7f180c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16fce01640 1 -- 172.21.15.151:0/1098801504 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f180c007dd0 con 0x55814b03dfd0 2024-09-12T16:52:20.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16fce01640 1 -- 172.21.15.151:0/1098801504 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f180c01e020 con 0x55814b03dfd0 2024-09-12T16:52:20.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1098801504 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55814b03f290 con 0x55814b03dfd0 2024-09-12T16:52:20.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16fce01640 1 -- 172.21.15.151:0/1098801504 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f180c019590 con 0x55814b03dfd0 2024-09-12T16:52:20.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1098801504 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814b03f800 con 0x55814b03dfd0 2024-09-12T16:52:20.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16fce01640 1 -- 172.21.15.151:0/1098801504 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f180c016040 con 0x55814b03dfd0 2024-09-12T16:52:20.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16fce01640 1 --2- 172.21.15.151:0/1098801504 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16ec039a70 0x7f16ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16fce01640 1 -- 172.21.15.151:0/1098801504 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f180c01f030 con 0x55814b03dfd0 2024-09-12T16:52:20.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f1812db2640 1 --2- 172.21.15.151:0/1098801504 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16ec039a70 0x7f16ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18152ac9c0 1 Processor -- start 2024-09-12T16:52:20.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18152ac9c0 1 -- start start 2024-09-12T16:52:20.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f1812db2640 1 --2- 172.21.15.151:0/1098801504 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16ec039a70 0x7f16ec03bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55814b024640 tx=0x7f1804029d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18152ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b04bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18152ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55814b01c150 con 0x55814b04b940 2024-09-12T16:52:20.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18135b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b04bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18135b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b04bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33276/0 (socket says 172.21.15.151:33276) 2024-09-12T16:52:20.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18135b3640 1 -- 172.21.15.151:0/411224065 learned_addr learned my addr 172.21.15.151:0/411224065 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18135b3640 1 -- 172.21.15.151:0/411224065 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814b04c330 con 0x55814b04b940 2024-09-12T16:52:20.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f18135b3640 1 --2- 172.21.15.151:0/411224065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b04bd40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f180c017b60 tx=0x7f180c018e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae56de5ad91e782 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16f67fc640 1 -- 172.21.15.151:0/411224065 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f180c01d040 con 0x55814b04b940 2024-09-12T16:52:20.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16f67fc640 1 -- 172.21.15.151:0/411224065 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f180c023460 con 0x55814b04b940 2024-09-12T16:52:20.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.629+0000 7f16f67fc640 1 -- 172.21.15.151:0/411224065 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f180c052110 con 0x55814b04b940 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- 172.21.15.151:0/411224065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 msgr2=0x55814b04bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/411224065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b04bd40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f180c017b60 tx=0x7f180c018e30 comp rx=0 tx=0).stop 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- 172.21.15.151:0/411224065 shutdown_connections 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/411224065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b04bd40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- 172.21.15.151:0/411224065 >> 172.21.15.151:0/411224065 conn(0x55814b046d60 msgr2=0x55814b044fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- 172.21.15.151:0/411224065 shutdown_connections 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- 172.21.15.151:0/411224065 wait complete. 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 Processor -- start 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- start start 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b051df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55814b04a890 con 0x55814b04b940 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18135b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b051df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18135b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b051df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33286/0 (socket says 172.21.15.151:33286) 2024-09-12T16:52:20.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 learned_addr learned my addr 172.21.15.151:0/1870133749 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814b052350 con 0x55814b04b940 2024-09-12T16:52:20.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18135b3640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b051df0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f180c04b010 tx=0x7f180c050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f16f4ff9640 1 -- 172.21.15.151:0/1870133749 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f180c01d030 con 0x55814b04b940 2024-09-12T16:52:20.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f16f4ff9640 1 -- 172.21.15.151:0/1870133749 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f180c031030 con 0x55814b04b940 2024-09-12T16:52:20.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55814b0525e0 con 0x55814b04b940 2024-09-12T16:52:20.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f16f4ff9640 1 -- 172.21.15.151:0/1870133749 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f180c048040 con 0x55814b04b940 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55814b052f90 con 0x55814b04b940 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f16f4ff9640 1 -- 172.21.15.151:0/1870133749 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f180c04f210 con 0x55814b04b940 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.633+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f16f4ff9640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16dc039a70 0x7f16dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f16f4ff9640 1 -- 172.21.15.151:0/1870133749 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f180c037c80 con 0x55814b04b940 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b05d0c0 0x55814b05f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b05fca0 con 0x55814b05d0c0 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f1812db2640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16dc039a70 0x7f16dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18125b1640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b05d0c0 0x55814b05f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f1812db2640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16dc039a70 0x7f16dc03bf30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f180404d580 tx=0x7f1804034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18125b1640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b05d0c0 0x55814b05f550 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 realm 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b060070 con 0x55814b05d0c0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b060940 con 0x55814b05d0c0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b060ce0 con 0x55814b05d0c0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b0617d0 0x55814b063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b064300 con 0x55814b0617d0 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18135b3640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b0617d0 0x55814b063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18135b3640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b0617d0 0x55814b063bc0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 20 searching for the correct realm 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55814b0662a0 0x55814b068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.637+0000 7f1812db2640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55814b0662a0 0x55814b068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f1812db2640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55814b0662a0 0x55814b068760 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f1812db2640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55814aea2200 0x7f1804042950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814aea2200 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18125b1640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55814aea2200 0x7f1804042950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18125b1640 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55814aea2200 0x7f1804042950 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b05d0c0 2024-09-12T16:52:20.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b05d0c0 2024-09-12T16:52:20.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.641+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814aea2200 2024-09-12T16:52:20.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b05d0c0 2024-09-12T16:52:20.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b05d0c0 2024-09-12T16:52:20.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814aea2200 2024-09-12T16:52:20.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.645+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b05d0c0 2024-09-12T16:52:20.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b05d0c0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814aea2200 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b05d0c0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.649+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814aea2200 2024-09-12T16:52:20.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0662a0 2024-09-12T16:52:20.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b0617d0 2024-09-12T16:52:20.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814b05d0c0 2024-09-12T16:52:20.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55814b068e30 con 0x55814aea2200 2024-09-12T16:52:20.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:20.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:20.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:20.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:20.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:20.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:20.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b064cc0 con 0x55814b05d0c0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b065110 con 0x55814b05d0c0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b065530 con 0x55814b05d0c0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:20.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 zone default found 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 4 Realm: () 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 zonegroup default 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b065530 con 0x55814b0617d0 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b06ae50 con 0x55814b0662a0 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.653+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b06b2e0 con 0x55814b0662a0 2024-09-12T16:52:20.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 20 started sync module instance, tier type = 2024-09-12T16:52:20.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:20.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06a140 con 0x55814aea2200 2024-09-12T16:52:20.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94013797869152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06a140 con 0x55814aea2200 2024-09-12T16:52:20.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06be60 con 0x55814b05d0c0 2024-09-12T16:52:20.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94013797869152] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94013797873968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06a140 con 0x55814b05d0c0 2024-09-12T16:52:20.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.657+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06c870 con 0x55814b0662a0 2024-09-12T16:52:20.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.661+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94013797873968] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.661+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.661+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94013797866640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06a0b0 con 0x55814b0662a0 2024-09-12T16:52:20.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.661+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06d5c0 con 0x55814aea2200 2024-09-12T16:52:20.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.661+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.661+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94013797880080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06d530 con 0x55814aea2200 2024-09-12T16:52:20.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.661+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06e4c0 con 0x55814b05d0c0 2024-09-12T16:52:20.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.665+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94013797866640] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.665+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94013797880080] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.665+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.665+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94013797878880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06dfd0 con 0x55814b05d0c0 2024-09-12T16:52:20.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.665+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06ed90 con 0x55814b0617d0 2024-09-12T16:52:20.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.665+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94013797878880] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.669+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.669+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94013797886176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06dfd0 con 0x55814b0617d0 2024-09-12T16:52:20.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.669+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06f5e0 con 0x55814b0617d0 2024-09-12T16:52:20.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.669+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94013797886176] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.669+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.669+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94013797882208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b06f5e0 con 0x55814b0617d0 2024-09-12T16:52:20.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.669+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b070040 con 0x55814b0617d0 2024-09-12T16:52:20.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94013797882208] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94013797890848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b070220 con 0x55814b0617d0 2024-09-12T16:52:20.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 20 add_watcher() i=0 2024-09-12T16:52:20.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 20 add_watcher() i=1 2024-09-12T16:52:20.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 20 add_watcher() i=2 2024-09-12T16:52:20.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 20 add_watcher() i=3 2024-09-12T16:52:20.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 20 add_watcher() i=4 2024-09-12T16:52:20.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 20 add_watcher() i=5 2024-09-12T16:52:20.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 20 add_watcher() i=6 2024-09-12T16:52:20.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94013797890848] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 20 add_watcher() i=7 2024-09-12T16:52:20.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:20.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0735f0 con 0x55814b05d0c0 2024-09-12T16:52:20.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.673+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94013797892368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0709e0 con 0x55814b05d0c0 2024-09-12T16:52:20.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94013797892368] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f16c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:20.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:20.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:20.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 5 note: GC not initialized 2024-09-12T16:52:20.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f1643fff640 20 reqs_thread_entry: start 2024-09-12T16:52:20.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:20.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 20 Filter name: none 2024-09-12T16:52:20.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f1641ffb640 20 reqs_thread_entry: start 2024-09-12T16:52:20.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b096770 con 0x55814aea2200 2024-09-12T16:52:20.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:20.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.677+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b097000 con 0x55814b0617d0 2024-09-12T16:52:20.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:20.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:52:20.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0971c0 con 0x55814aea2200 2024-09-12T16:52:20.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:20.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b098630 con 0x55814b0617d0 2024-09-12T16:52:20.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(65 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:20.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:52:20.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 4.3a 4:5d9d5add:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b099d30 con 0x55814b0662a0 2024-09-12T16:52:20.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 4.12 4:495b7da7:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b09c890 con 0x55814b05d0c0 2024-09-12T16:52:20.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 4.e 4:71891b96:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b09f470 con 0x55814aea2200 2024-09-12T16:52:20.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 4.3b 4:dcb0fad2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0a21c0 con 0x55814b0662a0 2024-09-12T16:52:20.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 4.1 4:81b1f111:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0a5080 con 0x55814aea2200 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 4.12 4:4a346742:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b09f470 con 0x55814b05d0c0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 4.31 4:8cce304c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0a5080 con 0x55814b05d0c0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 4.3 4:c37d83ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0a5080 con 0x55814b05d0c0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:74 4.3b 4:dcbe27d2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0ae880 con 0x55814b0662a0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 4.3d 4:bf8db400:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b1150 con 0x55814b0662a0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 4.2f 4:f7089978:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814b05d0c0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(68 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(70 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814aea2200 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(69 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(67 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f17fc0b3040 con 0x55814b05d0c0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(72 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f17fc0de070 con 0x55814b05d0c0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(74 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(71 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f17fc0de070 con 0x55814b05d0c0 2024-09-12T16:52:20.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(75 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(73 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f17fc0de070 con 0x55814b05d0c0 2024-09-12T16:52:20.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.681+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(76 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f17fc0de070 con 0x55814b05d0c0 2024-09-12T16:52:20.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.685+0000 7f16c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:20.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.685+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94013797892368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814b05d0c0 2024-09-12T16:52:20.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.685+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94013797892368] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17fc0de070 con 0x55814b05d0c0 2024-09-12T16:52:20.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.685+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94013797869152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814aea2200 2024-09-12T16:52:20.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.685+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94013797869152] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0de070 con 0x55814aea2200 2024-09-12T16:52:20.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.685+0000 7f18152ac9c0 20 remove_watcher() i=0 2024-09-12T16:52:20.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.685+0000 7f18152ac9c0 2 removed watcher, disabling cache 2024-09-12T16:52:20.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.685+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94013797873968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814b05d0c0 2024-09-12T16:52:20.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.689+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94013797873968] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0de070 con 0x55814b05d0c0 2024-09-12T16:52:20.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.689+0000 7f18152ac9c0 20 remove_watcher() i=1 2024-09-12T16:52:20.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.689+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94013797866640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814b0662a0 2024-09-12T16:52:20.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.689+0000 7f1812db2640 1 -- 172.21.15.151:0/1870133749 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94013797866640] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180401b030 con 0x55814b0662a0 2024-09-12T16:52:20.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.689+0000 7f18152ac9c0 20 remove_watcher() i=2 2024-09-12T16:52:20.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.689+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94013797880080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814aea2200 2024-09-12T16:52:20.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.693+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94013797880080] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0de070 con 0x55814aea2200 2024-09-12T16:52:20.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.693+0000 7f18152ac9c0 20 remove_watcher() i=3 2024-09-12T16:52:20.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.693+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94013797878880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814b05d0c0 2024-09-12T16:52:20.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.693+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94013797878880] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc0de070 con 0x55814b05d0c0 2024-09-12T16:52:20.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.693+0000 7f18152ac9c0 20 remove_watcher() i=4 2024-09-12T16:52:20.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.693+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94013797886176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814b0617d0 2024-09-12T16:52:20.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.697+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94013797886176] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.697+0000 7f18152ac9c0 20 remove_watcher() i=5 2024-09-12T16:52:20.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.697+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94013797882208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814b0617d0 2024-09-12T16:52:20.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.697+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94013797882208] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.697+0000 7f18152ac9c0 20 remove_watcher() i=6 2024-09-12T16:52:20.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.697+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94013797890848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55814b0b4010 con 0x55814b0617d0 2024-09-12T16:52:20.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18135b3640 1 -- 172.21.15.151:0/1870133749 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94013797890848] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f180c03d070 con 0x55814b0617d0 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 20 remove_watcher() i=7 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b0617d0 msgr2=0x55814b063bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b0617d0 0x55814b063bc0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b05d0c0 msgr2=0x55814b05f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b05d0c0 0x55814b05f550 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55814aea2200 msgr2=0x7f1804042950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55814aea2200 0x7f1804042950 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55814b0662a0 msgr2=0x55814b068760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55814b0662a0 0x55814b068760 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16dc039a70 msgr2=0x7f16dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16dc039a70 0x7f16dc03bf30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f180404d580 tx=0x7f1804034000 comp rx=0 tx=0).stop 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 msgr2=0x55814b051df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18125b1640 1 -- 172.21.15.151:0/1870133749 reap_dead start 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b051df0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f180c04b010 tx=0x7f180c050860 comp rx=0 tx=0).stop 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 shutdown_connections 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1870133749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b04b940 0x55814b051df0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 >> 172.21.15.151:0/1870133749 conn(0x55814b046d60 msgr2=0x55814b044f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 shutdown_connections 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1870133749 wait complete. 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1098801504 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16ec039a70 msgr2=0x7f16ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1098801504 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16ec039a70 0x7f16ec03bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55814b024640 tx=0x7f1804029d10 comp rx=0 tx=0).stop 2024-09-12T16:52:20.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1098801504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b03dfd0 msgr2=0x55814b03e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1098801504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b03dfd0 0x55814b03e3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55814ae9f9f0 tx=0x7f180c00af40 comp rx=0 tx=0).stop 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1098801504 shutdown_connections 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1098801504 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16ec039a70 0x7f16ec03bf30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/1098801504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814b03dfd0 0x55814b03e3f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1098801504 >> 172.21.15.151:0/1098801504 conn(0x55814b033980 msgr2=0x55814b033d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1098801504 shutdown_connections 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/1098801504 wait complete. 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b02ce60 msgr2=0x55814b02f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b02ce60 0x55814b02f250 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b028310 msgr2=0x55814b02a700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b028310 0x55814b02a700 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16f8039a70 msgr2=0x7f16f803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16f8039a70 0x7f16f803bf30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0ad000 tx=0x7f17fc0a5040 comp rx=0 tx=0).stop 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 msgr2=0x55814b0232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814b0232a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1804006a50 tx=0x7f1804000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 shutdown_connections 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55814b02ce60 0x55814b02f250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55814b028310 0x55814b02a700 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f16f8039a70 0x7f16f803bf30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 --2- 172.21.15.151:0/3733536334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55814aea25e0 0x55814b0232a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 >> 172.21.15.151:0/3733536334 conn(0x55814af28920 msgr2=0x55814b01cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 shutdown_connections 2024-09-12T16:52:20.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.701+0000 7f18152ac9c0 1 -- 172.21.15.151:0/3733536334 wait complete. 2024-09-12T16:52:20.715 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2480af9e-559e-4103-b02c-bfde6a0f7fec","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","marker":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T16:52:19.914090Z","creation_time":"2024-09-12T16:52:19.907293Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-12T16:52:20.716 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T16:52:19.914090Z', 'creation_time': '2024-09-12T16:52:19.907293Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T16:52:20.716 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-12T16:52:20.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-12T16:52:20.716 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-12T16:52:20.796 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:20.797 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:20.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.793+0000 7f2dee6a69c0 1 Processor -- start 2024-09-12T16:52:20.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.793+0000 7f2dee6a69c0 1 -- start start 2024-09-12T16:52:20.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.793+0000 7f2dee6a69c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5634f3ccd200 0x5634f3ccd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.793+0000 7f2dee6a69c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634f3b7f9c0 con 0x5634f3cd0340 2024-09-12T16:52:20.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.793+0000 7f2dee6a69c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5634f3bcf6d0 con 0x5634f3ccd200 2024-09-12T16:52:20.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.797+0000 7f2dec1ac640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5634f3ccd200 0x5634f3ccd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.797+0000 7f2dec1ac640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5634f3ccd200 0x5634f3ccd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33294/0 (socket says 172.21.15.151:33294) 2024-09-12T16:52:20.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.797+0000 7f2deb9ab640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5634f3cd0340 0x5634f3cd2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42576/0 (socket says 172.21.15.151:42576) 2024-09-12T16:52:20.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.797+0000 7f2dec1ac640 1 -- 172.21.15.151:0/2996050166 learned_addr learned my addr 172.21.15.151:0/2996050166 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.797+0000 7f2dec1ac640 1 -- 172.21.15.151:0/2996050166 >> v1:172.21.15.122:6789/0 conn(0x5634f3cd0340 legacy=0x5634f3cd2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.797+0000 7f2dec1ac640 1 -- 172.21.15.151:0/2996050166 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f3b73ca0 con 0x5634f3ccd200 2024-09-12T16:52:20.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/2996050166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3ccd5e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2de400a4e0 tx=0x7f2de401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49f12ef9caece31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2deb1aa640 1 -- 172.21.15.151:0/2996050166 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2de40aa540 con 0x5634f3ccd200 2024-09-12T16:52:20.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2deb1aa640 1 -- 172.21.15.151:0/2996050166 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de40aa6e0 con 0x5634f3ccd200 2024-09-12T16:52:20.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2deb1aa640 1 -- 172.21.15.151:0/2996050166 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2de40aaa40 con 0x5634f3ccd200 2024-09-12T16:52:20.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2996050166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 msgr2=0x5634f3ccd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/2996050166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3ccd5e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2de400a4e0 tx=0x7f2de401b090 comp rx=0 tx=0).stop 2024-09-12T16:52:20.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2996050166 shutdown_connections 2024-09-12T16:52:20.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/2996050166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3ccd5e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2996050166 >> 172.21.15.151:0/2996050166 conn(0x5634f3c40b10 msgr2=0x5634f3c40f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2996050166 shutdown_connections 2024-09-12T16:52:20.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.801+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2996050166 wait complete. 2024-09-12T16:52:20.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 Processor -- start 2024-09-12T16:52:20.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 -- start start 2024-09-12T16:52:20.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3db8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5634f3bd3680 con 0x5634f3ccd200 2024-09-12T16:52:20.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dec1ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3db8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dec1ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3db8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33304/0 (socket says 172.21.15.151:33304) 2024-09-12T16:52:20.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1414832997 learned_addr learned my addr 172.21.15.151:0/1414832997 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1414832997 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f3b4eda0 con 0x5634f3ccd200 2024-09-12T16:52:20.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/1414832997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3db8870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2de4017ca0 tx=0x7f2de40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9d9e8cedb25ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2cda60c640 1 -- 172.21.15.151:0/1414832997 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2de40b9030 con 0x5634f3ccd200 2024-09-12T16:52:20.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2cda60c640 1 -- 172.21.15.151:0/1414832997 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de40aaa80 con 0x5634f3ccd200 2024-09-12T16:52:20.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2cda60c640 1 -- 172.21.15.151:0/1414832997 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2de40aada0 con 0x5634f3ccd200 2024-09-12T16:52:20.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1414832997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 msgr2=0x5634f3db8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1414832997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3db8870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2de4017ca0 tx=0x7f2de40033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1414832997 shutdown_connections 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1414832997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3db8870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.817+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1414832997 >> 172.21.15.151:0/1414832997 conn(0x5634f3c40b10 msgr2=0x5634f3db4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1414832997 shutdown_connections 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1414832997 wait complete. 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dee6a69c0 1 Processor -- start 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dee6a69c0 1 -- start start 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dee6a69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3dbfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dee6a69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5634f3b75a50 con 0x5634f3ccd200 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dec1ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3dbfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dec1ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3dbfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33306/0 (socket says 172.21.15.151:33306) 2024-09-12T16:52:20.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dec1ac640 1 -- 172.21.15.151:0/560734233 learned_addr learned my addr 172.21.15.151:0/560734233 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dec1ac640 1 -- 172.21.15.151:0/560734233 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f3dc0400 con 0x5634f3ccd200 2024-09-12T16:52:20.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3dbfea0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2de4017ca0 tx=0x7f2de4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2cd8e09640 1 -- 172.21.15.151:0/560734233 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2de40b9070 con 0x5634f3ccd200 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634f3dc0690 con 0x5634f3ccd200 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2cd8e09640 1 -- 172.21.15.151:0/560734233 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de40c3030 con 0x5634f3ccd200 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2cd8e09640 1 -- 172.21.15.151:0/560734233 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2de40b5ba0 con 0x5634f3ccd200 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634f3dc1040 con 0x5634f3ccd200 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2cd8e09640 1 -- 172.21.15.151:0/560734233 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2de40b3040 con 0x5634f3ccd200 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2cd8e09640 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cd4039a70 0x7f2cd403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.821+0000 7f2cd8e09640 1 -- 172.21.15.151:0/560734233 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2de40ba070 con 0x5634f3ccd200 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2deb9ab640 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cd4039a70 0x7f2cd403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3cd0340 0x5634f3dc7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3dc7550 con 0x5634f3cd0340 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec9ad640 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3cd0340 0x5634f3dc7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2deb9ab640 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cd4039a70 0x7f2cd403bf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2de0001e40 tx=0x7f2de00013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec9ad640 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3cd0340 0x5634f3dc7010 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec9ad640 1 -- 172.21.15.151:0/560734233 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3cd0340 2024-09-12T16:52:20.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3dc1360 con 0x5634f3cd0340 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec9ad640 1 -- 172.21.15.151:0/560734233 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3cd0340 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dc97c0 0x5634f3dcbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3dcc250 con 0x5634f3dc97c0 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dc97c0 0x5634f3dcbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dc97c0 0x5634f3dcbbb0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec1ac640 1 -- 172.21.15.151:0/560734233 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3dc97c0 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3dc8660 con 0x5634f3cd0340 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec9ad640 1 -- 172.21.15.151:0/560734233 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3cd0340 2024-09-12T16:52:20.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3dc8b00 con 0x5634f3cd0340 2024-09-12T16:52:20.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.825+0000 7f2dec9ad640 1 -- 172.21.15.151:0/560734233 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3cd0340 2024-09-12T16:52:20.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dee6a69c0 1 Processor -- start 2024-09-12T16:52:20.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dee6a69c0 1 -- start start 2024-09-12T16:52:20.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dee6a69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3dda930 0x5634f3ddad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dee6a69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5634f3be0450 con 0x5634f3dda930 2024-09-12T16:52:20.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dec9ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3dda930 0x5634f3ddad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dec9ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3dda930 0x5634f3ddad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33312/0 (socket says 172.21.15.151:33312) 2024-09-12T16:52:20.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dec9ad640 1 -- 172.21.15.151:0/2749936970 learned_addr learned my addr 172.21.15.151:0/2749936970 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dec9ad640 1 -- 172.21.15.151:0/2749936970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f3ddb390 con 0x5634f3dda930 2024-09-12T16:52:20.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dec9ad640 1 --2- 172.21.15.151:0/2749936970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3dda930 0x5634f3ddad50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x5634f3dc12f0 tx=0x7f2ddc00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2cd1ffb640 1 -- 172.21.15.151:0/2749936970 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ddc007d10 con 0x5634f3dda930 2024-09-12T16:52:20.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2749936970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634f3ddbbf0 con 0x5634f3dda930 2024-09-12T16:52:20.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2cd1ffb640 1 -- 172.21.15.151:0/2749936970 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ddc01e020 con 0x5634f3dda930 2024-09-12T16:52:20.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2cd1ffb640 1 -- 172.21.15.151:0/2749936970 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ddc019420 con 0x5634f3dda930 2024-09-12T16:52:20.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2749936970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634f3ddc160 con 0x5634f3dda930 2024-09-12T16:52:20.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2cd1ffb640 1 -- 172.21.15.151:0/2749936970 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2ddc016040 con 0x5634f3dda930 2024-09-12T16:52:20.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.829+0000 7f2cd1ffb640 1 --2- 172.21.15.151:0/2749936970 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cc4039a70 0x7f2cc403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2cd1ffb640 1 -- 172.21.15.151:0/2749936970 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2ddc01f030 con 0x5634f3dda930 2024-09-12T16:52:20.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/2749936970 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cc4039a70 0x7f2cc403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 Processor -- start 2024-09-12T16:52:20.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- start start 2024-09-12T16:52:20.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/2749936970 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cc4039a70 0x7f2cc403bf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5634f3dc7960 tx=0x7f2de40d4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3de86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5634f3db9000 con 0x5634f3de82e0 2024-09-12T16:52:20.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec9ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3de86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec9ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3de86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33328/0 (socket says 172.21.15.151:33328) 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec9ad640 1 -- 172.21.15.151:0/2074614072 learned_addr learned my addr 172.21.15.151:0/2074614072 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec9ad640 1 -- 172.21.15.151:0/2074614072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f3de8cd0 con 0x5634f3de82e0 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec9ad640 1 --2- 172.21.15.151:0/2074614072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3de86e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0505c0 tx=0x7f2ddc0185b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6cd1cc3cd2c5ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2ccb7fe640 1 -- 172.21.15.151:0/2074614072 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ddc01d070 con 0x5634f3de82e0 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2ccb7fe640 1 -- 172.21.15.151:0/2074614072 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ddc049cf0 con 0x5634f3de82e0 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2ccb7fe640 1 -- 172.21.15.151:0/2074614072 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ddc017ac0 con 0x5634f3de82e0 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2074614072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 msgr2=0x5634f3de86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/2074614072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3de86e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0505c0 tx=0x7f2ddc0185b0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2074614072 shutdown_connections 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/2074614072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3de86e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2074614072 >> 172.21.15.151:0/2074614072 conn(0x5634f3de3700 msgr2=0x5634f3de1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2074614072 shutdown_connections 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2074614072 wait complete. 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 Processor -- start 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- start start 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3dee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dee6a69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5634f3de7230 con 0x5634f3de82e0 2024-09-12T16:52:20.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec9ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3dee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec9ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3dee7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33344/0 (socket says 172.21.15.151:33344) 2024-09-12T16:52:20.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.833+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 learned_addr learned my addr 172.21.15.151:0/1606009915 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:20.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634f3deed00 con 0x5634f3de82e0 2024-09-12T16:52:20.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dec9ad640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3dee7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc052110 tx=0x7f2ddc050520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2cc9ffb640 1 -- 172.21.15.151:0/1606009915 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ddc0175c0 con 0x5634f3de82e0 2024-09-12T16:52:20.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634f3deef90 con 0x5634f3de82e0 2024-09-12T16:52:20.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2cc9ffb640 1 -- 172.21.15.151:0/1606009915 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ddc017760 con 0x5634f3de82e0 2024-09-12T16:52:20.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2cc9ffb640 1 -- 172.21.15.151:0/1606009915 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ddc022920 con 0x5634f3de82e0 2024-09-12T16:52:20.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634f3deef90 con 0x5634f3de82e0 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2cc9ffb640 1 -- 172.21.15.151:0/1606009915 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2ddc034020 con 0x5634f3de82e0 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2cc9ffb640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cbc039a70 0x7f2cbc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2cc9ffb640 1 -- 172.21.15.151:0/1606009915 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2ddc032020 con 0x5634f3de82e0 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cbc039a70 0x7f2cbc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3df98a0 0x5634f3dfbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3dfc480 con 0x5634f3df98a0 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2deb9ab640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3df98a0 0x5634f3dfbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cbc039a70 0x7f2cbc03bf30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2de40aa570 tx=0x7f2de40dc000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.837+0000 7f2deb9ab640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3df98a0 0x5634f3dfbd30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2de000f620 con 0x5634f3df98a0 2024-09-12T16:52:20.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 realm 2024-09-12T16:52:20.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3df8d00 con 0x5634f3df98a0 2024-09-12T16:52:20.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2de000f620 con 0x5634f3df98a0 2024-09-12T16:52:20.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:20.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3dfcfd0 con 0x5634f3df98a0 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2de000f620 con 0x5634f3df98a0 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3dfd8a0 con 0x5634f3df98a0 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2de000f620 con 0x5634f3df98a0 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dfe1a0 0x5634f3e00590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e00cd0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dec9ad640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dfe1a0 0x5634f3e00590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dec9ad640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dfe1a0 0x5634f3e00590 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 20 searching for the correct realm 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5634f3e02c70 0x5634f3e05130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x5634f3e02c70 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5634f3e02c70 0x5634f3e05130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5634f3e02c70 0x5634f3e05130 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dec1ac640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2de40e21d0 0x7f2de40e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x7f2de40e21d0 2024-09-12T16:52:20.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.841+0000 7f2deb9ab640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2de40e21d0 0x7f2de40e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2de40e21d0 0x7f2de40e9880 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:20.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de000f620 con 0x7f2de40e21d0 2024-09-12T16:52:20.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x5634f3dfe1a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x5634f3df98a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de000f620 con 0x5634f3df98a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x5634f3df98a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x5634f3dfe1a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x5634f3dfe1a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x7f2de40e21d0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05800 con 0x5634f3e02c70 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3df98a0 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.845+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3dfe1a0 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3df98a0 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x7f2de40e21d0 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3e02c70 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3e02c70 2024-09-12T16:52:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3dfe1a0 2024-09-12T16:52:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3e02c70 2024-09-12T16:52:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3e02c70 2024-09-12T16:52:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3df98a0 2024-09-12T16:52:20.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3df98a0 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.849+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3dfe1a0 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3e02c70 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x7f2de40e21d0 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3df98a0 2024-09-12T16:52:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3dfe1a0 2024-09-12T16:52:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3e02c70 2024-09-12T16:52:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3dfe1a0 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x7f2de40e21d0 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.853+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3e02c70 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3dfe1a0 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x5634f3df98a0 2024-09-12T16:52:20.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2de40f9040 con 0x7f2de40e21d0 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e01690 con 0x5634f3df98a0 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e01ae0 con 0x5634f3df98a0 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e01fc0 con 0x5634f3df98a0 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 zone default found 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 4 Realm: () 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:20.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 zonegroup default 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e05c80 con 0x5634f3dfe1a0 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e07b70 con 0x5634f3e02c70 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e08080 con 0x5634f3e02c70 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 started sync module instance, tier type = 2024-09-12T16:52:20.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:20.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.857+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e06eb0 con 0x7f2de40e21d0 2024-09-12T16:52:20.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.861+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.861+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785429861328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e06eb0 con 0x7f2de40e21d0 2024-09-12T16:52:20.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.861+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e08b80 con 0x5634f3df98a0 2024-09-12T16:52:20.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.861+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94785429861328] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.861+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.861+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785429866064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e06eb0 con 0x5634f3df98a0 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.861+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e09590 con 0x5634f3e02c70 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.865+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.865+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785429868768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e09e30 con 0x5634f3e02c70 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.865+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0a7f0 con 0x7f2de40e21d0 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.865+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94785429866064] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.865+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.865+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785429873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0a760 con 0x7f2de40e21d0 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.865+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0b540 con 0x5634f3df98a0 2024-09-12T16:52:20.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.865+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94785429868768] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.869+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94785429873472] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.869+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.869+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785429870976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0b040 con 0x5634f3df98a0 2024-09-12T16:52:20.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.869+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0bde0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.869+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94785429870976] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.869+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.869+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785429875600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0afb0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.869+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0c290 con 0x5634f3dfe1a0 2024-09-12T16:52:20.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.873+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94785429875600] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.873+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.873+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785429879088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0c200 con 0x5634f3dfe1a0 2024-09-12T16:52:20.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.873+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0ccb0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.873+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94785429879088] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785429882768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0c200 con 0x5634f3dfe1a0 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 20 add_watcher() i=0 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 20 add_watcher() i=1 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 20 add_watcher() i=2 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 20 add_watcher() i=3 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 20 add_watcher() i=4 2024-09-12T16:52:20.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 20 add_watcher() i=5 2024-09-12T16:52:20.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 20 add_watcher() i=6 2024-09-12T16:52:20.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94785429882768] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 20 add_watcher() i=7 2024-09-12T16:52:20.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:20.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e10130 con 0x5634f3df98a0 2024-09-12T16:52:20.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.877+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785429880608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0d680 con 0x5634f3df98a0 2024-09-12T16:52:20.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94785429880608] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2ca27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:20.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:20.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:20.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 5 note: GC not initialized 2024-09-12T16:52:20.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2ca17e2640 20 reqs_thread_entry: start 2024-09-12T16:52:20.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:20.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 Filter name: none 2024-09-12T16:52:20.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2c12ffd640 20 reqs_thread_entry: start 2024-09-12T16:52:20.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e32f10 con 0x5634f3df98a0 2024-09-12T16:52:20.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:20.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e33900 con 0x5634f3df98a0 2024-09-12T16:52:20.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:20.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e34910 con 0x7f2de40e21d0 2024-09-12T16:52:20.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e320d0 con 0x7f2de40e21d0 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e345f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(66 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 4.3a 4:5d9d5add:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e36170 con 0x5634f3e02c70 2024-09-12T16:52:20.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.881+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 4.12 4:495b7da7:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e38bc0 con 0x5634f3df98a0 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 4.e 4:71891b96:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e3b780 con 0x7f2de40e21d0 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:70 4.3b 4:dcb0fad2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e3e070 con 0x5634f3e02c70 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 4.1 4:81b1f111:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e40a20 con 0x7f2de40e21d0 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 4.12 4:4a346742:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e3e070 con 0x5634f3df98a0 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 4.31 4:8cce304c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e45db0 con 0x5634f3df98a0 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:74 4.3 4:c37d83ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e48c70 con 0x5634f3df98a0 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 4.3b 4:dcbe27d2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e4ba70 con 0x5634f3e02c70 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:76 4.3d 4:bf8db400:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e4e860 con 0x5634f3e02c70 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:77 4.2f 4:f7089978:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e51720 con 0x5634f3df98a0 2024-09-12T16:52:20.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(70 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(71 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(69 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(72 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(73 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(74 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(77 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(76 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(75 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2ca27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:20.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785429880608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e45db0 con 0x5634f3df98a0 2024-09-12T16:52:20.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94785429880608] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.885+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785429861328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0bef0 con 0x7f2de40e21d0 2024-09-12T16:52:20.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.889+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94785429861328] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.889+0000 7f2dee6a69c0 20 remove_watcher() i=0 2024-09-12T16:52:20.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.889+0000 7f2dee6a69c0 2 removed watcher, disabling cache 2024-09-12T16:52:20.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.889+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785429866064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e4ba70 con 0x5634f3df98a0 2024-09-12T16:52:20.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.889+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94785429866064] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.889+0000 7f2dee6a69c0 20 remove_watcher() i=1 2024-09-12T16:52:20.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.889+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785429868768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e08650 con 0x5634f3e02c70 2024-09-12T16:52:20.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.893+0000 7f2dec1ac640 1 -- 172.21.15.151:0/1606009915 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94785429868768] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de40cf070 con 0x5634f3e02c70 2024-09-12T16:52:20.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.893+0000 7f2dee6a69c0 20 remove_watcher() i=2 2024-09-12T16:52:20.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.893+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785429873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e08650 con 0x7f2de40e21d0 2024-09-12T16:52:20.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.893+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94785429873472] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x7f2de40e21d0 2024-09-12T16:52:20.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.893+0000 7f2dee6a69c0 20 remove_watcher() i=3 2024-09-12T16:52:20.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.893+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785429870976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e08650 con 0x5634f3df98a0 2024-09-12T16:52:20.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.897+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94785429870976] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2de002b040 con 0x5634f3df98a0 2024-09-12T16:52:20.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.897+0000 7f2dee6a69c0 20 remove_watcher() i=4 2024-09-12T16:52:20.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.897+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785429875600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e08650 con 0x5634f3dfe1a0 2024-09-12T16:52:20.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.897+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94785429875600] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.897+0000 7f2dee6a69c0 20 remove_watcher() i=5 2024-09-12T16:52:20.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.897+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785429879088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e08650 con 0x5634f3dfe1a0 2024-09-12T16:52:20.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94785429879088] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 20 remove_watcher() i=6 2024-09-12T16:52:20.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785429882768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634f3e0b930 con 0x5634f3dfe1a0 2024-09-12T16:52:20.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dec9ad640 1 -- 172.21.15.151:0/1606009915 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94785429882768] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x5634f3dfe1a0 2024-09-12T16:52:20.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 20 remove_watcher() i=7 2024-09-12T16:52:20.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dfe1a0 msgr2=0x5634f3e00590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dfe1a0 0x5634f3e00590 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3df98a0 msgr2=0x5634f3dfbd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3df98a0 0x5634f3dfbd30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2de40e21d0 msgr2=0x7f2de40e9880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2de40e21d0 0x7f2de40e9880 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5634f3e02c70 msgr2=0x5634f3e05130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5634f3e02c70 0x5634f3e05130 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cbc039a70 msgr2=0x7f2cbc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cbc039a70 0x7f2cbc03bf30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2de40aa570 tx=0x7f2de40dc000 comp rx=0 tx=0).stop 2024-09-12T16:52:20.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 msgr2=0x5634f3dee7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3dee7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc052110 tx=0x7f2ddc050520 comp rx=0 tx=0).stop 2024-09-12T16:52:20.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2deb9ab640 1 -- 172.21.15.151:0/1606009915 reap_dead start 2024-09-12T16:52:20.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 shutdown_connections 2024-09-12T16:52:20.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/1606009915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3de82e0 0x5634f3dee7a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 >> 172.21.15.151:0/1606009915 conn(0x5634f3de3700 msgr2=0x5634f3de1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 shutdown_connections 2024-09-12T16:52:20.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/1606009915 wait complete. 2024-09-12T16:52:20.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2749936970 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cc4039a70 msgr2=0x7f2cc403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/2749936970 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cc4039a70 0x7f2cc403bf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5634f3dc7960 tx=0x7f2de40d4040 comp rx=0 tx=0).stop 2024-09-12T16:52:20.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2749936970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3dda930 msgr2=0x5634f3ddad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/2749936970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3dda930 0x5634f3ddad50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x5634f3dc12f0 tx=0x7f2ddc00aed0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2749936970 shutdown_connections 2024-09-12T16:52:20.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/2749936970 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cc4039a70 0x7f2cc403bf30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/2749936970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3dda930 0x5634f3ddad50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2749936970 >> 172.21.15.151:0/2749936970 conn(0x5634f3dd02e0 msgr2=0x5634f3dd06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2749936970 shutdown_connections 2024-09-12T16:52:20.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/2749936970 wait complete. 2024-09-12T16:52:20.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dc97c0 msgr2=0x5634f3dcbbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dc97c0 0x5634f3dcbbb0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3cd0340 msgr2=0x5634f3dc7010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.901+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3cd0340 0x5634f3dc7010 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cd4039a70 msgr2=0x7f2cd403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cd4039a70 0x7f2cd403bf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2de0001e40 tx=0x7f2de00013a0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 msgr2=0x5634f3dbfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:20.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3dbfea0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2de4017ca0 tx=0x7f2de4017e30 comp rx=0 tx=0).stop 2024-09-12T16:52:20.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 shutdown_connections 2024-09-12T16:52:20.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5634f3dc97c0 0x5634f3dcbbb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5634f3cd0340 0x5634f3dc7010 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2cd4039a70 0x7f2cd403bf30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 --2- 172.21.15.151:0/560734233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5634f3ccd200 0x5634f3dbfea0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:20.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 >> 172.21.15.151:0/560734233 conn(0x5634f3c40b10 msgr2=0x5634f3db2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:20.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 shutdown_connections 2024-09-12T16:52:20.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.905+0000 7f2dee6a69c0 1 -- 172.21.15.151:0/560734233 wait complete. 2024-09-12T16:52:20.917 INFO:teuthology.orchestra.run.smithi151.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2480af9e-559e-4103-b02c-bfde6a0f7fec","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","marker":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T16:52:19.914090Z","creation_time":"2024-09-12T16:52:19.907293Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-12T16:52:20.917 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T16:52:19.914090Z', 'creation_time': '2024-09-12T16:52:19.907293Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-12T16:52:20.927 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T16:52:20.928 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T16:52:20.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T16:52:20.928 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T16:52:20.996 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:20.996 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:20.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61b8a5f9c0 1 Processor -- start 2024-09-12T16:52:20.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61b8a5f9c0 1 -- start start 2024-09-12T16:52:20.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61b8a5f9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5618f4d835e0 0x5618f4e17760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:20.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61b8a5f9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618f4cc39c0 con 0x5618f4d83200 2024-09-12T16:52:20.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61b8a5f9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5618f4d136d0 con 0x5618f4d835e0 2024-09-12T16:52:20.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61affff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5618f4d835e0 0x5618f4e17760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:20.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61affff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5618f4d835e0 0x5618f4e17760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33356/0 (socket says 172.21.15.151:33356) 2024-09-12T16:52:20.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61b6565640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5618f4d83200 0x5618f4e14030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42584/0 (socket says 172.21.15.151:42584) 2024-09-12T16:52:21.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.993+0000 7f61affff640 1 -- 172.21.15.151:0/898623868 learned_addr learned my addr 172.21.15.151:0/898623868 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.997+0000 7f61affff640 1 -- 172.21.15.151:0/898623868 >> v1:172.21.15.122:6789/0 conn(0x5618f4d83200 legacy=0x5618f4e14030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.997+0000 7f61affff640 1 -- 172.21.15.151:0/898623868 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f4cb7ca0 con 0x5618f4d835e0 2024-09-12T16:52:21.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.997+0000 7f61affff640 1 --2- 172.21.15.151:0/898623868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d835e0 0x5618f4e17760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f61a800a5c0 tx=0x7f61a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ff6bea280ea639 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.997+0000 7f61b5d64640 1 -- 172.21.15.151:0/898623868 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a80a6070 con 0x5618f4d835e0 2024-09-12T16:52:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.997+0000 7f61b5d64640 1 -- 172.21.15.151:0/898623868 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a80af070 con 0x5618f4d835e0 2024-09-12T16:52:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.997+0000 7f61b5d64640 1 -- 172.21.15.151:0/898623868 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a80aa5c0 con 0x5618f4d835e0 2024-09-12T16:52:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.997+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/898623868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d835e0 msgr2=0x5618f4e17760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:20.997+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/898623868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d835e0 0x5618f4e17760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f61a800a5c0 tx=0x7f61a801b340 comp rx=0 tx=0).stop 2024-09-12T16:52:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.001+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/898623868 shutdown_connections 2024-09-12T16:52:21.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.001+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/898623868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d835e0 0x5618f4e17760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.001+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/898623868 >> 172.21.15.151:0/898623868 conn(0x5618f4e09920 msgr2=0x5618f4e0bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.001+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/898623868 shutdown_connections 2024-09-12T16:52:21.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.001+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/898623868 wait complete. 2024-09-12T16:52:21.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.013+0000 7f61b8a5f9c0 1 Processor -- start 2024-09-12T16:52:21.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- start start 2024-09-12T16:52:21.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4efc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618f4d17680 con 0x5618f4d83200 2024-09-12T16:52:21.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b6565640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4efc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b6565640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4efc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33366/0 (socket says 172.21.15.151:33366) 2024-09-12T16:52:21.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b6565640 1 -- 172.21.15.151:0/1051016773 learned_addr learned my addr 172.21.15.151:0/1051016773 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b6565640 1 -- 172.21.15.151:0/1051016773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f4c92da0 con 0x5618f4d83200 2024-09-12T16:52:21.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b6565640 1 --2- 172.21.15.151:0/1051016773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4efc900 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f61a000b270 tx=0x7f61a000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beaa361bb6e6c8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f60a4608640 1 -- 172.21.15.151:0/1051016773 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a000e5d0 con 0x5618f4d83200 2024-09-12T16:52:21.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f60a4608640 1 -- 172.21.15.151:0/1051016773 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a000e770 con 0x5618f4d83200 2024-09-12T16:52:21.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f60a4608640 1 -- 172.21.15.151:0/1051016773 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a000ea70 con 0x5618f4d83200 2024-09-12T16:52:21.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/1051016773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 msgr2=0x5618f4efc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/1051016773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4efc900 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f61a000b270 tx=0x7f61a000b670 comp rx=0 tx=0).stop 2024-09-12T16:52:21.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/1051016773 shutdown_connections 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/1051016773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4efc900 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/1051016773 >> 172.21.15.151:0/1051016773 conn(0x5618f4e09920 msgr2=0x5618f4ef8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/1051016773 shutdown_connections 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/1051016773 wait complete. 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 Processor -- start 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- start start 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4f03fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b8a5f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618f4cb9a50 con 0x5618f4d83200 2024-09-12T16:52:21.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b6565640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4f03fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b6565640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4f03fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33380/0 (socket says 172.21.15.151:33380) 2024-09-12T16:52:21.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.017+0000 7f61b6565640 1 -- 172.21.15.151:0/227229206 learned_addr learned my addr 172.21.15.151:0/227229206 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f61b6565640 1 -- 172.21.15.151:0/227229206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f4f04530 con 0x5618f4d83200 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f61b6565640 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4f03fd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x5618f4efd890 tx=0x7f61a0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f60a2e05640 1 -- 172.21.15.151:0/227229206 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a000ee20 con 0x5618f4d83200 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f60a2e05640 1 -- 172.21.15.151:0/227229206 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a000fa40 con 0x5618f4d83200 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f60a2e05640 1 -- 172.21.15.151:0/227229206 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a000fd40 con 0x5618f4d83200 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618f4f047c0 con 0x5618f4d83200 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618f4f05170 con 0x5618f4d83200 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f60a2e05640 1 -- 172.21.15.151:0/227229206 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61a0017070 con 0x5618f4d83200 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f60a2e05640 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f609c039ac0 0x7f609c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f60a2e05640 1 -- 172.21.15.151:0/227229206 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f61a0015020 con 0x5618f4d83200 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f61affff640 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f609c039ac0 0x7f609c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4d835e0 0x5618f4f0b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f0b680 con 0x5618f4d835e0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.021+0000 7f61b6d66640 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4d835e0 0x5618f4f0b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61affff640 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f609c039ac0 0x7f609c03bf80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ae000 tx=0x7f61a80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b6d66640 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4d835e0 0x5618f4f0b140 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b6d66640 1 -- 172.21.15.151:0/227229206 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61b000a4d0 con 0x5618f4d835e0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f0bad0 con 0x5618f4d835e0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b6d66640 1 -- 172.21.15.151:0/227229206 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61b000a4d0 con 0x5618f4d835e0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f0d8e0 0x5618f4f0fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f103c0 con 0x5618f4f0d8e0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b6565640 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f0d8e0 0x5618f4f0fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b6565640 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f0d8e0 0x5618f4f0fcd0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b6565640 1 -- 172.21.15.151:0/227229206 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f0d8e0 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f0c780 con 0x5618f4d835e0 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b6d66640 1 -- 172.21.15.151:0/227229206 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61b000a4d0 con 0x5618f4d835e0 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f0cbe0 con 0x5618f4d835e0 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b6d66640 1 -- 172.21.15.151:0/227229206 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61b000a4d0 con 0x5618f4d835e0 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b8a5f9c0 1 Processor -- start 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.025+0000 7f61b8a5f9c0 1 -- start start 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b8a5f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f1ea50 0x5618f4f1ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b8a5f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618f4d24450 con 0x5618f4f1ea50 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b6d66640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f1ea50 0x5618f4f1ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b6d66640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f1ea50 0x5618f4f1ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33388/0 (socket says 172.21.15.151:33388) 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b6d66640 1 -- 172.21.15.151:0/4081380581 learned_addr learned my addr 172.21.15.151:0/4081380581 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b6d66640 1 -- 172.21.15.151:0/4081380581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f4f1f4b0 con 0x5618f4f1ea50 2024-09-12T16:52:21.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b6d66640 1 --2- 172.21.15.151:0/4081380581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f1ea50 0x5618f4f1ee70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5618f4f05000 tx=0x7f61b0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f609bfff640 1 -- 172.21.15.151:0/4081380581 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b0014450 con 0x5618f4f1ea50 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f609bfff640 1 -- 172.21.15.151:0/4081380581 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b00145f0 con 0x5618f4f1ea50 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f609bfff640 1 -- 172.21.15.151:0/4081380581 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b00148f0 con 0x5618f4f1ea50 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/4081380581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618f4f1fd10 con 0x5618f4f1ea50 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/4081380581 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618f4f20280 con 0x5618f4f1ea50 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f609bfff640 1 -- 172.21.15.151:0/4081380581 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61b0011040 con 0x5618f4f1ea50 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f609bfff640 1 --2- 172.21.15.151:0/4081380581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6090039a70 0x7f609003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f609bfff640 1 -- 172.21.15.151:0/4081380581 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f61b001e070 con 0x5618f4f1ea50 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b6565640 1 --2- 172.21.15.151:0/4081380581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6090039a70 0x7f609003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b8a5f9c0 1 Processor -- start 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b8a5f9c0 1 -- start start 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b6565640 1 --2- 172.21.15.151:0/4081380581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6090039a70 0x7f609003bf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5618f4f05460 tx=0x7f61a000fee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b8a5f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f2b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.029+0000 7f61b8a5f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618f4efd150 con 0x5618f4f2b370 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f2b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f2b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33398/0 (socket says 172.21.15.151:33398) 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 -- 172.21.15.151:0/3474241251 learned_addr learned my addr 172.21.15.151:0/3474241251 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 -- 172.21.15.151:0/3474241251 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f4f2bd40 con 0x5618f4f2b370 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 --2- 172.21.15.151:0/3474241251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f2b750 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f61b0018430 tx=0x7f61b0001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8100ae16a4f2d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f6099ffb640 1 -- 172.21.15.151:0/3474241251 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b004f2a0 con 0x5618f4f2b370 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f6099ffb640 1 -- 172.21.15.151:0/3474241251 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b002bc50 con 0x5618f4f2b370 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f6099ffb640 1 -- 172.21.15.151:0/3474241251 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b0014a90 con 0x5618f4f2b370 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3474241251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 msgr2=0x5618f4f2b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3474241251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f2b750 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f61b0018430 tx=0x7f61b0001320 comp rx=0 tx=0).stop 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3474241251 shutdown_connections 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3474241251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f2b750 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3474241251 >> 172.21.15.151:0/3474241251 conn(0x5618f4f277a0 msgr2=0x5618f4f259e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3474241251 shutdown_connections 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3474241251 wait complete. 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 Processor -- start 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 -- start start 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f32890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b8a5f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618f4f2c380 con 0x5618f4f2b370 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f32890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f32890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33414/0 (socket says 172.21.15.151:33414) 2024-09-12T16:52:21.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 learned_addr learned my addr 172.21.15.151:0/3389404235 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f4f32df0 con 0x5618f4f2b370 2024-09-12T16:52:21.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.033+0000 7f61b6d66640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f32890 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f61b0011b90 tx=0x7f61b0050660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f6087fff640 1 -- 172.21.15.151:0/3389404235 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b003ebc0 con 0x5618f4f2b370 2024-09-12T16:52:21.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618f4f33080 con 0x5618f4f2b370 2024-09-12T16:52:21.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618f4f33a30 con 0x5618f4f2b370 2024-09-12T16:52:21.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f6087fff640 1 -- 172.21.15.151:0/3389404235 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b003ed60 con 0x5618f4f2b370 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f6087fff640 1 -- 172.21.15.151:0/3389404235 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61b003b060 con 0x5618f4f2b370 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f6087fff640 1 -- 172.21.15.151:0/3389404235 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61b003e350 con 0x5618f4f2b370 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f6087fff640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6080039a70 0x7f608003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f6087fff640 1 -- 172.21.15.151:0/3389404235 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f61b000e040 con 0x5618f4f2b370 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b6565640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6080039a70 0x7f608003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4f3db40 0x5618f4f3ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f40720 con 0x5618f4f3db40 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61affff640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4f3db40 0x5618f4f3ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b6565640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6080039a70 0x7f608003bf30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f61a0017fd0 tx=0x7f61a0043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61affff640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4f3db40 0x5618f4f3ffd0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 realm 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f40b50 con 0x5618f4f3db40 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f41420 con 0x5618f4f3db40 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f417c0 con 0x5618f4f3db40 2024-09-12T16:52:21.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f42520 0x5618f4f44910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.037+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f44e50 con 0x5618f4f42520 2024-09-12T16:52:21.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6d66640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f42520 0x5618f4f44910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6d66640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f42520 0x5618f4f44910 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b8a5f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b8a5f9c0 20 searching for the correct realm 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5618f4f46da0 0x5618f4f49260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f46da0 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6565640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5618f4f46da0 0x5618f4f49260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6565640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5618f4f46da0 0x5618f4f49260 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6565640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61a001b760 0x7f61a004f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x7f61a001b760 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61affff640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61a001b760 0x7f61a004f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61affff640 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61a001b760 0x7f61a004f6b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f42520 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.041+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f3db40 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f3db40 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f42520 2024-09-12T16:52:21.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f42520 2024-09-12T16:52:21.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x7f61a001b760 2024-09-12T16:52:21.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f46da0 2024-09-12T16:52:21.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f3db40 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f42520 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f3db40 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x7f61a001b760 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.045+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f46da0 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f46da0 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f42520 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f46da0 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f49930 con 0x5618f4f46da0 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f3db40 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f3db40 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f42520 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f46da0 2024-09-12T16:52:21.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x7f61a001b760 2024-09-12T16:52:21.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.049+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f3db40 2024-09-12T16:52:21.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f42520 2024-09-12T16:52:21.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f46da0 2024-09-12T16:52:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f42520 2024-09-12T16:52:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x7f61a001b760 2024-09-12T16:52:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f46da0 2024-09-12T16:52:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f42520 2024-09-12T16:52:21.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x5618f4f3db40 2024-09-12T16:52:21.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f61a005f040 con 0x7f61a001b760 2024-09-12T16:52:21.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:21.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:21.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:21.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:21.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:21.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:21.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f457a0 con 0x5618f4f3db40 2024-09-12T16:52:21.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.053+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f45c20 con 0x5618f4f3db40 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f46040 con 0x5618f4f3db40 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 zone default found 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 4 Realm: () 2024-09-12T16:52:21.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 zonegroup default 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f46040 con 0x5618f4f42520 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4b950 con 0x5618f4f46da0 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4be20 con 0x5618f4f46da0 2024-09-12T16:52:21.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 started sync module instance, tier type = 2024-09-12T16:52:21.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:21.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4ac40 con 0x7f61a001b760 2024-09-12T16:52:21.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94665188880704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4ac40 con 0x7f61a001b760 2024-09-12T16:52:21.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.057+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4c920 con 0x5618f4f3db40 2024-09-12T16:52:21.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.061+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94665188880704] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.061+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.061+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94665188885488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4ac40 con 0x5618f4f3db40 2024-09-12T16:52:21.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.061+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4d330 con 0x5618f4f46da0 2024-09-12T16:52:21.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.061+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.061+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94665188885488] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94665188878224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4abb0 con 0x5618f4f46da0 2024-09-12T16:52:21.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4e030 con 0x7f61a001b760 2024-09-12T16:52:21.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94665188891792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4e8d0 con 0x7f61a001b760 2024-09-12T16:52:21.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4f290 con 0x5618f4f3db40 2024-09-12T16:52:21.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94665188878224] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94665188891792] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94665188896224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4e840 con 0x5618f4f3db40 2024-09-12T16:52:21.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.065+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4f200 con 0x5618f4f42520 2024-09-12T16:52:21.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.069+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94665188896224] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.069+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.069+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94665188893888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f4fb30 con 0x5618f4f42520 2024-09-12T16:52:21.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.069+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f50380 con 0x5618f4f42520 2024-09-12T16:52:21.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.069+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94665188893888] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94665188898912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f502b0 con 0x5618f4f42520 2024-09-12T16:52:21.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f50dd0 con 0x5618f4f42520 2024-09-12T16:52:21.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94665188898912] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94665188903072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f50d90 con 0x5618f4f42520 2024-09-12T16:52:21.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 20 add_watcher() i=0 2024-09-12T16:52:21.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 20 add_watcher() i=1 2024-09-12T16:52:21.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 20 add_watcher() i=2 2024-09-12T16:52:21.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 20 add_watcher() i=3 2024-09-12T16:52:21.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 20 add_watcher() i=4 2024-09-12T16:52:21.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 20 add_watcher() i=5 2024-09-12T16:52:21.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.073+0000 7f61b8a5f9c0 20 add_watcher() i=6 2024-09-12T16:52:21.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94665188903072] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 20 add_watcher() i=7 2024-09-12T16:52:21.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:21.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f54220 con 0x5618f4f3db40 2024-09-12T16:52:21.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94665188900096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f51740 con 0x5618f4f3db40 2024-09-12T16:52:21.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94665188900096] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f606cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:21.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:21.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 5 note: GC not initialized 2024-09-12T16:52:21.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f5fe77fe640 20 reqs_thread_entry: start 2024-09-12T16:52:21.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:21.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 20 Filter name: none 2024-09-12T16:52:21.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f5fe57fa640 20 reqs_thread_entry: start 2024-09-12T16:52:21.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f77560 con 0x7f61a001b760 2024-09-12T16:52:21.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:21.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.077+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f77df0 con 0x5618f4f42520 2024-09-12T16:52:21.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:21.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:52:21.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f77fb0 con 0x7f61a001b760 2024-09-12T16:52:21.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:21.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f79400 con 0x5618f4f42520 2024-09-12T16:52:21.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(65 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:21.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:52:21.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 4.3a 4:5d9d5add:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f7aa90 con 0x5618f4f46da0 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 4.12 4:495b7da7:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f7d630 con 0x5618f4f3db40 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 4.e 4:71891b96:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f7ff90 con 0x7f61a001b760 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 4.3b 4:dcb0fad2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f82800 con 0x5618f4f46da0 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 4.1 4:81b1f111:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f850b0 con 0x7f61a001b760 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 4.12 4:4a346742:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f87b80 con 0x5618f4f3db40 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 4.31 4:8cce304c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f8a950 con 0x5618f4f3db40 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 4.3 4:c37d83ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f8d810 con 0x5618f4f3db40 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:74 4.3b 4:dcbe27d2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f90640 con 0x5618f4f46da0 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 4.3d 4:bf8db400:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f93000 con 0x5618f4f46da0 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 4.2f 4:f7089978:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x5618f4f3db40 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(67 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(68 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(69 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(74 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(75 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(71 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5 [call out=128b] v0'0 uv4 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(73 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(72 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(76 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.081+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(70 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.085+0000 7f606cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.085+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94665188900096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f850b0 con 0x5618f4f3db40 2024-09-12T16:52:21.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.085+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94665188900096] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.085+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94665188880704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x7f61a001b760 2024-09-12T16:52:21.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.085+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94665188880704] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.085+0000 7f61b8a5f9c0 20 remove_watcher() i=0 2024-09-12T16:52:21.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.085+0000 7f61b8a5f9c0 2 removed watcher, disabling cache 2024-09-12T16:52:21.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.085+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94665188885488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x5618f4f3db40 2024-09-12T16:52:21.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.089+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94665188885488] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.089+0000 7f61b8a5f9c0 20 remove_watcher() i=1 2024-09-12T16:52:21.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.089+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94665188878224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x5618f4f46da0 2024-09-12T16:52:21.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.089+0000 7f61b6565640 1 -- 172.21.15.151:0/3389404235 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94665188878224] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a002e070 con 0x5618f4f46da0 2024-09-12T16:52:21.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.089+0000 7f61b8a5f9c0 20 remove_watcher() i=2 2024-09-12T16:52:21.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.089+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94665188891792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x7f61a001b760 2024-09-12T16:52:21.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.093+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94665188891792] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x7f61a001b760 2024-09-12T16:52:21.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.093+0000 7f61b8a5f9c0 20 remove_watcher() i=3 2024-09-12T16:52:21.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.093+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94665188896224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x5618f4f3db40 2024-09-12T16:52:21.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.093+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94665188896224] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a80aaa70 con 0x5618f4f3db40 2024-09-12T16:52:21.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.093+0000 7f61b8a5f9c0 20 remove_watcher() i=4 2024-09-12T16:52:21.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.093+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94665188893888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x5618f4f42520 2024-09-12T16:52:21.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.097+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94665188893888] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.097+0000 7f61b8a5f9c0 20 remove_watcher() i=5 2024-09-12T16:52:21.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.097+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94665188898912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x5618f4f42520 2024-09-12T16:52:21.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.097+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94665188898912] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.097+0000 7f61b8a5f9c0 20 remove_watcher() i=6 2024-09-12T16:52:21.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.097+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94665188903072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5618f4f95ec0 con 0x5618f4f42520 2024-09-12T16:52:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b6d66640 1 -- 172.21.15.151:0/3389404235 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94665188903072] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61b002a070 con 0x5618f4f42520 2024-09-12T16:52:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 20 remove_watcher() i=7 2024-09-12T16:52:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f42520 msgr2=0x5618f4f44910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f42520 0x5618f4f44910 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4f3db40 msgr2=0x5618f4f3ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4f3db40 0x5618f4f3ffd0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61a001b760 msgr2=0x7f61a004f6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f61a001b760 0x7f61a004f6b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5618f4f46da0 msgr2=0x5618f4f49260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5618f4f46da0 0x5618f4f49260 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6080039a70 msgr2=0x7f608003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6080039a70 0x7f608003bf30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f61a0017fd0 tx=0x7f61a0043000 comp rx=0 tx=0).stop 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 msgr2=0x5618f4f32890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/3389404235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f2b370 0x5618f4f32890 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f61b0011b90 tx=0x7f61b0050660 comp rx=0 tx=0).stop 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 reap_dead start 2024-09-12T16:52:21.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61affff640 1 -- 172.21.15.151:0/3389404235 reap_dead start 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 shutdown_connections 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 >> 172.21.15.151:0/3389404235 conn(0x5618f4f277a0 msgr2=0x5618f4f259b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 shutdown_connections 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/3389404235 wait complete. 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/4081380581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6090039a70 msgr2=0x7f609003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/4081380581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6090039a70 0x7f609003bf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5618f4f05460 tx=0x7f61a000fee0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/4081380581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f1ea50 msgr2=0x5618f4f1ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/4081380581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f1ea50 0x5618f4f1ee70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5618f4f05000 tx=0x7f61b0018830 comp rx=0 tx=0).stop 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/4081380581 shutdown_connections 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/4081380581 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6090039a70 0x7f609003bf30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/4081380581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4f1ea50 0x5618f4f1ee70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/4081380581 >> 172.21.15.151:0/4081380581 conn(0x5618f4f14400 msgr2=0x5618f4f147e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/4081380581 shutdown_connections 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/4081380581 wait complete. 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f0d8e0 msgr2=0x5618f4f0fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f0d8e0 0x5618f4f0fcd0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4d835e0 msgr2=0x5618f4f0b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4d835e0 0x5618f4f0b140 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f609c039ac0 msgr2=0x7f609c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f609c039ac0 0x7f609c03bf80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ae000 tx=0x7f61a80a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 msgr2=0x5618f4f03fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4f03fd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x5618f4efd890 tx=0x7f61a0000ee0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 shutdown_connections 2024-09-12T16:52:21.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5618f4f0d8e0 0x5618f4f0fcd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5618f4d835e0 0x5618f4f0b140 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f609c039ac0 0x7f609c03bf80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 --2- 172.21.15.151:0/227229206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618f4d83200 0x5618f4f03fd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 >> 172.21.15.151:0/227229206 conn(0x5618f4e09920 msgr2=0x5618f4ef6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 shutdown_connections 2024-09-12T16:52:21.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.101+0000 7f61b8a5f9c0 1 -- 172.21.15.151:0/227229206 wait complete. 2024-09-12T16:52:21.117 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2480af9e-559e-4103-b02c-bfde6a0f7fec","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","marker":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T16:52:19.914090Z","creation_time":"2024-09-12T16:52:19.907293Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-12T16:52:21.117 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T16:52:19.914090Z', 'creation_time': '2024-09-12T16:52:19.907293Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T16:52:21.118 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-12T16:52:21.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-12T16:52:21.119 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-12T16:52:21.193 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:21.193 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:21.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.189+0000 7faff42da9c0 1 Processor -- start 2024-09-12T16:52:21.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff42da9c0 1 -- start start 2024-09-12T16:52:21.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff42da9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55efbc892340 0x55efbc894730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff42da9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55efbc7409c0 con 0x55efbc88e1f0 2024-09-12T16:52:21.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff42da9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55efbc7906d0 con 0x55efbc892340 2024-09-12T16:52:21.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff15df640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55efbc892340 0x55efbc894730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff15df640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55efbc892340 0x55efbc894730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33432/0 (socket says 172.21.15.151:33432) 2024-09-12T16:52:21.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff15df640 1 -- 172.21.15.151:0/1182797994 learned_addr learned my addr 172.21.15.151:0/1182797994 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff15df640 1 -- 172.21.15.151:0/1182797994 >> v1:172.21.15.122:6789/0 conn(0x55efbc88e1f0 legacy=0x55efbc88e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff15df640 1 -- 172.21.15.151:0/1182797994 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbc734ca0 con 0x55efbc892340 2024-09-12T16:52:21.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.193+0000 7faff15df640 1 --2- 172.21.15.151:0/1182797994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc892340 0x55efbc894730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fafe800a5c0 tx=0x7fafe801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0123e9cbb52f088 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff0dde640 1 -- 172.21.15.151:0/1182797994 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe80a9590 con 0x55efbc892340 2024-09-12T16:52:21.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff0dde640 1 -- 172.21.15.151:0/1182797994 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe80ae070 con 0x55efbc892340 2024-09-12T16:52:21.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff0dde640 1 -- 172.21.15.151:0/1182797994 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe80a9880 con 0x55efbc892340 2024-09-12T16:52:21.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff42da9c0 1 -- 172.21.15.151:0/1182797994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc892340 msgr2=0x55efbc894730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff42da9c0 1 --2- 172.21.15.151:0/1182797994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc892340 0x55efbc894730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fafe800a5c0 tx=0x7fafe801b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff42da9c0 1 -- 172.21.15.151:0/1182797994 shutdown_connections 2024-09-12T16:52:21.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff42da9c0 1 --2- 172.21.15.151:0/1182797994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc892340 0x55efbc894730 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff42da9c0 1 -- 172.21.15.151:0/1182797994 >> 172.21.15.151:0/1182797994 conn(0x55efbc801b00 msgr2=0x55efbc801f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff42da9c0 1 -- 172.21.15.151:0/1182797994 shutdown_connections 2024-09-12T16:52:21.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.197+0000 7faff42da9c0 1 -- 172.21.15.151:0/1182797994 wait complete. 2024-09-12T16:52:21.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 Processor -- start 2024-09-12T16:52:21.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- start start 2024-09-12T16:52:21.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc9798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55efbc794680 con 0x55efbc88e1f0 2024-09-12T16:52:21.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff1de0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc9798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff1de0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc9798e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33444/0 (socket says 172.21.15.151:33444) 2024-09-12T16:52:21.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff1de0640 1 -- 172.21.15.151:0/3800046346 learned_addr learned my addr 172.21.15.151:0/3800046346 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff1de0640 1 -- 172.21.15.151:0/3800046346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbc70fda0 con 0x55efbc88e1f0 2024-09-12T16:52:21.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff1de0640 1 --2- 172.21.15.151:0/3800046346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc9798e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fafe4001680 tx=0x7fafe4001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20d9e010fcd86d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faedfe07640 1 -- 172.21.15.151:0/3800046346 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe4016070 con 0x55efbc88e1f0 2024-09-12T16:52:21.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faedfe07640 1 -- 172.21.15.151:0/3800046346 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe400f660 con 0x55efbc88e1f0 2024-09-12T16:52:21.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faedfe07640 1 -- 172.21.15.151:0/3800046346 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe400f980 con 0x55efbc88e1f0 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- 172.21.15.151:0/3800046346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 msgr2=0x55efbc9798e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 --2- 172.21.15.151:0/3800046346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc9798e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fafe4001680 tx=0x7fafe4001b40 comp rx=0 tx=0).stop 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- 172.21.15.151:0/3800046346 shutdown_connections 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 --2- 172.21.15.151:0/3800046346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc9798e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- 172.21.15.151:0/3800046346 >> 172.21.15.151:0/3800046346 conn(0x55efbc801b00 msgr2=0x55efbc975520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- 172.21.15.151:0/3800046346 shutdown_connections 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- 172.21.15.151:0/3800046346 wait complete. 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 Processor -- start 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- start start 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc980fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff42da9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55efbc736a50 con 0x55efbc88e1f0 2024-09-12T16:52:21.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.213+0000 7faff1de0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc980fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff1de0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc980fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33448/0 (socket says 172.21.15.151:33448) 2024-09-12T16:52:21.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff1de0640 1 -- 172.21.15.151:0/625581061 learned_addr learned my addr 172.21.15.151:0/625581061 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff1de0640 1 -- 172.21.15.151:0/625581061 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbc981510 con 0x55efbc88e1f0 2024-09-12T16:52:21.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff1de0640 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc980fb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55efbc97a870 tx=0x7fafe4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faede604640 1 -- 172.21.15.151:0/625581061 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe4016040 con 0x55efbc88e1f0 2024-09-12T16:52:21.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faede604640 1 -- 172.21.15.151:0/625581061 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe4022070 con 0x55efbc88e1f0 2024-09-12T16:52:21.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efbc9817a0 con 0x55efbc88e1f0 2024-09-12T16:52:21.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faede604640 1 -- 172.21.15.151:0/625581061 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe4006330 con 0x55efbc88e1f0 2024-09-12T16:52:21.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efbc982150 con 0x55efbc88e1f0 2024-09-12T16:52:21.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faede604640 1 -- 172.21.15.151:0/625581061 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fafe4011510 con 0x55efbc88e1f0 2024-09-12T16:52:21.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faede604640 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faed8039c10 0x7faed803c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faede604640 1 -- 172.21.15.151:0/625581061 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fafe404fd80 con 0x55efbc88e1f0 2024-09-12T16:52:21.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff15df640 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faed8039c10 0x7faed803c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc892340 0x55efbc988120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc988660 con 0x55efbc892340 2024-09-12T16:52:21.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff25e1640 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc892340 0x55efbc988120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff15df640 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faed8039c10 0x7faed803c0d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fafe80ad000 tx=0x7fafe80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff25e1640 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc892340 0x55efbc988120 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff25e1640 1 -- 172.21.15.151:0/625581061 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafec0083f0 con 0x55efbc892340 2024-09-12T16:52:21.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.217+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9824b0 con 0x55efbc892340 2024-09-12T16:52:21.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff25e1640 1 -- 172.21.15.151:0/625581061 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafec0083f0 con 0x55efbc892340 2024-09-12T16:52:21.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc98a950 0x55efbc98cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc98d480 con 0x55efbc98a950 2024-09-12T16:52:21.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff1de0640 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc98a950 0x55efbc98cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff1de0640 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc98a950 0x55efbc98cd40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff1de0640 1 -- 172.21.15.151:0/625581061 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc98a950 2024-09-12T16:52:21.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9897f0 con 0x55efbc892340 2024-09-12T16:52:21.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff25e1640 1 -- 172.21.15.151:0/625581061 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafec0083f0 con 0x55efbc892340 2024-09-12T16:52:21.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc989be0 con 0x55efbc892340 2024-09-12T16:52:21.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff25e1640 1 -- 172.21.15.151:0/625581061 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafec0083f0 con 0x55efbc892340 2024-09-12T16:52:21.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff42da9c0 1 Processor -- start 2024-09-12T16:52:21.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff42da9c0 1 -- start start 2024-09-12T16:52:21.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff42da9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc99ba90 0x55efbc99beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff42da9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55efbc7a1450 con 0x55efbc99ba90 2024-09-12T16:52:21.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff25e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc99ba90 0x55efbc99beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff25e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc99ba90 0x55efbc99beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33458/0 (socket says 172.21.15.151:33458) 2024-09-12T16:52:21.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.221+0000 7faff25e1640 1 -- 172.21.15.151:0/1384708394 learned_addr learned my addr 172.21.15.151:0/1384708394 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff25e1640 1 -- 172.21.15.151:0/1384708394 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbc99c4f0 con 0x55efbc99ba90 2024-09-12T16:52:21.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff25e1640 1 --2- 172.21.15.151:0/1384708394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc99ba90 0x55efbc99beb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55efbc981d30 tx=0x7fafec00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faed77fe640 1 -- 172.21.15.151:0/1384708394 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec010d50 con 0x55efbc99ba90 2024-09-12T16:52:21.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faed77fe640 1 -- 172.21.15.151:0/1384708394 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec01f020 con 0x55efbc99ba90 2024-09-12T16:52:21.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faed77fe640 1 -- 172.21.15.151:0/1384708394 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec01a430 con 0x55efbc99ba90 2024-09-12T16:52:21.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff42da9c0 1 -- 172.21.15.151:0/1384708394 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efbc99cd50 con 0x55efbc99ba90 2024-09-12T16:52:21.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff42da9c0 1 -- 172.21.15.151:0/1384708394 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efbc99d2c0 con 0x55efbc99ba90 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faed77fe640 1 -- 172.21.15.151:0/1384708394 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fafec013030 con 0x55efbc99ba90 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faed77fe640 1 --2- 172.21.15.151:0/1384708394 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faecc039a70 0x7faecc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faed77fe640 1 -- 172.21.15.151:0/1384708394 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fafec020030 con 0x55efbc99ba90 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff1de0640 1 --2- 172.21.15.151:0/1384708394 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faecc039a70 0x7faecc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff42da9c0 1 Processor -- start 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff42da9c0 1 -- start start 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff1de0640 1 --2- 172.21.15.151:0/1384708394 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faecc039a70 0x7faecc03bf30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55efbc988ac0 tx=0x7fafe4005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff42da9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff42da9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55efbc97a130 con 0x55efbc9a9460 2024-09-12T16:52:21.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff25e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff25e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33460/0 (socket says 172.21.15.151:33460) 2024-09-12T16:52:21.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.225+0000 7faff25e1640 1 -- 172.21.15.151:0/1419282870 learned_addr learned my addr 172.21.15.151:0/1419282870 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff25e1640 1 -- 172.21.15.151:0/1419282870 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbc9a9e50 con 0x55efbc9a9460 2024-09-12T16:52:21.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff25e1640 1 --2- 172.21.15.151:0/1419282870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9a9860 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fafec050850 tx=0x7fafec019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3c4ace63b69ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faed57fa640 1 -- 172.21.15.151:0/1419282870 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec007b60 con 0x55efbc9a9460 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faed57fa640 1 -- 172.21.15.151:0/1419282870 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec04f2d0 con 0x55efbc9a9460 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faed57fa640 1 -- 172.21.15.151:0/1419282870 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec03ea00 con 0x55efbc9a9460 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- 172.21.15.151:0/1419282870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 msgr2=0x55efbc9a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 --2- 172.21.15.151:0/1419282870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9a9860 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fafec050850 tx=0x7fafec019690 comp rx=0 tx=0).stop 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- 172.21.15.151:0/1419282870 shutdown_connections 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 --2- 172.21.15.151:0/1419282870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9a9860 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- 172.21.15.151:0/1419282870 >> 172.21.15.151:0/1419282870 conn(0x55efbc9a4880 msgr2=0x55efbc9a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- 172.21.15.151:0/1419282870 shutdown_connections 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- 172.21.15.151:0/1419282870 wait complete. 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 Processor -- start 2024-09-12T16:52:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- start start 2024-09-12T16:52:21.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55efbc9a83b0 con 0x55efbc9a9460 2024-09-12T16:52:21.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff25e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff25e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33476/0 (socket says 172.21.15.151:33476) 2024-09-12T16:52:21.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 learned_addr learned my addr 172.21.15.151:0/4162170403 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efbc9afe60 con 0x55efbc9a9460 2024-09-12T16:52:21.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff25e1640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9af900 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fafec0196d0 tx=0x7fafec0507e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faec37fe640 1 -- 172.21.15.151:0/4162170403 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec0233c0 con 0x55efbc9a9460 2024-09-12T16:52:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efbc9b00f0 con 0x55efbc9a9460 2024-09-12T16:52:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faec37fe640 1 -- 172.21.15.151:0/4162170403 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec023580 con 0x55efbc9a9460 2024-09-12T16:52:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efbc9b0aa0 con 0x55efbc9a9460 2024-09-12T16:52:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.229+0000 7faec37fe640 1 -- 172.21.15.151:0/4162170403 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafec023730 con 0x55efbc9a9460 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faec37fe640 1 -- 172.21.15.151:0/4162170403 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fafec050990 con 0x55efbc9a9460 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faec37fe640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faebc039a70 0x7faebc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faec37fe640 1 -- 172.21.15.151:0/4162170403 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fafec038c80 con 0x55efbc9a9460 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff1de0640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faebc039a70 0x7faebc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc9babd0 0x55efbc9bd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9bd7b0 con 0x55efbc9babd0 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff15df640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc9babd0 0x55efbc9bd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff1de0640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faebc039a70 0x7faebc03bf30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fafe4005c70 tx=0x7fafe402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff15df640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc9babd0 0x55efbc9bd060 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 realm 2024-09-12T16:52:21.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9bdbe0 con 0x55efbc9babd0 2024-09-12T16:52:21.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9be4b0 con 0x55efbc9babd0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9be850 con 0x55efbc9babd0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc9bf5b0 0x55efbc9c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c1ee0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.233+0000 7faff25e1640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc9bf5b0 0x55efbc9c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff25e1640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc9bf5b0 0x55efbc9c19a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafec0083f0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff42da9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:21.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff42da9c0 20 searching for the correct realm 2024-09-12T16:52:21.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55efbc9c3e10 0x55efbc9c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff1de0640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55efbc9c3e10 0x55efbc9c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff1de0640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55efbc9c3e10 0x55efbc9c62d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff1de0640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fafe4011800 0x7fafe40486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x7fafe4011800 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff15df640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fafe4011800 0x7fafe40486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff15df640 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fafe4011800 0x7fafe40486f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.237+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9babd0 2024-09-12T16:52:21.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9babd0 2024-09-12T16:52:21.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x7fafe4011800 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9babd0 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9babd0 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x7fafe4011800 2024-09-12T16:52:21.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.241+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9babd0 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9babd0 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x7fafe4011800 2024-09-12T16:52:21.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.245+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9babd0 2024-09-12T16:52:21.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x7fafe4011800 2024-09-12T16:52:21.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x55efbc9babd0 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c69a0 con 0x7fafe4011800 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff42da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff42da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff42da9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff42da9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff42da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff42da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:21.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.249+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c2830 con 0x55efbc9babd0 2024-09-12T16:52:21.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c2c80 con 0x55efbc9babd0 2024-09-12T16:52:21.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c30a0 con 0x55efbc9babd0 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 zone default found 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 4 Realm: () 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 zonegroup default 2024-09-12T16:52:21.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c30a0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c89c0 con 0x55efbc9c3e10 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c8e90 con 0x55efbc9c3e10 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 started sync module instance, tier type = 2024-09-12T16:52:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:21.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.253+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c7cb0 con 0x7fafe4011800 2024-09-12T16:52:21.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.257+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.257+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94488149918160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c7cb0 con 0x7fafe4011800 2024-09-12T16:52:21.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.257+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c99a0 con 0x55efbc9babd0 2024-09-12T16:52:21.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.257+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94488149918160] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.257+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.257+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94488149922960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c7cb0 con 0x55efbc9babd0 2024-09-12T16:52:21.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.257+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9ca3b0 con 0x55efbc9c3e10 2024-09-12T16:52:21.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94488149922960] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94488149915648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c7c20 con 0x55efbc9c3e10 2024-09-12T16:52:21.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cb0b0 con 0x7fafe4011800 2024-09-12T16:52:21.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94488149929232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cb760 con 0x7fafe4011800 2024-09-12T16:52:21.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cc280 con 0x55efbc9babd0 2024-09-12T16:52:21.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94488149915648] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94488149929232] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94488149933392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cc240 con 0x55efbc9babd0 2024-09-12T16:52:21.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.261+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cc670 con 0x55efbc9bf5b0 2024-09-12T16:52:21.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.265+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94488149933392] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.265+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.265+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94488149927760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cca60 con 0x55efbc9bf5b0 2024-09-12T16:52:21.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.265+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cd420 con 0x55efbc9bf5b0 2024-09-12T16:52:21.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94488149927760] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94488149930416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cd420 con 0x55efbc9bf5b0 2024-09-12T16:52:21.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cdde0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94488149930416] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94488149938512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cdde0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 20 add_watcher() i=0 2024-09-12T16:52:21.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 20 add_watcher() i=1 2024-09-12T16:52:21.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 20 add_watcher() i=2 2024-09-12T16:52:21.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 20 add_watcher() i=3 2024-09-12T16:52:21.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 20 add_watcher() i=4 2024-09-12T16:52:21.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 20 add_watcher() i=5 2024-09-12T16:52:21.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.269+0000 7faff42da9c0 20 add_watcher() i=6 2024-09-12T16:52:21.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94488149938512] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 20 add_watcher() i=7 2024-09-12T16:52:21.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:21.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9d1210 con 0x55efbc9babd0 2024-09-12T16:52:21.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94488149940992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9ce7a0 con 0x55efbc9babd0 2024-09-12T16:52:21.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94488149940992] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faea37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 5 note: GC not initialized 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faea27fc640 20 reqs_thread_entry: start 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 20 Filter name: none 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7fae17fff640 20 reqs_thread_entry: start 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f3fd0 con 0x55efbc9babd0 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:21.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f5550 con 0x7fafe4011800 2024-09-12T16:52:21.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.273+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f5520 con 0x55efbc9bf5b0 2024-09-12T16:52:21.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(64 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:21.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:52:21.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:65 4.3a 4:5d9d5add:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f6fe0 con 0x55efbc9c3e10 2024-09-12T16:52:21.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 4.12 4:495b7da7:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f9950 con 0x55efbc9babd0 2024-09-12T16:52:21.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 4.e 4:71891b96:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9fc620 con 0x7fafe4011800 2024-09-12T16:52:21.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 4.3b 4:dcb0fad2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9ff210 con 0x55efbc9c3e10 2024-09-12T16:52:21.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 4.1 4:81b1f111:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbca01b00 con 0x7fafe4011800 2024-09-12T16:52:21.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 4.12 4:4a346742:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbca04370 con 0x55efbc9babd0 2024-09-12T16:52:21.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 4.31 4:8cce304c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbca06d10 con 0x55efbc9babd0 2024-09-12T16:52:21.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 4.3 4:c37d83ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbca091e0 con 0x55efbc9babd0 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 4.3b 4:dcbe27d2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbca0bac0 con 0x55efbc9c3e10 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:74 4.3d 4:bf8db400:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbca0e7a0 con 0x55efbc9c3e10 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 4.2f 4:f7089978:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbca113a0 con 0x55efbc9babd0 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(66 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(69 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(70 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5 [call out=128b] v0'0 uv4 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(68 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(65 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(74 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(71 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(73 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(72 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(75 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f30c0 con 0x7fafe4011800 2024-09-12T16:52:21.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.277+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f30c0 con 0x7fafe4011800 2024-09-12T16:52:21.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faff42da9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f30c0 con 0x55efbc9babd0 2024-09-12T16:52:21.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faff42da9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:21.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f30c0 con 0x7fafe4011800 2024-09-12T16:52:21.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faea37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.281+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94488149940992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9f30c0 con 0x55efbc9babd0 2024-09-12T16:52:21.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.285+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94488149940992] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.285+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94488149918160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cdad0 con 0x7fafe4011800 2024-09-12T16:52:21.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.285+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94488149918160] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.285+0000 7faff42da9c0 20 remove_watcher() i=0 2024-09-12T16:52:21.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.285+0000 7faff42da9c0 2 removed watcher, disabling cache 2024-09-12T16:52:21.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.285+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94488149922960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c81d0 con 0x55efbc9babd0 2024-09-12T16:52:21.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94488149922960] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff42da9c0 20 remove_watcher() i=1 2024-09-12T16:52:21.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94488149915648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c81d0 con 0x55efbc9c3e10 2024-09-12T16:52:21.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff1de0640 1 -- 172.21.15.151:0/4162170403 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94488149915648] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe400f070 con 0x55efbc9c3e10 2024-09-12T16:52:21.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff42da9c0 20 remove_watcher() i=2 2024-09-12T16:52:21.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94488149929232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c81d0 con 0x7fafe4011800 2024-09-12T16:52:21.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94488149929232] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x7fafe4011800 2024-09-12T16:52:21.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff42da9c0 20 remove_watcher() i=3 2024-09-12T16:52:21.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.289+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94488149933392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c81d0 con 0x55efbc9babd0 2024-09-12T16:52:21.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.293+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94488149933392] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe80a9990 con 0x55efbc9babd0 2024-09-12T16:52:21.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.293+0000 7faff42da9c0 20 remove_watcher() i=4 2024-09-12T16:52:21.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.293+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94488149927760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9cbd50 con 0x55efbc9bf5b0 2024-09-12T16:52:21.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.293+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94488149927760] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.293+0000 7faff42da9c0 20 remove_watcher() i=5 2024-09-12T16:52:21.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.293+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94488149930416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c81d0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94488149930416] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 20 remove_watcher() i=6 2024-09-12T16:52:21.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94488149938512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55efbc9c81d0 con 0x55efbc9bf5b0 2024-09-12T16:52:21.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff25e1640 1 -- 172.21.15.151:0/4162170403 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94488149938512] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafec05c040 con 0x55efbc9bf5b0 2024-09-12T16:52:21.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 20 remove_watcher() i=7 2024-09-12T16:52:21.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc9bf5b0 msgr2=0x55efbc9c19a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc9bf5b0 0x55efbc9c19a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc9babd0 msgr2=0x55efbc9bd060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc9babd0 0x55efbc9bd060 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fafe4011800 msgr2=0x7fafe40486f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fafe4011800 0x7fafe40486f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55efbc9c3e10 msgr2=0x55efbc9c62d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55efbc9c3e10 0x55efbc9c62d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faebc039a70 msgr2=0x7faebc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faebc039a70 0x7faebc03bf30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fafe4005c70 tx=0x7fafe402f000 comp rx=0 tx=0).stop 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff15df640 1 -- 172.21.15.151:0/4162170403 reap_dead start 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 msgr2=0x55efbc9af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.297+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9af900 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fafec0196d0 tx=0x7fafec0507e0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 shutdown_connections 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/4162170403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc9a9460 0x55efbc9af900 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 >> 172.21.15.151:0/4162170403 conn(0x55efbc9a4880 msgr2=0x55efbc9a2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 shutdown_connections 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/4162170403 wait complete. 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/1384708394 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faecc039a70 msgr2=0x7faecc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/1384708394 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faecc039a70 0x7faecc03bf30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55efbc988ac0 tx=0x7fafe4005f10 comp rx=0 tx=0).stop 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/1384708394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc99ba90 msgr2=0x55efbc99beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/1384708394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc99ba90 0x55efbc99beb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55efbc981d30 tx=0x7fafec00aed0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/1384708394 shutdown_connections 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/1384708394 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faecc039a70 0x7faecc03bf30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/1384708394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc99ba90 0x55efbc99beb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/1384708394 >> 172.21.15.151:0/1384708394 conn(0x55efbc991440 msgr2=0x55efbc991820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/1384708394 shutdown_connections 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/1384708394 wait complete. 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc98a950 msgr2=0x55efbc98cd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc98a950 0x55efbc98cd40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc892340 msgr2=0x55efbc988120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc892340 0x55efbc988120 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faed8039c10 msgr2=0x7faed803c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faed8039c10 0x7faed803c0d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fafe80ad000 tx=0x7fafe80a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 msgr2=0x55efbc980fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc980fb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55efbc97a870 tx=0x7fafe4000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 shutdown_connections 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55efbc98a950 0x55efbc98cd40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55efbc892340 0x55efbc988120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7faed8039c10 0x7faed803c0d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 --2- 172.21.15.151:0/625581061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efbc88e1f0 0x55efbc980fb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 >> 172.21.15.151:0/625581061 conn(0x55efbc801b00 msgr2=0x55efbc973fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 shutdown_connections 2024-09-12T16:52:21.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.301+0000 7faff42da9c0 1 -- 172.21.15.151:0/625581061 wait complete. 2024-09-12T16:52:21.314 INFO:teuthology.orchestra.run.smithi151.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-12T16:52:21.282114Z","last_stats_update":"2024-09-12T16:52:21.280018Z"} 2024-09-12T16:52:21.314 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-12T16:52:21.282114Z', 'last_stats_update': '2024-09-12T16:52:21.280018Z'} 2024-09-12T16:52:21.323 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:21.323 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-12T16:52:21.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-12T16:52:21.323 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-12T16:52:21.399 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:21.399 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:21.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a486a9c0 1 Processor -- start 2024-09-12T16:52:21.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a486a9c0 1 -- start start 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a486a9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559412884a10 0x559412915070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a486a9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594127c49c0 con 0x559412884df0 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a486a9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5594128146d0 con 0x559412884a10 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a2370640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559412884a10 0x559412915070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a1b6f640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x559412884df0 0x5594129175c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42600/0 (socket says 172.21.15.151:42600) 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a2370640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559412884a10 0x559412915070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33486/0 (socket says 172.21.15.151:33486) 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a1b6f640 1 -- 172.21.15.151:0/2306354312 learned_addr learned my addr 172.21.15.151:0/2306354312 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a2370640 1 -- 172.21.15.151:0/2306354312 >> v1:172.21.15.122:6789/0 conn(0x559412884df0 legacy=0x5594129175c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a2370640 1 -- 172.21.15.151:0/2306354312 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594127b8ca0 con 0x559412884a10 2024-09-12T16:52:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.397+0000 7f37a136e640 1 -- 172.21.15.151:0/2306354312 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971602801 0 0) 0x5594127c49c0 con 0x559412884df0 2024-09-12T16:52:21.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a2370640 1 --2- 172.21.15.151:0/2306354312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412915070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f378c00a480 tx=0x7f378c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b469cbd049e36205 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a136e640 1 -- 172.21.15.151:0/2306354312 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c0b0070 con 0x559412884a10 2024-09-12T16:52:21.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a136e640 1 -- 172.21.15.151:0/2306354312 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c0ab540 con 0x559412884a10 2024-09-12T16:52:21.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a136e640 1 -- 172.21.15.151:0/2306354312 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c0ab840 con 0x559412884a10 2024-09-12T16:52:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2306354312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 msgr2=0x559412915070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2306354312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412915070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f378c00a480 tx=0x7f378c01b280 comp rx=0 tx=0).stop 2024-09-12T16:52:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2306354312 shutdown_connections 2024-09-12T16:52:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2306354312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412915070 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2306354312 >> 172.21.15.151:0/2306354312 conn(0x55941290a960 msgr2=0x55941290cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2306354312 shutdown_connections 2024-09-12T16:52:21.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.401+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2306354312 wait complete. 2024-09-12T16:52:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a486a9c0 1 Processor -- start 2024-09-12T16:52:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a486a9c0 1 -- start start 2024-09-12T16:52:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a486a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x5594129fd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a486a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559412818680 con 0x559412884a10 2024-09-12T16:52:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a2370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x5594129fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a2370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x5594129fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33502/0 (socket says 172.21.15.151:33502) 2024-09-12T16:52:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a2370640 1 -- 172.21.15.151:0/1220873542 learned_addr learned my addr 172.21.15.151:0/1220873542 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a2370640 1 -- 172.21.15.151:0/1220873542 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559412793da0 con 0x559412884a10 2024-09-12T16:52:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.417+0000 7f37a2370640 1 --2- 172.21.15.151:0/1220873542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x5594129fd700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f378c017e90 tx=0x7f378c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b600eaf31646f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f3690608640 1 -- 172.21.15.151:0/1220873542 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c0bb070 con 0x559412884a10 2024-09-12T16:52:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f3690608640 1 -- 172.21.15.151:0/1220873542 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c00a1f0 con 0x559412884a10 2024-09-12T16:52:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f3690608640 1 -- 172.21.15.151:0/1220873542 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c0b0040 con 0x559412884a10 2024-09-12T16:52:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1220873542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 msgr2=0x5594129fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1220873542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x5594129fd700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f378c017e90 tx=0x7f378c003030 comp rx=0 tx=0).stop 2024-09-12T16:52:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1220873542 shutdown_connections 2024-09-12T16:52:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1220873542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x5594129fd700 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1220873542 >> 172.21.15.151:0/1220873542 conn(0x55941290a960 msgr2=0x5594129f9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1220873542 shutdown_connections 2024-09-12T16:52:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1220873542 wait complete. 2024-09-12T16:52:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 Processor -- start 2024-09-12T16:52:21.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- start start 2024-09-12T16:52:21.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412a04cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5594127baa50 con 0x559412884a10 2024-09-12T16:52:21.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a2370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412a04cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a2370640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412a04cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33512/0 (socket says 172.21.15.151:33512) 2024-09-12T16:52:21.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a2370640 1 -- 172.21.15.151:0/2709809833 learned_addr learned my addr 172.21.15.151:0/2709809833 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a2370640 1 -- 172.21.15.151:0/2709809833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559412a05220 con 0x559412884a10 2024-09-12T16:52:21.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a2370640 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412a04cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f378c000c10 tx=0x7f378c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f368ee05640 1 -- 172.21.15.151:0/2709809833 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c0b0070 con 0x559412884a10 2024-09-12T16:52:21.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559412a054b0 con 0x559412884a10 2024-09-12T16:52:21.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f368ee05640 1 -- 172.21.15.151:0/2709809833 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c00a2b0 con 0x559412884a10 2024-09-12T16:52:21.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f368ee05640 1 -- 172.21.15.151:0/2709809833 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c0bb040 con 0x559412884a10 2024-09-12T16:52:21.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.421+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559412a05e60 con 0x559412884a10 2024-09-12T16:52:21.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f368ee05640 1 -- 172.21.15.151:0/2709809833 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f378c0c7020 con 0x559412884a10 2024-09-12T16:52:21.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f368ee05640 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3688039a70 0x7f368803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f368ee05640 1 -- 172.21.15.151:0/2709809833 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f378c0c5020 con 0x559412884a10 2024-09-12T16:52:21.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a1b6f640 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3688039a70 0x7f368803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412884df0 0x559412a0be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a0c370 con 0x559412884df0 2024-09-12T16:52:21.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a2b71640 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412884df0 0x559412a0be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a1b6f640 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3688039a70 0x7f368803bf30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3794000c10 tx=0x7f37940013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a2b71640 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412884df0 0x559412a0be30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a2b71640 1 -- 172.21.15.151:0/2709809833 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f379c00a4d0 con 0x559412884df0 2024-09-12T16:52:21.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a061c0 con 0x559412884df0 2024-09-12T16:52:21.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a2b71640 1 -- 172.21.15.151:0/2709809833 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f379c00a4d0 con 0x559412884df0 2024-09-12T16:52:21.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a0e5e0 0x559412a109d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a110a0 con 0x559412a0e5e0 2024-09-12T16:52:21.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a2370640 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a0e5e0 0x559412a109d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.425+0000 7f37a2370640 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a0e5e0 0x559412a109d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a2370640 1 -- 172.21.15.151:0/2709809833 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f378c0be040 con 0x559412a0e5e0 2024-09-12T16:52:21.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a0d4b0 con 0x559412884df0 2024-09-12T16:52:21.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a2b71640 1 -- 172.21.15.151:0/2709809833 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f379c00a4d0 con 0x559412884df0 2024-09-12T16:52:21.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a0d8d0 con 0x559412884df0 2024-09-12T16:52:21.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a2b71640 1 -- 172.21.15.151:0/2709809833 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f379c00a4d0 con 0x559412884df0 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a486a9c0 1 Processor -- start 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a486a9c0 1 -- start start 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a486a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a1f6d0 0x559412a1faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a486a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559412825450 con 0x559412a1f6d0 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a2b71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a1f6d0 0x559412a1faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a2b71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a1f6d0 0x559412a1faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33514/0 (socket says 172.21.15.151:33514) 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a2b71640 1 -- 172.21.15.151:0/2996128314 learned_addr learned my addr 172.21.15.151:0/2996128314 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a2b71640 1 -- 172.21.15.151:0/2996128314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559412a20130 con 0x559412a1f6d0 2024-09-12T16:52:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a2b71640 1 --2- 172.21.15.151:0/2996128314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a1f6d0 0x559412a1faf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x559412a06e00 tx=0x7f379c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f3687fff640 1 -- 172.21.15.151:0/2996128314 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f379c014450 con 0x559412a1f6d0 2024-09-12T16:52:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f3687fff640 1 -- 172.21.15.151:0/2996128314 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f379c0145f0 con 0x559412a1f6d0 2024-09-12T16:52:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f3687fff640 1 -- 172.21.15.151:0/2996128314 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f379c014910 con 0x559412a1f6d0 2024-09-12T16:52:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2996128314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559412a20990 con 0x559412a1f6d0 2024-09-12T16:52:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.429+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2996128314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559412a20f00 con 0x559412a1f6d0 2024-09-12T16:52:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f3687fff640 1 -- 172.21.15.151:0/2996128314 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f379c011040 con 0x559412a1f6d0 2024-09-12T16:52:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f3687fff640 1 --2- 172.21.15.151:0/2996128314 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f367c039ac0 0x7f367c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f3687fff640 1 -- 172.21.15.151:0/2996128314 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f379c01e070 con 0x559412a1f6d0 2024-09-12T16:52:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a2370640 1 --2- 172.21.15.151:0/2996128314 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f367c039ac0 0x7f367c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 Processor -- start 2024-09-12T16:52:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 -- start start 2024-09-12T16:52:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a2370640 1 --2- 172.21.15.151:0/2996128314 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f367c039ac0 0x7f367c03bf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x559412a0c780 tx=0x7f378c0c1f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a2d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5594129fde90 con 0x559412a2d000 2024-09-12T16:52:21.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a2b71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a2d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a2b71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a2d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33526/0 (socket says 172.21.15.151:33526) 2024-09-12T16:52:21.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a2b71640 1 -- 172.21.15.151:0/2035699675 learned_addr learned my addr 172.21.15.151:0/2035699675 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a2b71640 1 -- 172.21.15.151:0/2035699675 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559412a2d9d0 con 0x559412a2d000 2024-09-12T16:52:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a2b71640 1 --2- 172.21.15.151:0/2035699675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a2d3e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f379c018430 tx=0x7f379c016c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dace8c24f1898e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f3685ffb640 1 -- 172.21.15.151:0/2035699675 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f379c028070 con 0x559412a2d000 2024-09-12T16:52:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f3685ffb640 1 -- 172.21.15.151:0/2035699675 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f379c0520d0 con 0x559412a2d000 2024-09-12T16:52:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f3685ffb640 1 -- 172.21.15.151:0/2035699675 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f379c0167c0 con 0x559412a2d000 2024-09-12T16:52:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2035699675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 msgr2=0x559412a2d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2035699675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a2d3e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f379c018430 tx=0x7f379c016c80 comp rx=0 tx=0).stop 2024-09-12T16:52:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2035699675 shutdown_connections 2024-09-12T16:52:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2035699675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a2d3e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.433+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2035699675 >> 172.21.15.151:0/2035699675 conn(0x559412a283c0 msgr2=0x559412a26600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2035699675 shutdown_connections 2024-09-12T16:52:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2035699675 wait complete. 2024-09-12T16:52:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a486a9c0 1 Processor -- start 2024-09-12T16:52:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a486a9c0 1 -- start start 2024-09-12T16:52:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a486a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a334c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a486a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559412a2bef0 con 0x559412a2d000 2024-09-12T16:52:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a2b71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a2b71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a334c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33540/0 (socket says 172.21.15.151:33540) 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 learned_addr learned my addr 172.21.15.151:0/1552476810 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559412a33a20 con 0x559412a2d000 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a2b71640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a334c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f379c018430 tx=0x7f379c0506b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f3673fff640 1 -- 172.21.15.151:0/1552476810 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f379c032030 con 0x559412a2d000 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559412a33cb0 con 0x559412a2d000 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f3673fff640 1 -- 172.21.15.151:0/1552476810 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f379c0520d0 con 0x559412a2d000 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f3673fff640 1 -- 172.21.15.151:0/1552476810 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f379c050860 con 0x559412a2d000 2024-09-12T16:52:21.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559412a34660 con 0x559412a2d000 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f3673fff640 1 -- 172.21.15.151:0/1552476810 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f379c035070 con 0x559412a2d000 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f3673fff640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f366c039a70 0x7f366c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.437+0000 7f3673fff640 1 -- 172.21.15.151:0/1552476810 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f379c033070 con 0x559412a2d000 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a2370640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f366c039a70 0x7f366c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412a3e980 0x559412a40e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a41590 con 0x559412a3e980 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a1b6f640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412a3e980 0x559412a40e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a2370640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f366c039a70 0x7f366c03bf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f378c01b0b0 tx=0x7f378c0d9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a1b6f640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412a3e980 0x559412a40e40 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f379400f600 con 0x559412a3e980 2024-09-12T16:52:21.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 realm 2024-09-12T16:52:21.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a3dcd0 con 0x559412a3e980 2024-09-12T16:52:21.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f379400f600 con 0x559412a3e980 2024-09-12T16:52:21.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:21.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a42090 con 0x559412a3e980 2024-09-12T16:52:21.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f379400f600 con 0x559412a3e980 2024-09-12T16:52:21.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a42960 con 0x559412a3e980 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f379400f600 con 0x559412a3e980 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a43380 0x559412a45770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a45ee0 con 0x559412a43380 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a2b71640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a43380 0x559412a45770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a2b71640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a43380 0x559412a45770 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.441+0000 7f37a486a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:21.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a486a9c0 20 searching for the correct realm 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559412a47e30 0x559412a4a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x559412a47e30 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2370640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559412a47e30 0x559412a4a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2370640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559412a47e30 0x559412a4a260 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2370640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f378c0ab030 0x7f378c0bf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x7f378c0ab030 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a1b6f640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f378c0ab030 0x7f378c0bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a1b6f640 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f378c0ab030 0x7f378c0bf370 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379400f600 con 0x7f378c0ab030 2024-09-12T16:52:21.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x559412a43380 2024-09-12T16:52:21.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x559412a3e980 2024-09-12T16:52:21.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379400f600 con 0x559412a3e980 2024-09-12T16:52:21.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x559412a3e980 2024-09-12T16:52:21.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x559412a43380 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.445+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x559412a43380 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x7f378c0ab030 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559412a4a8e0 con 0x559412a47e30 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a3e980 2024-09-12T16:52:21.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a43380 2024-09-12T16:52:21.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a3e980 2024-09-12T16:52:21.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x7f378c0ab030 2024-09-12T16:52:21.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a47e30 2024-09-12T16:52:21.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a47e30 2024-09-12T16:52:21.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a43380 2024-09-12T16:52:21.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a47e30 2024-09-12T16:52:21.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.449+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a47e30 2024-09-12T16:52:21.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a3e980 2024-09-12T16:52:21.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a3e980 2024-09-12T16:52:21.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a43380 2024-09-12T16:52:21.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a47e30 2024-09-12T16:52:21.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x7f378c0ab030 2024-09-12T16:52:21.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a3e980 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a43380 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a47e30 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.453+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a43380 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x7f378c0ab030 2024-09-12T16:52:21.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a47e30 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a43380 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x559412a3e980 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f378c0f8040 con 0x7f378c0ab030 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:21.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a468a0 con 0x559412a3e980 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a464e0 con 0x559412a3e980 2024-09-12T16:52:21.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a47280 con 0x559412a3e980 2024-09-12T16:52:21.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 zone default found 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 4 Realm: () 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 zonegroup default 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a4ad60 con 0x559412a43380 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.457+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a4cfa0 con 0x559412a47e30 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a4d340 con 0x559412a47e30 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 20 started sync module instance, tier type = 2024-09-12T16:52:21.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4c3e0 con 0x7f378c0ab030 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94094456309712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4c3e0 con 0x7f378c0ab030 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4dc00 con 0x559412a3e980 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.461+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94094456309712] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94094456307504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4dc00 con 0x559412a3e980 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4e450 con 0x559412a47e30 2024-09-12T16:52:21.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94094456315152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4e7c0 con 0x559412a47e30 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4f2c0 con 0x7f378c0ab030 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94094456307504] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94094456319408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4f280 con 0x7f378c0ab030 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4fc80 con 0x559412a3e980 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.465+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94094456315152] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.469+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94094456319408] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.469+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.469+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94094456313680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4f790 con 0x559412a3e980 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.469+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a50520 con 0x559412a43380 2024-09-12T16:52:21.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.469+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94094456313680] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.469+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.469+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94094456324208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4f790 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.469+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a50d70 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94094456326336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a511d0 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a51cf0 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94094456324208] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94094456326336] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94094456330176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a50ce0 con 0x559412a43380 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 20 add_watcher() i=0 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 20 add_watcher() i=1 2024-09-12T16:52:21.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 20 add_watcher() i=2 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 20 add_watcher() i=3 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 20 add_watcher() i=4 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 20 add_watcher() i=5 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.473+0000 7f37a486a9c0 20 add_watcher() i=6 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94094456330176] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a486a9c0 20 add_watcher() i=7 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a486a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a54ce0 con 0x559412a3e980 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94094456316432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a52160 con 0x559412a3e980 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94094456316432] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f3658fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a486a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a486a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.477+0000 7f37a486a9c0 5 note: GC not initialized 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f35d37fe640 20 reqs_thread_entry: start 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 20 Filter name: none 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f35d17fa640 20 reqs_thread_entry: start 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a77df0 con 0x559412a3e980 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:21.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a79ee0 con 0x7f378c0ab030 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:21.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a7b760 con 0x559412a43380 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(64 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:21.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T16:52:21.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.481+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a7e960 con 0x7f378c0ab030 2024-09-12T16:52:21.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-12T16:52:21.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a7da70 con 0x7f378c0ab030 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a7e4e0 con 0x7f378c0ab030 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.485+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94094456512432 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559412a7e4b0 con 0x559412a43380 2024-09-12T16:52:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== watch-notify(notify (1) cookie 94094456326336 notify 137438953473 ret 0) ==== 380+0+0 (crc 0 0 0) 0x559412a7ac80 con 0x559412a43380 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f3685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94094456326336 notifier 4481 bl.length()=338 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(68 notify.6 [notify cookie 94094456512432 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f3685ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f3685ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f3685ffb640 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3668003eb0 con 0x559412a43380 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== watch-notify(notify_complete (2) cookie 94094456512432 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559412a33cb0 con 0x559412a43380 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f3658fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94094456316432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a7e460 con 0x559412a3e980 2024-09-12T16:52:21.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94094456316432] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.489+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94094456309712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4e210 con 0x7f378c0ab030 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.493+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94094456309712] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.493+0000 7f37a486a9c0 20 remove_watcher() i=0 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.493+0000 7f37a486a9c0 2 removed watcher, disabling cache 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.493+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94094456307504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4c7d0 con 0x559412a3e980 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.493+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94094456307504] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.493+0000 7f37a486a9c0 20 remove_watcher() i=1 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.493+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94094456315152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4e210 con 0x559412a47e30 2024-09-12T16:52:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.497+0000 7f37a2370640 1 -- 172.21.15.151:0/1552476810 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94094456315152] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f378c0df040 con 0x559412a47e30 2024-09-12T16:52:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.497+0000 7f37a486a9c0 20 remove_watcher() i=2 2024-09-12T16:52:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.497+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94094456319408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4c7d0 con 0x7f378c0ab030 2024-09-12T16:52:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.497+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94094456319408] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x7f378c0ab030 2024-09-12T16:52:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.497+0000 7f37a486a9c0 20 remove_watcher() i=3 2024-09-12T16:52:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.497+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94094456313680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4edb0 con 0x559412a3e980 2024-09-12T16:52:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.501+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94094456313680] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379402b040 con 0x559412a3e980 2024-09-12T16:52:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.501+0000 7f37a486a9c0 20 remove_watcher() i=4 2024-09-12T16:52:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.501+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94094456324208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4c7d0 con 0x559412a43380 2024-09-12T16:52:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.501+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94094456324208] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.501+0000 7f37a486a9c0 20 remove_watcher() i=5 2024-09-12T16:52:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.501+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94094456326336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4d750 con 0x559412a43380 2024-09-12T16:52:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94094456326336] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 20 remove_watcher() i=6 2024-09-12T16:52:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94094456330176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559412a4edb0 con 0x559412a43380 2024-09-12T16:52:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a2b71640 1 -- 172.21.15.151:0/1552476810 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94094456330176] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f379c02a070 con 0x559412a43380 2024-09-12T16:52:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 20 remove_watcher() i=7 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a43380 msgr2=0x559412a45770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a43380 0x559412a45770 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412a3e980 msgr2=0x559412a40e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412a3e980 0x559412a40e40 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f378c0ab030 msgr2=0x7f378c0bf370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f378c0ab030 0x7f378c0bf370 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559412a47e30 msgr2=0x559412a4a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559412a47e30 0x559412a4a260 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f366c039a70 msgr2=0x7f366c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f366c039a70 0x7f366c03bf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f378c01b0b0 tx=0x7f378c0d9000 comp rx=0 tx=0).stop 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 msgr2=0x559412a334c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a1b6f640 1 -- 172.21.15.151:0/1552476810 reap_dead start 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a334c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f379c018430 tx=0x7f379c0506b0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 shutdown_connections 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/1552476810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a2d000 0x559412a334c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.505+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 >> 172.21.15.151:0/1552476810 conn(0x559412a283c0 msgr2=0x559412a265d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 shutdown_connections 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/1552476810 wait complete. 2024-09-12T16:52:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2996128314 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f367c039ac0 msgr2=0x7f367c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2996128314 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f367c039ac0 0x7f367c03bf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x559412a0c780 tx=0x7f378c0c1f60 comp rx=0 tx=0).stop 2024-09-12T16:52:21.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2996128314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a1f6d0 msgr2=0x559412a1faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2996128314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a1f6d0 0x559412a1faf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x559412a06e00 tx=0x7f379c018830 comp rx=0 tx=0).stop 2024-09-12T16:52:21.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2996128314 shutdown_connections 2024-09-12T16:52:21.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2996128314 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f367c039ac0 0x7f367c03bf80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2996128314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412a1f6d0 0x559412a1faf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2996128314 >> 172.21.15.151:0/2996128314 conn(0x559412a15080 msgr2=0x559412a15460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2996128314 shutdown_connections 2024-09-12T16:52:21.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2996128314 wait complete. 2024-09-12T16:52:21.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a0e5e0 msgr2=0x559412a109d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a0e5e0 0x559412a109d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412884df0 msgr2=0x559412a0be30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412884df0 0x559412a0be30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3688039a70 msgr2=0x7f368803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3688039a70 0x7f368803bf30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3794000c10 tx=0x7f37940013c0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 msgr2=0x559412a04cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412a04cc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f378c000c10 tx=0x7f378c018020 comp rx=0 tx=0).stop 2024-09-12T16:52:21.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 shutdown_connections 2024-09-12T16:52:21.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559412a0e5e0 0x559412a109d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559412884df0 0x559412a0be30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3688039a70 0x7f368803bf30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 --2- 172.21.15.151:0/2709809833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559412884a10 0x559412a04cc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 >> 172.21.15.151:0/2709809833 conn(0x55941290a960 msgr2=0x5594129f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 shutdown_connections 2024-09-12T16:52:21.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.509+0000 7f37a486a9c0 1 -- 172.21.15.151:0/2709809833 wait complete. 2024-09-12T16:52:21.523 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T16:52:21.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T16:52:21.524 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-12T16:52:21.612 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:21.613 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:21.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.609+0000 7f94dc7359c0 1 Processor -- start 2024-09-12T16:52:21.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.609+0000 7f94dc7359c0 1 -- start start 2024-09-12T16:52:21.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94dc7359c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563396636010 0x563396638400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94dc7359c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5633964e79c0 con 0x563396631e20 2024-09-12T16:52:21.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94dc7359c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5633965376d0 con 0x563396636010 2024-09-12T16:52:21.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9a3a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563396636010 0x563396638400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9a3a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563396636010 0x563396638400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33542/0 (socket says 172.21.15.151:33542) 2024-09-12T16:52:21.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9a3a640 1 -- 172.21.15.151:0/308341356 learned_addr learned my addr 172.21.15.151:0/308341356 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9a3a640 1 -- 172.21.15.151:0/308341356 >> v1:172.21.15.122:6789/0 conn(0x563396631e20 legacy=0x563396632200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9a3a640 1 -- 172.21.15.151:0/308341356 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633964dbca0 con 0x563396636010 2024-09-12T16:52:21.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9a3a640 1 --2- 172.21.15.151:0/308341356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396636010 0x563396638400 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f94c400a5c0 tx=0x7f94c401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9658ef7af8439051 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9239640 1 -- 172.21.15.151:0/308341356 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94c40a9590 con 0x563396636010 2024-09-12T16:52:21.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9239640 1 -- 172.21.15.151:0/308341356 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c40ae070 con 0x563396636010 2024-09-12T16:52:21.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.613+0000 7f94d9239640 1 -- 172.21.15.151:0/308341356 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94c40a9880 con 0x563396636010 2024-09-12T16:52:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.617+0000 7f94dc7359c0 1 -- 172.21.15.151:0/308341356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396636010 msgr2=0x563396638400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.617+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/308341356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396636010 0x563396638400 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f94c400a5c0 tx=0x7f94c401b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.617+0000 7f94dc7359c0 1 -- 172.21.15.151:0/308341356 shutdown_connections 2024-09-12T16:52:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.617+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/308341356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396636010 0x563396638400 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.617+0000 7f94dc7359c0 1 -- 172.21.15.151:0/308341356 >> 172.21.15.151:0/308341356 conn(0x56339662d940 msgr2=0x56339662fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.617+0000 7f94dc7359c0 1 -- 172.21.15.151:0/308341356 shutdown_connections 2024-09-12T16:52:21.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.617+0000 7f94dc7359c0 1 -- 172.21.15.151:0/308341356 wait complete. 2024-09-12T16:52:21.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.629+0000 7f94dc7359c0 1 Processor -- start 2024-09-12T16:52:21.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.629+0000 7f94dc7359c0 1 -- start start 2024-09-12T16:52:21.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.629+0000 7f94dc7359c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x5633965a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.629+0000 7f94dc7359c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56339653b680 con 0x563396631e20 2024-09-12T16:52:21.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.629+0000 7f94da23b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x5633965a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x5633965a6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33562/0 (socket says 172.21.15.151:33562) 2024-09-12T16:52:21.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 -- 172.21.15.151:0/194090049 learned_addr learned my addr 172.21.15.151:0/194090049 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 -- 172.21.15.151:0/194090049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633964b6da0 con 0x563396631e20 2024-09-12T16:52:21.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 --2- 172.21.15.151:0/194090049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x5633965a6d70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94d400b220 tx=0x7f94d400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7fa7c1dbc2a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f93c8608640 1 -- 172.21.15.151:0/194090049 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d400a040 con 0x563396631e20 2024-09-12T16:52:21.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f93c8608640 1 -- 172.21.15.151:0/194090049 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d400f750 con 0x563396631e20 2024-09-12T16:52:21.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f93c8608640 1 -- 172.21.15.151:0/194090049 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d400fa70 con 0x563396631e20 2024-09-12T16:52:21.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 -- 172.21.15.151:0/194090049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 msgr2=0x5633965a6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/194090049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x5633965a6d70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94d400b220 tx=0x7f94d400b6e0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 -- 172.21.15.151:0/194090049 shutdown_connections 2024-09-12T16:52:21.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/194090049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x5633965a6d70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 -- 172.21.15.151:0/194090049 >> 172.21.15.151:0/194090049 conn(0x56339662d940 msgr2=0x563396719300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 -- 172.21.15.151:0/194090049 shutdown_connections 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 -- 172.21.15.151:0/194090049 wait complete. 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 Processor -- start 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 -- start start 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x563396725e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94dc7359c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5633964dda50 con 0x563396631e20 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x563396725e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x563396725e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33564/0 (socket says 172.21.15.151:33564) 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 -- 172.21.15.151:0/497074123 learned_addr learned my addr 172.21.15.151:0/497074123 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 -- 172.21.15.151:0/497074123 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633967263f0 con 0x563396631e20 2024-09-12T16:52:21.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f94da23b640 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x563396725e90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x56339671f750 tx=0x7f94d4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.633+0000 7f93c6e05640 1 -- 172.21.15.151:0/497074123 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d401a880 con 0x563396631e20 2024-09-12T16:52:21.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563396726680 con 0x563396631e20 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f93c6e05640 1 -- 172.21.15.151:0/497074123 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d401aa20 con 0x563396631e20 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f93c6e05640 1 -- 172.21.15.151:0/497074123 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d401ad00 con 0x563396631e20 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563396727030 con 0x563396631e20 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f93c6e05640 1 -- 172.21.15.151:0/497074123 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f94d4017050 con 0x563396631e20 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f93c6e05640 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93c0039a70 0x7f93c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f93c6e05640 1 -- 172.21.15.151:0/497074123 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f94d4015020 con 0x563396631e20 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94d9a3a640 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93c0039a70 0x7f93c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396636010 0x56339672d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339672d540 con 0x563396636010 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94daa3c640 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396636010 0x56339672d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94d9a3a640 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93c0039a70 0x7f93c003bf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94c40ad000 tx=0x7f94c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94daa3c640 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396636010 0x56339672d000 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94daa3c640 1 -- 172.21.15.151:0/497074123 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94cc00a4d0 con 0x563396636010 2024-09-12T16:52:21.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339672d960 con 0x563396636010 2024-09-12T16:52:21.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94daa3c640 1 -- 172.21.15.151:0/497074123 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94cc00a4d0 con 0x563396636010 2024-09-12T16:52:21.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56339672f770 0x563396731b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563396732250 con 0x56339672f770 2024-09-12T16:52:21.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.637+0000 7f94da23b640 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56339672f770 0x563396731b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94da23b640 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56339672f770 0x563396731b60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94da23b640 1 -- 172.21.15.151:0/497074123 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94d402e070 con 0x56339672f770 2024-09-12T16:52:21.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339672e610 con 0x563396636010 2024-09-12T16:52:21.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94daa3c640 1 -- 172.21.15.151:0/497074123 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94cc00a4d0 con 0x563396636010 2024-09-12T16:52:21.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339672eab0 con 0x563396636010 2024-09-12T16:52:21.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94daa3c640 1 -- 172.21.15.151:0/497074123 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94cc00a4d0 con 0x563396636010 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94dc7359c0 1 Processor -- start 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94dc7359c0 1 -- start start 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94dc7359c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56339671ecb0 0x56339671d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94dc7359c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563396548450 con 0x56339671ecb0 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94daa3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56339671ecb0 0x56339671d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94daa3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56339671ecb0 0x56339671d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33570/0 (socket says 172.21.15.151:33570) 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94daa3c640 1 -- 172.21.15.151:0/2380750320 learned_addr learned my addr 172.21.15.151:0/2380750320 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94daa3c640 1 -- 172.21.15.151:0/2380750320 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56339671f1d0 con 0x56339671ecb0 2024-09-12T16:52:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94daa3c640 1 --2- 172.21.15.151:0/2380750320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56339671ecb0 0x56339671d550 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x563396727250 tx=0x7f94cc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f93bffff640 1 -- 172.21.15.151:0/2380750320 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94cc014450 con 0x56339671ecb0 2024-09-12T16:52:21.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f93bffff640 1 -- 172.21.15.151:0/2380750320 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94cc014610 con 0x56339671ecb0 2024-09-12T16:52:21.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2380750320 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56339671da90 con 0x56339671ecb0 2024-09-12T16:52:21.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.641+0000 7f93bffff640 1 -- 172.21.15.151:0/2380750320 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94cc014930 con 0x56339671ecb0 2024-09-12T16:52:21.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2380750320 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56339671e000 con 0x56339671ecb0 2024-09-12T16:52:21.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f93bffff640 1 -- 172.21.15.151:0/2380750320 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f94cc011040 con 0x56339671ecb0 2024-09-12T16:52:21.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f93bffff640 1 --2- 172.21.15.151:0/2380750320 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93b4039a70 0x7f93b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f93bffff640 1 -- 172.21.15.151:0/2380750320 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f94cc01e070 con 0x56339671ecb0 2024-09-12T16:52:21.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94da23b640 1 --2- 172.21.15.151:0/2380750320 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93b4039a70 0x7f93b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94dc7359c0 1 Processor -- start 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94dc7359c0 1 -- start start 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94da23b640 1 --2- 172.21.15.151:0/2380750320 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93b4039a70 0x7f93b403bf30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x563396727350 tx=0x7f94d404ebf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94dc7359c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x563396750860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94dc7359c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5633965a75c0 con 0x563396750480 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94daa3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x563396750860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94daa3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x563396750860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33580/0 (socket says 172.21.15.151:33580) 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94daa3c640 1 -- 172.21.15.151:0/2349558069 learned_addr learned my addr 172.21.15.151:0/2349558069 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94daa3c640 1 -- 172.21.15.151:0/2349558069 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563396750e50 con 0x563396750480 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f94daa3c640 1 --2- 172.21.15.151:0/2349558069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x563396750860 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f94cc050670 tx=0x7f94cc011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2eeec805c189151 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f93bdffb640 1 -- 172.21.15.151:0/2349558069 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94cc016440 con 0x563396750480 2024-09-12T16:52:21.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f93bdffb640 1 -- 172.21.15.151:0/2349558069 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94cc0165e0 con 0x563396750480 2024-09-12T16:52:21.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.645+0000 7f93bdffb640 1 -- 172.21.15.151:0/2349558069 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94cc043220 con 0x563396750480 2024-09-12T16:52:21.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2349558069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 msgr2=0x563396750860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/2349558069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x563396750860 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f94cc050670 tx=0x7f94cc011e40 comp rx=0 tx=0).stop 2024-09-12T16:52:21.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2349558069 shutdown_connections 2024-09-12T16:52:21.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/2349558069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x563396750860 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2349558069 >> 172.21.15.151:0/2349558069 conn(0x56339674b840 msgr2=0x563396749a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2349558069 shutdown_connections 2024-09-12T16:52:21.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2349558069 wait complete. 2024-09-12T16:52:21.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 Processor -- start 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- start start 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x5633967568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56339674f370 con 0x563396750480 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94daa3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x5633967568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94daa3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x5633967568d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33596/0 (socket says 172.21.15.151:33596) 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 learned_addr learned my addr 172.21.15.151:0/973771859 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563396756e30 con 0x563396750480 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94daa3c640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x5633967568d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f94cc04b010 tx=0x7f94cc0505d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f93abfff640 1 -- 172.21.15.151:0/973771859 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94cc04f2a0 con 0x563396750480 2024-09-12T16:52:21.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633967570c0 con 0x563396750480 2024-09-12T16:52:21.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f93abfff640 1 -- 172.21.15.151:0/973771859 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94cc031030 con 0x563396750480 2024-09-12T16:52:21.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563396757a70 con 0x563396750480 2024-09-12T16:52:21.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f93abfff640 1 -- 172.21.15.151:0/973771859 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94cc03b060 con 0x563396750480 2024-09-12T16:52:21.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.649+0000 7f93abfff640 1 -- 172.21.15.151:0/973771859 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f94cc03e350 con 0x563396750480 2024-09-12T16:52:21.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f93abfff640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93a4039c10 0x7f93a403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f93abfff640 1 -- 172.21.15.151:0/973771859 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f94cc00e040 con 0x563396750480 2024-09-12T16:52:21.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94da23b640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93a4039c10 0x7f93a403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396761bb0 0x563396764070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5633967647c0 con 0x563396761bb0 2024-09-12T16:52:21.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94d9a3a640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396761bb0 0x563396764070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94da23b640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93a4039c10 0x7f93a403c0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94d404ef80 tx=0x7f94d4035000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94d9a3a640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396761bb0 0x563396764070 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 realm 2024-09-12T16:52:21.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563396764bf0 con 0x563396761bb0 2024-09-12T16:52:21.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:21.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5633967654c0 con 0x563396761bb0 2024-09-12T16:52:21.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563396765860 con 0x563396761bb0 2024-09-12T16:52:21.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5633967665c0 0x5633967689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563396768fc0 con 0x5633967665c0 2024-09-12T16:52:21.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94daa3c640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5633967665c0 0x5633967689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94daa3c640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5633967665c0 0x5633967689b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 20 searching for the correct realm 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56339676af10 0x56339676d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.653+0000 7f94da23b640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56339676af10 0x56339676d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94da23b640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56339676af10 0x56339676d320 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94da23b640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f94d40500e0 0x7f94d40197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x7f94d40500e0 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94d9a3a640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f94d40500e0 0x7f94d40197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94d9a3a640 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f94d40500e0 0x7f94d40197a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x563396761bb0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x563396761bb0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.657+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x7f94d40500e0 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x563396761bb0 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x563396761bb0 2024-09-12T16:52:21.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x7f94d40500e0 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.661+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x563396761bb0 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x563396761bb0 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x7f94d40500e0 2024-09-12T16:52:21.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x563396761bb0 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.665+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x7f94d40500e0 2024-09-12T16:52:21.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x56339676af10 2024-09-12T16:52:21.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x5633967665c0 2024-09-12T16:52:21.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x563396761bb0 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56339676d9a0 con 0x7f94d40500e0 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:21.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563396769980 con 0x563396761bb0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5633967695c0 con 0x563396761bb0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339676a2a0 con 0x563396761bb0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 zone default found 2024-09-12T16:52:21.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 4 Realm: () 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 zonegroup default 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339676a2c0 con 0x5633967665c0 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339676fd40 con 0x56339676af10 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.669+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5633967700e0 con 0x56339676af10 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94dc7359c0 20 started sync module instance, tier type = 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94dc7359c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56339676f1d0 con 0x7f94d40500e0 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94779567699696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56339676f1d0 con 0x7f94d40500e0 2024-09-12T16:52:21.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396770bb0 con 0x563396761bb0 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94779567699696] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94779567703696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56339676f1d0 con 0x563396761bb0 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.673+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5633967715c0 con 0x56339676af10 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.677+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.677+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94779567706384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396771e60 con 0x56339676af10 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.677+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396772820 con 0x7f94d40500e0 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.677+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94779567703696] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.677+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.677+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94779567711088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396772790 con 0x7f94d40500e0 2024-09-12T16:52:21.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.677+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396773570 con 0x563396761bb0 2024-09-12T16:52:21.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.677+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94779567706384] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.681+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94779567711088] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.681+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.681+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94779567708592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396773030 con 0x563396761bb0 2024-09-12T16:52:21.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.681+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5633967738c0 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.681+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94779567708592] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.681+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.681+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94779567713456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396773cb0 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.681+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396774670 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94779567713456] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94779567714576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396774670 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396775030 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94779567714576] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94779567719328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396775030 con 0x5633967665c0 2024-09-12T16:52:21.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 20 add_watcher() i=0 2024-09-12T16:52:21.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 20 add_watcher() i=1 2024-09-12T16:52:21.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 20 add_watcher() i=2 2024-09-12T16:52:21.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 20 add_watcher() i=3 2024-09-12T16:52:21.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 20 add_watcher() i=4 2024-09-12T16:52:21.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 20 add_watcher() i=5 2024-09-12T16:52:21.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.685+0000 7f94dc7359c0 20 add_watcher() i=6 2024-09-12T16:52:21.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94779567719328] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 20 add_watcher() i=7 2024-09-12T16:52:21.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:21.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563396778430 con 0x563396761bb0 2024-09-12T16:52:21.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94779567721808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396775950 con 0x563396761bb0 2024-09-12T16:52:21.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94779567721808] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f93917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 5 note: GC not initialized 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f938b7fe640 20 reqs_thread_entry: start 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 20 Filter name: none 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f93897fa640 20 reqs_thread_entry: start 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339679b6f0 con 0x5633967665c0 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.689+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563396799d90 con 0x5633967665c0 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T16:52:21.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:21.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T16:52:21.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T16:52:21.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56339679a660 con 0x5633967665c0 2024-09-12T16:52:21.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94779567874480 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339679ece0 con 0x5633967665c0 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== watch-notify(notify (1) cookie 94779567713456 notify 137438953474 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56339679b040 con 0x5633967665c0 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f93bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94779567713456 notifier 4488 bl.length()=556 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f93bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f93bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(65 notify.5 [notify cookie 94779567874480 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f93bdffb640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f93a0003eb0 con 0x5633967665c0 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== watch-notify(notify_complete (2) cookie 94779567874480 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563396756e30 con 0x5633967665c0 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.693+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56339679a610 con 0x5633967665c0 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94dc7359c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94dc7359c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94dc7359c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94779567874400 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56339679eec0 con 0x56339676af10 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== watch-notify(notify (1) cookie 94779567706384 notify 137438953474 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f94d4047050 con 0x56339676af10 2024-09-12T16:52:21.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f93bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94779567706384 notifier 4488 bl.length()=177 2024-09-12T16:52:21.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f93bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T16:52:21.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f93bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:21.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f93bdffb640 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f93a0003eb0 con 0x56339676af10 2024-09-12T16:52:21.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 notify.2 [notify cookie 94779567874400 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.697+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== watch-notify(notify_complete (2) cookie 94779567874400 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563396727030 con 0x56339676af10 2024-09-12T16:52:21.703 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T16:52:21.694331Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:21.694304Z","tags":[],"group_ids":[]} 2024-09-12T16:52:21.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.701+0000 7f93917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.701+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94779567721808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x563396761bb0 2024-09-12T16:52:21.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.701+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94779567721808] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.701+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94779567699696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x7f94d40500e0 2024-09-12T16:52:21.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.701+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94779567699696] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.701+0000 7f94dc7359c0 20 remove_watcher() i=0 2024-09-12T16:52:21.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.701+0000 7f94dc7359c0 2 removed watcher, disabling cache 2024-09-12T16:52:21.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.701+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94779567703696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x563396761bb0 2024-09-12T16:52:21.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94779567703696] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94dc7359c0 20 remove_watcher() i=1 2024-09-12T16:52:21.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94779567706384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x56339676af10 2024-09-12T16:52:21.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94da23b640 1 -- 172.21.15.151:0/973771859 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94779567706384] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d402e070 con 0x56339676af10 2024-09-12T16:52:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94dc7359c0 20 remove_watcher() i=2 2024-09-12T16:52:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94779567711088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x7f94d40500e0 2024-09-12T16:52:21.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94779567711088] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x7f94d40500e0 2024-09-12T16:52:21.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94dc7359c0 20 remove_watcher() i=3 2024-09-12T16:52:21.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.705+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94779567708592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x563396761bb0 2024-09-12T16:52:21.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.709+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94779567708592] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c40a99f0 con 0x563396761bb0 2024-09-12T16:52:21.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.709+0000 7f94dc7359c0 20 remove_watcher() i=4 2024-09-12T16:52:21.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.709+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94779567713456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x5633967665c0 2024-09-12T16:52:21.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.713+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94779567713456] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.713+0000 7f94dc7359c0 20 remove_watcher() i=5 2024-09-12T16:52:21.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.713+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94779567714576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x5633967665c0 2024-09-12T16:52:21.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.713+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94779567714576] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.713+0000 7f94dc7359c0 20 remove_watcher() i=6 2024-09-12T16:52:21.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.713+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94779567719328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563396799490 con 0x5633967665c0 2024-09-12T16:52:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94daa3c640 1 -- 172.21.15.151:0/973771859 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94779567719328] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94cc02a070 con 0x5633967665c0 2024-09-12T16:52:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 20 remove_watcher() i=7 2024-09-12T16:52:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5633967665c0 msgr2=0x5633967689b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5633967665c0 0x5633967689b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396761bb0 msgr2=0x563396764070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396761bb0 0x563396764070 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f94d40500e0 msgr2=0x7f94d40197a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f94d40500e0 0x7f94d40197a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56339676af10 msgr2=0x56339676d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56339676af10 0x56339676d320 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93a4039c10 msgr2=0x7f93a403c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93a4039c10 0x7f93a403c0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94d404ef80 tx=0x7f94d4035000 comp rx=0 tx=0).stop 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 msgr2=0x5633967568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/973771859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396750480 0x5633967568d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f94cc04b010 tx=0x7f94cc0505d0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94d9a3a640 1 -- 172.21.15.151:0/973771859 reap_dead start 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 shutdown_connections 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 >> 172.21.15.151:0/973771859 conn(0x56339674b840 msgr2=0x563396749a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 shutdown_connections 2024-09-12T16:52:21.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/973771859 wait complete. 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2380750320 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93b4039a70 msgr2=0x7f93b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/2380750320 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93b4039a70 0x7f93b403bf30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x563396727350 tx=0x7f94d404ebf0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2380750320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56339671ecb0 msgr2=0x56339671d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/2380750320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56339671ecb0 0x56339671d550 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x563396727250 tx=0x7f94cc018830 comp rx=0 tx=0).stop 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2380750320 shutdown_connections 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/2380750320 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93b4039a70 0x7f93b403bf30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/2380750320 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56339671ecb0 0x56339671d550 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2380750320 >> 172.21.15.151:0/2380750320 conn(0x563396736290 msgr2=0x563396736670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2380750320 shutdown_connections 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/2380750320 wait complete. 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56339672f770 msgr2=0x563396731b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56339672f770 0x563396731b60 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396636010 msgr2=0x56339672d000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396636010 0x56339672d000 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93c0039a70 msgr2=0x7f93c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93c0039a70 0x7f93c003bf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94c40ad000 tx=0x7f94c40a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 msgr2=0x563396725e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x563396725e90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x56339671f750 tx=0x7f94d4000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 shutdown_connections 2024-09-12T16:52:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56339672f770 0x563396731b60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563396636010 0x56339672d000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f93c0039a70 0x7f93c003bf30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 --2- 172.21.15.151:0/497074123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563396631e20 0x563396725e90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 >> 172.21.15.151:0/497074123 conn(0x56339662d940 msgr2=0x563396717d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 shutdown_connections 2024-09-12T16:52:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.717+0000 7f94dc7359c0 1 -- 172.21.15.151:0/497074123 wait complete. 2024-09-12T16:52:21.733 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T16:52:21.694331Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:21.694304Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:21.742 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T16:52:21.748 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:21.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-12T16:52:21.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-12T16:52:21.749 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-12T16:52:21.778 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:21.778 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:21.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee21a2e9c0 1 Processor -- start 2024-09-12T16:52:21.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee21a2e9c0 1 -- start start 2024-09-12T16:52:21.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee21a2e9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5558fc1fbe00 0x5558fc1fc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee21a2e9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558fc0b19c0 con 0x5558fc1fefe0 2024-09-12T16:52:21.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee21a2e9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5558fc1016d0 con 0x5558fc1fbe00 2024-09-12T16:52:21.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee1f534640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5558fc1fbe00 0x5558fc1fc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee1f534640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5558fc1fbe00 0x5558fc1fc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33604/0 (socket says 172.21.15.151:33604) 2024-09-12T16:52:21.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee1f534640 1 -- 172.21.15.151:0/1857440367 learned_addr learned my addr 172.21.15.151:0/1857440367 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee1ed33640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5558fc1fefe0 0x5558fc2013d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42628/0 (socket says 172.21.15.151:42628) 2024-09-12T16:52:21.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee1f534640 1 -- 172.21.15.151:0/1857440367 >> v1:172.21.15.122:6789/0 conn(0x5558fc1fefe0 legacy=0x5558fc2013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee1f534640 1 -- 172.21.15.151:0/1857440367 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fc0a5ca0 con 0x5558fc1fbe00 2024-09-12T16:52:21.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.777+0000 7fee1e532640 1 -- 172.21.15.151:0/1857440367 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991654783 0 0) 0x5558fc0b19c0 con 0x5558fc1fefe0 2024-09-12T16:52:21.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee1f534640 1 --2- 172.21.15.151:0/1857440367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc1fc1e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fee1000a5c0 tx=0x7fee1001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4038a7ed8e7cb8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee1e532640 1 -- 172.21.15.151:0/1857440367 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee100a6070 con 0x5558fc1fbe00 2024-09-12T16:52:21.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee1e532640 1 -- 172.21.15.151:0/1857440367 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee100af070 con 0x5558fc1fbe00 2024-09-12T16:52:21.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee1e532640 1 -- 172.21.15.151:0/1857440367 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee100aa5c0 con 0x5558fc1fbe00 2024-09-12T16:52:21.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1857440367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 msgr2=0x5558fc1fc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/1857440367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc1fc1e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fee1000a5c0 tx=0x7fee1001b340 comp rx=0 tx=0).stop 2024-09-12T16:52:21.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1857440367 shutdown_connections 2024-09-12T16:52:21.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/1857440367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc1fc1e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1857440367 >> 172.21.15.151:0/1857440367 conn(0x5558fc1f7920 msgr2=0x5558fc1f9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1857440367 shutdown_connections 2024-09-12T16:52:21.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.781+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1857440367 wait complete. 2024-09-12T16:52:21.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 Processor -- start 2024-09-12T16:52:21.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 -- start start 2024-09-12T16:52:21.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc170d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5558fc105680 con 0x5558fc1fbe00 2024-09-12T16:52:21.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee1f534640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc170d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee1f534640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc170d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33614/0 (socket says 172.21.15.151:33614) 2024-09-12T16:52:21.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee1f534640 1 -- 172.21.15.151:0/688482271 learned_addr learned my addr 172.21.15.151:0/688482271 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee1f534640 1 -- 172.21.15.151:0/688482271 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fc080da0 con 0x5558fc1fbe00 2024-09-12T16:52:21.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee1f534640 1 --2- 172.21.15.151:0/688482271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc170d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fee100ac040 tx=0x7fee10003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1342e79cce04e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fed0d60a640 1 -- 172.21.15.151:0/688482271 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee100aa970 con 0x5558fc1fbe00 2024-09-12T16:52:21.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fed0d60a640 1 -- 172.21.15.151:0/688482271 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee100aab10 con 0x5558fc1fbe00 2024-09-12T16:52:21.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fed0d60a640 1 -- 172.21.15.151:0/688482271 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee100aae30 con 0x5558fc1fbe00 2024-09-12T16:52:21.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/688482271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 msgr2=0x5558fc170d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/688482271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc170d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fee100ac040 tx=0x7fee10003030 comp rx=0 tx=0).stop 2024-09-12T16:52:21.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/688482271 shutdown_connections 2024-09-12T16:52:21.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/688482271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc170d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/688482271 >> 172.21.15.151:0/688482271 conn(0x5558fc1f7920 msgr2=0x5558fc2e3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/688482271 shutdown_connections 2024-09-12T16:52:21.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.797+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/688482271 wait complete. 2024-09-12T16:52:21.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee21a2e9c0 1 Processor -- start 2024-09-12T16:52:21.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee21a2e9c0 1 -- start start 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee21a2e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc2efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee21a2e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5558fc0a7a50 con 0x5558fc1fbe00 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee1f534640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc2efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee1f534640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc2efac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33618/0 (socket says 172.21.15.151:33618) 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee1f534640 1 -- 172.21.15.151:0/964043762 learned_addr learned my addr 172.21.15.151:0/964043762 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee1f534640 1 -- 172.21.15.151:0/964043762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fc2f0020 con 0x5558fc1fbe00 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee1f534640 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc2efac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fee1001b170 tx=0x7fee100180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fed0be07640 1 -- 172.21.15.151:0/964043762 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee100c6690 con 0x5558fc1fbe00 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558fc2f02b0 con 0x5558fc1fbe00 2024-09-12T16:52:21.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fed0be07640 1 -- 172.21.15.151:0/964043762 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee100cc070 con 0x5558fc1fbe00 2024-09-12T16:52:21.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fed0be07640 1 -- 172.21.15.151:0/964043762 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee100c6960 con 0x5558fc1fbe00 2024-09-12T16:52:21.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558fc2f0c60 con 0x5558fc1fbe00 2024-09-12T16:52:21.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fed0be07640 1 -- 172.21.15.151:0/964043762 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee100c6b00 con 0x5558fc1fbe00 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fed0be07640 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed04039a70 0x7fed0403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fed0be07640 1 -- 172.21.15.151:0/964043762 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fee100ebd00 con 0x5558fc1fbe00 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee1ed33640 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed04039a70 0x7fed0403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc1fefe0 0x5558fc2f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc2f7170 con 0x5558fc1fefe0 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee1fd35640 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc1fefe0 0x5558fc2f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.801+0000 7fee1ed33640 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed04039a70 0x7fed0403bf30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fee14000c10 tx=0x7fee140013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1fd35640 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc1fefe0 0x5558fc2f6c30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1fd35640 1 -- 172.21.15.151:0/964043762 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1800a4d0 con 0x5558fc1fefe0 2024-09-12T16:52:21.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc2f75a0 con 0x5558fc1fefe0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1fd35640 1 -- 172.21.15.151:0/964043762 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee1800a4d0 con 0x5558fc1fefe0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc2f93b0 0x5558fc2fb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc2fbe70 con 0x5558fc2f93b0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1f534640 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc2f93b0 0x5558fc2fb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1f534640 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc2f93b0 0x5558fc2fb7a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1f534640 1 -- 172.21.15.151:0/964043762 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc2f93b0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc2f8250 con 0x5558fc1fefe0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1fd35640 1 -- 172.21.15.151:0/964043762 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee1800a4d0 con 0x5558fc1fefe0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc2f86d0 con 0x5558fc1fefe0 2024-09-12T16:52:21.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1fd35640 1 -- 172.21.15.151:0/964043762 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee1800a4d0 con 0x5558fc1fefe0 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 Processor -- start 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 -- start start 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc30a500 0x5558fc30a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee21a2e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5558fc112450 con 0x5558fc30a500 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1fd35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc30a500 0x5558fc30a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1fd35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc30a500 0x5558fc30a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33626/0 (socket says 172.21.15.151:33626) 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.805+0000 7fee1fd35640 1 -- 172.21.15.151:0/1375498955 learned_addr learned my addr 172.21.15.151:0/1375498955 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee1fd35640 1 -- 172.21.15.151:0/1375498955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fc30af60 con 0x5558fc30a500 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee1fd35640 1 --2- 172.21.15.151:0/1375498955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc30a500 0x5558fc30a920 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x5558fc2f1b80 tx=0x7fee18018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fed09602640 1 -- 172.21.15.151:0/1375498955 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee18014450 con 0x5558fc30a500 2024-09-12T16:52:21.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1375498955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558fc30b7c0 con 0x5558fc30a500 2024-09-12T16:52:21.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fed09602640 1 -- 172.21.15.151:0/1375498955 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee180145f0 con 0x5558fc30a500 2024-09-12T16:52:21.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fed09602640 1 -- 172.21.15.151:0/1375498955 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee18014910 con 0x5558fc30a500 2024-09-12T16:52:21.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1375498955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558fc30bd30 con 0x5558fc30a500 2024-09-12T16:52:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fed09602640 1 -- 172.21.15.151:0/1375498955 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee18011040 con 0x5558fc30a500 2024-09-12T16:52:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fed09602640 1 --2- 172.21.15.151:0/1375498955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fecf8039a70 0x7fecf803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fed09602640 1 -- 172.21.15.151:0/1375498955 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fee1801e070 con 0x5558fc30a500 2024-09-12T16:52:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee1f534640 1 --2- 172.21.15.151:0/1375498955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fecf8039a70 0x7fecf803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee21a2e9c0 1 Processor -- start 2024-09-12T16:52:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee21a2e9c0 1 -- start start 2024-09-12T16:52:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee21a2e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc3181f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee1f534640 1 --2- 172.21.15.151:0/1375498955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fecf8039a70 0x7fecf803bf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5558fc2f0f10 tx=0x7fee100dd040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee21a2e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5558fc171510 con 0x5558fc317e10 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee1fd35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc3181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee1fd35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc3181f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33630/0 (socket says 172.21.15.151:33630) 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee1fd35640 1 -- 172.21.15.151:0/1059207667 learned_addr learned my addr 172.21.15.151:0/1059207667 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.809+0000 7fee1fd35640 1 -- 172.21.15.151:0/1059207667 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fc3187e0 con 0x5558fc317e10 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee1fd35640 1 --2- 172.21.15.151:0/1059207667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc3181f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fee180505b0 tx=0x7fee18011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255ba3533111589c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fed02ffd640 1 -- 172.21.15.151:0/1059207667 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee18028070 con 0x5558fc317e10 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fed02ffd640 1 -- 172.21.15.151:0/1059207667 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1802b350 con 0x5558fc317e10 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fed02ffd640 1 -- 172.21.15.151:0/1059207667 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee18016440 con 0x5558fc317e10 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1059207667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 msgr2=0x5558fc3181f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/1059207667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc3181f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fee180505b0 tx=0x7fee18011a80 comp rx=0 tx=0).stop 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1059207667 shutdown_connections 2024-09-12T16:52:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/1059207667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc3181f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1059207667 >> 172.21.15.151:0/1059207667 conn(0x5558fc313230 msgr2=0x5558fc311470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1059207667 shutdown_connections 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1059207667 wait complete. 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 Processor -- start 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- start start 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc31e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5558fc316d60 con 0x5558fc317e10 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee1fd35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc31e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee1fd35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc31e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33636/0 (socket says 172.21.15.151:33636) 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 learned_addr learned my addr 172.21.15.151:0/4115673786 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fc31e820 con 0x5558fc317e10 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee1fd35640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc31e2c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fee18050510 tx=0x7fee18050540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fed017fa640 1 -- 172.21.15.151:0/4115673786 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee1802b350 con 0x5558fc317e10 2024-09-12T16:52:21.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558fc31eab0 con 0x5558fc317e10 2024-09-12T16:52:21.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fed017fa640 1 -- 172.21.15.151:0/4115673786 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee18032070 con 0x5558fc317e10 2024-09-12T16:52:21.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558fc31f460 con 0x5558fc317e10 2024-09-12T16:52:21.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.813+0000 7fed017fa640 1 -- 172.21.15.151:0/4115673786 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee18016440 con 0x5558fc317e10 2024-09-12T16:52:21.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fed017fa640 1 -- 172.21.15.151:0/4115673786 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee18001c90 con 0x5558fc317e10 2024-09-12T16:52:21.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fed017fa640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fece8039a70 0x7fece803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fed017fa640 1 -- 172.21.15.151:0/4115673786 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fee1800e040 con 0x5558fc317e10 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1f534640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fece8039a70 0x7fece803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc329780 0x5558fc32bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc32c360 con 0x5558fc329780 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1ed33640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc329780 0x5558fc32bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1f534640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fece8039a70 0x7fece803bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee100bdfd0 tx=0x7fee100e3000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1ed33640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc329780 0x5558fc32bc10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1400f600 con 0x5558fc329780 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 realm 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc328b90 con 0x5558fc329780 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1400f600 con 0x5558fc329780 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc32ce60 con 0x5558fc329780 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1400f600 con 0x5558fc329780 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc32d730 con 0x5558fc329780 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee1400f600 con 0x5558fc329780 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc32e030 0x5558fc330420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc330b80 con 0x5558fc32e030 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1fd35640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc32e030 0x5558fc330420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.817+0000 7fee1fd35640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc32e030 0x5558fc330420 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee21a2e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee21a2e9c0 20 searching for the correct realm 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5558fc332b20 0x5558fc334fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1f534640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5558fc332b20 0x5558fc334fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1f534640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5558fc332b20 0x5558fc334fe0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1f534640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fee10009040 0x7fee100cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x7fee10009040 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1ed33640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fee10009040 0x7fee100cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1ed33640 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fee10009040 0x7fee100cf7f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1400f600 con 0x7fee10009040 2024-09-12T16:52:21.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc329780 2024-09-12T16:52:21.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1400f600 con 0x5558fc329780 2024-09-12T16:52:21.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc329780 2024-09-12T16:52:21.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.821+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x7fee10009040 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc329780 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc329780 2024-09-12T16:52:21.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x7fee10009040 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.825+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc329780 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc329780 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x7fee10009040 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc329780 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.829+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x7fee10009040 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc332b20 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc32e030 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x5558fc329780 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3356b0 con 0x7fee10009040 2024-09-12T16:52:21.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc331540 con 0x5558fc329780 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc331990 con 0x5558fc329780 2024-09-12T16:52:21.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc331e70 con 0x5558fc329780 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 zone default found 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 4 Realm: () 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 zonegroup default 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.833+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc335b30 con 0x5558fc32e030 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc3379f0 con 0x5558fc332b20 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc337ee0 con 0x5558fc332b20 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 20 started sync module instance, tier type = 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:21.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc336d60 con 0x7fee10009040 2024-09-12T16:52:21.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93840676713056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc336d60 con 0x7fee10009040 2024-09-12T16:52:21.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc338a10 con 0x5558fc329780 2024-09-12T16:52:21.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.837+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93840676713056] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.841+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.841+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93840676717792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc336d60 con 0x5558fc329780 2024-09-12T16:52:21.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.841+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc339420 con 0x5558fc332b20 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.841+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.841+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93840676720496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc339cc0 con 0x5558fc332b20 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.841+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33a6c0 con 0x7fee10009040 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.841+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93840676717792] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.845+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.845+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93840676710576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33aab0 con 0x7fee10009040 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.845+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33b470 con 0x5558fc329780 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.845+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93840676720496] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.845+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93840676710576] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.845+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.845+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93840676725200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33afc0 con 0x5558fc329780 2024-09-12T16:52:21.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.845+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33b810 con 0x5558fc32e030 2024-09-12T16:52:21.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93840676725200] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93840676729040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33bae0 con 0x5558fc32e030 2024-09-12T16:52:21.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33c110 con 0x5558fc32e030 2024-09-12T16:52:21.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93840676722704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33c580 con 0x5558fc32e030 2024-09-12T16:52:21.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33d070 con 0x5558fc32e030 2024-09-12T16:52:21.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93840676729040] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93840676722704] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93840676735808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33c110 con 0x5558fc32e030 2024-09-12T16:52:21.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 20 add_watcher() i=0 2024-09-12T16:52:21.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 20 add_watcher() i=1 2024-09-12T16:52:21.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 20 add_watcher() i=2 2024-09-12T16:52:21.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 20 add_watcher() i=3 2024-09-12T16:52:21.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 20 add_watcher() i=4 2024-09-12T16:52:21.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 20 add_watcher() i=5 2024-09-12T16:52:21.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.849+0000 7fee21a2e9c0 20 add_watcher() i=6 2024-09-12T16:52:21.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93840676735808] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee21a2e9c0 20 add_watcher() i=7 2024-09-12T16:52:21.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee21a2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:21.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc340170 con 0x5558fc329780 2024-09-12T16:52:21.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93840676730160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33d5f0 con 0x5558fc329780 2024-09-12T16:52:21.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93840676730160] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fecd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee21a2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:21.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee21a2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:21.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.853+0000 7fee21a2e9c0 5 note: GC not initialized 2024-09-12T16:52:21.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fecd4fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:21.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee21a2e9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:21.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee21a2e9c0 20 Filter name: none 2024-09-12T16:52:21.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fec4e7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:21.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee21a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:21.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558fc362d10 con 0x7fee10009040 2024-09-12T16:52:21.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee21a2e9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:21.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fecd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:21.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93840676730160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc360bc0 con 0x5558fc329780 2024-09-12T16:52:21.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93840676730160] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.857+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93840676713056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc360bc0 con 0x7fee10009040 2024-09-12T16:52:21.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.861+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93840676713056] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.861+0000 7fee21a2e9c0 20 remove_watcher() i=0 2024-09-12T16:52:21.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.861+0000 7fee21a2e9c0 2 removed watcher, disabling cache 2024-09-12T16:52:21.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.861+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93840676717792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc337260 con 0x5558fc329780 2024-09-12T16:52:21.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.861+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93840676717792] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.861+0000 7fee21a2e9c0 20 remove_watcher() i=1 2024-09-12T16:52:21.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.861+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93840676720496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc360bc0 con 0x5558fc332b20 2024-09-12T16:52:21.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.865+0000 7fee1f534640 1 -- 172.21.15.151:0/4115673786 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93840676720496] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee100bc580 con 0x5558fc332b20 2024-09-12T16:52:21.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.865+0000 7fee21a2e9c0 20 remove_watcher() i=2 2024-09-12T16:52:21.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.865+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93840676710576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc337260 con 0x7fee10009040 2024-09-12T16:52:21.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.865+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93840676710576] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x7fee10009040 2024-09-12T16:52:21.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.865+0000 7fee21a2e9c0 20 remove_watcher() i=3 2024-09-12T16:52:21.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.865+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93840676725200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc338f70 con 0x5558fc329780 2024-09-12T16:52:21.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.865+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93840676725200] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1402b040 con 0x5558fc329780 2024-09-12T16:52:21.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.869+0000 7fee21a2e9c0 20 remove_watcher() i=4 2024-09-12T16:52:21.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.869+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93840676729040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc337260 con 0x5558fc32e030 2024-09-12T16:52:21.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.869+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93840676729040] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.869+0000 7fee21a2e9c0 20 remove_watcher() i=5 2024-09-12T16:52:21.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.869+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93840676722704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33a1d0 con 0x5558fc32e030 2024-09-12T16:52:21.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.869+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93840676722704] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.869+0000 7fee21a2e9c0 20 remove_watcher() i=6 2024-09-12T16:52:21.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.869+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93840676735808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558fc33b580 con 0x5558fc32e030 2024-09-12T16:52:21.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee1fd35640 1 -- 172.21.15.151:0/4115673786 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93840676735808] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1804a050 con 0x5558fc32e030 2024-09-12T16:52:21.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 20 remove_watcher() i=7 2024-09-12T16:52:21.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc32e030 msgr2=0x5558fc330420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc32e030 0x5558fc330420 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc329780 msgr2=0x5558fc32bc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc329780 0x5558fc32bc10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fee10009040 msgr2=0x7fee100cf7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fee10009040 0x7fee100cf7f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5558fc332b20 msgr2=0x5558fc334fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5558fc332b20 0x5558fc334fe0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fece8039a70 msgr2=0x7fece803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fece8039a70 0x7fece803bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee100bdfd0 tx=0x7fee100e3000 comp rx=0 tx=0).stop 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 msgr2=0x5558fc31e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/4115673786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc317e10 0x5558fc31e2c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fee18050510 tx=0x7fee18050540 comp rx=0 tx=0).stop 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee1ed33640 1 -- 172.21.15.151:0/4115673786 reap_dead start 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 shutdown_connections 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 >> 172.21.15.151:0/4115673786 conn(0x5558fc313230 msgr2=0x5558fc311440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 shutdown_connections 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/4115673786 wait complete. 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1375498955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fecf8039a70 msgr2=0x7fecf803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/1375498955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fecf8039a70 0x7fecf803bf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5558fc2f0f10 tx=0x7fee100dd040 comp rx=0 tx=0).stop 2024-09-12T16:52:21.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1375498955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc30a500 msgr2=0x5558fc30a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/1375498955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc30a500 0x5558fc30a920 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x5558fc2f1b80 tx=0x7fee18018830 comp rx=0 tx=0).stop 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1375498955 shutdown_connections 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/1375498955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fecf8039a70 0x7fecf803bf30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/1375498955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc30a500 0x5558fc30a920 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1375498955 >> 172.21.15.151:0/1375498955 conn(0x5558fc2ffeb0 msgr2=0x5558fc300290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1375498955 shutdown_connections 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/1375498955 wait complete. 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc2f93b0 msgr2=0x5558fc2fb7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc2f93b0 0x5558fc2fb7a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc1fefe0 msgr2=0x5558fc2f6c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc1fefe0 0x5558fc2f6c30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed04039a70 msgr2=0x7fed0403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed04039a70 0x7fed0403bf30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fee14000c10 tx=0x7fee140013c0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 msgr2=0x5558fc2efac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc2efac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fee1001b170 tx=0x7fee100180e0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 shutdown_connections 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5558fc2f93b0 0x5558fc2fb7a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5558fc1fefe0 0x5558fc2f6c30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed04039a70 0x7fed0403bf30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 --2- 172.21.15.151:0/964043762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5558fc1fbe00 0x5558fc2efac0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 >> 172.21.15.151:0/964043762 conn(0x5558fc1f7920 msgr2=0x5558fc2e1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 shutdown_connections 2024-09-12T16:52:21.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.873+0000 7fee21a2e9c0 1 -- 172.21.15.151:0/964043762 wait complete. 2024-09-12T16:52:21.888 INFO:teuthology.orchestra.run.smithi151.stdout:{"key":"bucket:myfoo","ver":{"tag":"_h-eYxeE4k7NASDOww7bkfrO","ver":2},"mtime":"2024-09-12T16:52:21.487287Z","data":{"bucket":{"name":"myfoo","marker":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","bucket_id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-12T16:52:19.907293Z","linked":false,"has_bucket_info":false}} 2024-09-12T16:52:21.888 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_h-eYxeE4k7NASDOww7bkfrO', 'ver': 2}, 'mtime': '2024-09-12T16:52:21.487287Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'bucket_id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-12T16:52:19.907293Z', 'linked': False, 'has_bucket_info': False}} 2024-09-12T16:52:21.888 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1'] 2024-09-12T16:52:21.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1'] 2024-09-12T16:52:21.889 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:21.966 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:21.967 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:21.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e991079c0 1 Processor -- start 2024-09-12T16:52:21.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e991079c0 1 -- start start 2024-09-12T16:52:21.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e991079c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555b829382d0 0x555b8293a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e991079c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b827e69c0 con 0x555b82934180 2024-09-12T16:52:21.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e991079c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x555b828366d0 con 0x555b829382d0 2024-09-12T16:52:21.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e9640c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555b829382d0 0x555b8293a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e9640c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555b829382d0 0x555b8293a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33644/0 (socket says 172.21.15.151:33644) 2024-09-12T16:52:21.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e9640c640 1 -- 172.21.15.151:0/4203051234 learned_addr learned my addr 172.21.15.151:0/4203051234 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e9640c640 1 -- 172.21.15.151:0/4203051234 >> v1:172.21.15.122:6789/0 conn(0x555b82934180 legacy=0x555b82934560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.965+0000 7f2e9640c640 1 -- 172.21.15.151:0/4203051234 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b827daca0 con 0x555b829382d0 2024-09-12T16:52:21.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e9640c640 1 --2- 172.21.15.151:0/4203051234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b8293a6c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00a5c0 tx=0x7f2e8c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfb44091e74a2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e95c0b640 1 -- 172.21.15.151:0/4203051234 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c0a9590 con 0x555b829382d0 2024-09-12T16:52:21.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e95c0b640 1 -- 172.21.15.151:0/4203051234 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0ae070 con 0x555b829382d0 2024-09-12T16:52:21.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e95c0b640 1 -- 172.21.15.151:0/4203051234 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c0a9880 con 0x555b829382d0 2024-09-12T16:52:21.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e991079c0 1 -- 172.21.15.151:0/4203051234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 msgr2=0x555b8293a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4203051234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b8293a6c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00a5c0 tx=0x7f2e8c01b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e991079c0 1 -- 172.21.15.151:0/4203051234 shutdown_connections 2024-09-12T16:52:21.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4203051234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b8293a6c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e991079c0 1 -- 172.21.15.151:0/4203051234 >> 172.21.15.151:0/4203051234 conn(0x555b828a7a90 msgr2=0x555b828a7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e991079c0 1 -- 172.21.15.151:0/4203051234 shutdown_connections 2024-09-12T16:52:21.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.969+0000 7f2e991079c0 1 -- 172.21.15.151:0/4203051234 wait complete. 2024-09-12T16:52:21.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e991079c0 1 Processor -- start 2024-09-12T16:52:21.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e991079c0 1 -- start start 2024-09-12T16:52:21.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e991079c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82934180 0x555b82a1f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e991079c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b8283a680 con 0x555b82934180 2024-09-12T16:52:21.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e96c0d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82934180 0x555b82a1f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e96c0d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82934180 0x555b82a1f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33652/0 (socket says 172.21.15.151:33652) 2024-09-12T16:52:21.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e96c0d640 1 -- 172.21.15.151:0/1769439379 learned_addr learned my addr 172.21.15.151:0/1769439379 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e96c0d640 1 -- 172.21.15.151:0/1769439379 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b827b5da0 con 0x555b82934180 2024-09-12T16:52:21.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/1769439379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82934180 0x555b82a1f970 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800b2d0 tx=0x7f2e8800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e434f1680ed9bc48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2d84e09640 1 -- 172.21.15.151:0/1769439379 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8800a040 con 0x555b82934180 2024-09-12T16:52:21.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2d84e09640 1 -- 172.21.15.151:0/1769439379 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8800f750 con 0x555b82934180 2024-09-12T16:52:21.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.985+0000 7f2d84e09640 1 -- 172.21.15.151:0/1769439379 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8800fa70 con 0x555b82934180 2024-09-12T16:52:21.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 -- 172.21.15.151:0/1769439379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82934180 msgr2=0x555b82a1f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:21.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 --2- 172.21.15.151:0/1769439379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82934180 0x555b82a1f970 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800b2d0 tx=0x7f2e8800b790 comp rx=0 tx=0).stop 2024-09-12T16:52:21.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 -- 172.21.15.151:0/1769439379 shutdown_connections 2024-09-12T16:52:21.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 --2- 172.21.15.151:0/1769439379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82934180 0x555b82a1f970 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:21.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 -- 172.21.15.151:0/1769439379 >> 172.21.15.151:0/1769439379 conn(0x555b828a7a90 msgr2=0x555b82a1b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:21.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 -- 172.21.15.151:0/1769439379 shutdown_connections 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 -- 172.21.15.151:0/1769439379 wait complete. 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 Processor -- start 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 -- start start 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b82a27320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e991079c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b827dca50 con 0x555b829382d0 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e96c0d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b82a27320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e96c0d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b82a27320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33666/0 (socket says 172.21.15.151:33666) 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e96c0d640 1 -- 172.21.15.151:0/3307645755 learned_addr learned my addr 172.21.15.151:0/3307645755 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:21.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e96c0d640 1 -- 172.21.15.151:0/3307645755 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b82a27880 con 0x555b829382d0 2024-09-12T16:52:21.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.989+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b82a27320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2e88000c10 tx=0x7f2e88000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2d83606640 1 -- 172.21.15.151:0/3307645755 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8801a880 con 0x555b829382d0 2024-09-12T16:52:21.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2d83606640 1 -- 172.21.15.151:0/3307645755 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8801aa20 con 0x555b829382d0 2024-09-12T16:52:21.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2d83606640 1 -- 172.21.15.151:0/3307645755 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8801ad40 con 0x555b829382d0 2024-09-12T16:52:21.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b82a27b10 con 0x555b829382d0 2024-09-12T16:52:21.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b82a284a0 con 0x555b829382d0 2024-09-12T16:52:21.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2d83606640 1 -- 172.21.15.151:0/3307645755 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e88017050 con 0x555b829382d0 2024-09-12T16:52:21.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2d83606640 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d7c039ac0 0x7f2d7c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2d83606640 1 -- 172.21.15.151:0/3307645755 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2e88015020 con 0x555b829382d0 2024-09-12T16:52:21.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.993+0000 7f2e9640c640 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d7c039ac0 0x7f2d7c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a2c3e0 0x555b82a2e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:21.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a2ed10 con 0x555b82a2c3e0 2024-09-12T16:52:21.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e9740e640 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a2c3e0 0x555b82a2e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:21.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e9640c640 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d7c039ac0 0x7f2d7c03bf80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0ad000 tx=0x7f2e8c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:21.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e9740e640 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a2c3e0 0x555b82a2e7d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e9740e640 1 -- 172.21.15.151:0/3307645755 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e9000a4d0 con 0x555b82a2c3e0 2024-09-12T16:52:22.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a2f0f0 con 0x555b82a2c3e0 2024-09-12T16:52:22.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e9740e640 1 -- 172.21.15.151:0/3307645755 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e9000a4d0 con 0x555b82a2c3e0 2024-09-12T16:52:22.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a30ed0 0x555b82a332c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a33990 con 0x555b82a30ed0 2024-09-12T16:52:22.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a30ed0 0x555b82a332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a30ed0 0x555b82a332c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e96c0d640 1 -- 172.21.15.151:0/3307645755 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a30ed0 2024-09-12T16:52:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a2fd70 con 0x555b82a2c3e0 2024-09-12T16:52:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e9740e640 1 -- 172.21.15.151:0/3307645755 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e9000a4d0 con 0x555b82a2c3e0 2024-09-12T16:52:22.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a30210 con 0x555b82a2c3e0 2024-09-12T16:52:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:21.997+0000 7f2e9740e640 1 -- 172.21.15.151:0/3307645755 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e9000a4d0 con 0x555b82a2c3e0 2024-09-12T16:52:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e991079c0 1 Processor -- start 2024-09-12T16:52:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e991079c0 1 -- start start 2024-09-12T16:52:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e991079c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a42070 0x555b82a42490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e991079c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b82847450 con 0x555b82a42070 2024-09-12T16:52:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e9740e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a42070 0x555b82a42490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e9740e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a42070 0x555b82a42490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33674/0 (socket says 172.21.15.151:33674) 2024-09-12T16:52:22.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e9740e640 1 -- 172.21.15.151:0/2939832879 learned_addr learned my addr 172.21.15.151:0/2939832879 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e9740e640 1 -- 172.21.15.151:0/2939832879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b82a42ad0 con 0x555b82a42070 2024-09-12T16:52:22.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e9740e640 1 --2- 172.21.15.151:0/2939832879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a42070 0x555b82a42490 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x555b82a293b0 tx=0x7f2e90018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2d80e01640 1 -- 172.21.15.151:0/2939832879 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90014450 con 0x555b82a42070 2024-09-12T16:52:22.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2d80e01640 1 -- 172.21.15.151:0/2939832879 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e900145f0 con 0x555b82a42070 2024-09-12T16:52:22.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e991079c0 1 -- 172.21.15.151:0/2939832879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b82a43330 con 0x555b82a42070 2024-09-12T16:52:22.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2d80e01640 1 -- 172.21.15.151:0/2939832879 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90014910 con 0x555b82a42070 2024-09-12T16:52:22.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e991079c0 1 -- 172.21.15.151:0/2939832879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b82a438a0 con 0x555b82a42070 2024-09-12T16:52:22.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2d80e01640 1 -- 172.21.15.151:0/2939832879 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e90011040 con 0x555b82a42070 2024-09-12T16:52:22.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2d80e01640 1 --2- 172.21.15.151:0/2939832879 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d70039a70 0x7f2d7003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2d80e01640 1 -- 172.21.15.151:0/2939832879 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2e9001e070 con 0x555b82a42070 2024-09-12T16:52:22.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/2939832879 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d70039a70 0x7f2d7003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e991079c0 1 Processor -- start 2024-09-12T16:52:22.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e991079c0 1 -- start start 2024-09-12T16:52:22.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.001+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/2939832879 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d70039a70 0x7f2d7003bf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x555b82a28740 tx=0x7f2e8800b790 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a4fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b82a201c0 con 0x555b82a4f9c0 2024-09-12T16:52:22.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a4fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a4fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33684/0 (socket says 172.21.15.151:33684) 2024-09-12T16:52:22.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 -- 172.21.15.151:0/3302517056 learned_addr learned my addr 172.21.15.151:0/3302517056 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 -- 172.21.15.151:0/3302517056 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b82a503b0 con 0x555b82a4f9c0 2024-09-12T16:52:22.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 --2- 172.21.15.151:0/3302517056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a4fdc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2e90050650 tx=0x7f2e90041f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf368153c9f2c352 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2d7a7fc640 1 -- 172.21.15.151:0/3302517056 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90016960 con 0x555b82a4f9c0 2024-09-12T16:52:22.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2d7a7fc640 1 -- 172.21.15.151:0/3302517056 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e90011330 con 0x555b82a4f9c0 2024-09-12T16:52:22.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2d7a7fc640 1 -- 172.21.15.151:0/3302517056 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90016b00 con 0x555b82a4f9c0 2024-09-12T16:52:22.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 -- 172.21.15.151:0/3302517056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 msgr2=0x555b82a4fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3302517056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a4fdc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2e90050650 tx=0x7f2e90041f60 comp rx=0 tx=0).stop 2024-09-12T16:52:22.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 -- 172.21.15.151:0/3302517056 shutdown_connections 2024-09-12T16:52:22.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3302517056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a4fdc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 -- 172.21.15.151:0/3302517056 >> 172.21.15.151:0/3302517056 conn(0x555b82a4ade0 msgr2=0x555b82a49020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 -- 172.21.15.151:0/3302517056 shutdown_connections 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 -- 172.21.15.151:0/3302517056 wait complete. 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 Processor -- start 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 -- start start 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a55ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e991079c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b82a4e910 con 0x555b82a4f9c0 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a55ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a55ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33696/0 (socket says 172.21.15.151:33696) 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 learned_addr learned my addr 172.21.15.151:0/4236875350 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b82a56430 con 0x555b82a4f9c0 2024-09-12T16:52:22.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.005+0000 7f2e9740e640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a55ed0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2e90014fd0 tx=0x7f2e900505b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2d78ff9640 1 -- 172.21.15.151:0/4236875350 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e900116b0 con 0x555b82a4f9c0 2024-09-12T16:52:22.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b82a566c0 con 0x555b82a4f9c0 2024-09-12T16:52:22.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2d78ff9640 1 -- 172.21.15.151:0/4236875350 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e90011850 con 0x555b82a4f9c0 2024-09-12T16:52:22.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b82a57070 con 0x555b82a4f9c0 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2d78ff9640 1 -- 172.21.15.151:0/4236875350 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90050a30 con 0x555b82a4f9c0 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2d78ff9640 1 -- 172.21.15.151:0/4236875350 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e9003e3f0 con 0x555b82a4f9c0 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2d78ff9640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d60039a70 0x7f2d6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2d78ff9640 1 -- 172.21.15.151:0/4236875350 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2e9000e040 con 0x555b82a4f9c0 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d60039a70 0x7f2d6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a611a0 0x555b82a63610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a63d60 con 0x555b82a611a0 2024-09-12T16:52:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e9640c640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a611a0 0x555b82a63610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d60039a70 0x7f2d6003bf30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2e8804ee10 tx=0x7f2e88033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e9640c640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a611a0 0x555b82a63610 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 realm 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a64190 con 0x555b82a611a0 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a64a60 con 0x555b82a611a0 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a64e00 con 0x555b82a611a0 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a65b60 0x555b82a67f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.009+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a68560 con 0x555b82a65b60 2024-09-12T16:52:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9740e640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a65b60 0x555b82a67f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9740e640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a65b60 0x555b82a67f50 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e991079c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e991079c0 20 searching for the correct realm 2024-09-12T16:52:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b82a6a440 0x555b82a6c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b82a6a440 0x555b82a6c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b82a6a440 0x555b82a6c8b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e96c0d640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x555b82934180 0x7f2e8801c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82934180 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9640c640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x555b82934180 0x7f2e8801c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9640c640 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x555b82934180 0x7f2e8801c460 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.013+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a611a0 2024-09-12T16:52:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a611a0 2024-09-12T16:52:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82934180 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a611a0 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a611a0 2024-09-12T16:52:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.017+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82934180 2024-09-12T16:52:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a611a0 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a611a0 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82934180 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.021+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a611a0 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82934180 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a6a440 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a65b60 2024-09-12T16:52:22.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82a611a0 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.025+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6cf80 con 0x555b82934180 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a68eb0 con 0x555b82a611a0 2024-09-12T16:52:22.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a68af0 con 0x555b82a611a0 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a697d0 con 0x555b82a611a0 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 zone default found 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 4 Realm: () 2024-09-12T16:52:22.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 zonegroup default 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a697d0 con 0x555b82a65b60 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6f2f0 con 0x555b82a6a440 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6f690 con 0x555b82a6a440 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 started sync module instance, tier type = 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.029+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6e780 con 0x555b82934180 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.033+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.033+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93851522362496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6e780 con 0x555b82934180 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.033+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a70120 con 0x555b82a611a0 2024-09-12T16:52:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.033+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93851522362496] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.033+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.033+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93851522366480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6e780 con 0x555b82a611a0 2024-09-12T16:52:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.033+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a70b30 con 0x555b82a6a440 2024-09-12T16:52:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93851522366480] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93851522360016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a6e6f0 con 0x555b82a6a440 2024-09-12T16:52:22.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a71870 con 0x555b82934180 2024-09-12T16:52:22.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93851522372480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a72110 con 0x555b82934180 2024-09-12T16:52:22.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a72b10 con 0x555b82a611a0 2024-09-12T16:52:22.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93851522360016] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.037+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93851522372480] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.041+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.041+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93851522371280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a71be0 con 0x555b82a611a0 2024-09-12T16:52:22.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.041+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a733b0 con 0x555b82a65b60 2024-09-12T16:52:22.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.041+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93851522371280] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.041+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.041+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93851522379520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a71be0 con 0x555b82a65b60 2024-09-12T16:52:22.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.041+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a73c00 con 0x555b82a65b60 2024-09-12T16:52:22.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93851522379520] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93851522381648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a73b70 con 0x555b82a65b60 2024-09-12T16:52:22.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a74600 con 0x555b82a65b60 2024-09-12T16:52:22.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93851522381648] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93851522377248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a745c0 con 0x555b82a65b60 2024-09-12T16:52:22.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 20 add_watcher() i=0 2024-09-12T16:52:22.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 20 add_watcher() i=1 2024-09-12T16:52:22.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 20 add_watcher() i=2 2024-09-12T16:52:22.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 20 add_watcher() i=3 2024-09-12T16:52:22.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 20 add_watcher() i=4 2024-09-12T16:52:22.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 20 add_watcher() i=5 2024-09-12T16:52:22.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.045+0000 7f2e991079c0 20 add_watcher() i=6 2024-09-12T16:52:22.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93851522377248] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e991079c0 20 add_watcher() i=7 2024-09-12T16:52:22.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e991079c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:22.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a77a50 con 0x555b82a611a0 2024-09-12T16:52:22.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93851522384608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a74f10 con 0x555b82a611a0 2024-09-12T16:52:22.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93851522384608] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2d4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e991079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:22.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e991079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:22.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2e991079c0 5 note: GC not initialized 2024-09-12T16:52:22.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.049+0000 7f2cc7fff640 20 reqs_thread_entry: start 2024-09-12T16:52:22.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:22.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 20 Filter name: none 2024-09-12T16:52:22.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2cc5ffb640 20 reqs_thread_entry: start 2024-09-12T16:52:22.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:52:22.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9ac60 con 0x555b82a65b60 2024-09-12T16:52:22.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T16:52:22.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9cd50 con 0x555b82934180 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:22.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e7b0 con 0x555b82a65b60 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(64 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-12T16:52:22.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.053+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82aa29f0 con 0x555b82934180 2024-09-12T16:52:22.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.057+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.057+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82aa87c0 con 0x555b82a65b60 2024-09-12T16:52:22.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(66 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:22.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:22.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1, ofs0, ns] 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 93851522557728 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82aa2e20 con 0x555b82a611a0 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 93851522366480 notify 137438953490 ret 0) ==== 802+0+0 (crc 0 0 0) 0x555b827daca0 con 0x555b82a611a0 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2d7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 93851522366480 notifier 4502 bl.length()=760 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2d7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2d7a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2d7a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(67 notify.1 [notify cookie 93851522557728 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2d7a7fc640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2d5c003eb0 con 0x555b82a611a0 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 93851522557728 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2e8c0bfbb0 con 0x555b82a611a0 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_sources= new_sources= 2024-09-12T16:52:22.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential sources added=[] removed=[] 2024-09-12T16:52:22.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_dests= new_dests= 2024-09-12T16:52:22.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential dests added=[] removed=[] 2024-09-12T16:52:22.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82aa7110 con 0x555b82a65b60 2024-09-12T16:52:22.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.061+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82934180 2024-09-12T16:52:22.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2e991079c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T16:52:22.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2e991079c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2e991079c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T16:52:22.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93851522545808 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82a65b60 2024-09-12T16:52:22.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== watch-notify(notify (1) cookie 93851522381648 notify 137438953475 ret 0) ==== 356+0+0 (crc 0 0 0) 0x555b82a56430 con 0x555b82a65b60 2024-09-12T16:52:22.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2d7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 93851522381648 notifier 4502 bl.length()=314 2024-09-12T16:52:22.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2d7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T16:52:22.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2d7a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2d7a7fc640 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2d5c003eb0 con 0x555b82a65b60 2024-09-12T16:52:22.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(71 notify.6 [notify cookie 93851522545808 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.065+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== watch-notify(notify_complete (2) cookie 93851522545808 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b82a503b0 con 0x555b82a65b60 2024-09-12T16:52:22.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2d4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93851522384608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82a611a0 2024-09-12T16:52:22.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93851522384608] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93851522362496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82934180 2024-09-12T16:52:22.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93851522362496] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2e991079c0 20 remove_watcher() i=0 2024-09-12T16:52:22.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2e991079c0 2 removed watcher, disabling cache 2024-09-12T16:52:22.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.069+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93851522366480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82a611a0 2024-09-12T16:52:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.073+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93851522366480] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.073+0000 7f2e991079c0 20 remove_watcher() i=1 2024-09-12T16:52:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.073+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93851522360016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82a6a440 2024-09-12T16:52:22.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e96c0d640 1 -- 172.21.15.151:0/4236875350 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93851522360016] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802e070 con 0x555b82a6a440 2024-09-12T16:52:22.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e991079c0 20 remove_watcher() i=2 2024-09-12T16:52:22.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93851522372480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82934180 2024-09-12T16:52:22.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93851522372480] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82934180 2024-09-12T16:52:22.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e991079c0 20 remove_watcher() i=3 2024-09-12T16:52:22.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93851522371280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82a611a0 2024-09-12T16:52:22.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93851522371280] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c0a99e0 con 0x555b82a611a0 2024-09-12T16:52:22.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e991079c0 20 remove_watcher() i=4 2024-09-12T16:52:22.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.077+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93851522379520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82a65b60 2024-09-12T16:52:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.081+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93851522379520] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.081+0000 7f2e991079c0 20 remove_watcher() i=5 2024-09-12T16:52:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.081+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93851522381648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82a65b60 2024-09-12T16:52:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93851522381648] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 20 remove_watcher() i=6 2024-09-12T16:52:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93851522377248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555b82a9e6d0 con 0x555b82a65b60 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e9740e640 1 -- 172.21.15.151:0/4236875350 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93851522377248] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9002a070 con 0x555b82a65b60 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 20 remove_watcher() i=7 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a65b60 msgr2=0x555b82a67f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a65b60 0x555b82a67f50 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a611a0 msgr2=0x555b82a63610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a611a0 0x555b82a63610 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x555b82934180 msgr2=0x7f2e8801c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x555b82934180 0x7f2e8801c460 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b82a6a440 msgr2=0x555b82a6c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555b82a6a440 0x555b82a6c8b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d60039a70 msgr2=0x7f2d6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d60039a70 0x7f2d6003bf30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2e8804ee10 tx=0x7f2e88033040 comp rx=0 tx=0).stop 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 msgr2=0x555b82a55ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 --2- 172.21.15.151:0/4236875350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a4f9c0 0x555b82a55ed0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2e90014fd0 tx=0x7f2e900505b0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e9640c640 1 -- 172.21.15.151:0/4236875350 reap_dead start 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 shutdown_connections 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.085+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 >> 172.21.15.151:0/4236875350 conn(0x555b82a4ade0 msgr2=0x555b82a48ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 shutdown_connections 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/4236875350 wait complete. 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/2939832879 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d70039a70 msgr2=0x7f2d7003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/2939832879 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d70039a70 0x7f2d7003bf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x555b82a28740 tx=0x7f2e8800b790 comp rx=0 tx=0).stop 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/2939832879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a42070 msgr2=0x555b82a42490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/2939832879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a42070 0x555b82a42490 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x555b82a293b0 tx=0x7f2e90018830 comp rx=0 tx=0).stop 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/2939832879 shutdown_connections 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/2939832879 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d70039a70 0x7f2d7003bf30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/2939832879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b82a42070 0x555b82a42490 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/2939832879 >> 172.21.15.151:0/2939832879 conn(0x555b82a37a20 msgr2=0x555b82a37e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/2939832879 shutdown_connections 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/2939832879 wait complete. 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a30ed0 msgr2=0x555b82a332c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a30ed0 0x555b82a332c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a2c3e0 msgr2=0x555b82a2e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a2c3e0 0x555b82a2e7d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d7c039ac0 msgr2=0x7f2d7c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d7c039ac0 0x7f2d7c03bf80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0ad000 tx=0x7f2e8c0a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 msgr2=0x555b82a27320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b82a27320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2e88000c10 tx=0x7f2e88000ee0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 shutdown_connections 2024-09-12T16:52:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555b82a30ed0 0x555b82a332c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555b82a2c3e0 0x555b82a2e7d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d7c039ac0 0x7f2d7c03bf80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 --2- 172.21.15.151:0/3307645755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b829382d0 0x555b82a27320 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 >> 172.21.15.151:0/3307645755 conn(0x555b828a7a90 msgr2=0x555b82a20c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 shutdown_connections 2024-09-12T16:52:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.089+0000 7f2e991079c0 1 -- 172.21.15.151:0/3307645755 wait complete. 2024-09-12T16:52:22.103 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T16:52:22.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T16:52:22.103 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T16:52:22.180 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:22.180 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:22.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.177+0000 7f65f19329c0 1 Processor -- start 2024-09-12T16:52:22.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.177+0000 7f65f19329c0 1 -- start start 2024-09-12T16:52:22.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.177+0000 7f65f19329c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e04a3f7350 0x55e04a3f9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.177+0000 7f65f19329c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e04a2a59c0 con 0x55e04a3f3200 2024-09-12T16:52:22.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.177+0000 7f65f19329c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55e04a2f56d0 con 0x55e04a3f7350 2024-09-12T16:52:22.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.177+0000 7f65e7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e04a3f7350 0x55e04a3f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.177+0000 7f65e7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e04a3f7350 0x55e04a3f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33700/0 (socket says 172.21.15.151:33700) 2024-09-12T16:52:22.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.177+0000 7f65e7fff640 1 -- 172.21.15.151:0/1825795028 learned_addr learned my addr 172.21.15.151:0/1825795028 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65e7fff640 1 -- 172.21.15.151:0/1825795028 >> v1:172.21.15.122:6789/0 conn(0x55e04a3f3200 legacy=0x55e04a3f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65e7fff640 1 -- 172.21.15.151:0/1825795028 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e04a299ca0 con 0x55e04a3f7350 2024-09-12T16:52:22.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65e7fff640 1 --2- 172.21.15.151:0/1825795028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f7350 0x55e04a3f9740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f65d800a5c0 tx=0x7f65d801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0da904117024c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65eec37640 1 -- 172.21.15.151:0/1825795028 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d80a9590 con 0x55e04a3f7350 2024-09-12T16:52:22.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65eec37640 1 -- 172.21.15.151:0/1825795028 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d80ae070 con 0x55e04a3f7350 2024-09-12T16:52:22.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65eec37640 1 -- 172.21.15.151:0/1825795028 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d80a9880 con 0x55e04a3f7350 2024-09-12T16:52:22.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65f19329c0 1 -- 172.21.15.151:0/1825795028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f7350 msgr2=0x55e04a3f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65f19329c0 1 --2- 172.21.15.151:0/1825795028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f7350 0x55e04a3f9740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f65d800a5c0 tx=0x7f65d801b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65f19329c0 1 -- 172.21.15.151:0/1825795028 shutdown_connections 2024-09-12T16:52:22.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65f19329c0 1 --2- 172.21.15.151:0/1825795028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f7350 0x55e04a3f9740 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65f19329c0 1 -- 172.21.15.151:0/1825795028 >> 172.21.15.151:0/1825795028 conn(0x55e04a366b10 msgr2=0x55e04a366f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65f19329c0 1 -- 172.21.15.151:0/1825795028 shutdown_connections 2024-09-12T16:52:22.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.181+0000 7f65f19329c0 1 -- 172.21.15.151:0/1825795028 wait complete. 2024-09-12T16:52:22.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.197+0000 7f65f19329c0 1 Processor -- start 2024-09-12T16:52:22.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.197+0000 7f65f19329c0 1 -- start start 2024-09-12T16:52:22.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.197+0000 7f65f19329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4de8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.197+0000 7f65f19329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e04a2f9680 con 0x55e04a3f3200 2024-09-12T16:52:22.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4de8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4de8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33716/0 (socket says 172.21.15.151:33716) 2024-09-12T16:52:22.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 -- 172.21.15.151:0/176890738 learned_addr learned my addr 172.21.15.151:0/176890738 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 -- 172.21.15.151:0/176890738 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e04a274da0 con 0x55e04a3f3200 2024-09-12T16:52:22.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 --2- 172.21.15.151:0/176890738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4de8a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f65e000b220 tx=0x7f65e000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e032310f7da09370 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f64dd60a640 1 -- 172.21.15.151:0/176890738 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e000a040 con 0x55e04a3f3200 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f64dd60a640 1 -- 172.21.15.151:0/176890738 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e000f750 con 0x55e04a3f3200 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f64dd60a640 1 -- 172.21.15.151:0/176890738 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e000fa70 con 0x55e04a3f3200 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 -- 172.21.15.151:0/176890738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 msgr2=0x55e04a4de8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 --2- 172.21.15.151:0/176890738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4de8a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f65e000b220 tx=0x7f65e000b6e0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 -- 172.21.15.151:0/176890738 shutdown_connections 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 --2- 172.21.15.151:0/176890738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4de8a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 -- 172.21.15.151:0/176890738 >> 172.21.15.151:0/176890738 conn(0x55e04a366b10 msgr2=0x55e04a4da4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 -- 172.21.15.151:0/176890738 shutdown_connections 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 -- 172.21.15.151:0/176890738 wait complete. 2024-09-12T16:52:22.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 Processor -- start 2024-09-12T16:52:22.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 -- start start 2024-09-12T16:52:22.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65f19329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e04a29ba50 con 0x55e04a3f3200 2024-09-12T16:52:22.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4e5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33724/0 (socket says 172.21.15.151:33724) 2024-09-12T16:52:22.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 -- 172.21.15.151:0/696218254 learned_addr learned my addr 172.21.15.151:0/696218254 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 -- 172.21.15.151:0/696218254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e04a4e64a0 con 0x55e04a3f3200 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.201+0000 7f65ef438640 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4e5f40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55e04a4df830 tx=0x7f65e0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f64dbe07640 1 -- 172.21.15.151:0/696218254 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e001a880 con 0x55e04a3f3200 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f64dbe07640 1 -- 172.21.15.151:0/696218254 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e001aa20 con 0x55e04a3f3200 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e04a4e6730 con 0x55e04a3f3200 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f64dbe07640 1 -- 172.21.15.151:0/696218254 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e001ad00 con 0x55e04a3f3200 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e04a4e70e0 con 0x55e04a3f3200 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f64dbe07640 1 -- 172.21.15.151:0/696218254 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f65e0017050 con 0x55e04a3f3200 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f64dbe07640 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64d4039b10 0x7f64d403bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f64dbe07640 1 -- 172.21.15.151:0/696218254 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65e0015020 con 0x55e04a3f3200 2024-09-12T16:52:22.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65e7fff640 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64d4039b10 0x7f64d403bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a3f7350 0x55e04a4ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a4ed5f0 con 0x55e04a3f7350 2024-09-12T16:52:22.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65efc39640 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a3f7350 0x55e04a4ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65e7fff640 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64d4039b10 0x7f64d403bfd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65d80ad000 tx=0x7f65d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65efc39640 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a3f7350 0x55e04a4ed0b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65efc39640 1 -- 172.21.15.151:0/696218254 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e800a4d0 con 0x55e04a3f7350 2024-09-12T16:52:22.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a4eda20 con 0x55e04a3f7350 2024-09-12T16:52:22.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65efc39640 1 -- 172.21.15.151:0/696218254 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65e800a4d0 con 0x55e04a3f7350 2024-09-12T16:52:22.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a4ef830 0x55e04a4f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a4f22f0 con 0x55e04a4ef830 2024-09-12T16:52:22.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.205+0000 7f65ef438640 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a4ef830 0x55e04a4f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65ef438640 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a4ef830 0x55e04a4f1c20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65ef438640 1 -- 172.21.15.151:0/696218254 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a4ef830 2024-09-12T16:52:22.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a4ee6d0 con 0x55e04a3f7350 2024-09-12T16:52:22.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65efc39640 1 -- 172.21.15.151:0/696218254 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65e800a4d0 con 0x55e04a3f7350 2024-09-12T16:52:22.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a4eeb50 con 0x55e04a3f7350 2024-09-12T16:52:22.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65efc39640 1 -- 172.21.15.151:0/696218254 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65e800a4d0 con 0x55e04a3f7350 2024-09-12T16:52:22.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65f19329c0 1 Processor -- start 2024-09-12T16:52:22.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65f19329c0 1 -- start start 2024-09-12T16:52:22.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65f19329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a500980 0x55e04a500da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65f19329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e04a306450 con 0x55e04a500980 2024-09-12T16:52:22.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65efc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a500980 0x55e04a500da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65efc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a500980 0x55e04a500da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33728/0 (socket says 172.21.15.151:33728) 2024-09-12T16:52:22.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65efc39640 1 -- 172.21.15.151:0/3956730517 learned_addr learned my addr 172.21.15.151:0/3956730517 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65efc39640 1 -- 172.21.15.151:0/3956730517 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e04a5013e0 con 0x55e04a500980 2024-09-12T16:52:22.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f65efc39640 1 --2- 172.21.15.151:0/3956730517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a500980 0x55e04a500da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55e04a4e72d0 tx=0x7f65e8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.209+0000 7f64d9602640 1 -- 172.21.15.151:0/3956730517 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8014450 con 0x55e04a500980 2024-09-12T16:52:22.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65f19329c0 1 -- 172.21.15.151:0/3956730517 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e04a501c40 con 0x55e04a500980 2024-09-12T16:52:22.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f64d9602640 1 -- 172.21.15.151:0/3956730517 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e80145f0 con 0x55e04a500980 2024-09-12T16:52:22.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f64d9602640 1 -- 172.21.15.151:0/3956730517 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8014910 con 0x55e04a500980 2024-09-12T16:52:22.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65f19329c0 1 -- 172.21.15.151:0/3956730517 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e04a5021b0 con 0x55e04a500980 2024-09-12T16:52:22.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f64d9602640 1 -- 172.21.15.151:0/3956730517 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f65e8011040 con 0x55e04a500980 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f64d9602640 1 --2- 172.21.15.151:0/3956730517 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64c8039a70 0x7f64c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f64d9602640 1 -- 172.21.15.151:0/3956730517 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65e801e070 con 0x55e04a500980 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65ef438640 1 --2- 172.21.15.151:0/3956730517 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64c8039a70 0x7f64c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65f19329c0 1 Processor -- start 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65f19329c0 1 -- start start 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65ef438640 1 --2- 172.21.15.151:0/3956730517 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64c8039a70 0x7f64c803bf30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e04a4e73c0 tx=0x7f65e00016d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65f19329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a50d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65f19329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e04a4df0f0 con 0x55e04a50d280 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65efc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a50d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65efc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a50d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33734/0 (socket says 172.21.15.151:33734) 2024-09-12T16:52:22.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65efc39640 1 -- 172.21.15.151:0/2422817587 learned_addr learned my addr 172.21.15.151:0/2422817587 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65efc39640 1 -- 172.21.15.151:0/2422817587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e04a50dc30 con 0x55e04a50d280 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f65efc39640 1 --2- 172.21.15.151:0/2422817587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a50d660 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f65e80506a0 tx=0x7f65e802b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1eb629701811c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f64d2ffd640 1 -- 172.21.15.151:0/2422817587 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8016960 con 0x55e04a50d280 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.213+0000 7f64d2ffd640 1 -- 172.21.15.151:0/2422817587 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e8011330 con 0x55e04a50d280 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f64d2ffd640 1 -- 172.21.15.151:0/2422817587 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8016b00 con 0x55e04a50d280 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- 172.21.15.151:0/2422817587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 msgr2=0x55e04a50d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 --2- 172.21.15.151:0/2422817587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a50d660 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f65e80506a0 tx=0x7f65e802b410 comp rx=0 tx=0).stop 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- 172.21.15.151:0/2422817587 shutdown_connections 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 --2- 172.21.15.151:0/2422817587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a50d660 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- 172.21.15.151:0/2422817587 >> 172.21.15.151:0/2422817587 conn(0x55e04a5096b0 msgr2=0x55e04a5078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- 172.21.15.151:0/2422817587 shutdown_connections 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- 172.21.15.151:0/2422817587 wait complete. 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 Processor -- start 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- start start 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a514750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e04a50e290 con 0x55e04a50d280 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65efc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a514750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65efc39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a514750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33746/0 (socket says 172.21.15.151:33746) 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 learned_addr learned my addr 172.21.15.151:0/238044521 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e04a514cb0 con 0x55e04a50d280 2024-09-12T16:52:22.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65efc39640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a514750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f65e8041fd0 tx=0x7f65e8050600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f64d17fa640 1 -- 172.21.15.151:0/238044521 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e804f2a0 con 0x55e04a50d280 2024-09-12T16:52:22.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e04a514f40 con 0x55e04a50d280 2024-09-12T16:52:22.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f64d17fa640 1 -- 172.21.15.151:0/238044521 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e80509c0 con 0x55e04a50d280 2024-09-12T16:52:22.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f64d17fa640 1 -- 172.21.15.151:0/238044521 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8050cc0 con 0x55e04a50d280 2024-09-12T16:52:22.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.217+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e04a5158f0 con 0x55e04a50d280 2024-09-12T16:52:22.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f64d17fa640 1 -- 172.21.15.151:0/238044521 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f65e803e350 con 0x55e04a50d280 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f64d17fa640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64b8039a70 0x7f64b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f64d17fa640 1 -- 172.21.15.151:0/238044521 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65e800e040 con 0x55e04a50d280 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65ef438640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64b8039a70 0x7f64b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a51f9e0 0x55e04a521ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5225f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65e7fff640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a51f9e0 0x55e04a521ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65ef438640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64b8039a70 0x7f64b803bf30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f65e004b3f0 tx=0x7f65e0033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65e7fff640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a51f9e0 0x55e04a521ea0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 realm 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a522a20 con 0x55e04a51f9e0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5232f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a523690 con 0x55e04a51f9e0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a5243f0 0x55e04a5267e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a526df0 con 0x55e04a5243f0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.221+0000 7f65efc39640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a5243f0 0x55e04a5267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65efc39640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a5243f0 0x55e04a5267e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65f19329c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:22.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65f19329c0 20 searching for the correct realm 2024-09-12T16:52:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e04a528d40 0x55e04a52b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a528d40 2024-09-12T16:52:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65ef438640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e04a528d40 0x55e04a52b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65ef438640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e04a528d40 0x55e04a52b150 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65ef438640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f65e00500b0 0x7f65e00197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x7f65e00500b0 2024-09-12T16:52:22.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65e7fff640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f65e00500b0 0x7f65e00197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65e7fff640 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f65e00500b0 0x7f65e00197a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a5243f0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a51f9e0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a51f9e0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.225+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a5243f0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a5243f0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x7f65e00500b0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a528d40 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a51f9e0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a5243f0 2024-09-12T16:52:22.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a51f9e0 2024-09-12T16:52:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x7f65e00500b0 2024-09-12T16:52:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a528d40 2024-09-12T16:52:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.229+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52b7d0 con 0x55e04a528d40 2024-09-12T16:52:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a5243f0 2024-09-12T16:52:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a528d40 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a528d40 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a51f9e0 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a51f9e0 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a5243f0 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a528d40 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x7f65e00500b0 2024-09-12T16:52:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a51f9e0 2024-09-12T16:52:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.233+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a5243f0 2024-09-12T16:52:22.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a528d40 2024-09-12T16:52:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a5243f0 2024-09-12T16:52:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x7f65e00500b0 2024-09-12T16:52:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a528d40 2024-09-12T16:52:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a5243f0 2024-09-12T16:52:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x55e04a51f9e0 2024-09-12T16:52:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e005d040 con 0x7f65e00500b0 2024-09-12T16:52:22.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:22.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:22.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:22.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5277b0 con 0x55e04a51f9e0 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.237+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5273f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5280d0 con 0x55e04a51f9e0 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 zone default found 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 4 Realm: () 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 zonegroup default 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5280d0 con 0x55e04a5243f0 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52db70 con 0x55e04a528d40 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52df10 con 0x55e04a528d40 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 started sync module instance, tier type = 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52d000 con 0x7f65e00500b0 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94421807977728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52d000 con 0x7f65e00500b0 2024-09-12T16:52:22.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.241+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52ea50 con 0x55e04a51f9e0 2024-09-12T16:52:22.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.245+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94421807977728] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.245+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.245+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94421807981872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52d000 con 0x55e04a51f9e0 2024-09-12T16:52:22.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.245+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52f460 con 0x55e04a528d40 2024-09-12T16:52:22.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.245+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94421807981872] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.245+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.245+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94421807975248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52cf70 con 0x55e04a528d40 2024-09-12T16:52:22.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.245+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a530160 con 0x7f65e00500b0 2024-09-12T16:52:22.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.249+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.249+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94421807988160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a530a00 con 0x7f65e00500b0 2024-09-12T16:52:22.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.249+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5313c0 con 0x55e04a51f9e0 2024-09-12T16:52:22.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.249+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94421807975248] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.249+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94421807988160] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.249+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.249+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94421807992592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a530970 con 0x55e04a51f9e0 2024-09-12T16:52:22.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.249+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a531330 con 0x55e04a5243f0 2024-09-12T16:52:22.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.253+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94421807992592] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.253+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.253+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94421807990224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a531c60 con 0x55e04a5243f0 2024-09-12T16:52:22.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.253+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5324b0 con 0x55e04a5243f0 2024-09-12T16:52:22.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.253+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.253+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94421807996480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a532910 con 0x55e04a5243f0 2024-09-12T16:52:22.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.253+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a533430 con 0x55e04a5243f0 2024-09-12T16:52:22.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.253+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94421807990224] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94421808000768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5333f0 con 0x55e04a5243f0 2024-09-12T16:52:22.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 20 add_watcher() i=0 2024-09-12T16:52:22.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 20 add_watcher() i=1 2024-09-12T16:52:22.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 20 add_watcher() i=2 2024-09-12T16:52:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 20 add_watcher() i=3 2024-09-12T16:52:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 20 add_watcher() i=4 2024-09-12T16:52:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 20 add_watcher() i=5 2024-09-12T16:52:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94421807996480] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 20 add_watcher() i=6 2024-09-12T16:52:22.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94421808000768] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 20 add_watcher() i=7 2024-09-12T16:52:22.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:22.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5323a0 con 0x55e04a51f9e0 2024-09-12T16:52:22.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.257+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94421807997792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5338c0 con 0x55e04a51f9e0 2024-09-12T16:52:22.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.261+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94421807997792] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.261+0000 7f64a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.261+0000 7f65f19329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:22.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.261+0000 7f65f19329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:22.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.261+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a53ec40 con 0x55e04a51f9e0 2024-09-12T16:52:22.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.261+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.261+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a53ec40 con 0x55e04a5243f0 2024-09-12T16:52:22.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.265+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.265+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a53ec40 con 0x55e04a528d40 2024-09-12T16:52:22.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.265+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.265+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a53f700 con 0x55e04a51f9e0 2024-09-12T16:52:22.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.265+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.265+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a53fc70 con 0x7f65e00500b0 2024-09-12T16:52:22.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.269+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.269+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a540120 con 0x55e04a528d40 2024-09-12T16:52:22.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.269+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.269+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a540120 con 0x55e04a51f9e0 2024-09-12T16:52:22.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.273+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.273+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a540120 con 0x55e04a5243f0 2024-09-12T16:52:22.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.273+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.273+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a540120 con 0x7f65e00500b0 2024-09-12T16:52:22.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.277+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.277+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5401b0 con 0x55e04a528d40 2024-09-12T16:52:22.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.277+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.277+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a540740 con 0x7f65e00500b0 2024-09-12T16:52:22.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.277+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.277+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a540720 con 0x55e04a5243f0 2024-09-12T16:52:22.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.281+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.281+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x7f65e00500b0 2024-09-12T16:52:22.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.281+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.281+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a5243f0 2024-09-12T16:52:22.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.285+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.285+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.285+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'114 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.285+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a528d40 2024-09-12T16:52:22.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.285+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.285+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x7f65e00500b0 2024-09-12T16:52:22.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.289+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.289+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a528d40 2024-09-12T16:52:22.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.289+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.289+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.289+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.289+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.293+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'115 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.293+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a528d40 2024-09-12T16:52:22.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.293+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.293+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x7f65e00500b0 2024-09-12T16:52:22.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.297+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.297+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a528d40 2024-09-12T16:52:22.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.297+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.297+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a528d40 2024-09-12T16:52:22.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.297+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.297+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a528d40 2024-09-12T16:52:22.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.301+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.301+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a528d40 2024-09-12T16:52:22.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.301+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.301+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5406f0 con 0x55e04a5243f0 2024-09-12T16:52:22.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.301+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.301+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5408c0 con 0x55e04a528d40 2024-09-12T16:52:22.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.305+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.305+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5408c0 con 0x55e04a5243f0 2024-09-12T16:52:22.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.305+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.305+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5408c0 con 0x55e04a528d40 2024-09-12T16:52:22.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.309+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.309+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5408c0 con 0x55e04a5243f0 2024-09-12T16:52:22.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.309+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.309+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a5408c0 con 0x7f65e00500b0 2024-09-12T16:52:22.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.313+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.313+0000 7f64a4fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:22.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.313+0000 7f65f19329c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:22.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.313+0000 7f65f19329c0 20 Filter name: none 2024-09-12T16:52:22.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.313+0000 7f641e7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:22.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.313+0000 7f65f19329c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:52:22.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.313+0000 7f65f19329c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.313+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a53d4e0 con 0x55e04a5243f0 2024-09-12T16:52:22.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f65f19329c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T16:52:22.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f65f19329c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T16:52:22.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f65f19329c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:22.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f65f19329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e04a55e240 con 0x55e04a5243f0 2024-09-12T16:52:22.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.319 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T16:52:22.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f64a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.317+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94421807997792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a538be0 con 0x55e04a51f9e0 2024-09-12T16:52:22.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94421807997792] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94421807977728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a532360 con 0x7f65e00500b0 2024-09-12T16:52:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94421807977728] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65f19329c0 20 remove_watcher() i=0 2024-09-12T16:52:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65f19329c0 2 removed watcher, disabling cache 2024-09-12T16:52:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94421807981872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a532360 con 0x55e04a51f9e0 2024-09-12T16:52:22.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94421807981872] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65f19329c0 20 remove_watcher() i=1 2024-09-12T16:52:22.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.321+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94421807975248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a532360 con 0x55e04a528d40 2024-09-12T16:52:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.325+0000 7f65ef438640 1 -- 172.21.15.151:0/238044521 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94421807975248] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e002e070 con 0x55e04a528d40 2024-09-12T16:52:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.325+0000 7f65f19329c0 20 remove_watcher() i=2 2024-09-12T16:52:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.325+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94421807988160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52cb50 con 0x7f65e00500b0 2024-09-12T16:52:22.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.325+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94421807988160] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x7f65e00500b0 2024-09-12T16:52:22.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.325+0000 7f65f19329c0 20 remove_watcher() i=3 2024-09-12T16:52:22.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.325+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94421807992592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a532360 con 0x55e04a51f9e0 2024-09-12T16:52:22.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.329+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94421807992592] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65d80a99f0 con 0x55e04a51f9e0 2024-09-12T16:52:22.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.329+0000 7f65f19329c0 20 remove_watcher() i=4 2024-09-12T16:52:22.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.329+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94421807990224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52fdc0 con 0x55e04a5243f0 2024-09-12T16:52:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.329+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94421807990224] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.329+0000 7f65f19329c0 20 remove_watcher() i=5 2024-09-12T16:52:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.329+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94421807996480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a52cb50 con 0x55e04a5243f0 2024-09-12T16:52:22.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.333+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94421807996480] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.333+0000 7f65f19329c0 20 remove_watcher() i=6 2024-09-12T16:52:22.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.333+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94421808000768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e04a530f10 con 0x55e04a5243f0 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65efc39640 1 -- 172.21.15.151:0/238044521 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94421808000768] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e802a070 con 0x55e04a5243f0 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 20 remove_watcher() i=7 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a5243f0 msgr2=0x55e04a5267e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a5243f0 0x55e04a5267e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a51f9e0 msgr2=0x55e04a521ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a51f9e0 0x55e04a521ea0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f65e00500b0 msgr2=0x7f65e00197a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f65e00500b0 0x7f65e00197a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e04a528d40 msgr2=0x55e04a52b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e04a528d40 0x55e04a52b150 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64b8039a70 msgr2=0x7f64b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64b8039a70 0x7f64b803bf30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f65e004b3f0 tx=0x7f65e0033040 comp rx=0 tx=0).stop 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65e7fff640 1 -- 172.21.15.151:0/238044521 reap_dead start 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 msgr2=0x55e04a514750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a514750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f65e8041fd0 tx=0x7f65e8050600 comp rx=0 tx=0).stop 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 shutdown_connections 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/238044521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a50d280 0x55e04a514750 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 >> 172.21.15.151:0/238044521 conn(0x55e04a5096b0 msgr2=0x55e04a5078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 shutdown_connections 2024-09-12T16:52:22.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/238044521 wait complete. 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/3956730517 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64c8039a70 msgr2=0x7f64c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/3956730517 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64c8039a70 0x7f64c803bf30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e04a4e73c0 tx=0x7f65e00016d0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/3956730517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a500980 msgr2=0x55e04a500da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/3956730517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a500980 0x55e04a500da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55e04a4e72d0 tx=0x7f65e8018830 comp rx=0 tx=0).stop 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/3956730517 shutdown_connections 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/3956730517 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64c8039a70 0x7f64c803bf30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/3956730517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a500980 0x55e04a500da0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/3956730517 >> 172.21.15.151:0/3956730517 conn(0x55e04a4f6330 msgr2=0x55e04a4f6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/3956730517 shutdown_connections 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/3956730517 wait complete. 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a4ef830 msgr2=0x55e04a4f1c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a4ef830 0x55e04a4f1c20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a3f7350 msgr2=0x55e04a4ed0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a3f7350 0x55e04a4ed0b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64d4039b10 msgr2=0x7f64d403bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64d4039b10 0x7f64d403bfd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65d80ad000 tx=0x7f65d80a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 msgr2=0x55e04a4e5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4e5f40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55e04a4df830 tx=0x7f65e0000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 shutdown_connections 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e04a4ef830 0x55e04a4f1c20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e04a3f7350 0x55e04a4ed0b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f64d4039b10 0x7f64d403bfd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 --2- 172.21.15.151:0/696218254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e04a3f3200 0x55e04a4e5f40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 >> 172.21.15.151:0/696218254 conn(0x55e04a366b10 msgr2=0x55e04a4d8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 shutdown_connections 2024-09-12T16:52:22.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.337+0000 7f65f19329c0 1 -- 172.21.15.151:0/696218254 wait complete. 2024-09-12T16:52:22.352 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T16:52:22.353 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-12T16:52:22.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-12T16:52:22.353 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-12T16:52:22.429 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:22.429 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:22.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f91116519c0 1 Processor -- start 2024-09-12T16:52:22.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f91116519c0 1 -- start start 2024-09-12T16:52:22.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f91116519c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d2261aa1f0 0x55d2261aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f91116519c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d22605c9c0 con 0x55d2261ad330 2024-09-12T16:52:22.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f91116519c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55d2260ac6d0 con 0x55d2261aa1f0 2024-09-12T16:52:22.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f910f157640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d2261aa1f0 0x55d2261aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f910f157640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d2261aa1f0 0x55d2261aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33760/0 (socket says 172.21.15.151:33760) 2024-09-12T16:52:22.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f910f157640 1 -- 172.21.15.151:0/3227574467 learned_addr learned my addr 172.21.15.151:0/3227574467 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f910f157640 1 -- 172.21.15.151:0/3227574467 >> v1:172.21.15.122:6789/0 conn(0x55d2261ad330 legacy=0x55d2261af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f910f157640 1 -- 172.21.15.151:0/3227574467 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d226050ca0 con 0x55d2261aa1f0 2024-09-12T16:52:22.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.429+0000 7f910f157640 1 --2- 172.21.15.151:0/3227574467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d2261aa5d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f910000a5c0 tx=0x7f910001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2cfed7756c5d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f910e155640 1 -- 172.21.15.151:0/3227574467 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91000a6070 con 0x55d2261aa1f0 2024-09-12T16:52:22.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f910e155640 1 -- 172.21.15.151:0/3227574467 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91000af070 con 0x55d2261aa1f0 2024-09-12T16:52:22.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f910e155640 1 -- 172.21.15.151:0/3227574467 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91000aa5c0 con 0x55d2261aa1f0 2024-09-12T16:52:22.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f91116519c0 1 -- 172.21.15.151:0/3227574467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 msgr2=0x55d2261aa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f91116519c0 1 --2- 172.21.15.151:0/3227574467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d2261aa5d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f910000a5c0 tx=0x7f910001b340 comp rx=0 tx=0).stop 2024-09-12T16:52:22.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f91116519c0 1 -- 172.21.15.151:0/3227574467 shutdown_connections 2024-09-12T16:52:22.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f91116519c0 1 --2- 172.21.15.151:0/3227574467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d2261aa5d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f91116519c0 1 -- 172.21.15.151:0/3227574467 >> 172.21.15.151:0/3227574467 conn(0x55d22611db00 msgr2=0x55d22611df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f91116519c0 1 -- 172.21.15.151:0/3227574467 shutdown_connections 2024-09-12T16:52:22.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.433+0000 7f91116519c0 1 -- 172.21.15.151:0/3227574467 wait complete. 2024-09-12T16:52:22.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 Processor -- start 2024-09-12T16:52:22.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- start start 2024-09-12T16:52:22.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d226295880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d2260b0680 con 0x55d2261aa1f0 2024-09-12T16:52:22.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f910f157640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d226295880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f910f157640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d226295880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33768/0 (socket says 172.21.15.151:33768) 2024-09-12T16:52:22.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f910f157640 1 -- 172.21.15.151:0/1625130553 learned_addr learned my addr 172.21.15.151:0/1625130553 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f910f157640 1 -- 172.21.15.151:0/1625130553 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22602bda0 con 0x55d2261aa1f0 2024-09-12T16:52:22.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f910f157640 1 --2- 172.21.15.151:0/1625130553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d226295880 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f91000ac040 tx=0x7f9100003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb94fbd355f6672 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f8ffd60a640 1 -- 172.21.15.151:0/1625130553 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91000aa970 con 0x55d2261aa1f0 2024-09-12T16:52:22.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f8ffd60a640 1 -- 172.21.15.151:0/1625130553 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91000aab10 con 0x55d2261aa1f0 2024-09-12T16:52:22.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f8ffd60a640 1 -- 172.21.15.151:0/1625130553 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91000aae30 con 0x55d2261aa1f0 2024-09-12T16:52:22.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- 172.21.15.151:0/1625130553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 msgr2=0x55d226295880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 --2- 172.21.15.151:0/1625130553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d226295880 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f91000ac040 tx=0x7f9100003030 comp rx=0 tx=0).stop 2024-09-12T16:52:22.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- 172.21.15.151:0/1625130553 shutdown_connections 2024-09-12T16:52:22.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 --2- 172.21.15.151:0/1625130553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d226295880 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- 172.21.15.151:0/1625130553 >> 172.21.15.151:0/1625130553 conn(0x55d22611db00 msgr2=0x55d226291500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- 172.21.15.151:0/1625130553 shutdown_connections 2024-09-12T16:52:22.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- 172.21.15.151:0/1625130553 wait complete. 2024-09-12T16:52:22.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 Processor -- start 2024-09-12T16:52:22.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- start start 2024-09-12T16:52:22.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d22629ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.449+0000 7f91116519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d226052a50 con 0x55d2261aa1f0 2024-09-12T16:52:22.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910f157640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d22629ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910f157640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d22629ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33780/0 (socket says 172.21.15.151:33780) 2024-09-12T16:52:22.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910f157640 1 -- 172.21.15.151:0/3382126955 learned_addr learned my addr 172.21.15.151:0/3382126955 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910f157640 1 -- 172.21.15.151:0/3382126955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d22629d3d0 con 0x55d2261aa1f0 2024-09-12T16:52:22.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910f157640 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d22629ce70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f910001b820 tx=0x7f91000180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f8ffbe07640 1 -- 172.21.15.151:0/3382126955 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91000c6650 con 0x55d2261aa1f0 2024-09-12T16:52:22.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f8ffbe07640 1 -- 172.21.15.151:0/3382126955 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91000c67f0 con 0x55d2261aa1f0 2024-09-12T16:52:22.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d22629d660 con 0x55d2261aa1f0 2024-09-12T16:52:22.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f8ffbe07640 1 -- 172.21.15.151:0/3382126955 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91000c6ad0 con 0x55d2261aa1f0 2024-09-12T16:52:22.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d22629e010 con 0x55d2261aa1f0 2024-09-12T16:52:22.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f8ffbe07640 1 -- 172.21.15.151:0/3382126955 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f91000d0400 con 0x55d2261aa1f0 2024-09-12T16:52:22.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f8ffbe07640 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ff4039a70 0x7f8ff403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f8ffbe07640 1 -- 172.21.15.151:0/3382126955 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f91000ec190 con 0x55d2261aa1f0 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910e956640 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ff4039a70 0x7f8ff403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2261ad330 0x55d2262a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262a4520 con 0x55d2261ad330 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910f958640 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2261ad330 0x55d2262a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910e956640 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ff4039a70 0x7f8ff403bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f90f80015d0 tx=0x7f90f80066b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910f958640 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2261ad330 0x55d2262a3fe0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.453+0000 7f910f958640 1 -- 172.21.15.151:0/3382126955 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91080083f0 con 0x55d2261ad330 2024-09-12T16:52:22.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262a4990 con 0x55d2261ad330 2024-09-12T16:52:22.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f958640 1 -- 172.21.15.151:0/3382126955 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91080083f0 con 0x55d2261ad330 2024-09-12T16:52:22.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262a67a0 0x55d2262a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262a9280 con 0x55d2262a67a0 2024-09-12T16:52:22.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f157640 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262a67a0 0x55d2262a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f157640 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262a67a0 0x55d2262a8b90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f157640 1 -- 172.21.15.151:0/3382126955 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f91000cd020 con 0x55d2262a67a0 2024-09-12T16:52:22.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262a5640 con 0x55d2261ad330 2024-09-12T16:52:22.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f958640 1 -- 172.21.15.151:0/3382126955 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f91080083f0 con 0x55d2261ad330 2024-09-12T16:52:22.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262a5ae0 con 0x55d2261ad330 2024-09-12T16:52:22.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f958640 1 -- 172.21.15.151:0/3382126955 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f91080083f0 con 0x55d2261ad330 2024-09-12T16:52:22.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 Processor -- start 2024-09-12T16:52:22.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 -- start start 2024-09-12T16:52:22.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262b7910 0x55d2262b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f91116519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d2260bd450 con 0x55d2262b7910 2024-09-12T16:52:22.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f958640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262b7910 0x55d2262b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f958640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262b7910 0x55d2262b7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33790/0 (socket says 172.21.15.151:33790) 2024-09-12T16:52:22.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.457+0000 7f910f958640 1 -- 172.21.15.151:0/3571719087 learned_addr learned my addr 172.21.15.151:0/3571719087 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f910f958640 1 -- 172.21.15.151:0/3571719087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2262b8370 con 0x55d2262b7910 2024-09-12T16:52:22.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f910f958640 1 --2- 172.21.15.151:0/3571719087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262b7910 0x55d2262b7d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55d22629e200 tx=0x7f910800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f8ff9602640 1 -- 172.21.15.151:0/3571719087 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9108007dd0 con 0x55d2262b7910 2024-09-12T16:52:22.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f8ff9602640 1 -- 172.21.15.151:0/3571719087 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f910801e020 con 0x55d2262b7910 2024-09-12T16:52:22.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f91116519c0 1 -- 172.21.15.151:0/3571719087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2262b8bd0 con 0x55d2262b7910 2024-09-12T16:52:22.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f8ff9602640 1 -- 172.21.15.151:0/3571719087 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9108019590 con 0x55d2262b7910 2024-09-12T16:52:22.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f91116519c0 1 -- 172.21.15.151:0/3571719087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2262b9140 con 0x55d2262b7910 2024-09-12T16:52:22.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f8ff9602640 1 -- 172.21.15.151:0/3571719087 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9108016040 con 0x55d2262b7910 2024-09-12T16:52:22.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f8ff9602640 1 --2- 172.21.15.151:0/3571719087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fe8039a70 0x7f8fe803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f8ff9602640 1 -- 172.21.15.151:0/3571719087 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f910801f030 con 0x55d2262b7910 2024-09-12T16:52:22.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f910f157640 1 --2- 172.21.15.151:0/3571719087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fe8039a70 0x7f8fe803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f91116519c0 1 Processor -- start 2024-09-12T16:52:22.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f91116519c0 1 -- start start 2024-09-12T16:52:22.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f910f157640 1 --2- 172.21.15.151:0/3571719087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fe8039a70 0x7f8fe803bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d22629e300 tx=0x7f91000c6f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f91116519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f91116519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d226296010 con 0x55d2262c52c0 2024-09-12T16:52:22.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f910f958640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f910f958640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262c56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33802/0 (socket says 172.21.15.151:33802) 2024-09-12T16:52:22.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.461+0000 7f910f958640 1 -- 172.21.15.151:0/4223524151 learned_addr learned my addr 172.21.15.151:0/4223524151 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f910f958640 1 -- 172.21.15.151:0/4223524151 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2262c5cb0 con 0x55d2262c52c0 2024-09-12T16:52:22.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f910f958640 1 --2- 172.21.15.151:0/4223524151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262c56c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9108050950 tx=0x7f9108017780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb6f67f6108dd4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f8ff2ffd640 1 -- 172.21.15.151:0/4223524151 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f910801d070 con 0x55d2262c52c0 2024-09-12T16:52:22.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f8ff2ffd640 1 -- 172.21.15.151:0/4223524151 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9108017c60 con 0x55d2262c52c0 2024-09-12T16:52:22.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f8ff2ffd640 1 -- 172.21.15.151:0/4223524151 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91080520d0 con 0x55d2262c52c0 2024-09-12T16:52:22.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- 172.21.15.151:0/4223524151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 msgr2=0x55d2262c56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 --2- 172.21.15.151:0/4223524151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262c56c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9108050950 tx=0x7f9108017780 comp rx=0 tx=0).stop 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- 172.21.15.151:0/4223524151 shutdown_connections 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 --2- 172.21.15.151:0/4223524151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262c56c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- 172.21.15.151:0/4223524151 >> 172.21.15.151:0/4223524151 conn(0x55d2262c06e0 msgr2=0x55d2262be920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- 172.21.15.151:0/4223524151 shutdown_connections 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- 172.21.15.151:0/4223524151 wait complete. 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 Processor -- start 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- start start 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d2262c4210 con 0x55d2262c52c0 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f910f958640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f910f958640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33810/0 (socket says 172.21.15.151:33810) 2024-09-12T16:52:22.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 learned_addr learned my addr 172.21.15.151:0/1916495753 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2262cbcf0 con 0x55d2262c52c0 2024-09-12T16:52:22.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f910f958640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262cb790 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9108008a50 tx=0x7f91080508b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f8ff17fa640 1 -- 172.21.15.151:0/1916495753 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f910802b350 con 0x55d2262c52c0 2024-09-12T16:52:22.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2262cbf80 con 0x55d2262c52c0 2024-09-12T16:52:22.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f8ff17fa640 1 -- 172.21.15.151:0/1916495753 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9108032020 con 0x55d2262c52c0 2024-09-12T16:52:22.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2262cbf80 con 0x55d2262c52c0 2024-09-12T16:52:22.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.465+0000 7f8ff17fa640 1 -- 172.21.15.151:0/1916495753 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f910804f560 con 0x55d2262c52c0 2024-09-12T16:52:22.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f8ff17fa640 1 -- 172.21.15.151:0/1916495753 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9108050c70 con 0x55d2262c52c0 2024-09-12T16:52:22.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f8ff17fa640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fd8039a70 0x7f8fd803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f8ff17fa640 1 -- 172.21.15.151:0/1916495753 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9108033030 con 0x55d2262c52c0 2024-09-12T16:52:22.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910f157640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fd8039a70 0x7f8fd803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2262d68c0 0x55d2262d8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262d94a0 con 0x55d2262d68c0 2024-09-12T16:52:22.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910e956640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2262d68c0 0x55d2262d8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910f157640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fd8039a70 0x7f8fd803bf30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91000acf30 tx=0x7f91000e7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910e956640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2262d68c0 0x55d2262d8d50 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 realm 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262d5c30 con 0x55d2262d68c0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262d9fa0 con 0x55d2262d68c0 2024-09-12T16:52:22.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262da870 con 0x55d2262d68c0 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262db290 0x55d2262dd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262ddd70 con 0x55d2262db290 2024-09-12T16:52:22.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.469+0000 7f910f958640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262db290 0x55d2262dd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f958640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262db290 0x55d2262dd680 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f910802a070 con 0x55d2262db290 2024-09-12T16:52:22.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f91116519c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f91116519c0 20 searching for the correct realm 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d2262dfcc0 0x55d2262e20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262dfcc0 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f157640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d2262dfcc0 0x55d2262e20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f157640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d2262dfcc0 0x55d2262e20f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f157640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9100009040 0x7f91000c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x7f9100009040 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910e956640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9100009040 0x7f91000c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910e956640 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9100009040 0x7f91000c53a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262db290 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262d68c0 2024-09-12T16:52:22.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.473+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262d68c0 2024-09-12T16:52:22.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262db290 2024-09-12T16:52:22.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262db290 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x7f9100009040 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262dfcc0 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262d68c0 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262db290 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262d68c0 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x7f9100009040 2024-09-12T16:52:22.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e27c0 con 0x55d2262dfcc0 2024-09-12T16:52:22.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.477+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262dfcc0 2024-09-12T16:52:22.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262db290 2024-09-12T16:52:22.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262dfcc0 2024-09-12T16:52:22.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262dfcc0 2024-09-12T16:52:22.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262d68c0 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262d68c0 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262db290 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262dfcc0 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x7f9100009040 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262d68c0 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.481+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262db290 2024-09-12T16:52:22.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262dfcc0 2024-09-12T16:52:22.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262db290 2024-09-12T16:52:22.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x7f9100009040 2024-09-12T16:52:22.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262dfcc0 2024-09-12T16:52:22.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262db290 2024-09-12T16:52:22.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x55d2262d68c0 2024-09-12T16:52:22.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9100104040 con 0x7f9100009040 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f91116519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f91116519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f91116519c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f91116519c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f91116519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f91116519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262de730 con 0x55d2262d68c0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.485+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262defd0 con 0x55d2262d68c0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262de370 con 0x55d2262d68c0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 zone default found 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 4 Realm: () 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:22.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 zonegroup default 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e2c40 con 0x55d2262db290 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e4ed0 con 0x55d2262dfcc0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e52c0 con 0x55d2262dfcc0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 started sync module instance, tier type = 2024-09-12T16:52:22.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:22.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e4360 con 0x7f9100009040 2024-09-12T16:52:22.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94361072060512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e4360 con 0x7f9100009040 2024-09-12T16:52:22.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.489+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e5da0 con 0x55d2262d68c0 2024-09-12T16:52:22.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.493+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94361072060512] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.493+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.493+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94361072064656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e4360 con 0x55d2262d68c0 2024-09-12T16:52:22.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.493+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e67b0 con 0x55d2262dfcc0 2024-09-12T16:52:22.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.493+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.493+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94361072064656] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.493+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94361072067328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e7000 con 0x55d2262dfcc0 2024-09-12T16:52:22.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.493+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e3eb0 con 0x7f9100009040 2024-09-12T16:52:22.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.497+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.497+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94361072071952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e7de0 con 0x7f9100009040 2024-09-12T16:52:22.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.497+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e87a0 con 0x55d2262d68c0 2024-09-12T16:52:22.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.497+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94361072067328] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.497+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.497+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94361072069456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e87a0 con 0x55d2262d68c0 2024-09-12T16:52:22.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.497+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e9050 con 0x55d2262db290 2024-09-12T16:52:22.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.497+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94361072071952] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.501+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94361072069456] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.501+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.501+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94361072073008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e87a0 con 0x55d2262db290 2024-09-12T16:52:22.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.501+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e98f0 con 0x55d2262db290 2024-09-12T16:52:22.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.501+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94361072073008] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.501+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.501+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94361072075504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e8710 con 0x55d2262db290 2024-09-12T16:52:22.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.501+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e9f10 con 0x55d2262db290 2024-09-12T16:52:22.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94361072081504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262ea330 con 0x55d2262db290 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 20 add_watcher() i=0 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 20 add_watcher() i=1 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 20 add_watcher() i=2 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 20 add_watcher() i=3 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 20 add_watcher() i=4 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 20 add_watcher() i=5 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94361072075504] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 20 add_watcher() i=6 2024-09-12T16:52:22.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94361072081504] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 20 add_watcher() i=7 2024-09-12T16:52:22.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:22.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.505+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e9440 con 0x55d2262d68c0 2024-09-12T16:52:22.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94361072079936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262ea810 con 0x55d2262d68c0 2024-09-12T16:52:22.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94361072079936] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f8fc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:22.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:22.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 5 note: GC not initialized 2024-09-12T16:52:22.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f8fc57e2640 20 reqs_thread_entry: start 2024-09-12T16:52:22.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 20 Filter name: none 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f8fbe7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d226310580 con 0x55d2262db290 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.509+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d226312670 con 0x7f9100009040 2024-09-12T16:52:22.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d2263140b0 con 0x55d2262db290 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(64 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:22.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:22.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-12T16:52:22.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.513+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d226317270 con 0x55d2262db290 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d226316360 con 0x7f9100009040 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d226316e00 con 0x7f9100009040 2024-09-12T16:52:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T16:52:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T16:52:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94361072265376 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d226316e00 con 0x55d2262db290 2024-09-12T16:52:22.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== watch-notify(notify (1) cookie 94361072075504 notify 137438953476 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55d2263135f0 con 0x55d2262db290 2024-09-12T16:52:22.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f8ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94361072075504 notifier 4516 bl.length()=338 2024-09-12T16:52:22.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f8ff2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T16:52:22.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.517+0000 7f8ff2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.521+0000 7f8ff2ffd640 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8fd4003eb0 con 0x55d2262db290 2024-09-12T16:52:22.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.521+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(68 notify.6 [notify cookie 94361072265376 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.521+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.521+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== watch-notify(notify_complete (2) cookie 94361072265376 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d2262c5cb0 con 0x55d2262db290 2024-09-12T16:52:22.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.521+0000 7f8fc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.521+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94361072079936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d226316dc0 con 0x55d2262d68c0 2024-09-12T16:52:22.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.521+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94361072079936] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.521+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94361072060512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d226316d90 con 0x7f9100009040 2024-09-12T16:52:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.525+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94361072060512] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.525+0000 7f91116519c0 20 remove_watcher() i=0 2024-09-12T16:52:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.525+0000 7f91116519c0 2 removed watcher, disabling cache 2024-09-12T16:52:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.525+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94361072064656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d226316d90 con 0x55d2262d68c0 2024-09-12T16:52:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.525+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94361072064656] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.525+0000 7f91116519c0 20 remove_watcher() i=1 2024-09-12T16:52:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.525+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94361072067328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d226316d90 con 0x55d2262dfcc0 2024-09-12T16:52:22.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.529+0000 7f910f157640 1 -- 172.21.15.151:0/1916495753 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94361072067328] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91000f5070 con 0x55d2262dfcc0 2024-09-12T16:52:22.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.529+0000 7f91116519c0 20 remove_watcher() i=2 2024-09-12T16:52:22.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.529+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94361072071952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e5890 con 0x7f9100009040 2024-09-12T16:52:22.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.529+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94361072071952] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x7f9100009040 2024-09-12T16:52:22.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.529+0000 7f91116519c0 20 remove_watcher() i=3 2024-09-12T16:52:22.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.529+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94361072069456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e6300 con 0x55d2262d68c0 2024-09-12T16:52:22.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.533+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94361072069456] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90f800f030 con 0x55d2262d68c0 2024-09-12T16:52:22.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.533+0000 7f91116519c0 20 remove_watcher() i=4 2024-09-12T16:52:22.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.533+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94361072073008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e7510 con 0x55d2262db290 2024-09-12T16:52:22.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.533+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94361072073008] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.533+0000 7f91116519c0 20 remove_watcher() i=5 2024-09-12T16:52:22.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.533+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94361072075504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e5890 con 0x55d2262db290 2024-09-12T16:52:22.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94361072075504] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 20 remove_watcher() i=6 2024-09-12T16:52:22.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94361072081504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d2262e6300 con 0x55d2262db290 2024-09-12T16:52:22.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f910f958640 1 -- 172.21.15.151:0/1916495753 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94361072081504] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f910805c040 con 0x55d2262db290 2024-09-12T16:52:22.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 20 remove_watcher() i=7 2024-09-12T16:52:22.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262db290 msgr2=0x55d2262dd680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262db290 0x55d2262dd680 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2262d68c0 msgr2=0x55d2262d8d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2262d68c0 0x55d2262d8d50 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9100009040 msgr2=0x7f91000c53a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f9100009040 0x7f91000c53a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d2262dfcc0 msgr2=0x55d2262e20f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d2262dfcc0 0x55d2262e20f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fd8039a70 msgr2=0x7f8fd803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fd8039a70 0x7f8fd803bf30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91000acf30 tx=0x7f91000e7000 comp rx=0 tx=0).stop 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 msgr2=0x55d2262cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f910e956640 1 -- 172.21.15.151:0/1916495753 reap_dead start 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262cb790 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9108008a50 tx=0x7f91080508b0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 shutdown_connections 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/1916495753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262c52c0 0x55d2262cb790 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 >> 172.21.15.151:0/1916495753 conn(0x55d2262c06e0 msgr2=0x55d2262be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 shutdown_connections 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/1916495753 wait complete. 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/3571719087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fe8039a70 msgr2=0x7f8fe803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/3571719087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fe8039a70 0x7f8fe803bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d22629e300 tx=0x7f91000c6f20 comp rx=0 tx=0).stop 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 -- 172.21.15.151:0/3571719087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262b7910 msgr2=0x55d2262b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.537+0000 7f91116519c0 1 --2- 172.21.15.151:0/3571719087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262b7910 0x55d2262b7d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55d22629e200 tx=0x7f910800af40 comp rx=0 tx=0).stop 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3571719087 shutdown_connections 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3571719087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8fe8039a70 0x7f8fe803bf30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3571719087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2262b7910 0x55d2262b7d30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3571719087 >> 172.21.15.151:0/3571719087 conn(0x55d2262ad2c0 msgr2=0x55d2262ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3571719087 shutdown_connections 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3571719087 wait complete. 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262a67a0 msgr2=0x55d2262a8b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262a67a0 0x55d2262a8b90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2261ad330 msgr2=0x55d2262a3fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2261ad330 0x55d2262a3fe0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ff4039a70 msgr2=0x7f8ff403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ff4039a70 0x7f8ff403bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f90f80015d0 tx=0x7f90f80066b0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 msgr2=0x55d22629ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d22629ce70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f910001b820 tx=0x7f91000180e0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 shutdown_connections 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d2262a67a0 0x55d2262a8b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d2261ad330 0x55d2262a3fe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ff4039a70 0x7f8ff403bf30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 --2- 172.21.15.151:0/3382126955 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2261aa1f0 0x55d22629ce70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 >> 172.21.15.151:0/3382126955 conn(0x55d22611db00 msgr2=0x55d22628ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 shutdown_connections 2024-09-12T16:52:22.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.541+0000 7f91116519c0 1 -- 172.21.15.151:0/3382126955 wait complete. 2024-09-12T16:52:22.553 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1'] 2024-09-12T16:52:22.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1'] 2024-09-12T16:52:22.554 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:22.633 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:22.634 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:22.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b27a399c0 1 Processor -- start 2024-09-12T16:52:22.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b27a399c0 1 -- start start 2024-09-12T16:52:22.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b27a399c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55b2afa74f30 0x55b2afa75310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b27a399c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b2af9299c0 con 0x55b2afa780c0 2024-09-12T16:52:22.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b27a399c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55b2af9796d0 con 0x55b2afa74f30 2024-09-12T16:52:22.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b2553f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55b2afa74f30 0x55b2afa75310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b24d3e640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55b2afa780c0 0x55b2afa7a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42650/0 (socket says 172.21.15.151:42650) 2024-09-12T16:52:22.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2519353996 learned_addr learned my addr 172.21.15.151:0/2519353996 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:22.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b2553f640 1 --2- 172.21.15.151:0/2519353996 >> v2:172.21.15.122:3300/0 conn(0x55b2afa74f30 0x55b2afa75310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33824/0 (socket says 172.21.15.151:33824) 2024-09-12T16:52:22.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b2553f640 1 -- 172.21.15.151:0/2519353996 >> v1:172.21.15.122:6789/0 conn(0x55b2afa780c0 legacy=0x55b2afa7a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.633+0000 7f7b2553f640 1 -- 172.21.15.151:0/2519353996 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2af91dca0 con 0x55b2afa74f30 2024-09-12T16:52:22.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b2553f640 1 --2- 172.21.15.151:0/2519353996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afa75310 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000a420 tx=0x7f7b2001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b3360810750361 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b17fff640 1 -- 172.21.15.151:0/2519353996 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b200af070 con 0x55b2afa74f30 2024-09-12T16:52:22.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b17fff640 1 -- 172.21.15.151:0/2519353996 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b200aa530 con 0x55b2afa74f30 2024-09-12T16:52:22.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b17fff640 1 -- 172.21.15.151:0/2519353996 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b200aa850 con 0x55b2afa74f30 2024-09-12T16:52:22.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2519353996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 msgr2=0x55b2afa75310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2519353996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afa75310 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000a420 tx=0x7f7b2001afd0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2519353996 shutdown_connections 2024-09-12T16:52:22.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2519353996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afa75310 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2519353996 >> 172.21.15.151:0/2519353996 conn(0x55b2afa70a50 msgr2=0x55b2afa72e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2519353996 shutdown_connections 2024-09-12T16:52:22.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.637+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2519353996 wait complete. 2024-09-12T16:52:22.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 Processor -- start 2024-09-12T16:52:22.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 -- start start 2024-09-12T16:52:22.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2af9eb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b2af97d680 con 0x55b2afa74f30 2024-09-12T16:52:22.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b2553f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2af9eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b2553f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2af9eb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33832/0 (socket says 172.21.15.151:33832) 2024-09-12T16:52:22.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b2553f640 1 -- 172.21.15.151:0/3300348691 learned_addr learned my addr 172.21.15.151:0/3300348691 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b2553f640 1 -- 172.21.15.151:0/3300348691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2af8f8da0 con 0x55b2afa74f30 2024-09-12T16:52:22.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b2553f640 1 --2- 172.21.15.151:0/3300348691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2af9eb990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7b20018c00 tx=0x7f7b200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34d9d700c02977c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7a13606640 1 -- 172.21.15.151:0/3300348691 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b200af040 con 0x55b2afa74f30 2024-09-12T16:52:22.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7a13606640 1 -- 172.21.15.151:0/3300348691 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b200aaa00 con 0x55b2afa74f30 2024-09-12T16:52:22.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7a13606640 1 -- 172.21.15.151:0/3300348691 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b200aace0 con 0x55b2afa74f30 2024-09-12T16:52:22.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3300348691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 msgr2=0x55b2af9eb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3300348691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2af9eb990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7b20018c00 tx=0x7f7b200033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3300348691 shutdown_connections 2024-09-12T16:52:22.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3300348691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2af9eb990 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.653+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3300348691 >> 172.21.15.151:0/3300348691 conn(0x55b2afa70a50 msgr2=0x55b2afb5c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3300348691 shutdown_connections 2024-09-12T16:52:22.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3300348691 wait complete. 2024-09-12T16:52:22.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b27a399c0 1 Processor -- start 2024-09-12T16:52:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b27a399c0 1 -- start start 2024-09-12T16:52:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b27a399c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afb69ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b27a399c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b2af91fa50 con 0x55b2afa74f30 2024-09-12T16:52:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b2553f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afb69ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b2553f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afb69ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33834/0 (socket says 172.21.15.151:33834) 2024-09-12T16:52:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b2553f640 1 -- 172.21.15.151:0/3762810534 learned_addr learned my addr 172.21.15.151:0/3762810534 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b2553f640 1 -- 172.21.15.151:0/3762810534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2afb6a400 con 0x55b2afa74f30 2024-09-12T16:52:22.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b2553f640 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afb69ea0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7b20000f90 tx=0x7f7b20017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7a11e03640 1 -- 172.21.15.151:0/3762810534 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b200c5030 con 0x55b2afa74f30 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2afb6a690 con 0x55b2afa74f30 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7a11e03640 1 -- 172.21.15.151:0/3762810534 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b200c1690 con 0x55b2afa74f30 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7a11e03640 1 -- 172.21.15.151:0/3762810534 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b200c1990 con 0x55b2afa74f30 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2afb6b0c0 con 0x55b2afa74f30 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7a11e03640 1 -- 172.21.15.151:0/3762810534 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7b200c8070 con 0x55b2afa74f30 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7a11e03640 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7a0c039a70 0x7f7a0c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.657+0000 7f7a11e03640 1 -- 172.21.15.151:0/3762810534 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7b200c6070 con 0x55b2afa74f30 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b24d3e640 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7a0c039a70 0x7f7a0c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afa780c0 0x55b2afb71010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afb71550 con 0x55b2afa780c0 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b25d40640 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afa780c0 0x55b2afb71010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b24d3e640 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7a0c039a70 0x7f7a0c03bf30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c001d80 tx=0x7f7b1c0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b25d40640 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afa780c0 0x55b2afb71010 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b25d40640 1 -- 172.21.15.151:0/3762810534 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1800a510 con 0x55b2afa780c0 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afb71950 con 0x55b2afa780c0 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b25d40640 1 -- 172.21.15.151:0/3762810534 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b1800a510 con 0x55b2afa780c0 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afb73760 0x55b2afb75b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afb76240 con 0x55b2afb73760 2024-09-12T16:52:22.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b2553f640 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afb73760 0x55b2afb75b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b2553f640 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afb73760 0x55b2afb75b50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b2553f640 1 -- 172.21.15.151:0/3762810534 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afb73760 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afb725d0 con 0x55b2afa780c0 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b25d40640 1 -- 172.21.15.151:0/3762810534 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b1800a510 con 0x55b2afa780c0 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.661+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afb72a70 con 0x55b2afa780c0 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b25d40640 1 -- 172.21.15.151:0/3762810534 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b1800a510 con 0x55b2afa780c0 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b27a399c0 1 Processor -- start 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b27a399c0 1 -- start start 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b27a399c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb848a0 0x55b2afb84cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b27a399c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b2af98a450 con 0x55b2afb848a0 2024-09-12T16:52:22.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b25d40640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb848a0 0x55b2afb84cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b25d40640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb848a0 0x55b2afb84cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33846/0 (socket says 172.21.15.151:33846) 2024-09-12T16:52:22.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b25d40640 1 -- 172.21.15.151:0/1720630410 learned_addr learned my addr 172.21.15.151:0/1720630410 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b25d40640 1 -- 172.21.15.151:0/1720630410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2afb85300 con 0x55b2afb848a0 2024-09-12T16:52:22.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b25d40640 1 --2- 172.21.15.151:0/1720630410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb848a0 0x55b2afb84cc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55b2afb6a8e0 tx=0x7f7b18008f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7a0affd640 1 -- 172.21.15.151:0/1720630410 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b18007d50 con 0x55b2afb848a0 2024-09-12T16:52:22.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7a0affd640 1 -- 172.21.15.151:0/1720630410 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1801e020 con 0x55b2afb848a0 2024-09-12T16:52:22.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1720630410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2afb85b60 con 0x55b2afb848a0 2024-09-12T16:52:22.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7a0affd640 1 -- 172.21.15.151:0/1720630410 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b18019590 con 0x55b2afb848a0 2024-09-12T16:52:22.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1720630410 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2afb860d0 con 0x55b2afb848a0 2024-09-12T16:52:22.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7a0affd640 1 -- 172.21.15.151:0/1720630410 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7b18016040 con 0x55b2afb848a0 2024-09-12T16:52:22.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7a0affd640 1 --2- 172.21.15.151:0/1720630410 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79fc039a70 0x7f79fc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7a0affd640 1 -- 172.21.15.151:0/1720630410 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7b1801f030 con 0x55b2afb848a0 2024-09-12T16:52:22.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.665+0000 7f7b2553f640 1 --2- 172.21.15.151:0/1720630410 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79fc039a70 0x7f79fc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 Processor -- start 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- start start 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b2553f640 1 --2- 172.21.15.151:0/1720630410 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79fc039a70 0x7f79fc03bf30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b200a9df0 tx=0x7f7b200b6870 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb92610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b2af9ec100 con 0x55b2afb92210 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb92610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb92610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33862/0 (socket says 172.21.15.151:33862) 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 -- 172.21.15.151:0/1751082822 learned_addr learned my addr 172.21.15.151:0/1751082822 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 -- 172.21.15.151:0/1751082822 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2afb92c00 con 0x55b2afb92210 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 --2- 172.21.15.151:0/1751082822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb92610 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7b18050960 tx=0x7f7b18019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aa3a6f371f18a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7a08ff9640 1 -- 172.21.15.151:0/1751082822 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1801d040 con 0x55b2afb92210 2024-09-12T16:52:22.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7a08ff9640 1 -- 172.21.15.151:0/1751082822 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b18023790 con 0x55b2afb92210 2024-09-12T16:52:22.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7a08ff9640 1 -- 172.21.15.151:0/1751082822 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b180173b0 con 0x55b2afb92210 2024-09-12T16:52:22.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1751082822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 msgr2=0x55b2afb92610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/1751082822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb92610 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7b18050960 tx=0x7f7b18019830 comp rx=0 tx=0).stop 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1751082822 shutdown_connections 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/1751082822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb92610 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1751082822 >> 172.21.15.151:0/1751082822 conn(0x55b2afb8d630 msgr2=0x55b2afb8b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1751082822 shutdown_connections 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1751082822 wait complete. 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 Processor -- start 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- start start 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b27a399c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b2afb91160 con 0x55b2afb92210 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33874/0 (socket says 172.21.15.151:33874) 2024-09-12T16:52:22.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 learned_addr learned my addr 172.21.15.151:0/2377372032 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.669+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2afb98c20 con 0x55b2afb92210 2024-09-12T16:52:22.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b25d40640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb986c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7b1804b010 tx=0x7f7b180508f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f79faffd640 1 -- 172.21.15.151:0/2377372032 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1801d030 con 0x55b2afb92210 2024-09-12T16:52:22.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2afb98eb0 con 0x55b2afb92210 2024-09-12T16:52:22.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f79faffd640 1 -- 172.21.15.151:0/2377372032 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b18031030 con 0x55b2afb92210 2024-09-12T16:52:22.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2afb99860 con 0x55b2afb92210 2024-09-12T16:52:22.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f79faffd640 1 -- 172.21.15.151:0/2377372032 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1803b060 con 0x55b2afb92210 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f79faffd640 1 -- 172.21.15.151:0/2377372032 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7b180520d0 con 0x55b2afb92210 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f79faffd640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79f0039a70 0x7f79f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f79faffd640 1 -- 172.21.15.151:0/2377372032 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7b1802e040 con 0x55b2afb92210 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b2553f640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79f0039a70 0x7f79f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afba3990 0x55b2afba5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afba6570 con 0x55b2afba3990 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b24d3e640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afba3990 0x55b2afba5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b2553f640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79f0039a70 0x7f79f003bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7b200cafd0 tx=0x7f7b200db000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b24d3e640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afba3990 0x55b2afba5e20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1c00e5a0 con 0x55b2afba3990 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 20 realm 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afba2da0 con 0x55b2afba3990 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1c00e5a0 con 0x55b2afba3990 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afba7070 con 0x55b2afba3990 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1c00e5a0 con 0x55b2afba3990 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.673+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afba7940 con 0x55b2afba3990 2024-09-12T16:52:22.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b1c00e5a0 con 0x55b2afba3990 2024-09-12T16:52:22.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b27a399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afba8360 0x55b2afbaa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaae40 con 0x55b2afba8360 2024-09-12T16:52:22.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b25d40640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afba8360 0x55b2afbaa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b25d40640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afba8360 0x55b2afbaa750 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b27a399c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b27a399c0 20 searching for the correct realm 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b2afbacd90 0x55b2afbaf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b2553f640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b2afbacd90 0x55b2afbaf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b2553f640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b2afbacd90 0x55b2afbaf1c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b2553f640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7b200ca030 0x7f7b200c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x7f7b200ca030 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b24d3e640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7b200ca030 0x7f7b200c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b24d3e640 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7b200ca030 0x7f7b200c03e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c00e5a0 con 0x7f7b200ca030 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.677+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba3990 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c00e5a0 con 0x55b2afba3990 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba3990 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x7f7b200ca030 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x7f7b200ca030 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba3990 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba3990 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x7f7b200ca030 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.681+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b1c029040 con 0x7f7b200ca030 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba3990 2024-09-12T16:52:22.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba3990 2024-09-12T16:52:22.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x7f7b200ca030 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x7f7b200ca030 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba3990 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.685+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x7f7b200ca030 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x7f7b200ca030 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afbacd90 2024-09-12T16:52:22.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba8360 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x55b2afba3990 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbaf890 con 0x7f7b200ca030 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1c029040 con 0x7f7b200ca030 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbab800 con 0x55b2afba3990 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbac0a0 con 0x55b2afba3990 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b1c029040 con 0x55b2afba3990 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.689+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbab440 con 0x55b2afba3990 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 zone default found 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 4 Realm: () 2024-09-12T16:52:22.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:22.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:22.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:22.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 zonegroup default 2024-09-12T16:52:22.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbac0a0 con 0x55b2afba8360 2024-09-12T16:52:22.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb1c00 con 0x55b2afbacd90 2024-09-12T16:52:22.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb1fa0 con 0x55b2afbacd90 2024-09-12T16:52:22.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 started sync module instance, tier type = 2024-09-12T16:52:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb1090 con 0x7f7b200ca030 2024-09-12T16:52:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94225940813232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb1090 con 0x7f7b200ca030 2024-09-12T16:52:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb2a90 con 0x55b2afba3990 2024-09-12T16:52:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.693+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94225940813232] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.697+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.697+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94225940817280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb1090 con 0x55b2afba3990 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.697+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb34a0 con 0x55b2afbacd90 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.697+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.697+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94225940819952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb3d40 con 0x55b2afbacd90 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.697+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb4700 con 0x7f7b200ca030 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.697+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94225940817280] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94225940824656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb4670 con 0x7f7b200ca030 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb5490 con 0x55b2afba3990 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94225940824656] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94225940819952] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94225940822160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb4f50 con 0x55b2afba3990 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb5d30 con 0x55b2afba8360 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94225940830336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb4f50 con 0x55b2afba8360 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.701+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb6a90 con 0x55b2afba8360 2024-09-12T16:52:22.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94225940822160] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94225940833664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb6c70 con 0x55b2afba8360 2024-09-12T16:52:22.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb74c0 con 0x55b2afba8360 2024-09-12T16:52:22.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94225940830336] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94225940833664] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94225940832464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb7120 con 0x55b2afba8360 2024-09-12T16:52:22.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 20 add_watcher() i=0 2024-09-12T16:52:22.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 20 add_watcher() i=1 2024-09-12T16:52:22.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 20 add_watcher() i=2 2024-09-12T16:52:22.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 20 add_watcher() i=3 2024-09-12T16:52:22.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 20 add_watcher() i=4 2024-09-12T16:52:22.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 20 add_watcher() i=5 2024-09-12T16:52:22.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.705+0000 7f7b27a399c0 20 add_watcher() i=6 2024-09-12T16:52:22.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94225940832464] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 20 add_watcher() i=7 2024-09-12T16:52:22.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:22.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbba350 con 0x55b2afba3990 2024-09-12T16:52:22.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94225940835808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbb76b0 con 0x55b2afba3990 2024-09-12T16:52:22.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94225940835808] v32'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f79db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:22.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:22.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 5 note: GC not initialized 2024-09-12T16:52:22.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f79da7e4640 20 reqs_thread_entry: start 2024-09-12T16:52:22.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:22.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f7b27a399c0 20 Filter name: none 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.709+0000 7f794bfff640 20 reqs_thread_entry: start 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbdd670 con 0x55b2afba3990 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbdf760 con 0x7f7b200ca030 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0fc0 con 0x55b2afba8360 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(64 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:22.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:22.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:22.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T16:52:22.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.713+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe52a0 con 0x55b2afba8360 2024-09-12T16:52:22.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbeb000 con 0x55b2afba8360 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(66 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1, ofs0, ns] 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94225941008096 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe56d0 con 0x55b2afba3990 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== watch-notify(notify (1) cookie 94225940817280 notify 137438953491 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55b2af9299c0 con 0x55b2afba3990 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7a08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94225940817280 notifier 4523 bl.length()=760 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7a08ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7a08ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7a08ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7a08ff9640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f79e8003eb0 con 0x55b2afba3990 2024-09-12T16:52:22.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(67 notify.1 [notify cookie 94225941008096 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== watch-notify(notify_complete (2) cookie 94225941008096 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7b1c02fd80 con 0x55b2afba3990 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_sources= new_sources= 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential sources added=[] removed=[] 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_dests= new_dests= 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential dests added=[] removed=[] 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.717+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe99c0 con 0x7f7b200ca030 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.721+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.721+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x7f7b200ca030 2024-09-12T16:52:22.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.721+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b27a399c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T16:52:22.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b27a399c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b27a399c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T16:52:22.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94225941019920 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x55b2afba8360 2024-09-12T16:52:22.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== watch-notify(notify (1) cookie 94225940833664 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55b2afb98c20 con 0x55b2afba8360 2024-09-12T16:52:22.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f79fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94225940833664 notifier 4523 bl.length()=314 2024-09-12T16:52:22.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f79fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T16:52:22.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f79fbfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:22.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(71 notify.6 [notify cookie 94225941019920 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f79fbfff640 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7958003410 con 0x55b2afba8360 2024-09-12T16:52:22.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== watch-notify(notify_complete (2) cookie 94225941019920 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b2afb92c00 con 0x55b2afba8360 2024-09-12T16:52:22.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f79db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94225940835808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x55b2afba3990 2024-09-12T16:52:22.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94225940835808] v32'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.725+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94225940813232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x7f7b200ca030 2024-09-12T16:52:22.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.729+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94225940813232] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.729+0000 7f7b27a399c0 20 remove_watcher() i=0 2024-09-12T16:52:22.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.729+0000 7f7b27a399c0 2 removed watcher, disabling cache 2024-09-12T16:52:22.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.729+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94225940817280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x55b2afba3990 2024-09-12T16:52:22.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.729+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94225940817280] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.729+0000 7f7b27a399c0 20 remove_watcher() i=1 2024-09-12T16:52:22.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.729+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94225940819952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x55b2afbacd90 2024-09-12T16:52:22.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b2553f640 1 -- 172.21.15.151:0/2377372032 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94225940819952] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b200b2040 con 0x55b2afbacd90 2024-09-12T16:52:22.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b27a399c0 20 remove_watcher() i=2 2024-09-12T16:52:22.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94225940824656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x7f7b200ca030 2024-09-12T16:52:22.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94225940824656] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x7f7b200ca030 2024-09-12T16:52:22.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b27a399c0 20 remove_watcher() i=3 2024-09-12T16:52:22.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94225940822160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x55b2afba3990 2024-09-12T16:52:22.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94225940822160] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1c0391c0 con 0x55b2afba3990 2024-09-12T16:52:22.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b27a399c0 20 remove_watcher() i=4 2024-09-12T16:52:22.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.733+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94225940830336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x55b2afba8360 2024-09-12T16:52:22.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.737+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94225940830336] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.737+0000 7f7b27a399c0 20 remove_watcher() i=5 2024-09-12T16:52:22.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.737+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94225940833664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x55b2afba8360 2024-09-12T16:52:22.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.737+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94225940833664] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.737+0000 7f7b27a399c0 20 remove_watcher() i=6 2024-09-12T16:52:22.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.737+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94225940832464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2afbe0ee0 con 0x55b2afba8360 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b25d40640 1 -- 172.21.15.151:0/2377372032 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94225940832464] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b18050d70 con 0x55b2afba8360 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 20 remove_watcher() i=7 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afba8360 msgr2=0x55b2afbaa750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afba8360 0x55b2afbaa750 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afba3990 msgr2=0x55b2afba5e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afba3990 0x55b2afba5e20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7b200ca030 msgr2=0x7f7b200c03e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7b200ca030 0x7f7b200c03e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b2afbacd90 msgr2=0x55b2afbaf1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b2afbacd90 0x55b2afbaf1c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79f0039a70 msgr2=0x7f79f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79f0039a70 0x7f79f003bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7b200cafd0 tx=0x7f7b200db000 comp rx=0 tx=0).stop 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b24d3e640 1 -- 172.21.15.151:0/2377372032 reap_dead start 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 msgr2=0x55b2afb986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb986c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7b1804b010 tx=0x7f7b180508f0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 shutdown_connections 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/2377372032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb92210 0x55b2afb986c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 >> 172.21.15.151:0/2377372032 conn(0x55b2afb8d630 msgr2=0x55b2afb8b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 shutdown_connections 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/2377372032 wait complete. 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1720630410 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79fc039a70 msgr2=0x7f79fc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/1720630410 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79fc039a70 0x7f79fc03bf30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b200a9df0 tx=0x7f7b200b6870 comp rx=0 tx=0).stop 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1720630410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb848a0 msgr2=0x55b2afb84cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/1720630410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb848a0 0x55b2afb84cc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55b2afb6a8e0 tx=0x7f7b18008f10 comp rx=0 tx=0).stop 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1720630410 shutdown_connections 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/1720630410 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f79fc039a70 0x7f79fc03bf30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/1720630410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afb848a0 0x55b2afb84cc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1720630410 >> 172.21.15.151:0/1720630410 conn(0x55b2afb7a250 msgr2=0x55b2afb7a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1720630410 shutdown_connections 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/1720630410 wait complete. 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afb73760 msgr2=0x55b2afb75b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afb73760 0x55b2afb75b50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afa780c0 msgr2=0x55b2afb71010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afa780c0 0x55b2afb71010 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7a0c039a70 msgr2=0x7f7a0c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7a0c039a70 0x7f7a0c03bf30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c001d80 tx=0x7f7b1c0012e0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 msgr2=0x55b2afb69ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afb69ea0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7b20000f90 tx=0x7f7b20017d70 comp rx=0 tx=0).stop 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 shutdown_connections 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b2afb73760 0x55b2afb75b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b2afa780c0 0x55b2afb71010 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7a0c039a70 0x7f7a0c03bf30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 --2- 172.21.15.151:0/3762810534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b2afa74f30 0x55b2afb69ea0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 >> 172.21.15.151:0/3762810534 conn(0x55b2afa70a50 msgr2=0x55b2af9ea5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 shutdown_connections 2024-09-12T16:52:22.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.741+0000 7f7b27a399c0 1 -- 172.21.15.151:0/3762810534 wait complete. 2024-09-12T16:52:22.754 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T16:52:22.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T16:52:22.755 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T16:52:22.831 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:22.831 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:22.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feebd0989c0 1 Processor -- start 2024-09-12T16:52:22.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feebd0989c0 1 -- start start 2024-09-12T16:52:22.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feebd0989c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5598f306f700 0x5598f3071af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feebd0989c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598f2f199c0 con 0x5598f2fdbfa0 2024-09-12T16:52:22.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feebd0989c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5598f2f696d0 con 0x5598f306f700 2024-09-12T16:52:22.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feeba39d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5598f306f700 0x5598f3071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feeba39d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5598f306f700 0x5598f3071af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33884/0 (socket says 172.21.15.151:33884) 2024-09-12T16:52:22.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feeba39d640 1 -- 172.21.15.151:0/3862791430 learned_addr learned my addr 172.21.15.151:0/3862791430 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feebab9e640 1 --1- 172.21.15.151:0/3862791430 >> v1:172.21.15.122:6789/0 conn(0x5598f2fdbfa0 0x5598f2fdc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42658/0 (socket says 172.21.15.151:42658) 2024-09-12T16:52:22.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feeba39d640 1 -- 172.21.15.151:0/3862791430 >> v1:172.21.15.122:6789/0 conn(0x5598f2fdbfa0 legacy=0x5598f2fdc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.829+0000 7feeba39d640 1 -- 172.21.15.151:0/3862791430 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f2f0dca0 con 0x5598f306f700 2024-09-12T16:52:22.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feeba39d640 1 --2- 172.21.15.151:0/3862791430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f306f700 0x5598f3071af0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7feea400a5c0 tx=0x7feea401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05356c2bd7ff17d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feeb9b9c640 1 -- 172.21.15.151:0/3862791430 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea40a9590 con 0x5598f306f700 2024-09-12T16:52:22.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feeb9b9c640 1 -- 172.21.15.151:0/3862791430 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea40ae070 con 0x5598f306f700 2024-09-12T16:52:22.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feeb9b9c640 1 -- 172.21.15.151:0/3862791430 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea40a9880 con 0x5598f306f700 2024-09-12T16:52:22.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feebd0989c0 1 -- 172.21.15.151:0/3862791430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f306f700 msgr2=0x5598f3071af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feebd0989c0 1 --2- 172.21.15.151:0/3862791430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f306f700 0x5598f3071af0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7feea400a5c0 tx=0x7feea401b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feebd0989c0 1 -- 172.21.15.151:0/3862791430 shutdown_connections 2024-09-12T16:52:22.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feebd0989c0 1 --2- 172.21.15.151:0/3862791430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f306f700 0x5598f3071af0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feebd0989c0 1 -- 172.21.15.151:0/3862791430 >> 172.21.15.151:0/3862791430 conn(0x5598f2fdab10 msgr2=0x5598f2fdaf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feebd0989c0 1 -- 172.21.15.151:0/3862791430 shutdown_connections 2024-09-12T16:52:22.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.833+0000 7feebd0989c0 1 -- 172.21.15.151:0/3862791430 wait complete. 2024-09-12T16:52:22.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.845+0000 7feebd0989c0 1 Processor -- start 2024-09-12T16:52:22.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.845+0000 7feebd0989c0 1 -- start start 2024-09-12T16:52:22.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.845+0000 7feebd0989c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f3156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598f2f6d680 con 0x5598f2fdbfa0 2024-09-12T16:52:22.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebab9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f3156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebab9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f3156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33892/0 (socket says 172.21.15.151:33892) 2024-09-12T16:52:22.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebab9e640 1 -- 172.21.15.151:0/3432462165 learned_addr learned my addr 172.21.15.151:0/3432462165 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebab9e640 1 -- 172.21.15.151:0/3432462165 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f2ee8da0 con 0x5598f2fdbfa0 2024-09-12T16:52:22.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebab9e640 1 --2- 172.21.15.151:0/3432462165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f3156cc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7feeac001680 tx=0x7feeac001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56b7c07118ed74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feda8e09640 1 -- 172.21.15.151:0/3432462165 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac013420 con 0x5598f2fdbfa0 2024-09-12T16:52:22.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feda8e09640 1 -- 172.21.15.151:0/3432462165 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac0135c0 con 0x5598f2fdbfa0 2024-09-12T16:52:22.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feda8e09640 1 -- 172.21.15.151:0/3432462165 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac0138e0 con 0x5598f2fdbfa0 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 -- 172.21.15.151:0/3432462165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 msgr2=0x5598f3156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 --2- 172.21.15.151:0/3432462165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f3156cc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7feeac001680 tx=0x7feeac001b40 comp rx=0 tx=0).stop 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 -- 172.21.15.151:0/3432462165 shutdown_connections 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 --2- 172.21.15.151:0/3432462165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f3156cc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 -- 172.21.15.151:0/3432462165 >> 172.21.15.151:0/3432462165 conn(0x5598f2fdab10 msgr2=0x5598f3152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 -- 172.21.15.151:0/3432462165 shutdown_connections 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 -- 172.21.15.151:0/3432462165 wait complete. 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 Processor -- start 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 -- start start 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f315e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebd0989c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598f2f0fa50 con 0x5598f2fdbfa0 2024-09-12T16:52:22.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebab9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f315e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebab9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f315e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33896/0 (socket says 172.21.15.151:33896) 2024-09-12T16:52:22.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.849+0000 7feebab9e640 1 -- 172.21.15.151:0/37368687 learned_addr learned my addr 172.21.15.151:0/37368687 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebab9e640 1 -- 172.21.15.151:0/37368687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f315e8f0 con 0x5598f2fdbfa0 2024-09-12T16:52:22.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebab9e640 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f315e390 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feeac001b80 tx=0x7feeac000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feda7606640 1 -- 172.21.15.151:0/37368687 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac013630 con 0x5598f2fdbfa0 2024-09-12T16:52:22.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598f315eb80 con 0x5598f2fdbfa0 2024-09-12T16:52:22.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feda7606640 1 -- 172.21.15.151:0/37368687 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac023070 con 0x5598f2fdbfa0 2024-09-12T16:52:22.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feda7606640 1 -- 172.21.15.151:0/37368687 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac013920 con 0x5598f2fdbfa0 2024-09-12T16:52:22.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f315f530 con 0x5598f2fdbfa0 2024-09-12T16:52:22.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feda7606640 1 -- 172.21.15.151:0/37368687 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7feeac010070 con 0x5598f2fdbfa0 2024-09-12T16:52:22.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feda7606640 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feda0039a70 0x7feda003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feda7606640 1 -- 172.21.15.151:0/37368687 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feeac0500b0 con 0x5598f2fdbfa0 2024-09-12T16:52:22.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feeba39d640 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feda0039a70 0x7feda003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f306f700 0x5598f3165500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f3165a40 con 0x5598f306f700 2024-09-12T16:52:22.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebb39f640 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f306f700 0x5598f3165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feeba39d640 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feda0039a70 0x7feda003bf30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feea40ad000 tx=0x7feea40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebb39f640 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f306f700 0x5598f3165500 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebb39f640 1 -- 172.21.15.151:0/37368687 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feeb40083f0 con 0x5598f306f700 2024-09-12T16:52:22.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f315f930 con 0x5598f306f700 2024-09-12T16:52:22.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebb39f640 1 -- 172.21.15.151:0/37368687 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feeb40083f0 con 0x5598f306f700 2024-09-12T16:52:22.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f3167cb0 0x5598f316a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.853+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f316a770 con 0x5598f3167cb0 2024-09-12T16:52:22.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebab9e640 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f3167cb0 0x5598f316a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebab9e640 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f3167cb0 0x5598f316a0a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebab9e640 1 -- 172.21.15.151:0/37368687 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feeac00f030 con 0x5598f3167cb0 2024-09-12T16:52:22.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f3166b50 con 0x5598f306f700 2024-09-12T16:52:22.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebb39f640 1 -- 172.21.15.151:0/37368687 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feeb40083f0 con 0x5598f306f700 2024-09-12T16:52:22.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f3166fd0 con 0x5598f306f700 2024-09-12T16:52:22.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebb39f640 1 -- 172.21.15.151:0/37368687 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feeb40083f0 con 0x5598f306f700 2024-09-12T16:52:22.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebd0989c0 1 Processor -- start 2024-09-12T16:52:22.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebd0989c0 1 -- start start 2024-09-12T16:52:22.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebd0989c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3178dc0 0x5598f31791e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebd0989c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598f2f7a450 con 0x5598f3178dc0 2024-09-12T16:52:22.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebb39f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3178dc0 0x5598f31791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebb39f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3178dc0 0x5598f31791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33912/0 (socket says 172.21.15.151:33912) 2024-09-12T16:52:22.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebb39f640 1 -- 172.21.15.151:0/2677930189 learned_addr learned my addr 172.21.15.151:0/2677930189 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebb39f640 1 -- 172.21.15.151:0/2677930189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f3179820 con 0x5598f3178dc0 2024-09-12T16:52:22.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.857+0000 7feebb39f640 1 --2- 172.21.15.151:0/2677930189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3178dc0 0x5598f31791e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x5598f31604c0 tx=0x7feeb400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feda4e01640 1 -- 172.21.15.151:0/2677930189 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4007e00 con 0x5598f3178dc0 2024-09-12T16:52:22.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feda4e01640 1 -- 172.21.15.151:0/2677930189 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb401e020 con 0x5598f3178dc0 2024-09-12T16:52:22.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebd0989c0 1 -- 172.21.15.151:0/2677930189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598f317a080 con 0x5598f3178dc0 2024-09-12T16:52:22.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feda4e01640 1 -- 172.21.15.151:0/2677930189 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4019590 con 0x5598f3178dc0 2024-09-12T16:52:22.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebd0989c0 1 -- 172.21.15.151:0/2677930189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f317a5f0 con 0x5598f3178dc0 2024-09-12T16:52:22.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feda4e01640 1 -- 172.21.15.151:0/2677930189 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7feeb4016040 con 0x5598f3178dc0 2024-09-12T16:52:22.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feda4e01640 1 --2- 172.21.15.151:0/2677930189 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed94039ac0 0x7fed9403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feda4e01640 1 -- 172.21.15.151:0/2677930189 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feeb401f030 con 0x5598f3178dc0 2024-09-12T16:52:22.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebab9e640 1 --2- 172.21.15.151:0/2677930189 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed94039ac0 0x7fed9403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebd0989c0 1 Processor -- start 2024-09-12T16:52:22.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebd0989c0 1 -- start start 2024-09-12T16:52:22.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebab9e640 1 --2- 172.21.15.151:0/2677930189 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed94039ac0 0x7fed9403bf80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5598f3165e50 tx=0x7feeac04e430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebd0989c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f3185a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebd0989c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598f3157510 con 0x5598f3185620 2024-09-12T16:52:22.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebb39f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f3185a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebb39f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f3185a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33924/0 (socket says 172.21.15.151:33924) 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebb39f640 1 -- 172.21.15.151:0/2117234141 learned_addr learned my addr 172.21.15.151:0/2117234141 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebb39f640 1 -- 172.21.15.151:0/2117234141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f3185ff0 con 0x5598f3185620 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7feebb39f640 1 --2- 172.21.15.151:0/2117234141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f3185a00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feeb4017a80 tx=0x7feeb4017760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4e7c922e71751c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7fed9e7fc640 1 -- 172.21.15.151:0/2117234141 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb401d040 con 0x5598f3185620 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.861+0000 7fed9e7fc640 1 -- 172.21.15.151:0/2117234141 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb4023460 con 0x5598f3185620 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7fed9e7fc640 1 -- 172.21.15.151:0/2117234141 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4019c50 con 0x5598f3185620 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- 172.21.15.151:0/2117234141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 msgr2=0x5598f3185a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 --2- 172.21.15.151:0/2117234141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f3185a00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feeb4017a80 tx=0x7feeb4017760 comp rx=0 tx=0).stop 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- 172.21.15.151:0/2117234141 shutdown_connections 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 --2- 172.21.15.151:0/2117234141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f3185a00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- 172.21.15.151:0/2117234141 >> 172.21.15.151:0/2117234141 conn(0x5598f3181a50 msgr2=0x5598f317fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- 172.21.15.151:0/2117234141 shutdown_connections 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- 172.21.15.151:0/2117234141 wait complete. 2024-09-12T16:52:22.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 Processor -- start 2024-09-12T16:52:22.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- start start 2024-09-12T16:52:22.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f318cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598f3186630 con 0x5598f3185620 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebb39f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f318cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebb39f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f318cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33930/0 (socket says 172.21.15.151:33930) 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 learned_addr learned my addr 172.21.15.151:0/1490686304 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f318d0b0 con 0x5598f3185620 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebb39f640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f318cb50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feeb404b010 tx=0x7feeb4050890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7fed9cff9640 1 -- 172.21.15.151:0/1490686304 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb401d070 con 0x5598f3185620 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598f318d340 con 0x5598f3185620 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7fed9cff9640 1 -- 172.21.15.151:0/1490686304 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb4031030 con 0x5598f3185620 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f318dcf0 con 0x5598f3185620 2024-09-12T16:52:22.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7fed9cff9640 1 -- 172.21.15.151:0/1490686304 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb403b060 con 0x5598f3185620 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.865+0000 7fed9cff9640 1 -- 172.21.15.151:0/1490686304 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7feeb404f210 con 0x5598f3185620 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7fed9cff9640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed84039a70 0x7fed8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7fed9cff9640 1 -- 172.21.15.151:0/1490686304 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feeb4024ba0 con 0x5598f3185620 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebab9e640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed84039a70 0x7fed8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f3197e40 0x5598f319a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f319aa20 con 0x5598f3197e40 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feeba39d640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f3197e40 0x5598f319a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebab9e640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed84039a70 0x7fed8403bf30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5598f316ab50 tx=0x7feeac04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feeba39d640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f3197e40 0x5598f319a2d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 realm 2024-09-12T16:52:22.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f319ae50 con 0x5598f3197e40 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f319b720 con 0x5598f3197e40 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f319bac0 con 0x5598f3197e40 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f319c820 0x5598f319ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f319f220 con 0x5598f319c820 2024-09-12T16:52:22.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebb39f640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f319c820 0x5598f319ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebb39f640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f319c820 0x5598f319ec10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:22.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 20 searching for the correct realm 2024-09-12T16:52:22.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5598f31a1100 0x5598f31a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.869+0000 7feebab9e640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5598f31a1100 0x5598f31a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebab9e640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5598f31a1100 0x5598f31a3570 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebab9e640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7feeac041640 0x7feeac041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x7feeac041640 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feeba39d640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7feeac041640 0x7feeac041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feeba39d640 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7feeac041640 0x7feeac041a20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f3197e40 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f3197e40 2024-09-12T16:52:22.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.873+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x7feeac041640 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f3197e40 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f3197e40 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x7feeac041640 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f3197e40 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.877+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f3197e40 2024-09-12T16:52:22.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x7feeac041640 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f3197e40 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x7feeac041640 2024-09-12T16:52:22.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f31a1100 2024-09-12T16:52:22.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.881+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f319c820 2024-09-12T16:52:22.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x5598f3197e40 2024-09-12T16:52:22.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a3c40 con 0x7feeac041640 2024-09-12T16:52:22.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:22.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:22.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:22.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:22.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:22.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:22.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f319fb70 con 0x5598f3197e40 2024-09-12T16:52:22.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f319f7b0 con 0x5598f3197e40 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a0490 con 0x5598f3197e40 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 zone default found 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 4 Realm: () 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 zonegroup default 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a0490 con 0x5598f319c820 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a5f60 con 0x5598f31a1100 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a6300 con 0x5598f31a1100 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 started sync module instance, tier type = 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.885+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a53f0 con 0x7feeac041640 2024-09-12T16:52:22.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.889+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.889+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94115401980224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a53f0 con 0x7feeac041640 2024-09-12T16:52:22.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.889+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a6df0 con 0x5598f3197e40 2024-09-12T16:52:22.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.889+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94115401980224] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.889+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.889+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94115401984224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a53f0 con 0x5598f3197e40 2024-09-12T16:52:22.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.889+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a7800 con 0x5598f31a1100 2024-09-12T16:52:22.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94115401984224] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94115401986896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a7bf0 con 0x5598f31a1100 2024-09-12T16:52:22.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a85b0 con 0x7feeac041640 2024-09-12T16:52:22.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94115401990672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a8ca0 con 0x7feeac041640 2024-09-12T16:52:22.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a97c0 con 0x5598f3197e40 2024-09-12T16:52:22.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94115401986896] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94115401990672] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94115401994896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a9780 con 0x5598f3197e40 2024-09-12T16:52:22.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.893+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a9bb0 con 0x5598f319c820 2024-09-12T16:52:22.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.897+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94115401994896] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.897+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.897+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94115401977664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a9fa0 con 0x5598f319c820 2024-09-12T16:52:22.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.897+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31aa830 con 0x5598f319c820 2024-09-12T16:52:22.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94115401998240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31aaf00 con 0x5598f319c820 2024-09-12T16:52:22.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31ab8c0 con 0x5598f319c820 2024-09-12T16:52:22.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94115401977664] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94115401991920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31ab8c0 con 0x5598f319c820 2024-09-12T16:52:22.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 20 add_watcher() i=0 2024-09-12T16:52:22.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 20 add_watcher() i=1 2024-09-12T16:52:22.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 20 add_watcher() i=2 2024-09-12T16:52:22.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 20 add_watcher() i=3 2024-09-12T16:52:22.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 20 add_watcher() i=4 2024-09-12T16:52:22.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 20 add_watcher() i=5 2024-09-12T16:52:22.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94115401998240] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.901+0000 7feebd0989c0 20 add_watcher() i=6 2024-09-12T16:52:22.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94115401991920] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebd0989c0 20 add_watcher() i=7 2024-09-12T16:52:22.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebd0989c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:22.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31ae8f0 con 0x5598f3197e40 2024-09-12T16:52:22.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94115402003472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31abce0 con 0x5598f3197e40 2024-09-12T16:52:22.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94115402003472] v32'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7fed717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebd0989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:22.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebd0989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:22.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b7070 con 0x5598f3197e40 2024-09-12T16:52:22.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.905+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b7070 con 0x5598f319c820 2024-09-12T16:52:22.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.909+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.909+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b7070 con 0x5598f31a1100 2024-09-12T16:52:22.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.909+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.909+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b6730 con 0x5598f3197e40 2024-09-12T16:52:22.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.913+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.913+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b6730 con 0x7feeac041640 2024-09-12T16:52:22.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.913+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.913+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b87e0 con 0x5598f31a1100 2024-09-12T16:52:22.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.913+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.913+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b87c0 con 0x5598f3197e40 2024-09-12T16:52:22.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.913+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.913+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8aa0 con 0x5598f319c820 2024-09-12T16:52:22.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.917+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.917+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8aa0 con 0x7feeac041640 2024-09-12T16:52:22.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.917+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.917+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8aa0 con 0x5598f31a1100 2024-09-12T16:52:22.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.921+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.921+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8aa0 con 0x7feeac041640 2024-09-12T16:52:22.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.921+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.921+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8aa0 con 0x5598f319c820 2024-09-12T16:52:22.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.925+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.925+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8b30 con 0x7feeac041640 2024-09-12T16:52:22.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.925+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.925+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8b30 con 0x5598f319c820 2024-09-12T16:52:22.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.925+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.925+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8bc0 con 0x5598f3197e40 2024-09-12T16:52:22.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.929+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'123 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.929+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8bc0 con 0x5598f31a1100 2024-09-12T16:52:22.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.929+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.929+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8bc0 con 0x7feeac041640 2024-09-12T16:52:22.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.933+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.933+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x5598f31a1100 2024-09-12T16:52:22.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.933+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.933+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x5598f3197e40 2024-09-12T16:52:22.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.933+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.933+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x5598f3197e40 2024-09-12T16:52:22.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.937+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'124 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.937+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x5598f31a1100 2024-09-12T16:52:22.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.937+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.937+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x7feeac041640 2024-09-12T16:52:22.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.937+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.937+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x5598f31a1100 2024-09-12T16:52:22.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.941+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.941+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x5598f31a1100 2024-09-12T16:52:22.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.941+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.941+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x5598f31a1100 2024-09-12T16:52:22.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.941+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.941+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c20 con 0x5598f31a1100 2024-09-12T16:52:22.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.941+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.945+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c60 con 0x5598f319c820 2024-09-12T16:52:22.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.945+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.945+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8c90 con 0x5598f31a1100 2024-09-12T16:52:22.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.945+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.945+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8cd0 con 0x5598f319c820 2024-09-12T16:52:22.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.949+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.949+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8cb0 con 0x5598f31a1100 2024-09-12T16:52:22.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.949+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.949+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8cb0 con 0x5598f319c820 2024-09-12T16:52:22.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.953+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.953+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b8cf0 con 0x7feeac041640 2024-09-12T16:52:22.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.953+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.953+0000 7fecebfff640 20 reqs_thread_entry: start 2024-09-12T16:52:22.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.953+0000 7feebd0989c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:22.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 20 Filter name: none 2024-09-12T16:52:22.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7fece9ffb640 20 reqs_thread_entry: start 2024-09-12T16:52:22.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:52:22.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:22.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31b5910 con 0x5598f319c820 2024-09-12T16:52:22.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T16:52:22.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T16:52:22.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:52:22.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:22.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d6890 con 0x5598f319c820 2024-09-12T16:52:22.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T16:52:22.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.957+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d4870 con 0x5598f319c820 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebd0989c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94115402175440 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d6d30 con 0x5598f31a1100 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== watch-notify(notify (1) cookie 94115401986896 notify 137438953475 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5598f31b0980 con 0x5598f31a1100 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7fed9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94115401986896 notifier 4530 bl.length()=170 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(97 notify.2 [notify cookie 94115402175440 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7fed9e7fc640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fed80003d70 con 0x5598f31a1100 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== watch-notify(notify_complete (2) cookie 94115402175440 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598f318d340 con 0x5598f31a1100 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebd0989c0 10 removing email index: 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebd0989c0 10 removing user buckets index 2024-09-12T16:52:22.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d4870 con 0x5598f319c820 2024-09-12T16:52:22.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebd0989c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-12T16:52:22.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94115402175440 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d6cb0 con 0x5598f319c820 2024-09-12T16:52:22.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== watch-notify(notify (1) cookie 94115401998240 notify 137438953478 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5598f31b6280 con 0x5598f319c820 2024-09-12T16:52:22.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7fed9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94115401998240 notifier 4530 bl.length()=160 2024-09-12T16:52:22.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7fed9dffb640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fecf00032d0 con 0x5598f319c820 2024-09-12T16:52:22.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.961+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(100 notify.6 [notify cookie 94115402175440 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== watch-notify(notify_complete (2) cookie 94115402175440 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598f318d0b0 con 0x5598f319c820 2024-09-12T16:52:22.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebd0989c0 10 removing user index: fud 2024-09-12T16:52:22.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d69f0 con 0x5598f319c820 2024-09-12T16:52:22.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebd0989c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-12T16:52:22.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebd0989c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T16:52:22.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94115402179904 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d6960 con 0x5598f319c820 2024-09-12T16:52:22.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== watch-notify(notify (1) cookie 94115401977664 notify 137438953479 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5598f318d0b0 con 0x5598f319c820 2024-09-12T16:52:22.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7fed9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94115401977664 notifier 4530 bl.length()=152 2024-09-12T16:52:22.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7fed9e7fc640 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fed80003d70 con 0x5598f319c820 2024-09-12T16:52:22.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.965+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(103 notify.5 [notify cookie 94115402179904 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== watch-notify(notify_complete (2) cookie 94115402179904 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598f3185ff0 con 0x5598f319c820 2024-09-12T16:52:22.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7fed717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:22.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94115402003472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d6540 con 0x5598f3197e40 2024-09-12T16:52:22.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94115402003472] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94115401980224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31d6540 con 0x7feeac041640 2024-09-12T16:52:22.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94115401980224] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feebd0989c0 20 remove_watcher() i=0 2024-09-12T16:52:22.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feebd0989c0 2 removed watcher, disabling cache 2024-09-12T16:52:22.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.969+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94115401984224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a5920 con 0x5598f3197e40 2024-09-12T16:52:22.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.973+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94115401984224] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.973+0000 7feebd0989c0 20 remove_watcher() i=1 2024-09-12T16:52:22.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.973+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94115401986896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a68e0 con 0x5598f31a1100 2024-09-12T16:52:22.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.973+0000 7feebab9e640 1 -- 172.21.15.151:0/1490686304 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94115401986896] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac03a070 con 0x5598f31a1100 2024-09-12T16:52:22.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.973+0000 7feebd0989c0 20 remove_watcher() i=2 2024-09-12T16:52:22.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.973+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94115401990672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a68e0 con 0x7feeac041640 2024-09-12T16:52:22.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.977+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94115401990672] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x7feeac041640 2024-09-12T16:52:22.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.977+0000 7feebd0989c0 20 remove_watcher() i=3 2024-09-12T16:52:22.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.977+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94115401994896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a8210 con 0x5598f3197e40 2024-09-12T16:52:22.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.977+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94115401994896] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea40a9a50 con 0x5598f3197e40 2024-09-12T16:52:22.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.977+0000 7feebd0989c0 20 remove_watcher() i=4 2024-09-12T16:52:22.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.977+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94115401977664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a8210 con 0x5598f319c820 2024-09-12T16:52:22.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.981+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94115401977664] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.981+0000 7feebd0989c0 20 remove_watcher() i=5 2024-09-12T16:52:22.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.981+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94115401998240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a8210 con 0x5598f319c820 2024-09-12T16:52:22.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.981+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94115401998240] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.981+0000 7feebd0989c0 20 remove_watcher() i=6 2024-09-12T16:52:22.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.981+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94115401991920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598f31a8210 con 0x5598f319c820 2024-09-12T16:52:22.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebb39f640 1 -- 172.21.15.151:0/1490686304 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94115401991920] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x5598f319c820 2024-09-12T16:52:22.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 20 remove_watcher() i=7 2024-09-12T16:52:22.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f319c820 msgr2=0x5598f319ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f319c820 0x5598f319ec10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f3197e40 msgr2=0x5598f319a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f3197e40 0x5598f319a2d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7feeac041640 msgr2=0x7feeac041a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7feeac041640 0x7feeac041a20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5598f31a1100 msgr2=0x5598f31a3570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5598f31a1100 0x5598f31a3570 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed84039a70 msgr2=0x7fed8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed84039a70 0x7fed8403bf30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5598f316ab50 tx=0x7feeac04f000 comp rx=0 tx=0).stop 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 msgr2=0x5598f318cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f318cb50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feeb404b010 tx=0x7feeb4050890 comp rx=0 tx=0).stop 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feeba39d640 1 -- 172.21.15.151:0/1490686304 reap_dead start 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 shutdown_connections 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/1490686304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3185620 0x5598f318cb50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 >> 172.21.15.151:0/1490686304 conn(0x5598f3181a50 msgr2=0x5598f317fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 shutdown_connections 2024-09-12T16:52:22.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/1490686304 wait complete. 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/2677930189 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed94039ac0 msgr2=0x7fed9403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/2677930189 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed94039ac0 0x7fed9403bf80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5598f3165e50 tx=0x7feeac04e430 comp rx=0 tx=0).stop 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/2677930189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3178dc0 msgr2=0x5598f31791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/2677930189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3178dc0 0x5598f31791e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x5598f31604c0 tx=0x7feeb400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/2677930189 shutdown_connections 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/2677930189 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed94039ac0 0x7fed9403bf80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/2677930189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f3178dc0 0x5598f31791e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/2677930189 >> 172.21.15.151:0/2677930189 conn(0x5598f316e770 msgr2=0x5598f316eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/2677930189 shutdown_connections 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/2677930189 wait complete. 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f3167cb0 msgr2=0x5598f316a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f3167cb0 0x5598f316a0a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f306f700 msgr2=0x5598f3165500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f306f700 0x5598f3165500 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feda0039a70 msgr2=0x7feda003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feda0039a70 0x7feda003bf30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feea40ad000 tx=0x7feea40a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 msgr2=0x5598f315e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f315e390 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feeac001b80 tx=0x7feeac000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 shutdown_connections 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5598f3167cb0 0x5598f316a0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5598f306f700 0x5598f3165500 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feda0039a70 0x7feda003bf30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 --2- 172.21.15.151:0/37368687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598f2fdbfa0 0x5598f315e390 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 >> 172.21.15.151:0/37368687 conn(0x5598f2fdab10 msgr2=0x5598f3151390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:22.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 shutdown_connections 2024-09-12T16:52:22.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:22.985+0000 7feebd0989c0 1 -- 172.21.15.151:0/37368687 wait complete. 2024-09-12T16:52:22.997 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T16:52:22.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T16:52:22.998 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-12T16:52:23.084 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:23.084 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.081+0000 7f84111e89c0 1 Processor -- start 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.081+0000 7f84111e89c0 1 -- start start 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.081+0000 7f84111e89c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x560a02531730 0x560a02530300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.081+0000 7f84111e89c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a0246f9c0 con 0x560a02531200 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.081+0000 7f84111e89c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x560a024bf6d0 con 0x560a02531730 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.081+0000 7f840e4ed640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x560a02531730 0x560a02530300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.081+0000 7f840ecee640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x560a02531200 0x560a0252fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42672/0 (socket says 172.21.15.151:42672) 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.081+0000 7f840ecee640 1 -- 172.21.15.151:0/1387073256 learned_addr learned my addr 172.21.15.151:0/1387073256 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f840e4ed640 1 -- 172.21.15.151:0/1387073256 >> v1:172.21.15.122:6789/0 conn(0x560a02531200 legacy=0x560a0252fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f840e4ed640 1 -- 172.21.15.151:0/1387073256 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a02463ca0 con 0x560a02531730 2024-09-12T16:52:23.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f840e4ed640 1 --2- 172.21.15.151:0/1387073256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531730 0x560a02530300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f83f800a420 tx=0x7f83f801af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8260a3c124ecc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f840dcec640 1 -- 172.21.15.151:0/1387073256 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f80b0070 con 0x560a02531730 2024-09-12T16:52:23.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f840dcec640 1 -- 172.21.15.151:0/1387073256 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f80a3e10 con 0x560a02531730 2024-09-12T16:52:23.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f840dcec640 1 -- 172.21.15.151:0/1387073256 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f80ab570 con 0x560a02531730 2024-09-12T16:52:23.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f84111e89c0 1 -- 172.21.15.151:0/1387073256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531730 msgr2=0x560a02530300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f84111e89c0 1 --2- 172.21.15.151:0/1387073256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531730 0x560a02530300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f83f800a420 tx=0x7f83f801af10 comp rx=0 tx=0).stop 2024-09-12T16:52:23.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f84111e89c0 1 -- 172.21.15.151:0/1387073256 shutdown_connections 2024-09-12T16:52:23.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f84111e89c0 1 --2- 172.21.15.151:0/1387073256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531730 0x560a02530300 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f84111e89c0 1 -- 172.21.15.151:0/1387073256 >> 172.21.15.151:0/1387073256 conn(0x560a025b6a20 msgr2=0x560a025b8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f84111e89c0 1 -- 172.21.15.151:0/1387073256 shutdown_connections 2024-09-12T16:52:23.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.085+0000 7f84111e89c0 1 -- 172.21.15.151:0/1387073256 wait complete. 2024-09-12T16:52:23.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 Processor -- start 2024-09-12T16:52:23.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 -- start start 2024-09-12T16:52:23.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560a024c3680 con 0x560a02531200 2024-09-12T16:52:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f840ecee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f840ecee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026a8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33956/0 (socket says 172.21.15.151:33956) 2024-09-12T16:52:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f840ecee640 1 -- 172.21.15.151:0/373477426 learned_addr learned my addr 172.21.15.151:0/373477426 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f840ecee640 1 -- 172.21.15.151:0/373477426 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a0243eda0 con 0x560a02531200 2024-09-12T16:52:23.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f840ecee640 1 --2- 172.21.15.151:0/373477426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026a8c00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8400001e00 tx=0x7f840000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56b322d6bad24a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f82fce09640 1 -- 172.21.15.151:0/373477426 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8400012020 con 0x560a02531200 2024-09-12T16:52:23.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f82fce09640 1 -- 172.21.15.151:0/373477426 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840000e690 con 0x560a02531200 2024-09-12T16:52:23.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f82fce09640 1 -- 172.21.15.151:0/373477426 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840000ea10 con 0x560a02531200 2024-09-12T16:52:23.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 -- 172.21.15.151:0/373477426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 msgr2=0x560a026a8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 --2- 172.21.15.151:0/373477426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026a8c00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8400001e00 tx=0x7f840000b6d0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 -- 172.21.15.151:0/373477426 shutdown_connections 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 --2- 172.21.15.151:0/373477426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026a8c00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 -- 172.21.15.151:0/373477426 >> 172.21.15.151:0/373477426 conn(0x560a025b6a20 msgr2=0x560a026a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 -- 172.21.15.151:0/373477426 shutdown_connections 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.101+0000 7f84111e89c0 1 -- 172.21.15.151:0/373477426 wait complete. 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f84111e89c0 1 Processor -- start 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f84111e89c0 1 -- start start 2024-09-12T16:52:23.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f84111e89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f84111e89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560a02465a50 con 0x560a02531200 2024-09-12T16:52:23.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f840ecee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f840ecee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33964/0 (socket says 172.21.15.151:33964) 2024-09-12T16:52:23.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f840ecee640 1 -- 172.21.15.151:0/487107641 learned_addr learned my addr 172.21.15.151:0/487107641 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f840ecee640 1 -- 172.21.15.151:0/487107641 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a026b0830 con 0x560a02531200 2024-09-12T16:52:23.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f840ecee640 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026b02d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x560a026a9b90 tx=0x7f8400000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f82fb606640 1 -- 172.21.15.151:0/487107641 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8400012030 con 0x560a02531200 2024-09-12T16:52:23.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a026b0ac0 con 0x560a02531200 2024-09-12T16:52:23.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f82fb606640 1 -- 172.21.15.151:0/487107641 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840001a750 con 0x560a02531200 2024-09-12T16:52:23.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f82fb606640 1 -- 172.21.15.151:0/487107641 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840001aa50 con 0x560a02531200 2024-09-12T16:52:23.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a026b1470 con 0x560a02531200 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f82fb606640 1 -- 172.21.15.151:0/487107641 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8400015020 con 0x560a02531200 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f82fb606640 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82f4039a70 0x7f82f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f82fb606640 1 -- 172.21.15.151:0/487107641 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8400020030 con 0x560a02531200 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f840e4ed640 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82f4039a70 0x7f82f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a02531730 0x560a026b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.105+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026b7980 con 0x560a02531730 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840f4ef640 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a02531730 0x560a026b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840e4ed640 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82f4039a70 0x7f82f403bf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83f80ad000 tx=0x7f83f80a5070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840f4ef640 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a02531730 0x560a026b7440 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840f4ef640 1 -- 172.21.15.151:0/487107641 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84080083f0 con 0x560a02531730 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026b7dd0 con 0x560a02531730 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840f4ef640 1 -- 172.21.15.151:0/487107641 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84080083f0 con 0x560a02531730 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026b9be0 0x560a026bbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026bc6a0 con 0x560a026b9be0 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840ecee640 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026b9be0 0x560a026bbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840ecee640 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026b9be0 0x560a026bbfd0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840ecee640 1 -- 172.21.15.151:0/487107641 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8400008030 con 0x560a026b9be0 2024-09-12T16:52:23.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026b8a80 con 0x560a02531730 2024-09-12T16:52:23.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840f4ef640 1 -- 172.21.15.151:0/487107641 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84080083f0 con 0x560a02531730 2024-09-12T16:52:23.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026b8f20 con 0x560a02531730 2024-09-12T16:52:23.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f840f4ef640 1 -- 172.21.15.151:0/487107641 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f84080083f0 con 0x560a02531730 2024-09-12T16:52:23.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f84111e89c0 1 Processor -- start 2024-09-12T16:52:23.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.109+0000 7f84111e89c0 1 -- start start 2024-09-12T16:52:23.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f84111e89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026cad10 0x560a026cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f84111e89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560a024d0450 con 0x560a026cad10 2024-09-12T16:52:23.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f840f4ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026cad10 0x560a026cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f840f4ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026cad10 0x560a026cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33978/0 (socket says 172.21.15.151:33978) 2024-09-12T16:52:23.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f840f4ef640 1 -- 172.21.15.151:0/522785495 learned_addr learned my addr 172.21.15.151:0/522785495 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f840f4ef640 1 -- 172.21.15.151:0/522785495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a026cb770 con 0x560a026cad10 2024-09-12T16:52:23.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f840f4ef640 1 --2- 172.21.15.151:0/522785495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026cad10 0x560a026cb130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x560a026b23f0 tx=0x7f840800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f82f8e01640 1 -- 172.21.15.151:0/522785495 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8408007e00 con 0x560a026cad10 2024-09-12T16:52:23.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f82f8e01640 1 -- 172.21.15.151:0/522785495 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840801e020 con 0x560a026cad10 2024-09-12T16:52:23.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f84111e89c0 1 -- 172.21.15.151:0/522785495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a026cbfd0 con 0x560a026cad10 2024-09-12T16:52:23.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f82f8e01640 1 -- 172.21.15.151:0/522785495 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8408019590 con 0x560a026cad10 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f84111e89c0 1 -- 172.21.15.151:0/522785495 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a026cc540 con 0x560a026cad10 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f82f8e01640 1 -- 172.21.15.151:0/522785495 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8408016040 con 0x560a026cad10 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f82f8e01640 1 --2- 172.21.15.151:0/522785495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82e8039a70 0x7f82e803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f82f8e01640 1 -- 172.21.15.151:0/522785495 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f840801f030 con 0x560a026cad10 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f840ecee640 1 --2- 172.21.15.151:0/522785495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82e8039a70 0x7f82e803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f84111e89c0 1 Processor -- start 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f84111e89c0 1 -- start start 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f840ecee640 1 --2- 172.21.15.151:0/522785495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82e8039a70 0x7f82e803bf30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x560a026b1760 tx=0x7f840002c950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f84111e89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026d8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f84111e89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560a026a9450 con 0x560a026d8660 2024-09-12T16:52:23.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.113+0000 7f840f4ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026d8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026d8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33986/0 (socket says 172.21.15.151:33986) 2024-09-12T16:52:23.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 -- 172.21.15.151:0/853702429 learned_addr learned my addr 172.21.15.151:0/853702429 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 -- 172.21.15.151:0/853702429 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a026d9050 con 0x560a026d8660 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 --2- 172.21.15.151:0/853702429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026d8a60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f84080509c0 tx=0x7f8408019b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd9584e59061fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f82f27fc640 1 -- 172.21.15.151:0/853702429 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840801d040 con 0x560a026d8660 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f82f27fc640 1 -- 172.21.15.151:0/853702429 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8408019c50 con 0x560a026d8660 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f82f27fc640 1 -- 172.21.15.151:0/853702429 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8408022ce0 con 0x560a026d8660 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- 172.21.15.151:0/853702429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 msgr2=0x560a026d8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 --2- 172.21.15.151:0/853702429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026d8a60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f84080509c0 tx=0x7f8408019b00 comp rx=0 tx=0).stop 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- 172.21.15.151:0/853702429 shutdown_connections 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 --2- 172.21.15.151:0/853702429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026d8a60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- 172.21.15.151:0/853702429 >> 172.21.15.151:0/853702429 conn(0x560a026d3a80 msgr2=0x560a026d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- 172.21.15.151:0/853702429 shutdown_connections 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- 172.21.15.151:0/853702429 wait complete. 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 Processor -- start 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- start start 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026deae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560a026d75b0 con 0x560a026d8660 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026deae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33994/0 (socket says 172.21.15.151:33994) 2024-09-12T16:52:23.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 learned_addr learned my addr 172.21.15.151:0/2935984364 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a026df040 con 0x560a026d8660 2024-09-12T16:52:23.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f840f4ef640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026deae0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f840804f860 tx=0x7f8408050920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f82f0ff9640 1 -- 172.21.15.151:0/2935984364 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840801d070 con 0x560a026d8660 2024-09-12T16:52:23.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a026df2d0 con 0x560a026d8660 2024-09-12T16:52:23.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f82f0ff9640 1 -- 172.21.15.151:0/2935984364 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8408032020 con 0x560a026d8660 2024-09-12T16:52:23.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a026df2d0 con 0x560a026d8660 2024-09-12T16:52:23.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.117+0000 7f82f0ff9640 1 -- 172.21.15.151:0/2935984364 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f840804f4b0 con 0x560a026d8660 2024-09-12T16:52:23.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f82f0ff9640 1 -- 172.21.15.151:0/2935984364 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f84080520d0 con 0x560a026d8660 2024-09-12T16:52:23.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f82f0ff9640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82d8039a70 0x7f82d803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f82f0ff9640 1 -- 172.21.15.151:0/2935984364 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8408033030 con 0x560a026d8660 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840ecee640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82d8039a70 0x7f82d803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a026e9c80 0x560a026ec110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026ec860 con 0x560a026e9c80 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840e4ed640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a026e9c80 0x560a026ec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840ecee640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82d8039a70 0x7f82d803bf30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f840000b710 tx=0x7f840002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840e4ed640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a026e9c80 0x560a026ec110 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 realm 2024-09-12T16:52:23.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026ecc90 con 0x560a026e9c80 2024-09-12T16:52:23.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:23.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026ed560 con 0x560a026e9c80 2024-09-12T16:52:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026ed900 con 0x560a026e9c80 2024-09-12T16:52:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026ee660 0x560a026f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026f1060 con 0x560a026ee660 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840f4ef640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026ee660 0x560a026f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.121+0000 7f840f4ef640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026ee660 0x560a026f0a50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f840802a070 con 0x560a026ee660 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f84111e89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f84111e89c0 20 searching for the correct realm 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560a026f2f40 0x560a026f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a026f5a80 con 0x560a026f2f40 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840ecee640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560a026f2f40 0x560a026f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840ecee640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560a026f2f40 0x560a026f53b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840ecee640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8400017050 0x7f840004d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a026f5a80 con 0x7f8400017050 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840e4ed640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8400017050 0x7f840004d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840e4ed640 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8400017050 0x7f840004d3b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a026f5a80 con 0x560a026ee660 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a026f5a80 con 0x560a026e9c80 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a026f5a80 con 0x560a026e9c80 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026ee660 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026ee660 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.125+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x7f8400017050 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026f2f40 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026e9c80 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026ee660 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026e9c80 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x7f8400017050 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026f2f40 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026f2f40 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026ee660 2024-09-12T16:52:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026f2f40 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026f2f40 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026e9c80 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.129+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026e9c80 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026ee660 2024-09-12T16:52:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026f2f40 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x7f8400017050 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026e9c80 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026ee660 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026f2f40 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026ee660 2024-09-12T16:52:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x7f8400017050 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026f2f40 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.133+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026ee660 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x560a026e9c80 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f83f80d0040 con 0x7f8400017050 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026f19b0 con 0x560a026e9c80 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026f1da0 con 0x560a026e9c80 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026f1da0 con 0x560a026e9c80 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 zone default found 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 4 Realm: () 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 zonegroup default 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026f21c0 con 0x560a026ee660 2024-09-12T16:52:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026f7940 con 0x560a026f2f40 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a026f7ed0 con 0x560a026f2f40 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 started sync module instance, tier type = 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.137+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026f6d90 con 0x7f8400017050 2024-09-12T16:52:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.141+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.141+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94600990519680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026f6d90 con 0x7f8400017050 2024-09-12T16:52:23.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.141+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026f8950 con 0x560a026e9c80 2024-09-12T16:52:23.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.141+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.141+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94600990524576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026f8d70 con 0x560a026e9c80 2024-09-12T16:52:23.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.141+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026f9820 con 0x560a026f2f40 2024-09-12T16:52:23.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.141+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94600990519680] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94600990524576] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94600990517472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026f8d70 con 0x560a026f2f40 2024-09-12T16:52:23.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fa0c0 con 0x7f8400017050 2024-09-12T16:52:23.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94600990530848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fa730 con 0x7f8400017050 2024-09-12T16:52:23.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fb250 con 0x560a026e9c80 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94600990517472] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.145+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94600990530848] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.149+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.149+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94600990534944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fb210 con 0x560a026e9c80 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.149+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fbaf0 con 0x560a026ee660 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.149+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94600990534944] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.149+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.149+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94600990537280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fb210 con 0x560a026ee660 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.149+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fc360 con 0x560a026ee660 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94600990539408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fc810 con 0x560a026ee660 2024-09-12T16:52:23.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fd2f0 con 0x560a026ee660 2024-09-12T16:52:23.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94600990537280] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94600990539408] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94600990543360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fd2f0 con 0x560a026ee660 2024-09-12T16:52:23.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 20 add_watcher() i=0 2024-09-12T16:52:23.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 20 add_watcher() i=1 2024-09-12T16:52:23.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 20 add_watcher() i=2 2024-09-12T16:52:23.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 20 add_watcher() i=3 2024-09-12T16:52:23.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 20 add_watcher() i=4 2024-09-12T16:52:23.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 20 add_watcher() i=5 2024-09-12T16:52:23.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.153+0000 7f84111e89c0 20 add_watcher() i=6 2024-09-12T16:52:23.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94600990543360] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 20 add_watcher() i=7 2024-09-12T16:52:23.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:23.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a02700320 con 0x560a026e9c80 2024-09-12T16:52:23.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94600990540640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a026fd7a0 con 0x560a026e9c80 2024-09-12T16:52:23.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94600990540640] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f82c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:23.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:23.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 5 note: GC not initialized 2024-09-12T16:52:23.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f823ffff640 20 reqs_thread_entry: start 2024-09-12T16:52:23.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:23.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 20 Filter name: none 2024-09-12T16:52:23.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f823dffb640 20 reqs_thread_entry: start 2024-09-12T16:52:23.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T16:52:23.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.157+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a027235a0 con 0x560a026ee660 2024-09-12T16:52:23.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-12T16:52:23.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T16:52:23.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T16:52:23.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a02721b90 con 0x560a026ee660 2024-09-12T16:52:23.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T16:52:23.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:23.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T16:52:23.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T16:52:23.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a02722410 con 0x560a026ee660 2024-09-12T16:52:23.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-12T16:52:23.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T16:52:23.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-12T16:52:23.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94600990695264 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a02726b90 con 0x7f8400017050 2024-09-12T16:52:23.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.161+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== watch-notify(notify (1) cookie 94600990530848 notify 137438953484 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f83f80ca040 con 0x7f8400017050 2024-09-12T16:52:23.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f82f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94600990530848 notifier 4537 bl.length()=610 2024-09-12T16:52:23.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f82f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-12T16:52:23.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f82f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T16:52:23.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(65 notify.3 [notify cookie 94600990695264 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f82f27fc640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f82d4003eb0 con 0x7f8400017050 2024-09-12T16:52:23.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== watch-notify(notify_complete (2) cookie 94600990695264 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f83f80bc040 con 0x7f8400017050 2024-09-12T16:52:23.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a02721ee0 con 0x560a026ee660 2024-09-12T16:52:23.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f84111e89c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T16:52:23.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f84111e89c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:23.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f84111e89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T16:52:23.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94600990695136 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a02726b90 con 0x560a026f2f40 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== watch-notify(notify (1) cookie 94600990517472 notify 137438953476 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f8400056040 con 0x560a026f2f40 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f82f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94600990517472 notifier 4537 bl.length()=192 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f82f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f82f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f82f27fc640 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f82d4003eb0 con 0x560a026f2f40 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 notify.2 [notify cookie 94600990695136 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.165+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== watch-notify(notify_complete (2) cookie 94600990695136 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560a026b1470 con 0x560a026f2f40 2024-09-12T16:52:23.170 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T16:52:23.162912Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:23.162896Z","tags":[],"group_ids":[]} 2024-09-12T16:52:23.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.169+0000 7f82c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.169+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94600990540640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x560a026e9c80 2024-09-12T16:52:23.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.169+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94600990540640] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.169+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94600990519680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x7f8400017050 2024-09-12T16:52:23.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.169+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94600990519680] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.169+0000 7f84111e89c0 20 remove_watcher() i=0 2024-09-12T16:52:23.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.169+0000 7f84111e89c0 2 removed watcher, disabling cache 2024-09-12T16:52:23.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.169+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94600990524576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x560a026e9c80 2024-09-12T16:52:23.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94600990524576] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f84111e89c0 20 remove_watcher() i=1 2024-09-12T16:52:23.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94600990517472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x560a026f2f40 2024-09-12T16:52:23.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f840ecee640 1 -- 172.21.15.151:0/2935984364 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94600990517472] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8400008030 con 0x560a026f2f40 2024-09-12T16:52:23.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f84111e89c0 20 remove_watcher() i=2 2024-09-12T16:52:23.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94600990530848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x7f8400017050 2024-09-12T16:52:23.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94600990530848] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x7f8400017050 2024-09-12T16:52:23.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f84111e89c0 20 remove_watcher() i=3 2024-09-12T16:52:23.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.173+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94600990534944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x560a026e9c80 2024-09-12T16:52:23.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.177+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94600990534944] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f80aba40 con 0x560a026e9c80 2024-09-12T16:52:23.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.177+0000 7f84111e89c0 20 remove_watcher() i=4 2024-09-12T16:52:23.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.177+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94600990537280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x560a026ee660 2024-09-12T16:52:23.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.177+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94600990537280] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.177+0000 7f84111e89c0 20 remove_watcher() i=5 2024-09-12T16:52:23.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94600990539408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x560a026ee660 2024-09-12T16:52:23.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94600990539408] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 20 remove_watcher() i=6 2024-09-12T16:52:23.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94600990543360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a027211b0 con 0x560a026ee660 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f840f4ef640 1 -- 172.21.15.151:0/2935984364 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94600990543360] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f840805c040 con 0x560a026ee660 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 20 remove_watcher() i=7 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026ee660 msgr2=0x560a026f0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026ee660 0x560a026f0a50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a026e9c80 msgr2=0x560a026ec110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a026e9c80 0x560a026ec110 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8400017050 msgr2=0x7f840004d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8400017050 0x7f840004d3b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560a026f2f40 msgr2=0x560a026f53b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x560a026f2f40 0x560a026f53b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82d8039a70 msgr2=0x7f82d803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82d8039a70 0x7f82d803bf30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f840000b710 tx=0x7f840002f000 comp rx=0 tx=0).stop 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 msgr2=0x560a026deae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026deae0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f840804f860 tx=0x7f8408050920 comp rx=0 tx=0).stop 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.181+0000 7f840e4ed640 1 -- 172.21.15.151:0/2935984364 reap_dead start 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 shutdown_connections 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/2935984364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026d8660 0x560a026deae0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 >> 172.21.15.151:0/2935984364 conn(0x560a026d3a80 msgr2=0x560a026d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 shutdown_connections 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/2935984364 wait complete. 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/522785495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82e8039a70 msgr2=0x7f82e803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/522785495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82e8039a70 0x7f82e803bf30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x560a026b1760 tx=0x7f840002c950 comp rx=0 tx=0).stop 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/522785495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026cad10 msgr2=0x560a026cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/522785495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026cad10 0x560a026cb130 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x560a026b23f0 tx=0x7f840800af40 comp rx=0 tx=0).stop 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/522785495 shutdown_connections 2024-09-12T16:52:23.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/522785495 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82e8039a70 0x7f82e803bf30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/522785495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a026cad10 0x560a026cb130 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/522785495 >> 172.21.15.151:0/522785495 conn(0x560a026c06c0 msgr2=0x560a026c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/522785495 shutdown_connections 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/522785495 wait complete. 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026b9be0 msgr2=0x560a026bbfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026b9be0 0x560a026bbfd0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a02531730 msgr2=0x560a026b7440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a02531730 0x560a026b7440 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82f4039a70 msgr2=0x7f82f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82f4039a70 0x7f82f403bf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83f80ad000 tx=0x7f83f80a5070 comp rx=0 tx=0).stop 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 msgr2=0x560a026b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026b02d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x560a026a9b90 tx=0x7f8400000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 shutdown_connections 2024-09-12T16:52:23.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x560a026b9be0 0x560a026bbfd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x560a02531730 0x560a026b7440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f82f4039a70 0x7f82f403bf30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 --2- 172.21.15.151:0/487107641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a02531200 0x560a026b02d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 >> 172.21.15.151:0/487107641 conn(0x560a025b6a20 msgr2=0x560a026a32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 shutdown_connections 2024-09-12T16:52:23.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.185+0000 7f84111e89c0 1 -- 172.21.15.151:0/487107641 wait complete. 2024-09-12T16:52:23.196 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T16:52:23.162912Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:23.162896Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:23.196 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T16:52:23.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T16:52:23.197 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-12T16:52:23.276 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:23.276 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:23.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.273+0000 7f633c1959c0 1 Processor -- start 2024-09-12T16:52:23.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.273+0000 7f633c1959c0 1 -- start start 2024-09-12T16:52:23.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.273+0000 7f633c1959c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563251f910d0 0x563251f934c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.273+0000 7f633c1959c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563251e419c0 con 0x563251f8cf30 2024-09-12T16:52:23.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.273+0000 7f633c1959c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x563251e916d0 con 0x563251f910d0 2024-09-12T16:52:23.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.273+0000 7f633949a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563251f910d0 0x563251f934c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.273+0000 7f6339c9b640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x563251f8cf30 0x563251f8d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42676/0 (socket says 172.21.15.151:42676) 2024-09-12T16:52:23.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.273+0000 7f6339c9b640 1 -- 172.21.15.151:0/2364967981 learned_addr learned my addr 172.21.15.151:0/2364967981 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:23.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f6338c99640 1 -- 172.21.15.151:0/2364967981 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603605168 0 0) 0x563251e419c0 con 0x563251f8cf30 2024-09-12T16:52:23.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f6338c99640 1 -- 172.21.15.151:0/2364967981 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f631c001e20 con 0x563251f8cf30 2024-09-12T16:52:23.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633949a640 1 -- 172.21.15.151:0/2364967981 >> v1:172.21.15.122:6789/0 conn(0x563251f8cf30 legacy=0x563251f8d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633949a640 1 -- 172.21.15.151:0/2364967981 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563251e35ca0 con 0x563251f910d0 2024-09-12T16:52:23.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633949a640 1 --2- 172.21.15.151:0/2364967981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f910d0 0x563251f934c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f633400a420 tx=0x7f633401b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46585f998eb3372 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f6338c99640 1 -- 172.21.15.151:0/2364967981 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63340af070 con 0x563251f910d0 2024-09-12T16:52:23.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f6338c99640 1 -- 172.21.15.151:0/2364967981 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63340aa530 con 0x563251f910d0 2024-09-12T16:52:23.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f6338c99640 1 -- 172.21.15.151:0/2364967981 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63340aa810 con 0x563251f910d0 2024-09-12T16:52:23.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633c1959c0 1 -- 172.21.15.151:0/2364967981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f910d0 msgr2=0x563251f934c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2364967981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f910d0 0x563251f934c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f633400a420 tx=0x7f633401b060 comp rx=0 tx=0).stop 2024-09-12T16:52:23.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633c1959c0 1 -- 172.21.15.151:0/2364967981 shutdown_connections 2024-09-12T16:52:23.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2364967981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f910d0 0x563251f934c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633c1959c0 1 -- 172.21.15.151:0/2364967981 >> 172.21.15.151:0/2364967981 conn(0x563251f88a50 msgr2=0x563251f8ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633c1959c0 1 -- 172.21.15.151:0/2364967981 shutdown_connections 2024-09-12T16:52:23.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.277+0000 7f633c1959c0 1 -- 172.21.15.151:0/2364967981 wait complete. 2024-09-12T16:52:23.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 Processor -- start 2024-09-12T16:52:23.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 -- start start 2024-09-12T16:52:23.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563252078580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563251e95680 con 0x563251f8cf30 2024-09-12T16:52:23.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f6339c9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563252078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f6339c9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563252078580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34014/0 (socket says 172.21.15.151:34014) 2024-09-12T16:52:23.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f6339c9b640 1 -- 172.21.15.151:0/1569403149 learned_addr learned my addr 172.21.15.151:0/1569403149 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f6339c9b640 1 -- 172.21.15.151:0/1569403149 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563251e10da0 con 0x563251f8cf30 2024-09-12T16:52:23.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f6339c9b640 1 --2- 172.21.15.151:0/1569403149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563252078580 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f632c001e40 tx=0x7f632c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a205963fb184ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f6226e15640 1 -- 172.21.15.151:0/1569403149 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c012020 con 0x563251f8cf30 2024-09-12T16:52:23.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f6226e15640 1 -- 172.21.15.151:0/1569403149 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c00e690 con 0x563251f8cf30 2024-09-12T16:52:23.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f6226e15640 1 -- 172.21.15.151:0/1569403149 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c00e9b0 con 0x563251f8cf30 2024-09-12T16:52:23.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 -- 172.21.15.151:0/1569403149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 msgr2=0x563252078580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1569403149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563252078580 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f632c001e40 tx=0x7f632c00b790 comp rx=0 tx=0).stop 2024-09-12T16:52:23.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 -- 172.21.15.151:0/1569403149 shutdown_connections 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1569403149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563252078580 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 -- 172.21.15.151:0/1569403149 >> 172.21.15.151:0/1569403149 conn(0x563251f88a50 msgr2=0x563252074220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 -- 172.21.15.151:0/1569403149 shutdown_connections 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.293+0000 7f633c1959c0 1 -- 172.21.15.151:0/1569403149 wait complete. 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f633c1959c0 1 Processor -- start 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f633c1959c0 1 -- start start 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f633c1959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563251f03b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f633c1959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563251e37a50 con 0x563251f8cf30 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6339c9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563251f03b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6339c9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563251f03b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34016/0 (socket says 172.21.15.151:34016) 2024-09-12T16:52:23.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6339c9b640 1 -- 172.21.15.151:0/1069428650 learned_addr learned my addr 172.21.15.151:0/1069428650 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6339c9b640 1 -- 172.21.15.151:0/1069428650 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563251f040f0 con 0x563251f8cf30 2024-09-12T16:52:23.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6339c9b640 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563251f03b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x563252079570 tx=0x7f632c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6225612640 1 -- 172.21.15.151:0/1069428650 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c012030 con 0x563251f8cf30 2024-09-12T16:52:23.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563251f024d0 con 0x563251f8cf30 2024-09-12T16:52:23.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6225612640 1 -- 172.21.15.151:0/1069428650 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c01a720 con 0x563251f8cf30 2024-09-12T16:52:23.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6225612640 1 -- 172.21.15.151:0/1069428650 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c01aa60 con 0x563251f8cf30 2024-09-12T16:52:23.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563251f02a60 con 0x563251f8cf30 2024-09-12T16:52:23.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6225612640 1 -- 172.21.15.151:0/1069428650 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f632c015020 con 0x563251f8cf30 2024-09-12T16:52:23.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6225612640 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6220039a70 0x7f622003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f6225612640 1 -- 172.21.15.151:0/1069428650 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f632c020070 con 0x563251f8cf30 2024-09-12T16:52:23.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.297+0000 7f633949a640 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6220039a70 0x7f622003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563251f910d0 0x563252088fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520894e0 con 0x563251f910d0 2024-09-12T16:52:23.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633a49c640 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563251f910d0 0x563252088fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633949a640 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6220039a70 0x7f622003bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f63340ac000 tx=0x7f63340a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633a49c640 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563251f910d0 0x563252088fa0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633a49c640 1 -- 172.21.15.151:0/1069428650 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63240083f0 con 0x563251f910d0 2024-09-12T16:52:23.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520898a0 con 0x563251f910d0 2024-09-12T16:52:23.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633a49c640 1 -- 172.21.15.151:0/1069428650 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63240083f0 con 0x563251f910d0 2024-09-12T16:52:23.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56325208b6b0 0x56325208daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56325208e190 con 0x56325208b6b0 2024-09-12T16:52:23.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f6339c9b640 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56325208b6b0 0x56325208daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f6339c9b640 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56325208b6b0 0x56325208daa0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f6339c9b640 1 -- 172.21.15.151:0/1069428650 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f632c008030 con 0x56325208b6b0 2024-09-12T16:52:23.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56325208a550 con 0x563251f910d0 2024-09-12T16:52:23.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633a49c640 1 -- 172.21.15.151:0/1069428650 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f63240083f0 con 0x563251f910d0 2024-09-12T16:52:23.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56325208a9f0 con 0x563251f910d0 2024-09-12T16:52:23.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633a49c640 1 -- 172.21.15.151:0/1069428650 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f63240083f0 con 0x563251f910d0 2024-09-12T16:52:23.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 Processor -- start 2024-09-12T16:52:23.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 -- start start 2024-09-12T16:52:23.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56325209c870 0x56325209cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.301+0000 7f633c1959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563251ea2450 con 0x56325209c870 2024-09-12T16:52:23.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633a49c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56325209c870 0x56325209cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633a49c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56325209c870 0x56325209cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34022/0 (socket says 172.21.15.151:34022) 2024-09-12T16:52:23.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633a49c640 1 -- 172.21.15.151:0/3456344898 learned_addr learned my addr 172.21.15.151:0/3456344898 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633a49c640 1 -- 172.21.15.151:0/3456344898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325209d2d0 con 0x56325209c870 2024-09-12T16:52:23.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633a49c640 1 --2- 172.21.15.151:0/3456344898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56325209c870 0x56325209cc90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x563251f03760 tx=0x7f632400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f621e7fc640 1 -- 172.21.15.151:0/3456344898 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6324007dd0 con 0x56325209c870 2024-09-12T16:52:23.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633c1959c0 1 -- 172.21.15.151:0/3456344898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56325209db30 con 0x56325209c870 2024-09-12T16:52:23.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f621e7fc640 1 -- 172.21.15.151:0/3456344898 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632401e020 con 0x56325209c870 2024-09-12T16:52:23.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f621e7fc640 1 -- 172.21.15.151:0/3456344898 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6324019590 con 0x56325209c870 2024-09-12T16:52:23.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633c1959c0 1 -- 172.21.15.151:0/3456344898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56325209e0a0 con 0x56325209c870 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f621e7fc640 1 -- 172.21.15.151:0/3456344898 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6324016040 con 0x56325209c870 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f621e7fc640 1 --2- 172.21.15.151:0/3456344898 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6210039a70 0x7f621003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f621e7fc640 1 -- 172.21.15.151:0/3456344898 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f632401f030 con 0x56325209c870 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f6339c9b640 1 --2- 172.21.15.151:0/3456344898 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6210039a70 0x7f621003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633c1959c0 1 Processor -- start 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633c1959c0 1 -- start start 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f6339c9b640 1 --2- 172.21.15.151:0/3456344898 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6210039a70 0x7f621003bf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x563251f02d90 tx=0x7f632c00df00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633c1959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633c1959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563252078db0 con 0x5632520aa1c0 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633a49c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633a49c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34024/0 (socket says 172.21.15.151:34024) 2024-09-12T16:52:23.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.305+0000 7f633a49c640 1 -- 172.21.15.151:0/3412282613 learned_addr learned my addr 172.21.15.151:0/3412282613 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633a49c640 1 -- 172.21.15.151:0/3412282613 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632520aabb0 con 0x5632520aa1c0 2024-09-12T16:52:23.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633a49c640 1 --2- 172.21.15.151:0/3412282613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520aa5c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6324018fd0 tx=0x7f6324019e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b7de025fc38434 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f620ffff640 1 -- 172.21.15.151:0/3412282613 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632401d040 con 0x5632520aa1c0 2024-09-12T16:52:23.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f620ffff640 1 -- 172.21.15.151:0/3412282613 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63240520d0 con 0x5632520aa1c0 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f620ffff640 1 -- 172.21.15.151:0/3412282613 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6324017aa0 con 0x5632520aa1c0 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- 172.21.15.151:0/3412282613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 msgr2=0x5632520aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 --2- 172.21.15.151:0/3412282613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520aa5c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6324018fd0 tx=0x7f6324019e50 comp rx=0 tx=0).stop 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- 172.21.15.151:0/3412282613 shutdown_connections 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 --2- 172.21.15.151:0/3412282613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520aa5c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- 172.21.15.151:0/3412282613 >> 172.21.15.151:0/3412282613 conn(0x5632520a55c0 msgr2=0x5632520a3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- 172.21.15.151:0/3412282613 shutdown_connections 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- 172.21.15.151:0/3412282613 wait complete. 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 Processor -- start 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- start start 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5632520a90f0 con 0x5632520aa1c0 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633a49c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633a49c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34034/0 (socket says 172.21.15.151:34034) 2024-09-12T16:52:23.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 learned_addr learned my addr 172.21.15.151:0/2467697116 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632520b0ba0 con 0x5632520aa1c0 2024-09-12T16:52:23.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633a49c640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520b0640 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6324019e90 tx=0x7f6324050810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f620e7fc640 1 -- 172.21.15.151:0/2467697116 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6324048040 con 0x5632520aa1c0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632520b0e30 con 0x5632520aa1c0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f620e7fc640 1 -- 172.21.15.151:0/2467697116 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6324031070 con 0x5632520aa1c0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632520b17e0 con 0x5632520aa1c0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.309+0000 7f620e7fc640 1 -- 172.21.15.151:0/2467697116 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632401d040 con 0x5632520aa1c0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f620e7fc640 1 -- 172.21.15.151:0/2467697116 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f63240173b0 con 0x5632520aa1c0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f620e7fc640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6204039a70 0x7f620403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f620e7fc640 1 -- 172.21.15.151:0/2467697116 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6324037020 con 0x5632520aa1c0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f6339c9b640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6204039a70 0x7f620403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5632520bb920 0x5632520bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520be4c0 con 0x5632520bb920 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633949a640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5632520bb920 0x5632520bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f6339c9b640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6204039a70 0x7f620403bf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x56325208e590 tx=0x7f632c045000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633949a640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5632520bb920 0x5632520bdd70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 realm 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520be8f0 con 0x5632520bb920 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520bf1c0 con 0x5632520bb920 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520bf560 con 0x5632520bb920 2024-09-12T16:52:23.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5632520c02c0 0x5632520c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520c2cc0 con 0x5632520c02c0 2024-09-12T16:52:23.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633a49c640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5632520c02c0 0x5632520c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.313+0000 7f633a49c640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5632520c02c0 0x5632520c26b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633c1959c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633c1959c0 20 searching for the correct realm 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5632520c4ba0 0x5632520c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f6339c9b640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5632520c4ba0 0x5632520c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f6339c9b640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5632520c4ba0 0x5632520c7010 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f6339c9b640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f632c017050 0x7f632c050050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x7f632c017050 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633949a640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f632c017050 0x7f632c050050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633949a640 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f632c017050 0x7f632c050050 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520bb920 2024-09-12T16:52:23.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520bb920 2024-09-12T16:52:23.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.317+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x7f632c017050 2024-09-12T16:52:23.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520bb920 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520bb920 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x7f632c017050 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.321+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520bb920 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520bb920 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x7f632c017050 2024-09-12T16:52:23.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520bb920 2024-09-12T16:52:23.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.325+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x7f632c017050 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c4ba0 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520c02c0 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x5632520bb920 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632520c76e0 con 0x7f632c017050 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:23.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520c3610 con 0x5632520bb920 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520c3250 con 0x5632520bb920 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520c3fb0 con 0x5632520bb920 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 zone default found 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 4 Realm: () 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 zonegroup default 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520c7b60 con 0x5632520c02c0 2024-09-12T16:52:23.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520c9df0 con 0x5632520c4ba0 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.329+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520ca190 con 0x5632520c4ba0 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633c1959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633c1959c0 20 started sync module instance, tier type = 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633c1959c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520c9280 con 0x7f632c017050 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94774124910544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520c9280 con 0x7f632c017050 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cacb0 con 0x5632520bb920 2024-09-12T16:52:23.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94774124914592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cac70 con 0x5632520bb920 2024-09-12T16:52:23.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cbbf0 con 0x5632520c4ba0 2024-09-12T16:52:23.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.333+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94774124910544] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.337+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94774124914592] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.337+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.337+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94774124918560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cb0a0 con 0x5632520c4ba0 2024-09-12T16:52:23.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.337+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cc4c0 con 0x7f632c017050 2024-09-12T16:52:23.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.337+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.337+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94774124921120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520ccb10 con 0x7f632c017050 2024-09-12T16:52:23.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.337+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cd610 con 0x5632520bb920 2024-09-12T16:52:23.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.337+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94774124918560] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.341+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94774124921120] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.341+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.341+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94774124925184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cd5d0 con 0x5632520bb920 2024-09-12T16:52:23.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.341+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cda30 con 0x5632520c02c0 2024-09-12T16:52:23.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.341+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94774124925184] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.341+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.341+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94774124922240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cda30 con 0x5632520c02c0 2024-09-12T16:52:23.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.341+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520ce330 con 0x5632520c02c0 2024-09-12T16:52:23.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94774124922240] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94774124928544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520ce2f0 con 0x5632520c02c0 2024-09-12T16:52:23.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520ced60 con 0x5632520c02c0 2024-09-12T16:52:23.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94774124928544] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94774124931120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520ced20 con 0x5632520c02c0 2024-09-12T16:52:23.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 20 add_watcher() i=0 2024-09-12T16:52:23.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 20 add_watcher() i=1 2024-09-12T16:52:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 20 add_watcher() i=2 2024-09-12T16:52:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 20 add_watcher() i=3 2024-09-12T16:52:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 20 add_watcher() i=4 2024-09-12T16:52:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 20 add_watcher() i=5 2024-09-12T16:52:23.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.345+0000 7f633c1959c0 20 add_watcher() i=6 2024-09-12T16:52:23.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94774124931120] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633c1959c0 20 add_watcher() i=7 2024-09-12T16:52:23.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633c1959c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:23.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520d2180 con 0x5632520bb920 2024-09-12T16:52:23.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94774124907984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cf640 con 0x5632520bb920 2024-09-12T16:52:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94774124907984] v32'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f61eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633c1959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633c1959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:23.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633c1959c0 5 note: GC not initialized 2024-09-12T16:52:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f61edfe3640 20 reqs_thread_entry: start 2024-09-12T16:52:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.349+0000 7f633c1959c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 20 Filter name: none 2024-09-12T16:52:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f615f7fe640 20 reqs_thread_entry: start 2024-09-12T16:52:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T16:52:23.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520f5520 con 0x5632520c02c0 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520f4eb0 con 0x7f632c017050 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:23.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:23.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:23.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632520f8da0 con 0x5632520c02c0 2024-09-12T16:52:23.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(64 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-12T16:52:23.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.353+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520fcf60 con 0x7f632c017050 2024-09-12T16:52:23.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.357+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.357+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 8.3 8:c1aff4d1:root::.bucket.meta.testx%3amyfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563252100870 con 0x5632520bb920 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.357+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [create,call,writefull 0~420,setxattr (203)] v32'4 uv4 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.357+0000 7f633c1959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x7 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.357+0000 7f633c1959c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.357+0000 7f633c1959c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.357+0000 7f633c1959c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1, ofs0, ns] 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.357+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94774125127328 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632521002a0 con 0x7f632c017050 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== watch-notify(notify (1) cookie 94774124910544 notify 137438953485 ret 0) ==== 897+0+0 (crc 0 0 0) 0x563252100c10 con 0x7f632c017050 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94774124910544 notifier 4544 bl.length()=855 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x7 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:23.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(67 notify.0 [notify cookie 94774125127328 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T16:52:23.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f61fc003eb0 con 0x7f632c017050 2024-09-12T16:52:23.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== watch-notify(notify_complete (2) cookie 94774125127328 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632520fca60 con 0x7f632c017050 2024-09-12T16:52:23.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 20 handle_bi_update(): bucket=testx:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_sources= new_sources= 2024-09-12T16:52:23.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 20 handle_bi_update(): bucket=testx:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential sources added=[] removed=[] 2024-09-12T16:52:23.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 20 handle_bi_update(): bucket=testx:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_dests= new_dests= 2024-09-12T16:52:23.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 20 handle_bi_update(): bucket=testx:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential dests added=[] removed=[] 2024-09-12T16:52:23.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632521003a0 con 0x5632520bb920 2024-09-12T16:52:23.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632521003a0 con 0x5632520bb920 2024-09-12T16:52:23.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-12T16:52:23.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T16:52:23.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94774125133552 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563252100310 con 0x5632520bb920 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify (1) cookie 94774124925184 notify 137438953492 ret 0) ==== 390+0+0 (crc 0 0 0) 0x563252100740 con 0x5632520bb920 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94774124925184 notifier 4544 bl.length()=348 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f620ffff640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f61fc003eb0 con 0x5632520bb920 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(71 notify.4 [notify cookie 94774125133552 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== watch-notify(notify_complete (2) cookie 94774125133552 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632520ff6b0 con 0x5632520bb920 2024-09-12T16:52:23.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.361+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563252100360 con 0x7f632c017050 2024-09-12T16:52:23.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633c1959c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T16:52:23.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633c1959c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T16:52:23.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94774125133488 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632521002d0 con 0x5632520c02c0 2024-09-12T16:52:23.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== watch-notify(notify (1) cookie 94774124928544 notify 137438953480 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5632520f72c0 con 0x5632520c02c0 2024-09-12T16:52:23.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f620f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94774124928544 notifier 4544 bl.length()=149 2024-09-12T16:52:23.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f620f7fe640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f616c0032d0 con 0x5632520c02c0 2024-09-12T16:52:23.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(74 notify.6 [notify cookie 94774125133488 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== watch-notify(notify_complete (2) cookie 94774125133488 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632520b0ba0 con 0x5632520c02c0 2024-09-12T16:52:23.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.365+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563252100320 con 0x5632520c02c0 2024-09-12T16:52:23.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(76 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633c1959c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 from cache 2024-09-12T16:52:23.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633c1959c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1, ofs0, ns] 2024-09-12T16:52:23.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94774125104400 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563252100320 con 0x5632520bb920 2024-09-12T16:52:23.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== watch-notify(notify (1) cookie 94774124914592 notify 137438953493 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5632520ff6b0 con 0x5632520bb920 2024-09-12T16:52:23.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f620ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94774124914592 notifier 4544 bl.length()=206 2024-09-12T16:52:23.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f620ffff640 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f61fc003eb0 con 0x5632520bb920 2024-09-12T16:52:23.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(77 notify.1 [notify cookie 94774125104400 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== watch-notify(notify_complete (2) cookie 94774125104400 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632520fca60 con 0x5632520bb920 2024-09-12T16:52:23.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f61eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94774124907984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520ff880 con 0x5632520bb920 2024-09-12T16:52:23.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94774124907984] v32'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.369+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94774124910544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520c8dd0 con 0x7f632c017050 2024-09-12T16:52:23.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.373+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94774124910544] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.373+0000 7f633c1959c0 20 remove_watcher() i=0 2024-09-12T16:52:23.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.373+0000 7f633c1959c0 2 removed watcher, disabling cache 2024-09-12T16:52:23.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.373+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94774124914592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520c8dd0 con 0x5632520bb920 2024-09-12T16:52:23.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.373+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94774124914592] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.373+0000 7f633c1959c0 20 remove_watcher() i=1 2024-09-12T16:52:23.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.373+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94774124918560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520c8dd0 con 0x5632520c4ba0 2024-09-12T16:52:23.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.377+0000 7f6339c9b640 1 -- 172.21.15.151:0/2467697116 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94774124918560] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c008030 con 0x5632520c4ba0 2024-09-12T16:52:23.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.377+0000 7f633c1959c0 20 remove_watcher() i=2 2024-09-12T16:52:23.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.377+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94774124921120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cb720 con 0x7f632c017050 2024-09-12T16:52:23.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.377+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94774124921120] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x7f632c017050 2024-09-12T16:52:23.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.377+0000 7f633c1959c0 20 remove_watcher() i=3 2024-09-12T16:52:23.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.377+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94774124925184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520c8dd0 con 0x5632520bb920 2024-09-12T16:52:23.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94774124925184] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63340b2070 con 0x5632520bb920 2024-09-12T16:52:23.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633c1959c0 20 remove_watcher() i=4 2024-09-12T16:52:23.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94774124922240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cb720 con 0x5632520c02c0 2024-09-12T16:52:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94774124922240] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633c1959c0 20 remove_watcher() i=5 2024-09-12T16:52:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94774124928544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520c8dd0 con 0x5632520c02c0 2024-09-12T16:52:23.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94774124928544] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633c1959c0 20 remove_watcher() i=6 2024-09-12T16:52:23.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.381+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94774124931120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632520cb720 con 0x5632520c02c0 2024-09-12T16:52:23.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633a49c640 1 -- 172.21.15.151:0/2467697116 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94774124931120] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632402a070 con 0x5632520c02c0 2024-09-12T16:52:23.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 20 remove_watcher() i=7 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5632520c02c0 msgr2=0x5632520c26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5632520c02c0 0x5632520c26b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5632520bb920 msgr2=0x5632520bdd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5632520bb920 0x5632520bdd70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f632c017050 msgr2=0x7f632c050050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f632c017050 0x7f632c050050 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5632520c4ba0 msgr2=0x5632520c7010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5632520c4ba0 0x5632520c7010 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6204039a70 msgr2=0x7f620403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6204039a70 0x7f620403bf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x56325208e590 tx=0x7f632c045000 comp rx=0 tx=0).stop 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 msgr2=0x5632520b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633949a640 1 -- 172.21.15.151:0/2467697116 reap_dead start 2024-09-12T16:52:23.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520b0640 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6324019e90 tx=0x7f6324050810 comp rx=0 tx=0).stop 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 shutdown_connections 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/2467697116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632520aa1c0 0x5632520b0640 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 >> 172.21.15.151:0/2467697116 conn(0x5632520a55c0 msgr2=0x5632520a37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 shutdown_connections 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/2467697116 wait complete. 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/3456344898 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6210039a70 msgr2=0x7f621003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/3456344898 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6210039a70 0x7f621003bf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x563251f02d90 tx=0x7f632c00df00 comp rx=0 tx=0).stop 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/3456344898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56325209c870 msgr2=0x56325209cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/3456344898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56325209c870 0x56325209cc90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x563251f03760 tx=0x7f632400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/3456344898 shutdown_connections 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/3456344898 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6210039a70 0x7f621003bf30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/3456344898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56325209c870 0x56325209cc90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/3456344898 >> 172.21.15.151:0/3456344898 conn(0x563252092220 msgr2=0x563252092600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/3456344898 shutdown_connections 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/3456344898 wait complete. 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56325208b6b0 msgr2=0x56325208daa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56325208b6b0 0x56325208daa0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563251f910d0 msgr2=0x563252088fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563251f910d0 0x563252088fa0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6220039a70 msgr2=0x7f622003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6220039a70 0x7f622003bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f63340ac000 tx=0x7f63340a5000 comp rx=0 tx=0).stop 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 msgr2=0x563251f03b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563251f03b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x563252079570 tx=0x7f632c0040f0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 shutdown_connections 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56325208b6b0 0x56325208daa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563251f910d0 0x563252088fa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6220039a70 0x7f622003bf30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 --2- 172.21.15.151:0/1069428650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563251f8cf30 0x563251f03b90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 >> 172.21.15.151:0/1069428650 conn(0x563251f88a50 msgr2=0x563252072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 shutdown_connections 2024-09-12T16:52:23.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.385+0000 7f633c1959c0 1 -- 172.21.15.151:0/1069428650 wait complete. 2024-09-12T16:52:23.399 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-12T16:52:23.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-12T16:52:23.399 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-12T16:52:23.469 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:23.469 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:23.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f902c21d9c0 1 Processor -- start 2024-09-12T16:52:23.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f902c21d9c0 1 -- start start 2024-09-12T16:52:23.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f902c21d9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5605f691f310 0x5605f6921700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f902c21d9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5605f67cf9c0 con 0x5605f688f240 2024-09-12T16:52:23.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f902c21d9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5605f681f6d0 con 0x5605f691f310 2024-09-12T16:52:23.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f9029522640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5605f691f310 0x5605f6921700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f9029d23640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5605f688f240 0x5605f691dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42680/0 (socket says 172.21.15.151:42680) 2024-09-12T16:52:23.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f9029522640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5605f691f310 0x5605f6921700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34054/0 (socket says 172.21.15.151:34054) 2024-09-12T16:52:23.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f9029d23640 1 -- 172.21.15.151:0/2368556788 learned_addr learned my addr 172.21.15.151:0/2368556788 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:23.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f9029522640 1 -- 172.21.15.151:0/2368556788 >> v1:172.21.15.122:6789/0 conn(0x5605f688f240 legacy=0x5605f691dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f9029522640 1 -- 172.21.15.151:0/2368556788 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f67c3ca0 con 0x5605f691f310 2024-09-12T16:52:23.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.469+0000 7f9029522640 1 --2- 172.21.15.151:0/2368556788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f691f310 0x5605f6921700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f901400a480 tx=0x7f901401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7430b81886fc4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f9028d21640 1 -- 172.21.15.151:0/2368556788 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90140af070 con 0x5605f691f310 2024-09-12T16:52:23.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f9028d21640 1 -- 172.21.15.151:0/2368556788 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90140aa530 con 0x5605f691f310 2024-09-12T16:52:23.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f9028d21640 1 -- 172.21.15.151:0/2368556788 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90140aa830 con 0x5605f691f310 2024-09-12T16:52:23.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f902c21d9c0 1 -- 172.21.15.151:0/2368556788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f691f310 msgr2=0x5605f6921700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/2368556788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f691f310 0x5605f6921700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f901400a480 tx=0x7f901401b280 comp rx=0 tx=0).stop 2024-09-12T16:52:23.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f902c21d9c0 1 -- 172.21.15.151:0/2368556788 shutdown_connections 2024-09-12T16:52:23.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/2368556788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f691f310 0x5605f6921700 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f902c21d9c0 1 -- 172.21.15.151:0/2368556788 >> 172.21.15.151:0/2368556788 conn(0x5605f6915920 msgr2=0x5605f6917d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f902c21d9c0 1 -- 172.21.15.151:0/2368556788 shutdown_connections 2024-09-12T16:52:23.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.473+0000 7f902c21d9c0 1 -- 172.21.15.151:0/2368556788 wait complete. 2024-09-12T16:52:23.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f902c21d9c0 1 Processor -- start 2024-09-12T16:52:23.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f902c21d9c0 1 -- start start 2024-09-12T16:52:23.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f902c21d9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a06820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f902c21d9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605f6823680 con 0x5605f688f240 2024-09-12T16:52:23.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f9029d23640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a06820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f9029d23640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a06820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34056/0 (socket says 172.21.15.151:34056) 2024-09-12T16:52:23.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f9029d23640 1 -- 172.21.15.151:0/4105026070 learned_addr learned my addr 172.21.15.151:0/4105026070 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f9029d23640 1 -- 172.21.15.151:0/4105026070 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f679eda0 con 0x5605f688f240 2024-09-12T16:52:23.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f9029d23640 1 --2- 172.21.15.151:0/4105026070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a06820 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f901c0017b0 tx=0x7f901c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b0904b74e30e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.485+0000 7f8f17e07640 1 -- 172.21.15.151:0/4105026070 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f901c0044f0 con 0x5605f688f240 2024-09-12T16:52:23.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f8f17e07640 1 -- 172.21.15.151:0/4105026070 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901c0046b0 con 0x5605f688f240 2024-09-12T16:52:23.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f8f17e07640 1 -- 172.21.15.151:0/4105026070 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f901c004a10 con 0x5605f688f240 2024-09-12T16:52:23.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4105026070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 msgr2=0x5605f6a06820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/4105026070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a06820 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f901c0017b0 tx=0x7f901c001c70 comp rx=0 tx=0).stop 2024-09-12T16:52:23.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4105026070 shutdown_connections 2024-09-12T16:52:23.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/4105026070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a06820 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4105026070 >> 172.21.15.151:0/4105026070 conn(0x5605f6915920 msgr2=0x5605f6a02460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4105026070 shutdown_connections 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4105026070 wait complete. 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 Processor -- start 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- start start 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a0def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605f67c5a50 con 0x5605f688f240 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f9029d23640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a0def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f9029d23640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a0def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34058/0 (socket says 172.21.15.151:34058) 2024-09-12T16:52:23.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f9029d23640 1 -- 172.21.15.151:0/422020148 learned_addr learned my addr 172.21.15.151:0/422020148 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f9029d23640 1 -- 172.21.15.151:0/422020148 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f6a0e450 con 0x5605f688f240 2024-09-12T16:52:23.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f9029d23640 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a0def0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f901c0012f0 tx=0x7f901c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f8f16604640 1 -- 172.21.15.151:0/422020148 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f901c013820 con 0x5605f688f240 2024-09-12T16:52:23.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f6a0e6e0 con 0x5605f688f240 2024-09-12T16:52:23.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f8f16604640 1 -- 172.21.15.151:0/422020148 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901c0139c0 con 0x5605f688f240 2024-09-12T16:52:23.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f8f16604640 1 -- 172.21.15.151:0/422020148 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f901c013ca0 con 0x5605f688f240 2024-09-12T16:52:23.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.489+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f6a0f090 con 0x5605f688f240 2024-09-12T16:52:23.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f8f16604640 1 -- 172.21.15.151:0/422020148 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f901c010070 con 0x5605f688f240 2024-09-12T16:52:23.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f8f16604640 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f10039a70 0x7f8f1003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f8f16604640 1 -- 172.21.15.151:0/422020148 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f901c018070 con 0x5605f688f240 2024-09-12T16:52:23.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f9029522640 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f10039a70 0x7f8f1003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f691f310 0x5605f6a15060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a155a0 con 0x5605f691f310 2024-09-12T16:52:23.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902a524640 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f691f310 0x5605f6a15060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f9029522640 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f10039a70 0x7f8f1003bf30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f90140ac000 tx=0x7f90140a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902a524640 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f691f310 0x5605f6a15060 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902a524640 1 -- 172.21.15.151:0/422020148 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90240083f0 con 0x5605f691f310 2024-09-12T16:52:23.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a0f4c0 con 0x5605f691f310 2024-09-12T16:52:23.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902a524640 1 -- 172.21.15.151:0/422020148 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90240083f0 con 0x5605f691f310 2024-09-12T16:52:23.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a17840 0x5605f6a19c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a1a300 con 0x5605f6a17840 2024-09-12T16:52:23.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f9029d23640 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a17840 0x5605f6a19c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f9029d23640 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a17840 0x5605f6a19c30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f9029d23640 1 -- 172.21.15.151:0/422020148 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a17840 2024-09-12T16:52:23.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.493+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a166e0 con 0x5605f691f310 2024-09-12T16:52:23.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902a524640 1 -- 172.21.15.151:0/422020148 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90240083f0 con 0x5605f691f310 2024-09-12T16:52:23.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a16b80 con 0x5605f691f310 2024-09-12T16:52:23.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902a524640 1 -- 172.21.15.151:0/422020148 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90240083f0 con 0x5605f691f310 2024-09-12T16:52:23.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902c21d9c0 1 Processor -- start 2024-09-12T16:52:23.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902c21d9c0 1 -- start start 2024-09-12T16:52:23.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902c21d9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6a28970 0x5605f6a28d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902c21d9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605f6830450 con 0x5605f6a28970 2024-09-12T16:52:23.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902a524640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6a28970 0x5605f6a28d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902a524640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6a28970 0x5605f6a28d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34068/0 (socket says 172.21.15.151:34068) 2024-09-12T16:52:23.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902a524640 1 -- 172.21.15.151:0/680108761 learned_addr learned my addr 172.21.15.151:0/680108761 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902a524640 1 -- 172.21.15.151:0/680108761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f6a293d0 con 0x5605f6a28970 2024-09-12T16:52:23.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902a524640 1 --2- 172.21.15.151:0/680108761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6a28970 0x5605f6a28d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x5605f6a10050 tx=0x7f902400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/680108761 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9024007e00 con 0x5605f6a28970 2024-09-12T16:52:23.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/680108761 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902401e020 con 0x5605f6a28970 2024-09-12T16:52:23.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902c21d9c0 1 -- 172.21.15.151:0/680108761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f6a29c30 con 0x5605f6a28970 2024-09-12T16:52:23.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/680108761 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9024019590 con 0x5605f6a28970 2024-09-12T16:52:23.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f902c21d9c0 1 -- 172.21.15.151:0/680108761 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f6a2a1a0 con 0x5605f6a28970 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/680108761 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9024016040 con 0x5605f6a28970 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f8f0f7fe640 1 --2- 172.21.15.151:0/680108761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f04039a70 0x7f8f0403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/680108761 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f902401f030 con 0x5605f6a28970 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.497+0000 7f9029d23640 1 --2- 172.21.15.151:0/680108761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f04039a70 0x7f8f0403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 Processor -- start 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- start start 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f9029d23640 1 --2- 172.21.15.151:0/680108761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f04039a70 0x7f8f0403bf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5605f6a159b0 tx=0x7f901c014f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6919fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605f6a07070 con 0x5605f6919bb0 2024-09-12T16:52:23.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6919fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6919fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34072/0 (socket says 172.21.15.151:34072) 2024-09-12T16:52:23.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 -- 172.21.15.151:0/4138236708 learned_addr learned my addr 172.21.15.151:0/4138236708 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 -- 172.21.15.151:0/4138236708 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f691a4f0 con 0x5605f6919bb0 2024-09-12T16:52:23.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 --2- 172.21.15.151:0/4138236708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6919fb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9024023fb0 tx=0x7f9024023970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc5a2d73d76bf94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f8f0d7fa640 1 -- 172.21.15.151:0/4138236708 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902401d040 con 0x5605f6919bb0 2024-09-12T16:52:23.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f8f0d7fa640 1 -- 172.21.15.151:0/4138236708 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9024017470 con 0x5605f6919bb0 2024-09-12T16:52:23.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f8f0d7fa640 1 -- 172.21.15.151:0/4138236708 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9024019d80 con 0x5605f6919bb0 2024-09-12T16:52:23.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4138236708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 msgr2=0x5605f6919fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/4138236708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6919fb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9024023fb0 tx=0x7f9024023970 comp rx=0 tx=0).stop 2024-09-12T16:52:23.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4138236708 shutdown_connections 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/4138236708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6919fb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4138236708 >> 172.21.15.151:0/4138236708 conn(0x5605f6a31630 msgr2=0x5605f6a2f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4138236708 shutdown_connections 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- 172.21.15.151:0/4138236708 wait complete. 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 Processor -- start 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- start start 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6a3e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902c21d9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5605f691aa70 con 0x5605f6919bb0 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6a3e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6a3e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34088/0 (socket says 172.21.15.151:34088) 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 learned_addr learned my addr 172.21.15.151:0/3722821404 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.501+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f6a3eeb0 con 0x5605f6919bb0 2024-09-12T16:52:23.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902a524640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6a3e950 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9024005710 tx=0x7f90240508e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f8efb7fe640 1 -- 172.21.15.151:0/3722821404 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902401d070 con 0x5605f6919bb0 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f6a3f140 con 0x5605f6919bb0 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f6a3faf0 con 0x5605f6919bb0 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f8efb7fe640 1 -- 172.21.15.151:0/3722821404 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9024049040 con 0x5605f6919bb0 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f8efb7fe640 1 -- 172.21.15.151:0/3722821404 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902403c060 con 0x5605f6919bb0 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f8efb7fe640 1 -- 172.21.15.151:0/3722821404 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f902403ed10 con 0x5605f6919bb0 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f8efb7fe640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ef4039a70 0x7f8ef403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f8efb7fe640 1 -- 172.21.15.151:0/3722821404 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9024024030 con 0x5605f6919bb0 2024-09-12T16:52:23.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f9029d23640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ef4039a70 0x7f8ef403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f6a49c30 0x5605f6a4c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a4c810 con 0x5605f6a49c30 2024-09-12T16:52:23.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f9029522640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f6a49c30 0x5605f6a4c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f9029d23640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ef4039a70 0x7f8ef403bf30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f901c01dfd0 tx=0x7f901c041000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f9029522640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f6a49c30 0x5605f6a4c0c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 realm 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a4cbe0 con 0x5605f6a49c30 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a4d4b0 con 0x5605f6a49c30 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a4d850 con 0x5605f6a49c30 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a4e300 0x5605f6a506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.505+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a50e50 con 0x5605f6a4e300 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902a524640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a4e300 0x5605f6a506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902a524640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a4e300 0x5605f6a506f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902c21d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:23.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902c21d9c0 20 searching for the correct realm 2024-09-12T16:52:23.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5605f6a52df0 0x5605f6a552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029d23640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5605f6a52df0 0x5605f6a552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029d23640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5605f6a52df0 0x5605f6a552b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029d23640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f901c046040 0x7f901c0123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x7f901c046040 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029522640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f901c046040 0x7f901c0123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029522640 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f901c046040 0x7f901c0123c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.509+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a49c30 2024-09-12T16:52:23.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a49c30 2024-09-12T16:52:23.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x7f901c046040 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a49c30 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a49c30 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x7f901c046040 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.513+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a49c30 2024-09-12T16:52:23.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a49c30 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x7f901c046040 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a49c30 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.517+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x7f901c046040 2024-09-12T16:52:23.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a52df0 2024-09-12T16:52:23.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a4e300 2024-09-12T16:52:23.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x5605f6a49c30 2024-09-12T16:52:23.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55980 con 0x7f901c046040 2024-09-12T16:52:23.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:23.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a51810 con 0x5605f6a49c30 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a51c60 con 0x5605f6a49c30 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a52140 con 0x5605f6a49c30 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 zone default found 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 4 Realm: () 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 zonegroup default 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.521+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a55e00 con 0x5605f6a4e300 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57d20 con 0x5605f6a52df0 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a581e0 con 0x5605f6a52df0 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 20 started sync module instance, tier type = 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:23.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57030 con 0x7f901c046040 2024-09-12T16:52:23.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94583612863792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57030 con 0x7f901c046040 2024-09-12T16:52:23.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a58d10 con 0x5605f6a49c30 2024-09-12T16:52:23.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.525+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94583612863792] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94583612868576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57030 con 0x5605f6a49c30 2024-09-12T16:52:23.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a59720 con 0x5605f6a52df0 2024-09-12T16:52:23.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94583612871280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a59fc0 con 0x5605f6a52df0 2024-09-12T16:52:23.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5a9c0 con 0x7f901c046040 2024-09-12T16:52:23.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94583612868576] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94583612861312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5a980 con 0x7f901c046040 2024-09-12T16:52:23.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.529+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5b3d0 con 0x5605f6a49c30 2024-09-12T16:52:23.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94583612871280] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94583612861312] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94583612875984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a59c20 con 0x5605f6a49c30 2024-09-12T16:52:23.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5b880 con 0x5605f6a4e300 2024-09-12T16:52:23.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94583612875984] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94583612878624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a59c20 con 0x5605f6a4e300 2024-09-12T16:52:23.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.533+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5c3a0 con 0x5605f6a4e300 2024-09-12T16:52:23.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94583612878624] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94583612882544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5c360 con 0x5605f6a4e300 2024-09-12T16:52:23.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5cde0 con 0x5605f6a4e300 2024-09-12T16:52:23.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94583612882544] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94583612885200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5cda0 con 0x5605f6a4e300 2024-09-12T16:52:23.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 20 add_watcher() i=0 2024-09-12T16:52:23.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 20 add_watcher() i=1 2024-09-12T16:52:23.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 20 add_watcher() i=2 2024-09-12T16:52:23.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 20 add_watcher() i=3 2024-09-12T16:52:23.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 20 add_watcher() i=4 2024-09-12T16:52:23.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 20 add_watcher() i=5 2024-09-12T16:52:23.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.537+0000 7f902c21d9c0 20 add_watcher() i=6 2024-09-12T16:52:23.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94583612885200] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 20 add_watcher() i=7 2024-09-12T16:52:23.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:23.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a60230 con 0x5605f6a49c30 2024-09-12T16:52:23.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94583612879680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5d780 con 0x5605f6a49c30 2024-09-12T16:52:23.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94583612879680] v32'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f8edb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:23.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:23.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 5 note: GC not initialized 2024-09-12T16:52:23.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f8eda7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:23.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:23.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 20 Filter name: none 2024-09-12T16:52:23.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f8e4bfff640 20 reqs_thread_entry: start 2024-09-12T16:52:23.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.541+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a82f20 con 0x5605f6a49c30 2024-09-12T16:52:23.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f902c21d9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T16:52:23.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f8edb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94583612879680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a43f90 con 0x5605f6a49c30 2024-09-12T16:52:23.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94583612879680] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94583612863792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5b340 con 0x7f901c046040 2024-09-12T16:52:23.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94583612863792] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f902c21d9c0 20 remove_watcher() i=0 2024-09-12T16:52:23.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f902c21d9c0 2 removed watcher, disabling cache 2024-09-12T16:52:23.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.545+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94583612868576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57530 con 0x5605f6a49c30 2024-09-12T16:52:23.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.549+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94583612868576] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.549+0000 7f902c21d9c0 20 remove_watcher() i=1 2024-09-12T16:52:23.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.549+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94583612871280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57530 con 0x5605f6a52df0 2024-09-12T16:52:23.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.549+0000 7f9029d23640 1 -- 172.21.15.151:0/3722821404 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94583612871280] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901c01b030 con 0x5605f6a52df0 2024-09-12T16:52:23.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.549+0000 7f902c21d9c0 20 remove_watcher() i=2 2024-09-12T16:52:23.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.549+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94583612861312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57530 con 0x7f901c046040 2024-09-12T16:52:23.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.553+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94583612861312] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x7f901c046040 2024-09-12T16:52:23.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.553+0000 7f902c21d9c0 20 remove_watcher() i=3 2024-09-12T16:52:23.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.553+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94583612875984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57530 con 0x5605f6a49c30 2024-09-12T16:52:23.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.553+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94583612875984] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90140a8070 con 0x5605f6a49c30 2024-09-12T16:52:23.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.553+0000 7f902c21d9c0 20 remove_watcher() i=4 2024-09-12T16:52:23.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.553+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94583612878624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57530 con 0x5605f6a4e300 2024-09-12T16:52:23.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.557+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94583612878624] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.557+0000 7f902c21d9c0 20 remove_watcher() i=5 2024-09-12T16:52:23.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.557+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94583612882544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a57530 con 0x5605f6a4e300 2024-09-12T16:52:23.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.557+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94583612882544] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.557+0000 7f902c21d9c0 20 remove_watcher() i=6 2024-09-12T16:52:23.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.557+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94583612885200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f6a5be70 con 0x5605f6a4e300 2024-09-12T16:52:23.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902a524640 1 -- 172.21.15.151:0/3722821404 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94583612885200] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902403e070 con 0x5605f6a4e300 2024-09-12T16:52:23.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 20 remove_watcher() i=7 2024-09-12T16:52:23.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a4e300 msgr2=0x5605f6a506f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a4e300 0x5605f6a506f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f6a49c30 msgr2=0x5605f6a4c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f6a49c30 0x5605f6a4c0c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f901c046040 msgr2=0x7f901c0123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f901c046040 0x7f901c0123c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5605f6a52df0 msgr2=0x5605f6a552b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5605f6a52df0 0x5605f6a552b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ef4039a70 msgr2=0x7f8ef403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8ef4039a70 0x7f8ef403bf30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f901c01dfd0 tx=0x7f901c041000 comp rx=0 tx=0).stop 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 msgr2=0x5605f6a3e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6a3e950 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9024005710 tx=0x7f90240508e0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f9029522640 1 -- 172.21.15.151:0/3722821404 reap_dead start 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 shutdown_connections 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/3722821404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6919bb0 0x5605f6a3e950 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 >> 172.21.15.151:0/3722821404 conn(0x5605f6a31630 msgr2=0x5605f6a2f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 shutdown_connections 2024-09-12T16:52:23.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/3722821404 wait complete. 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/680108761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f04039a70 msgr2=0x7f8f0403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/680108761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f04039a70 0x7f8f0403bf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5605f6a159b0 tx=0x7f901c014f20 comp rx=0 tx=0).stop 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/680108761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6a28970 msgr2=0x5605f6a28d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/680108761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6a28970 0x5605f6a28d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x5605f6a10050 tx=0x7f902400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/680108761 shutdown_connections 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/680108761 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f04039a70 0x7f8f0403bf30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/680108761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f6a28970 0x5605f6a28d90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/680108761 >> 172.21.15.151:0/680108761 conn(0x5605f6a1e320 msgr2=0x5605f6a1e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/680108761 shutdown_connections 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/680108761 wait complete. 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a17840 msgr2=0x5605f6a19c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a17840 0x5605f6a19c30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f691f310 msgr2=0x5605f6a15060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f691f310 0x5605f6a15060 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f10039a70 msgr2=0x7f8f1003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f10039a70 0x7f8f1003bf30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f90140ac000 tx=0x7f90140a5000 comp rx=0 tx=0).stop 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 msgr2=0x5605f6a0def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a0def0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f901c0012f0 tx=0x7f901c000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 shutdown_connections 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5605f6a17840 0x5605f6a19c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5605f691f310 0x5605f6a15060 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8f10039a70 0x7f8f1003bf30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 --2- 172.21.15.151:0/422020148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5605f688f240 0x5605f6a0def0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 >> 172.21.15.151:0/422020148 conn(0x5605f6915920 msgr2=0x5605f6a00ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 shutdown_connections 2024-09-12T16:52:23.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.561+0000 7f902c21d9c0 1 -- 172.21.15.151:0/422020148 wait complete. 2024-09-12T16:52:23.573 INFO:teuthology.orchestra.run.smithi151.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"AruSC20GRQIbxVuvjtau4aS2","ver":2},"mtime":"2024-09-12T16:52:23.364139Z","data":{"bucket":{"name":"myfoo","marker":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","bucket_id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-12T16:52:19.907293Z","linked":true,"has_bucket_info":false}} 2024-09-12T16:52:23.573 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'AruSC20GRQIbxVuvjtau4aS2', 'ver': 2}, 'mtime': '2024-09-12T16:52:23.364139Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'bucket_id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-12T16:52:19.907293Z', 'linked': True, 'has_bucket_info': False}} 2024-09-12T16:52:23.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-12T16:52:23.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-12T16:52:23.573 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-12T16:52:23.651 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:23.652 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:23.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd20b9ac9c0 1 Processor -- start 2024-09-12T16:52:23.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd20b9ac9c0 1 -- start start 2024-09-12T16:52:23.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd20b9ac9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e614eb21f0 0x55e614eb25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd20b9ac9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e614d649c0 con 0x55e614eb5330 2024-09-12T16:52:23.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd20b9ac9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55e614db46d0 con 0x55e614eb21f0 2024-09-12T16:52:23.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd2094b2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e614eb21f0 0x55e614eb25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd208cb1640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55e614eb5330 0x55e614eb7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42694/0 (socket says 172.21.15.151:42694) 2024-09-12T16:52:23.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd208cb1640 1 -- 172.21.15.151:0/4280835638 learned_addr learned my addr 172.21.15.151:0/4280835638 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:23.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd2094b2640 1 --2- 172.21.15.151:0/4280835638 >> v2:172.21.15.122:3300/0 conn(0x55e614eb21f0 0x55e614eb25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34104/0 (socket says 172.21.15.151:34104) 2024-09-12T16:52:23.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.649+0000 7fd2094b2640 1 -- 172.21.15.151:0/4280835638 >> v1:172.21.15.122:6789/0 conn(0x55e614eb5330 legacy=0x55e614eb7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.653+0000 7fd2094b2640 1 -- 172.21.15.151:0/4280835638 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e614d58ca0 con 0x55e614eb21f0 2024-09-12T16:52:23.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.653+0000 7fd2094b2640 1 --2- 172.21.15.151:0/4280835638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614eb25d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00a480 tx=0x7fd1fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea507f976c932ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd1fbfff640 1 -- 172.21.15.151:0/4280835638 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc0b0070 con 0x55e614eb21f0 2024-09-12T16:52:23.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd1fbfff640 1 -- 172.21.15.151:0/4280835638 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0ab540 con 0x55e614eb21f0 2024-09-12T16:52:23.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd1fbfff640 1 -- 172.21.15.151:0/4280835638 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc0ab840 con 0x55e614eb21f0 2024-09-12T16:52:23.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/4280835638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 msgr2=0x55e614eb25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/4280835638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614eb25d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00a480 tx=0x7fd1fc01b280 comp rx=0 tx=0).stop 2024-09-12T16:52:23.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/4280835638 shutdown_connections 2024-09-12T16:52:23.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/4280835638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614eb25d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/4280835638 >> 172.21.15.151:0/4280835638 conn(0x55e614e25b00 msgr2=0x55e614e25f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/4280835638 shutdown_connections 2024-09-12T16:52:23.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.657+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/4280835638 wait complete. 2024-09-12T16:52:23.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd20b9ac9c0 1 Processor -- start 2024-09-12T16:52:23.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd20b9ac9c0 1 -- start start 2024-09-12T16:52:23.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd20b9ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614f9d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd20b9ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e614db8680 con 0x55e614eb21f0 2024-09-12T16:52:23.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd2094b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614f9d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd2094b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614f9d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34108/0 (socket says 172.21.15.151:34108) 2024-09-12T16:52:23.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd2094b2640 1 -- 172.21.15.151:0/2535943681 learned_addr learned my addr 172.21.15.151:0/2535943681 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd2094b2640 1 -- 172.21.15.151:0/2535943681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e614d33da0 con 0x55e614eb21f0 2024-09-12T16:52:23.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.669+0000 7fd2094b2640 1 --2- 172.21.15.151:0/2535943681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614f9d8c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc018eb0 tx=0x7fd1fc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88b8cd2416936d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd0f7606640 1 -- 172.21.15.151:0/2535943681 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc0b0070 con 0x55e614eb21f0 2024-09-12T16:52:23.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd0f7606640 1 -- 172.21.15.151:0/2535943681 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0b1040 con 0x55e614eb21f0 2024-09-12T16:52:23.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd0f7606640 1 -- 172.21.15.151:0/2535943681 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc0ab6f0 con 0x55e614eb21f0 2024-09-12T16:52:23.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/2535943681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 msgr2=0x55e614f9d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/2535943681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614f9d8c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc018eb0 tx=0x7fd1fc003030 comp rx=0 tx=0).stop 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/2535943681 shutdown_connections 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/2535943681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614f9d8c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/2535943681 >> 172.21.15.151:0/2535943681 conn(0x55e614e25b00 msgr2=0x55e614f99540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/2535943681 shutdown_connections 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/2535943681 wait complete. 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 Processor -- start 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- start start 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614fa4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e614d5aa50 con 0x55e614eb21f0 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd2094b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614fa4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd2094b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614fa4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34118/0 (socket says 172.21.15.151:34118) 2024-09-12T16:52:23.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd2094b2640 1 -- 172.21.15.151:0/3900654359 learned_addr learned my addr 172.21.15.151:0/3900654359 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd2094b2640 1 -- 172.21.15.151:0/3900654359 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e614fa5430 con 0x55e614eb21f0 2024-09-12T16:52:23.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd2094b2640 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614fa4ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0ab510 tx=0x7fd1fc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd0f5e03640 1 -- 172.21.15.151:0/3900654359 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc0c4070 con 0x55e614eb21f0 2024-09-12T16:52:23.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e614fa56c0 con 0x55e614eb21f0 2024-09-12T16:52:23.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd0f5e03640 1 -- 172.21.15.151:0/3900654359 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0b75b0 con 0x55e614eb21f0 2024-09-12T16:52:23.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd0f5e03640 1 -- 172.21.15.151:0/3900654359 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc0b7890 con 0x55e614eb21f0 2024-09-12T16:52:23.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.673+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e614fa6070 con 0x55e614eb21f0 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd0f5e03640 1 -- 172.21.15.151:0/3900654359 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd1fc0c7070 con 0x55e614eb21f0 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd0f5e03640 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0f0039a70 0x7fd0f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd0f5e03640 1 -- 172.21.15.151:0/3900654359 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd1fc0bc070 con 0x55e614eb21f0 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd208cb1640 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0f0039a70 0x7fd0f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614eb5330 0x55e614fac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fac580 con 0x55e614eb5330 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd209cb3640 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614eb5330 0x55e614fac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd208cb1640 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0f0039a70 0x7fd0f003bf30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd200001650 tx=0x7fd200006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd209cb3640 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614eb5330 0x55e614fac040 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd209cb3640 1 -- 172.21.15.151:0/3900654359 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2040083f0 con 0x55e614eb5330 2024-09-12T16:52:23.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fac9d0 con 0x55e614eb5330 2024-09-12T16:52:23.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd209cb3640 1 -- 172.21.15.151:0/3900654359 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2040083f0 con 0x55e614eb5330 2024-09-12T16:52:23.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fae7e0 0x55e614fb0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fb12c0 con 0x55e614fae7e0 2024-09-12T16:52:23.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd2094b2640 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fae7e0 0x55e614fb0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd2094b2640 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fae7e0 0x55e614fb0bd0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd2094b2640 1 -- 172.21.15.151:0/3900654359 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd1fc0d0070 con 0x55e614fae7e0 2024-09-12T16:52:23.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.677+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fad680 con 0x55e614eb5330 2024-09-12T16:52:23.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd209cb3640 1 -- 172.21.15.151:0/3900654359 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2040083f0 con 0x55e614eb5330 2024-09-12T16:52:23.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fadb20 con 0x55e614eb5330 2024-09-12T16:52:23.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd209cb3640 1 -- 172.21.15.151:0/3900654359 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2040083f0 con 0x55e614eb5330 2024-09-12T16:52:23.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd20b9ac9c0 1 Processor -- start 2024-09-12T16:52:23.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd20b9ac9c0 1 -- start start 2024-09-12T16:52:23.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd20b9ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fbf950 0x55e614fbfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd20b9ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e614dc5450 con 0x55e614fbf950 2024-09-12T16:52:23.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd209cb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fbf950 0x55e614fbfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd209cb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fbf950 0x55e614fbfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34126/0 (socket says 172.21.15.151:34126) 2024-09-12T16:52:23.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd209cb3640 1 -- 172.21.15.151:0/3610423642 learned_addr learned my addr 172.21.15.151:0/3610423642 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd209cb3640 1 -- 172.21.15.151:0/3610423642 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e614fc03b0 con 0x55e614fbf950 2024-09-12T16:52:23.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd209cb3640 1 --2- 172.21.15.151:0/3610423642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fbf950 0x55e614fbfd70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55e614fa6260 tx=0x7fd20400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd0eeffd640 1 -- 172.21.15.151:0/3610423642 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd204007d70 con 0x55e614fbf950 2024-09-12T16:52:23.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3610423642 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e614fc0c10 con 0x55e614fbf950 2024-09-12T16:52:23.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd0eeffd640 1 -- 172.21.15.151:0/3610423642 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20401e020 con 0x55e614fbf950 2024-09-12T16:52:23.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd0eeffd640 1 -- 172.21.15.151:0/3610423642 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd204019590 con 0x55e614fbf950 2024-09-12T16:52:23.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3610423642 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e614fc1180 con 0x55e614fbf950 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd0eeffd640 1 -- 172.21.15.151:0/3610423642 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd204016040 con 0x55e614fbf950 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd0eeffd640 1 --2- 172.21.15.151:0/3610423642 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0e0039a70 0x7fd0e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd0eeffd640 1 -- 172.21.15.151:0/3610423642 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd20401f030 con 0x55e614fbf950 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.681+0000 7fd2094b2640 1 --2- 172.21.15.151:0/3610423642 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0e0039a70 0x7fd0e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 Processor -- start 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- start start 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd2094b2640 1 --2- 172.21.15.151:0/3610423642 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0e0039a70 0x7fd0e003bf30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55e614fa6360 tx=0x7fd1fc009e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fcd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e614f9e050 con 0x55e614fcd2e0 2024-09-12T16:52:23.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fcd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fcd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34134/0 (socket says 172.21.15.151:34134) 2024-09-12T16:52:23.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 -- 172.21.15.151:0/298824691 learned_addr learned my addr 172.21.15.151:0/298824691 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 -- 172.21.15.151:0/298824691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e614fcdcd0 con 0x55e614fcd2e0 2024-09-12T16:52:23.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 --2- 172.21.15.151:0/298824691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fcd6e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd2040508d0 tx=0x7fd2040174f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1355c8ccfc8d47be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd0ecff9640 1 -- 172.21.15.151:0/298824691 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20401d040 con 0x55e614fcd2e0 2024-09-12T16:52:23.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd0ecff9640 1 -- 172.21.15.151:0/298824691 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20404f210 con 0x55e614fcd2e0 2024-09-12T16:52:23.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd0ecff9640 1 -- 172.21.15.151:0/298824691 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20404f510 con 0x55e614fcd2e0 2024-09-12T16:52:23.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/298824691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 msgr2=0x55e614fcd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/298824691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fcd6e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd2040508d0 tx=0x7fd2040174f0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/298824691 shutdown_connections 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/298824691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fcd6e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/298824691 >> 172.21.15.151:0/298824691 conn(0x55e614fc8700 msgr2=0x55e614fc6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/298824691 shutdown_connections 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/298824691 wait complete. 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 Processor -- start 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- start start 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fd3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd20b9ac9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e614fcc230 con 0x55e614fcd2e0 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fd3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fd3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34136/0 (socket says 172.21.15.151:34136) 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 learned_addr learned my addr 172.21.15.151:0/359233049 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.685+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e614fd3cd0 con 0x55e614fcd2e0 2024-09-12T16:52:23.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd209cb3640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fd3770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd204008fd0 tx=0x7fd204050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd0deffd640 1 -- 172.21.15.151:0/359233049 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20401d030 con 0x55e614fcd2e0 2024-09-12T16:52:23.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e614fd3f60 con 0x55e614fcd2e0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd0deffd640 1 -- 172.21.15.151:0/359233049 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd204031030 con 0x55e614fcd2e0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd0deffd640 1 -- 172.21.15.151:0/359233049 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd204048040 con 0x55e614fcd2e0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e614fd4910 con 0x55e614fcd2e0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd0deffd640 1 -- 172.21.15.151:0/359233049 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd20402b350 con 0x55e614fcd2e0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd0deffd640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0d4039a70 0x7fd0d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd0deffd640 1 -- 172.21.15.151:0/359233049 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd204037c80 con 0x55e614fcd2e0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd2094b2640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0d4039a70 0x7fd0d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614fdea30 0x55e614fe0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fe1640 con 0x55e614fdea30 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd208cb1640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614fdea30 0x55e614fe0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd2094b2640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0d4039a70 0x7fd0d403bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0aafc0 tx=0x7fd1fc0d6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd208cb1640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614fdea30 0x55e614fe0ef0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 realm 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fddd80 con 0x55e614fdea30 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fe2140 con 0x55e614fdea30 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fe2a10 con 0x55e614fdea30 2024-09-12T16:52:23.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fe3430 0x55e614fe5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.689+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fe5f10 con 0x55e614fe3430 2024-09-12T16:52:23.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd209cb3640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fe3430 0x55e614fe5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd209cb3640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fe3430 0x55e614fe5820 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd20b9ac9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:23.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd20b9ac9c0 20 searching for the correct realm 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e614fe7e60 0x55e614fea290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd2094b2640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e614fe7e60 0x55e614fea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd2094b2640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e614fe7e60 0x55e614fea290 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0dc070 con 0x55e614fe7e60 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd2094b2640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd1fc0c9070 0x7fd1fc0b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x7fd1fc0c9070 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd208cb1640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd1fc0c9070 0x7fd1fc0b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd208cb1640 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd1fc0c9070 0x7fd1fc0b6840 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fdea30 2024-09-12T16:52:23.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fdea30 2024-09-12T16:52:23.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.693+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x7fd1fc0c9070 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0dc070 con 0x55e614fe7e60 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fdea30 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fdea30 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x7fd1fc0c9070 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.697+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fdea30 2024-09-12T16:52:23.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fdea30 2024-09-12T16:52:23.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x7fd1fc0c9070 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fdea30 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.701+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x7fd1fc0c9070 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe7e60 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fe3430 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x55e614fdea30 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e614fea910 con 0x7fd1fc0c9070 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:23.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fe68d0 con 0x55e614fdea30 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fe64e0 con 0x55e614fdea30 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fe7240 con 0x55e614fdea30 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 zone default found 2024-09-12T16:52:23.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 4 Realm: () 2024-09-12T16:52:23.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:23.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:23.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:23.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 zonegroup default 2024-09-12T16:52:23.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fead90 con 0x55e614fe3430 2024-09-12T16:52:23.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fed020 con 0x55e614fe7e60 2024-09-12T16:52:23.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614fed3e0 con 0x55e614fe7e60 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 started sync module instance, tier type = 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.705+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fec4b0 con 0x7fd1fc0c9070 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.709+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.709+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94446683081168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fec4b0 con 0x7fd1fc0c9070 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.709+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fede60 con 0x55e614fdea30 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.709+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94446683081168] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.709+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.709+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94446683085504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fec4b0 con 0x55e614fdea30 2024-09-12T16:52:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.709+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fee8a0 con 0x55e614fe7e60 2024-09-12T16:52:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94446683085504] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94446683078656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fec420 con 0x55e614fe7e60 2024-09-12T16:52:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fef5a0 con 0x7fd1fc0c9070 2024-09-12T16:52:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94446683091456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fefe40 con 0x7fd1fc0c9070 2024-09-12T16:52:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff0800 con 0x55e614fdea30 2024-09-12T16:52:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94446683078656] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.713+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94446683091456] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.717+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.717+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94446683095888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff0770 con 0x55e614fdea30 2024-09-12T16:52:23.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.717+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614fefd90 con 0x55e614fe3430 2024-09-12T16:52:23.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.717+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94446683095888] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.717+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.717+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94446683093216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff10a0 con 0x55e614fe3430 2024-09-12T16:52:23.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.717+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff18f0 con 0x55e614fe3430 2024-09-12T16:52:23.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94446683099808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff1d70 con 0x55e614fe3430 2024-09-12T16:52:23.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff2890 con 0x55e614fe3430 2024-09-12T16:52:23.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94446683093216] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94446683099808] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94446683104096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff17c0 con 0x55e614fe3430 2024-09-12T16:52:23.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 20 add_watcher() i=0 2024-09-12T16:52:23.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 20 add_watcher() i=1 2024-09-12T16:52:23.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 20 add_watcher() i=2 2024-09-12T16:52:23.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 20 add_watcher() i=3 2024-09-12T16:52:23.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 20 add_watcher() i=4 2024-09-12T16:52:23.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 20 add_watcher() i=5 2024-09-12T16:52:23.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.721+0000 7fd20b9ac9c0 20 add_watcher() i=6 2024-09-12T16:52:23.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94446683104096] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 add_watcher() i=7 2024-09-12T16:52:23.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:23.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff5880 con 0x55e614fdea30 2024-09-12T16:52:23.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94446683098016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e614ff2d30 con 0x55e614fdea30 2024-09-12T16:52:23.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94446683098016] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd0bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 5 note: GC not initialized 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd0be7e4640 20 reqs_thread_entry: start 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 Filter name: none 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd02ffff640 20 reqs_thread_entry: start 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e6150189b0 con 0x55e614fdea30 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e61501aaa0 con 0x55e614fdea30 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.725+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 8.3 8:c1aff4d1:root::.bucket.meta.testx%3amyfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e61501c360 con 0x55e614fdea30 2024-09-12T16:52:23.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv4 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6150209e0 con 0x55e614fdea30 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.729+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6150242f0 con 0x55e614fe3430 2024-09-12T16:52:23.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(66 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [create,call,writefull 0~387,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x7 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1, ofs0, ns] 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94446683299472 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e615023ab0 con 0x55e614fdea30 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== watch-notify(notify (1) cookie 94446683085504 notify 137438953494 ret 0) ==== 778+0+0 (crc 0 0 0) 0x55e61501c750 con 0x55e614fdea30 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd0dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94446683085504 notifier 4558 bl.length()=736 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd0dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x7 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd0dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd0dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(67 notify.1 [notify cookie 94446683299472 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd0dffff640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd0cc003eb0 con 0x55e614fdea30 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== watch-notify(notify_complete (2) cookie 94446683299472 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e61501b8b0 con 0x55e614fdea30 2024-09-12T16:52:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_sources= new_sources= 2024-09-12T16:52:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential sources added=[] removed=[] 2024-09-12T16:52:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_dests= new_dests= 2024-09-12T16:52:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential dests added=[] removed=[] 2024-09-12T16:52:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e615024490 con 0x7fd1fc0c9070 2024-09-12T16:52:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.733+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e615022ea0 con 0x7fd1fc0c9070 2024-09-12T16:52:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd20b9ac9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T16:52:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd20b9ac9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd20b9ac9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T16:52:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94446683289360 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e615022ea0 con 0x55e614fe3430 2024-09-12T16:52:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== watch-notify(notify (1) cookie 94446683099808 notify 137438953481 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55e614fd3cd0 con 0x55e614fe3430 2024-09-12T16:52:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.6 [notify cookie 94446683289360 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd0ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94446683099808 notifier 4558 bl.length()=314 2024-09-12T16:52:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd0ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T16:52:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd0ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd0ecff9640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd03c003410 con 0x55e614fe3430 2024-09-12T16:52:23.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== watch-notify(notify_complete (2) cookie 94446683289360 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e614fcdcd0 con 0x55e614fe3430 2024-09-12T16:52:23.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.737+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e61501fbc0 con 0x55e614fdea30 2024-09-12T16:52:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd20b9ac9c0 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-12T16:52:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd20b9ac9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-12T16:52:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94446683289360 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e61501ffe0 con 0x55e614fdea30 2024-09-12T16:52:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== watch-notify(notify (1) cookie 94446683095888 notify 137438953495 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55e615024620 con 0x55e614fdea30 2024-09-12T16:52:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd0ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94446683095888 notifier 4558 bl.length()=155 2024-09-12T16:52:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(74 notify.4 [notify cookie 94446683289360 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd0ecff9640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd03c003410 con 0x55e614fdea30 2024-09-12T16:52:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== watch-notify(notify_complete (2) cookie 94446683289360 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e615024450 con 0x55e614fdea30 2024-09-12T16:52:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 8.3 8:c1aff4d1:root::.bucket.meta.testx%3amyfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e61501fbc0 con 0x55e614fdea30 2024-09-12T16:52:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call,delete] v32'5 uv5 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd20b9ac9c0 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 from cache 2024-09-12T16:52:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd20b9ac9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1, ofs0, ns] 2024-09-12T16:52:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94446683277856 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e61501fbc0 con 0x7fd1fc0c9070 2024-09-12T16:52:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== watch-notify(notify (1) cookie 94446683081168 notify 137438953486 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55e615024450 con 0x7fd1fc0c9070 2024-09-12T16:52:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd0dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94446683081168 notifier 4558 bl.length()=212 2024-09-12T16:52:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd0dffff640 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd0cc003eb0 con 0x7fd1fc0c9070 2024-09-12T16:52:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(77 notify.0 [notify cookie 94446683277856 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.741+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== watch-notify(notify_complete (2) cookie 94446683277856 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e61501b8b0 con 0x7fd1fc0c9070 2024-09-12T16:52:23.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.745+0000 7fd0bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.745+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94446683098016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6150167c0 con 0x55e614fdea30 2024-09-12T16:52:23.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.745+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94446683098016] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.745+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94446683081168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6150167c0 con 0x7fd1fc0c9070 2024-09-12T16:52:23.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.745+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94446683081168] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.745+0000 7fd20b9ac9c0 20 remove_watcher() i=0 2024-09-12T16:52:23.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.745+0000 7fd20b9ac9c0 2 removed watcher, disabling cache 2024-09-12T16:52:23.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.745+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94446683085504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6150167c0 con 0x55e614fdea30 2024-09-12T16:52:23.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94446683085504] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd20b9ac9c0 20 remove_watcher() i=1 2024-09-12T16:52:23.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94446683078656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e6150167c0 con 0x55e614fe7e60 2024-09-12T16:52:23.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd2094b2640 1 -- 172.21.15.151:0/359233049 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94446683078656] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1fc0fd040 con 0x55e614fe7e60 2024-09-12T16:52:23.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd20b9ac9c0 20 remove_watcher() i=2 2024-09-12T16:52:23.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94446683091456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e61501bc50 con 0x7fd1fc0c9070 2024-09-12T16:52:23.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94446683091456] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x7fd1fc0c9070 2024-09-12T16:52:23.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd20b9ac9c0 20 remove_watcher() i=3 2024-09-12T16:52:23.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.749+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94446683095888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e61501bc50 con 0x55e614fdea30 2024-09-12T16:52:23.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.753+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94446683095888] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20000f070 con 0x55e614fdea30 2024-09-12T16:52:23.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.753+0000 7fd20b9ac9c0 20 remove_watcher() i=4 2024-09-12T16:52:23.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.753+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94446683093216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e61501bc50 con 0x55e614fe3430 2024-09-12T16:52:23.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.753+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94446683093216] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.753+0000 7fd20b9ac9c0 20 remove_watcher() i=5 2024-09-12T16:52:23.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.753+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94446683099808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e61501bc50 con 0x55e614fe3430 2024-09-12T16:52:23.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94446683099808] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 20 remove_watcher() i=6 2024-09-12T16:52:23.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94446683104096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e61501bc50 con 0x55e614fe3430 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd209cb3640 1 -- 172.21.15.151:0/359233049 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94446683104096] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20403d070 con 0x55e614fe3430 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 20 remove_watcher() i=7 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fe3430 msgr2=0x55e614fe5820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fe3430 0x55e614fe5820 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614fdea30 msgr2=0x55e614fe0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614fdea30 0x55e614fe0ef0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd1fc0c9070 msgr2=0x7fd1fc0b6840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd1fc0c9070 0x7fd1fc0b6840 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e614fe7e60 msgr2=0x55e614fea290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e614fe7e60 0x55e614fea290 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0d4039a70 msgr2=0x7fd0d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0d4039a70 0x7fd0d403bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0aafc0 tx=0x7fd1fc0d6000 comp rx=0 tx=0).stop 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 msgr2=0x55e614fd3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd208cb1640 1 -- 172.21.15.151:0/359233049 reap_dead start 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fd3770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd204008fd0 tx=0x7fd204050860 comp rx=0 tx=0).stop 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 shutdown_connections 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/359233049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fcd2e0 0x55e614fd3770 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.757+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 >> 172.21.15.151:0/359233049 conn(0x55e614fc8700 msgr2=0x55e614fc6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 shutdown_connections 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/359233049 wait complete. 2024-09-12T16:52:23.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3610423642 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0e0039a70 msgr2=0x7fd0e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3610423642 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0e0039a70 0x7fd0e003bf30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55e614fa6360 tx=0x7fd1fc009e60 comp rx=0 tx=0).stop 2024-09-12T16:52:23.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3610423642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fbf950 msgr2=0x55e614fbfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3610423642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fbf950 0x55e614fbfd70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x55e614fa6260 tx=0x7fd20400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:23.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3610423642 shutdown_connections 2024-09-12T16:52:23.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3610423642 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0e0039a70 0x7fd0e003bf30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3610423642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614fbf950 0x55e614fbfd70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3610423642 >> 172.21.15.151:0/3610423642 conn(0x55e614fb5300 msgr2=0x55e614fb56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3610423642 shutdown_connections 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3610423642 wait complete. 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fae7e0 msgr2=0x55e614fb0bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fae7e0 0x55e614fb0bd0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614eb5330 msgr2=0x55e614fac040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614eb5330 0x55e614fac040 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0f0039a70 msgr2=0x7fd0f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0f0039a70 0x7fd0f003bf30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd200001650 tx=0x7fd200006720 comp rx=0 tx=0).stop 2024-09-12T16:52:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 msgr2=0x55e614fa4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614fa4ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0ab510 tx=0x7fd1fc018020 comp rx=0 tx=0).stop 2024-09-12T16:52:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 shutdown_connections 2024-09-12T16:52:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e614fae7e0 0x55e614fb0bd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e614eb5330 0x55e614fac040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd0f0039a70 0x7fd0f003bf30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 --2- 172.21.15.151:0/3900654359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e614eb21f0 0x55e614fa4ed0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 >> 172.21.15.151:0/3900654359 conn(0x55e614e25b00 msgr2=0x55e614f97fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 shutdown_connections 2024-09-12T16:52:23.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.761+0000 7fd20b9ac9c0 1 -- 172.21.15.151:0/3900654359 wait complete. 2024-09-12T16:52:23.772 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T16:52:23.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T16:52:23.773 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-12T16:52:23.853 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:23.853 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:23.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c4d1e9c0 1 Processor -- start 2024-09-12T16:52:23.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c4d1e9c0 1 -- start start 2024-09-12T16:52:23.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c4d1e9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5631a4c3d340 0x5631a4c3f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c4d1e9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5631a4aeb9c0 con 0x5631a4c391f0 2024-09-12T16:52:23.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c4d1e9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5631a4b3b6d0 con 0x5631a4c3d340 2024-09-12T16:52:23.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c2023640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5631a4c3d340 0x5631a4c3f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c2023640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5631a4c3d340 0x5631a4c3f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34148/0 (socket says 172.21.15.151:34148) 2024-09-12T16:52:23.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c2023640 1 -- 172.21.15.151:0/2105226001 learned_addr learned my addr 172.21.15.151:0/2105226001 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c2023640 1 -- 172.21.15.151:0/2105226001 >> v1:172.21.15.122:6789/0 conn(0x5631a4c391f0 legacy=0x5631a4c395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c2023640 1 -- 172.21.15.151:0/2105226001 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a4adfca0 con 0x5631a4c3d340 2024-09-12T16:52:23.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c2023640 1 --2- 172.21.15.151:0/2105226001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c3d340 0x5631a4c3f730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800a5c0 tx=0x7fd7b801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc56799c313e11b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.853+0000 7fd7c1822640 1 -- 172.21.15.151:0/2105226001 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7b80a9590 con 0x5631a4c3d340 2024-09-12T16:52:23.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c1822640 1 -- 172.21.15.151:0/2105226001 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b80ae070 con 0x5631a4c3d340 2024-09-12T16:52:23.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c1822640 1 -- 172.21.15.151:0/2105226001 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7b80a9880 con 0x5631a4c3d340 2024-09-12T16:52:23.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2105226001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c3d340 msgr2=0x5631a4c3f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/2105226001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c3d340 0x5631a4c3f730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800a5c0 tx=0x7fd7b801b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2105226001 shutdown_connections 2024-09-12T16:52:23.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/2105226001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c3d340 0x5631a4c3f730 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2105226001 >> 172.21.15.151:0/2105226001 conn(0x5631a4bacb00 msgr2=0x5631a4bacf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2105226001 shutdown_connections 2024-09-12T16:52:23.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.857+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2105226001 wait complete. 2024-09-12T16:52:23.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c4d1e9c0 1 Processor -- start 2024-09-12T16:52:23.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c4d1e9c0 1 -- start start 2024-09-12T16:52:23.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c4d1e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d24890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c4d1e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631a4b3f680 con 0x5631a4c391f0 2024-09-12T16:52:23.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c2824640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d24890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c2824640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d24890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34158/0 (socket says 172.21.15.151:34158) 2024-09-12T16:52:23.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c2824640 1 -- 172.21.15.151:0/1051685212 learned_addr learned my addr 172.21.15.151:0/1051685212 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c2824640 1 -- 172.21.15.151:0/1051685212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a4abada0 con 0x5631a4c391f0 2024-09-12T16:52:23.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd7c2824640 1 --2- 172.21.15.151:0/1051685212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d24890 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400b220 tx=0x7fd7b400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cd24257ecdf407 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.869+0000 7fd6b0e09640 1 -- 172.21.15.151:0/1051685212 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7b400a040 con 0x5631a4c391f0 2024-09-12T16:52:23.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd6b0e09640 1 -- 172.21.15.151:0/1051685212 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b400f750 con 0x5631a4c391f0 2024-09-12T16:52:23.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd6b0e09640 1 -- 172.21.15.151:0/1051685212 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7b400fa70 con 0x5631a4c391f0 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1051685212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 msgr2=0x5631a4d24890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1051685212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d24890 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400b220 tx=0x7fd7b400b6e0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1051685212 shutdown_connections 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1051685212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d24890 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1051685212 >> 172.21.15.151:0/1051685212 conn(0x5631a4bacb00 msgr2=0x5631a4d204d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1051685212 shutdown_connections 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1051685212 wait complete. 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 Processor -- start 2024-09-12T16:52:23.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- start start 2024-09-12T16:52:23.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d2bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631a4ae1a50 con 0x5631a4c391f0 2024-09-12T16:52:23.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c2824640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d2bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c2824640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d2bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34174/0 (socket says 172.21.15.151:34174) 2024-09-12T16:52:23.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c2824640 1 -- 172.21.15.151:0/1466699592 learned_addr learned my addr 172.21.15.151:0/1466699592 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c2824640 1 -- 172.21.15.151:0/1466699592 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a4d2c4c0 con 0x5631a4c391f0 2024-09-12T16:52:23.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c2824640 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d2bf60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x5631a4d25820 tx=0x7fd7b4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd6af606640 1 -- 172.21.15.151:0/1466699592 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7b401a880 con 0x5631a4c391f0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd6af606640 1 -- 172.21.15.151:0/1466699592 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b401aa20 con 0x5631a4c391f0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631a4d2c750 con 0x5631a4c391f0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd6af606640 1 -- 172.21.15.151:0/1466699592 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7b401ad00 con 0x5631a4c391f0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.873+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631a4d2d100 con 0x5631a4c391f0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd6af606640 1 -- 172.21.15.151:0/1466699592 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd7b4017050 con 0x5631a4c391f0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd6af606640 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd6a8039a70 0x7fd6a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd6af606640 1 -- 172.21.15.151:0/1466699592 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd7b4015020 con 0x5631a4c391f0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c2023640 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd6a8039a70 0x7fd6a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4c3d340 0x5631a4d330d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d33610 con 0x5631a4c3d340 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c3025640 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4c3d340 0x5631a4d330d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c2023640 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd6a8039a70 0x7fd6a803bf30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80ad000 tx=0x7fd7b80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c3025640 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4c3d340 0x5631a4d330d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c3025640 1 -- 172.21.15.151:0/1466699592 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7bc00a4d0 con 0x5631a4c3d340 2024-09-12T16:52:23.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d33a30 con 0x5631a4c3d340 2024-09-12T16:52:23.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c3025640 1 -- 172.21.15.151:0/1466699592 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7bc00a4d0 con 0x5631a4c3d340 2024-09-12T16:52:23.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d35840 0x5631a4d37c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d38300 con 0x5631a4d35840 2024-09-12T16:52:23.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c2824640 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d35840 0x5631a4d37c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c2824640 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d35840 0x5631a4d37c30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c2824640 1 -- 172.21.15.151:0/1466699592 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d35840 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d346e0 con 0x5631a4c3d340 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c3025640 1 -- 172.21.15.151:0/1466699592 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7bc00a4d0 con 0x5631a4c3d340 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.877+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d34b80 con 0x5631a4c3d340 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c3025640 1 -- 172.21.15.151:0/1466699592 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd7bc00a4d0 con 0x5631a4c3d340 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c4d1e9c0 1 Processor -- start 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c4d1e9c0 1 -- start start 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c4d1e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d46970 0x5631a4d46d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c4d1e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631a4b4c450 con 0x5631a4d46970 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c3025640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d46970 0x5631a4d46d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c3025640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d46970 0x5631a4d46d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34176/0 (socket says 172.21.15.151:34176) 2024-09-12T16:52:23.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c3025640 1 -- 172.21.15.151:0/2572705327 learned_addr learned my addr 172.21.15.151:0/2572705327 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c3025640 1 -- 172.21.15.151:0/2572705327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a4d473d0 con 0x5631a4d46970 2024-09-12T16:52:23.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c3025640 1 --2- 172.21.15.151:0/2572705327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d46970 0x5631a4d46d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x5631a4d2e050 tx=0x7fd7bc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd6ace01640 1 -- 172.21.15.151:0/2572705327 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7bc014450 con 0x5631a4d46970 2024-09-12T16:52:23.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2572705327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631a4d47c30 con 0x5631a4d46970 2024-09-12T16:52:23.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd6ace01640 1 -- 172.21.15.151:0/2572705327 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0145f0 con 0x5631a4d46970 2024-09-12T16:52:23.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd6ace01640 1 -- 172.21.15.151:0/2572705327 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7bc014910 con 0x5631a4d46970 2024-09-12T16:52:23.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2572705327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631a4d481a0 con 0x5631a4d46970 2024-09-12T16:52:23.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd6ace01640 1 -- 172.21.15.151:0/2572705327 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd7bc011040 con 0x5631a4d46970 2024-09-12T16:52:23.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd6ace01640 1 --2- 172.21.15.151:0/2572705327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd69c039a70 0x7fd69c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd6ace01640 1 -- 172.21.15.151:0/2572705327 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd7bc01e070 con 0x5631a4d46970 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.881+0000 7fd7c2824640 1 --2- 172.21.15.151:0/2572705327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd69c039a70 0x7fd69c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 Processor -- start 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- start start 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c2824640 1 --2- 172.21.15.151:0/2572705327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd69c039a70 0x7fd69c03bf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5631a4d2d420 tx=0x7fd7b40016d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d54670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631a4d250e0 con 0x5631a4d54270 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d54670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d54670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34184/0 (socket says 172.21.15.151:34184) 2024-09-12T16:52:23.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 -- 172.21.15.151:0/2548276016 learned_addr learned my addr 172.21.15.151:0/2548276016 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 -- 172.21.15.151:0/2548276016 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a4d54c60 con 0x5631a4d54270 2024-09-12T16:52:23.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 --2- 172.21.15.151:0/2548276016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d54670 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc016fd0 tx=0x7fd7bc001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf936027caf3f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd6a67fc640 1 -- 172.21.15.151:0/2548276016 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7bc028070 con 0x5631a4d54270 2024-09-12T16:52:23.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd6a67fc640 1 -- 172.21.15.151:0/2548276016 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc022dc0 con 0x5631a4d54270 2024-09-12T16:52:23.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd6a67fc640 1 -- 172.21.15.151:0/2548276016 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7bc04f280 con 0x5631a4d54270 2024-09-12T16:52:23.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2548276016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 msgr2=0x5631a4d54670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:23.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/2548276016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d54670 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc016fd0 tx=0x7fd7bc001450 comp rx=0 tx=0).stop 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2548276016 shutdown_connections 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/2548276016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d54670 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2548276016 >> 172.21.15.151:0/2548276016 conn(0x5631a4d4f690 msgr2=0x5631a4d4d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2548276016 shutdown_connections 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2548276016 wait complete. 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 Processor -- start 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- start start 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d5a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c4d1e9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631a4d531c0 con 0x5631a4d54270 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d5a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d5a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34190/0 (socket says 172.21.15.151:34190) 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 learned_addr learned my addr 172.21.15.151:0/3817100256 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:23.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.885+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a4d5ad00 con 0x5631a4d54270 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c3025640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d5a7a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc001490 tx=0x7fd7bc0506d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd6a4ff9640 1 -- 172.21.15.151:0/3817100256 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7bc032030 con 0x5631a4d54270 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631a4d5af90 con 0x5631a4d54270 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd6a4ff9640 1 -- 172.21.15.151:0/3817100256 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc011330 con 0x5631a4d54270 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd6a4ff9640 1 -- 172.21.15.151:0/3817100256 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7bc04f280 con 0x5631a4d54270 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631a4d5b940 con 0x5631a4d54270 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd6a4ff9640 1 -- 172.21.15.151:0/3817100256 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd7bc035070 con 0x5631a4d54270 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd6a4ff9640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd68c039a70 0x7fd68c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd6a4ff9640 1 -- 172.21.15.151:0/3817100256 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd7bc033070 con 0x5631a4d54270 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c2824640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd68c039a70 0x7fd68c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4d65a00 0x5631a4d67e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d685e0 con 0x5631a4d65a00 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c2023640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4d65a00 0x5631a4d67e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c2824640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd68c039a70 0x7fd68c03bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4018a60 tx=0x7fd7b4033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c2023640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4d65a00 0x5631a4d67e90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 realm 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d68a10 con 0x5631a4d65a00 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d692e0 con 0x5631a4d65a00 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d69680 con 0x5631a4d65a00 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d6a3e0 0x5631a4d6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d6cde0 con 0x5631a4d6a3e0 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.889+0000 7fd7c3025640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d6a3e0 0x5631a4d6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c3025640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d6a3e0 0x5631a4d6c7d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c4d1e9c0 20 searching for the correct realm 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631a4d6ecc0 0x5631a4d71130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2824640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631a4d6ecc0 0x5631a4d71130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2824640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631a4d6ecc0 0x5631a4d71130 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2824640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd7b401c460 0x7fd7b40500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x7fd7b401c460 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2023640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd7b401c460 0x7fd7b40500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2023640 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd7b401c460 0x7fd7b40500b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d65a00 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d65a00 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.893+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x7fd7b401c460 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d65a00 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d65a00 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x7fd7b401c460 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.897+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d65a00 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d65a00 2024-09-12T16:52:23.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x7fd7b401c460 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d65a00 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x7fd7b401c460 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.901+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6ecc0 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d6a3e0 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x5631a4d65a00 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d71800 con 0x7fd7b401c460 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:23.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d6d730 con 0x5631a4d65a00 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d6d370 con 0x5631a4d65a00 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d6e050 con 0x5631a4d65a00 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 zone default found 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 4 Realm: () 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 zonegroup default 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d6e070 con 0x5631a4d6a3e0 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d73ba0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d73f40 con 0x5631a4d6ecc0 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 started sync module instance, tier type = 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.905+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d73030 con 0x7fd7b401c460 2024-09-12T16:52:23.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.909+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.909+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94771218953520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d73030 con 0x7fd7b401c460 2024-09-12T16:52:23.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.909+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d74a50 con 0x5631a4d65a00 2024-09-12T16:52:23.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.909+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94771218953520] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.909+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.909+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94771218957632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d73030 con 0x5631a4d65a00 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.909+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d75490 con 0x5631a4d6ecc0 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94771218957632] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94771218951040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d72fa0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d76190 con 0x7fd7b401c460 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94771218963984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d76a30 con 0x7fd7b401c460 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d77430 con 0x5631a4d65a00 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94771218951040] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.913+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94771218963984] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.917+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.917+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94771218962480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d76510 con 0x5631a4d65a00 2024-09-12T16:52:23.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.917+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d77cd0 con 0x5631a4d6a3e0 2024-09-12T16:52:23.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.917+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94771218962480] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.917+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.917+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94771218970656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d76510 con 0x5631a4d6a3e0 2024-09-12T16:52:23.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.917+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d78520 con 0x5631a4d6a3e0 2024-09-12T16:52:23.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94771218970656] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94771218968384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d78520 con 0x5631a4d6a3e0 2024-09-12T16:52:23.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d78f60 con 0x5631a4d6a3e0 2024-09-12T16:52:23.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94771218968384] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94771218975280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d79140 con 0x5631a4d6a3e0 2024-09-12T16:52:23.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 20 add_watcher() i=0 2024-09-12T16:52:23.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 20 add_watcher() i=1 2024-09-12T16:52:23.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 20 add_watcher() i=2 2024-09-12T16:52:23.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 20 add_watcher() i=3 2024-09-12T16:52:23.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 20 add_watcher() i=4 2024-09-12T16:52:23.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 20 add_watcher() i=5 2024-09-12T16:52:23.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.921+0000 7fd7c4d1e9c0 20 add_watcher() i=6 2024-09-12T16:52:23.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94771218975280] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c4d1e9c0 20 add_watcher() i=7 2024-09-12T16:52:23.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c4d1e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:23.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d7c510 con 0x5631a4d65a00 2024-09-12T16:52:23.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94771218976816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d79900 con 0x5631a4d65a00 2024-09-12T16:52:23.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94771218976816] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd6797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c4d1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:23.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c4d1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:23.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.925+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84d70 con 0x5631a4d65a00 2024-09-12T16:52:23.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.929+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.929+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d7e7f0 con 0x5631a4d6a3e0 2024-09-12T16:52:23.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.929+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.929+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d7e7f0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.929+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.929+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d85960 con 0x5631a4d65a00 2024-09-12T16:52:23.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.933+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.933+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d85ed0 con 0x7fd7b401c460 2024-09-12T16:52:23.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.933+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.933+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d86380 con 0x5631a4d6ecc0 2024-09-12T16:52:23.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.933+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.933+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d843e0 con 0x5631a4d65a00 2024-09-12T16:52:23.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.937+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.937+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d843e0 con 0x5631a4d6a3e0 2024-09-12T16:52:23.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.937+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.937+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x7fd7b401c460 2024-09-12T16:52:23.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.941+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.941+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d83d60 con 0x5631a4d6ecc0 2024-09-12T16:52:23.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.941+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.941+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x7fd7b401c460 2024-09-12T16:52:23.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.941+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.941+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d6a3e0 2024-09-12T16:52:23.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.945+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.945+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x7fd7b401c460 2024-09-12T16:52:23.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.945+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.945+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d6a3e0 2024-09-12T16:52:23.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.945+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.945+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d65a00 2024-09-12T16:52:23.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.949+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'136 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.949+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.949+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.949+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84570 con 0x7fd7b401c460 2024-09-12T16:52:23.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.949+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.949+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84570 con 0x5631a4d6ecc0 2024-09-12T16:52:23.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.953+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.953+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84540 con 0x5631a4d65a00 2024-09-12T16:52:23.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.953+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.953+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84540 con 0x5631a4d65a00 2024-09-12T16:52:23.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.953+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'137 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.953+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84540 con 0x5631a4d6ecc0 2024-09-12T16:52:23.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.957+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.957+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x7fd7b401c460 2024-09-12T16:52:23.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.957+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.957+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.957+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.957+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.961+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.961+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.961+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.961+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.961+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.961+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844f0 con 0x5631a4d6a3e0 2024-09-12T16:52:23.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.965+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.965+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d844b0 con 0x5631a4d6ecc0 2024-09-12T16:52:23.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.965+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.965+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84580 con 0x5631a4d6a3e0 2024-09-12T16:52:23.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.965+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.965+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84580 con 0x5631a4d6ecc0 2024-09-12T16:52:23.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.969+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.969+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84540 con 0x5631a4d6a3e0 2024-09-12T16:52:23.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.969+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.969+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d84580 con 0x7fd7b401c460 2024-09-12T16:52:23.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd5f3fff640 20 reqs_thread_entry: start 2024-09-12T16:52:23.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:23.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 20 Filter name: none 2024-09-12T16:52:23.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd5f1ffb640 20 reqs_thread_entry: start 2024-09-12T16:52:23.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T16:52:23.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:23.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d83d70 con 0x5631a4d6a3e0 2024-09-12T16:52:23.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T16:52:23.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-12T16:52:23.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T16:52:23.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:23.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4da4710 con 0x5631a4d65a00 2024-09-12T16:52:23.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T16:52:23.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.973+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4da26f0 con 0x5631a4d6a3e0 2024-09-12T16:52:23.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T16:52:23.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94771219149392 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4da4b30 con 0x5631a4d6ecc0 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== watch-notify(notify (1) cookie 94771218951040 notify 137438953477 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5631a4d84b00 con 0x5631a4d6ecc0 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd6a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94771218951040 notifier 4565 bl.length()=170 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(97 notify.2 [notify cookie 94771219149392 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd6a67fc640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd688003d70 con 0x5631a4d6ecc0 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== watch-notify(notify_complete (2) cookie 94771219149392 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5631a4d84e00 con 0x5631a4d6ecc0 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 10 removing email index: 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 10 removing user buckets index 2024-09-12T16:52:23.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4da26f0 con 0x5631a4d65a00 2024-09-12T16:52:23.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94771219149392 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4da4b30 con 0x5631a4d65a00 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== watch-notify(notify (1) cookie 94771218962480 notify 137438953496 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5631a4d85b30 con 0x5631a4d65a00 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd6a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94771218962480 notifier 4565 bl.length()=175 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(100 notify.4 [notify cookie 94771219149392 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd6a67fc640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd688003d70 con 0x5631a4d65a00 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== watch-notify(notify_complete (2) cookie 94771219149392 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5631a4d85960 con 0x5631a4d65a00 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 10 removing user index: testx$tenanteduser 2024-09-12T16:52:23.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.977+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4da6890 con 0x5631a4d6a3e0 2024-09-12T16:52:23.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c4d1e9c0 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-12T16:52:23.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c4d1e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-12T16:52:23.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94771219145280 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631a4da3b20 con 0x7fd7b401c460 2024-09-12T16:52:23.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== watch-notify(notify (1) cookie 94771218963984 notify 137438953487 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5631a4d85960 con 0x7fd7b401c460 2024-09-12T16:52:23.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd6a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94771218963984 notifier 4565 bl.length()=167 2024-09-12T16:52:23.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(103 notify.3 [notify cookie 94771219145280 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd6a5ffb640 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd5f80032d0 con 0x7fd7b401c460 2024-09-12T16:52:23.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== watch-notify(notify_complete (2) cookie 94771219145280 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5631a4d85d00 con 0x7fd7b401c460 2024-09-12T16:52:23.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd6797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:23.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.981+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94771218976816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d82510 con 0x5631a4d65a00 2024-09-12T16:52:23.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94771218976816] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94771218953520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d79030 con 0x7fd7b401c460 2024-09-12T16:52:23.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94771218953520] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c4d1e9c0 20 remove_watcher() i=0 2024-09-12T16:52:23.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c4d1e9c0 2 removed watcher, disabling cache 2024-09-12T16:52:23.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94771218957632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d79030 con 0x5631a4d65a00 2024-09-12T16:52:23.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94771218957632] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c4d1e9c0 20 remove_watcher() i=1 2024-09-12T16:52:23.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.985+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94771218951040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d74540 con 0x5631a4d6ecc0 2024-09-12T16:52:23.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.989+0000 7fd7c2824640 1 -- 172.21.15.151:0/3817100256 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94771218951040] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b402e070 con 0x5631a4d6ecc0 2024-09-12T16:52:23.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.989+0000 7fd7c4d1e9c0 20 remove_watcher() i=2 2024-09-12T16:52:23.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.989+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94771218963984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d79030 con 0x7fd7b401c460 2024-09-12T16:52:23.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.989+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94771218963984] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x7fd7b401c460 2024-09-12T16:52:23.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.989+0000 7fd7c4d1e9c0 20 remove_watcher() i=3 2024-09-12T16:52:23.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.989+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94771218962480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d72b80 con 0x5631a4d65a00 2024-09-12T16:52:23.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.993+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94771218962480] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7b80a99f0 con 0x5631a4d65a00 2024-09-12T16:52:23.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.993+0000 7fd7c4d1e9c0 20 remove_watcher() i=4 2024-09-12T16:52:23.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.993+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94771218970656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d74540 con 0x5631a4d6a3e0 2024-09-12T16:52:23.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.993+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94771218970656] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.993+0000 7fd7c4d1e9c0 20 remove_watcher() i=5 2024-09-12T16:52:23.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.993+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94771218968384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d75e10 con 0x5631a4d6a3e0 2024-09-12T16:52:23.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94771218968384] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:23.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 20 remove_watcher() i=6 2024-09-12T16:52:23.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94771218975280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631a4d79030 con 0x5631a4d6a3e0 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c3025640 1 -- 172.21.15.151:0/3817100256 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94771218975280] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7bc05c040 con 0x5631a4d6a3e0 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 20 remove_watcher() i=7 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d6a3e0 msgr2=0x5631a4d6c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d6a3e0 0x5631a4d6c7d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4d65a00 msgr2=0x5631a4d67e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4d65a00 0x5631a4d67e90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd7b401c460 msgr2=0x7fd7b40500b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd7b401c460 0x7fd7b40500b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631a4d6ecc0 msgr2=0x5631a4d71130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631a4d6ecc0 0x5631a4d71130 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd68c039a70 msgr2=0x7fd68c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd68c039a70 0x7fd68c03bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4018a60 tx=0x7fd7b4033040 comp rx=0 tx=0).stop 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 msgr2=0x5631a4d5a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/3817100256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d54270 0x5631a4d5a7a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc001490 tx=0x7fd7bc0506d0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 reap_dead start 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c2023640 1 -- 172.21.15.151:0/3817100256 reap_dead start 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 shutdown_connections 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 >> 172.21.15.151:0/3817100256 conn(0x5631a4d4f690 msgr2=0x5631a4d4d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 shutdown_connections 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/3817100256 wait complete. 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2572705327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd69c039a70 msgr2=0x7fd69c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/2572705327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd69c039a70 0x7fd69c03bf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5631a4d2d420 tx=0x7fd7b40016d0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2572705327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d46970 msgr2=0x5631a4d46d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/2572705327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d46970 0x5631a4d46d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x5631a4d2e050 tx=0x7fd7bc018830 comp rx=0 tx=0).stop 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2572705327 shutdown_connections 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/2572705327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd69c039a70 0x7fd69c03bf30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/2572705327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4d46970 0x5631a4d46d90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2572705327 >> 172.21.15.151:0/2572705327 conn(0x5631a4d3c320 msgr2=0x5631a4d3c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2572705327 shutdown_connections 2024-09-12T16:52:24.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/2572705327 wait complete. 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d35840 msgr2=0x5631a4d37c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d35840 0x5631a4d37c30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4c3d340 msgr2=0x5631a4d330d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4c3d340 0x5631a4d330d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd6a8039a70 msgr2=0x7fd6a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd6a8039a70 0x7fd6a803bf30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80ad000 tx=0x7fd7b80a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 msgr2=0x5631a4d2bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d2bf60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x5631a4d25820 tx=0x7fd7b4000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 shutdown_connections 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631a4d35840 0x5631a4d37c30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631a4c3d340 0x5631a4d330d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd6a8039a70 0x7fd6a803bf30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 --2- 172.21.15.151:0/1466699592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631a4c391f0 0x5631a4d2bf60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 >> 172.21.15.151:0/1466699592 conn(0x5631a4bacb00 msgr2=0x5631a4d1ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 shutdown_connections 2024-09-12T16:52:24.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:23.997+0000 7fd7c4d1e9c0 1 -- 172.21.15.151:0/1466699592 wait complete. 2024-09-12T16:52:24.019 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-12T16:52:24.022 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-12T16:52:24.065 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:24.065 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-12T16:52:24.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-12T16:52:24.066 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-12T16:52:24.103 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:24.103 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:24.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0ae2a9a9c0 1 Processor -- start 2024-09-12T16:52:24.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0ae2a9a9c0 1 -- start start 2024-09-12T16:52:24.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0ae2a9a9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55ec7b5e6340 0x55ec7b5e8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0ae2a9a9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ec7b4969c0 con 0x55ec7b5561f0 2024-09-12T16:52:24.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0ae2a9a9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55ec7b4e66d0 con 0x55ec7b5e6340 2024-09-12T16:52:24.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0adfd9f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55ec7b5e6340 0x55ec7b5e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0ae05a0640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55ec7b5561f0 0x55ec7b5e4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42718/0 (socket says 172.21.15.151:42718) 2024-09-12T16:52:24.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0ae05a0640 1 -- 172.21.15.151:0/467940693 learned_addr learned my addr 172.21.15.151:0/467940693 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:24.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0adfd9f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55ec7b5e6340 0x55ec7b5e8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34206/0 (socket says 172.21.15.151:34206) 2024-09-12T16:52:24.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0adfd9f640 1 -- 172.21.15.151:0/467940693 >> v1:172.21.15.122:6789/0 conn(0x55ec7b5561f0 legacy=0x55ec7b5e4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.101+0000 7f0adfd9f640 1 -- 172.21.15.151:0/467940693 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec7b48aca0 con 0x55ec7b5e6340 2024-09-12T16:52:24.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0adfd9f640 1 --2- 172.21.15.151:0/467940693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5e6340 0x55ec7b5e8730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400a420 tx=0x7f0ad401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03615b6fcc15bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0adf59e640 1 -- 172.21.15.151:0/467940693 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad40b0070 con 0x55ec7b5e6340 2024-09-12T16:52:24.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0adf59e640 1 -- 172.21.15.151:0/467940693 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad40a3dc0 con 0x55ec7b5e6340 2024-09-12T16:52:24.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0adf59e640 1 -- 172.21.15.151:0/467940693 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad40ab570 con 0x55ec7b5e6340 2024-09-12T16:52:24.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/467940693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5e6340 msgr2=0x55ec7b5e8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/467940693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5e6340 0x55ec7b5e8730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400a420 tx=0x7f0ad401afd0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/467940693 shutdown_connections 2024-09-12T16:52:24.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/467940693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5e6340 0x55ec7b5e8730 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/467940693 >> 172.21.15.151:0/467940693 conn(0x55ec7b5dc910 msgr2=0x55ec7b5ded30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/467940693 shutdown_connections 2024-09-12T16:52:24.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.105+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/467940693 wait complete. 2024-09-12T16:52:24.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 Processor -- start 2024-09-12T16:52:24.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 -- start start 2024-09-12T16:52:24.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec7b4ea680 con 0x55ec7b5561f0 2024-09-12T16:52:24.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae05a0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae05a0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34220/0 (socket says 172.21.15.151:34220) 2024-09-12T16:52:24.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3797507651 learned_addr learned my addr 172.21.15.151:0/3797507651 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3797507651 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec7b465da0 con 0x55ec7b5561f0 2024-09-12T16:52:24.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/3797507651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6cd7b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0001e00 tx=0x7f0ad000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cd18af08eb5dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f09ce60c640 1 -- 172.21.15.151:0/3797507651 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad0012020 con 0x55ec7b5561f0 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f09ce60c640 1 -- 172.21.15.151:0/3797507651 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad000e690 con 0x55ec7b5561f0 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f09ce60c640 1 -- 172.21.15.151:0/3797507651 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad000ea10 con 0x55ec7b5561f0 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3797507651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 msgr2=0x55ec7b6cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3797507651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6cd7b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0001e00 tx=0x7f0ad000b6d0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3797507651 shutdown_connections 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3797507651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6cd7b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3797507651 >> 172.21.15.151:0/3797507651 conn(0x55ec7b5dc910 msgr2=0x55ec7b6c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3797507651 shutdown_connections 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.121+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3797507651 wait complete. 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae2a9a9c0 1 Processor -- start 2024-09-12T16:52:24.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae2a9a9c0 1 -- start start 2024-09-12T16:52:24.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae2a9a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6d4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae2a9a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec7b48ca50 con 0x55ec7b5561f0 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae05a0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6d4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae05a0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6d4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34222/0 (socket says 172.21.15.151:34222) 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae05a0640 1 -- 172.21.15.151:0/4040789438 learned_addr learned my addr 172.21.15.151:0/4040789438 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae05a0640 1 -- 172.21.15.151:0/4040789438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec7b6d53e0 con 0x55ec7b5561f0 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6d4e80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55ec7b6ce740 tx=0x7f0ad0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f09cce09640 1 -- 172.21.15.151:0/4040789438 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad0012030 con 0x55ec7b5561f0 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec7b6d5670 con 0x55ec7b5561f0 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f09cce09640 1 -- 172.21.15.151:0/4040789438 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad001a750 con 0x55ec7b5561f0 2024-09-12T16:52:24.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec7b6d6020 con 0x55ec7b5561f0 2024-09-12T16:52:24.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f09cce09640 1 -- 172.21.15.151:0/4040789438 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad001aa30 con 0x55ec7b5561f0 2024-09-12T16:52:24.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f09cce09640 1 -- 172.21.15.151:0/4040789438 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ad0015020 con 0x55ec7b5561f0 2024-09-12T16:52:24.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f09cce09640 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c8039ac0 0x7f09c803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f09cce09640 1 -- 172.21.15.151:0/4040789438 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0ad0020030 con 0x55ec7b5561f0 2024-09-12T16:52:24.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0adfd9f640 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c8039ac0 0x7f09c803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b5e6340 0x55ec7b6dbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b6dc530 con 0x55ec7b5e6340 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae0da1640 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b5e6340 0x55ec7b6dbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0adfd9f640 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c8039ac0 0x7f09c803bf80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40ad000 tx=0x7f0ad40a5070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.125+0000 7f0ae0da1640 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b5e6340 0x55ec7b6dbff0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae0da1640 1 -- 172.21.15.151:0/4040789438 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ad80083f0 con 0x55ec7b5e6340 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b6d6360 con 0x55ec7b5e6340 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae0da1640 1 -- 172.21.15.151:0/4040789438 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ad80083f0 con 0x55ec7b5e6340 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b6de7a0 0x55ec7b6e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b6e1280 con 0x55ec7b6de7a0 2024-09-12T16:52:24.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b6de7a0 0x55ec7b6e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b6de7a0 0x55ec7b6e0b90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae05a0640 1 -- 172.21.15.151:0/4040789438 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ad0008030 con 0x55ec7b6de7a0 2024-09-12T16:52:24.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b6dd640 con 0x55ec7b5e6340 2024-09-12T16:52:24.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae0da1640 1 -- 172.21.15.151:0/4040789438 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ad80083f0 con 0x55ec7b5e6340 2024-09-12T16:52:24.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b6ddae0 con 0x55ec7b5e6340 2024-09-12T16:52:24.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae0da1640 1 -- 172.21.15.151:0/4040789438 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ad80083f0 con 0x55ec7b5e6340 2024-09-12T16:52:24.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 Processor -- start 2024-09-12T16:52:24.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 -- start start 2024-09-12T16:52:24.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6ef910 0x55ec7b6efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae2a9a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec7b4f7450 con 0x55ec7b6ef910 2024-09-12T16:52:24.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae0da1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6ef910 0x55ec7b6efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae0da1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6ef910 0x55ec7b6efd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34238/0 (socket says 172.21.15.151:34238) 2024-09-12T16:52:24.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.129+0000 7f0ae0da1640 1 -- 172.21.15.151:0/332888696 learned_addr learned my addr 172.21.15.151:0/332888696 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae0da1640 1 -- 172.21.15.151:0/332888696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec7b6f0370 con 0x55ec7b6ef910 2024-09-12T16:52:24.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae0da1640 1 --2- 172.21.15.151:0/332888696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6ef910 0x55ec7b6efd30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55ec7b6d6210 tx=0x7f0ad800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f09c5ffb640 1 -- 172.21.15.151:0/332888696 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad8007d70 con 0x55ec7b6ef910 2024-09-12T16:52:24.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/332888696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec7b6f0bd0 con 0x55ec7b6ef910 2024-09-12T16:52:24.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f09c5ffb640 1 -- 172.21.15.151:0/332888696 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad801e020 con 0x55ec7b6ef910 2024-09-12T16:52:24.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f09c5ffb640 1 -- 172.21.15.151:0/332888696 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad8019590 con 0x55ec7b6ef910 2024-09-12T16:52:24.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/332888696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec7b6f1140 con 0x55ec7b6ef910 2024-09-12T16:52:24.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f09c5ffb640 1 -- 172.21.15.151:0/332888696 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ad8016040 con 0x55ec7b6ef910 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f09c5ffb640 1 --2- 172.21.15.151:0/332888696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f09c5ffb640 1 -- 172.21.15.151:0/332888696 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0ad801f030 con 0x55ec7b6ef910 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/332888696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae2a9a9c0 1 Processor -- start 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae2a9a9c0 1 -- start start 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/332888696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55ec7b6dc940 tx=0x7f0ad0018d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae2a9a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b6fd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae2a9a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec7b6ce000 con 0x55ec7b6fd300 2024-09-12T16:52:24.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae0da1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b6fd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae0da1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b6fd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34252/0 (socket says 172.21.15.151:34252) 2024-09-12T16:52:24.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.133+0000 7f0ae0da1640 1 -- 172.21.15.151:0/1804125174 learned_addr learned my addr 172.21.15.151:0/1804125174 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae0da1640 1 -- 172.21.15.151:0/1804125174 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec7b6fdcb0 con 0x55ec7b6fd300 2024-09-12T16:52:24.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae0da1640 1 --2- 172.21.15.151:0/1804125174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b6fd6e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80508d0 tx=0x7f0ad80174f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21913e2b06f5a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f09bf7fe640 1 -- 172.21.15.151:0/1804125174 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad801d040 con 0x55ec7b6fd300 2024-09-12T16:52:24.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f09bf7fe640 1 -- 172.21.15.151:0/1804125174 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad804f210 con 0x55ec7b6fd300 2024-09-12T16:52:24.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f09bf7fe640 1 -- 172.21.15.151:0/1804125174 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad804f510 con 0x55ec7b6fd300 2024-09-12T16:52:24.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/1804125174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 msgr2=0x55ec7b6fd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/1804125174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b6fd6e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80508d0 tx=0x7f0ad80174f0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/1804125174 shutdown_connections 2024-09-12T16:52:24.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/1804125174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b6fd6e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/1804125174 >> 172.21.15.151:0/1804125174 conn(0x55ec7b6f86c0 msgr2=0x55ec7b6f6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/1804125174 shutdown_connections 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/1804125174 wait complete. 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 Processor -- start 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- start start 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b703730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ec7b6fc1f0 con 0x55ec7b6fd300 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae0da1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b703730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae0da1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b703730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34256/0 (socket says 172.21.15.151:34256) 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 learned_addr learned my addr 172.21.15.151:0/3371671161 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec7b703c90 con 0x55ec7b6fd300 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae0da1640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b703730 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8008fd0 tx=0x7f0ad8050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f09bdffb640 1 -- 172.21.15.151:0/3371671161 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad801d030 con 0x55ec7b6fd300 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec7b703f20 con 0x55ec7b6fd300 2024-09-12T16:52:24.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f09bdffb640 1 -- 172.21.15.151:0/3371671161 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad8031030 con 0x55ec7b6fd300 2024-09-12T16:52:24.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec7b7048d0 con 0x55ec7b6fd300 2024-09-12T16:52:24.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.137+0000 7f09bdffb640 1 -- 172.21.15.151:0/3371671161 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad803b060 con 0x55ec7b6fd300 2024-09-12T16:52:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f09bdffb640 1 -- 172.21.15.151:0/3371671161 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ad802b350 con 0x55ec7b6fd300 2024-09-12T16:52:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f09bdffb640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b0039a70 0x7f09b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f09bdffb640 1 -- 172.21.15.151:0/3371671161 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0ad8024030 con 0x55ec7b6fd300 2024-09-12T16:52:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b70ea30 0x55ec7b710ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b0039a70 0x7f09b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b711610 con 0x55ec7b70ea30 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0adfd9f640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b70ea30 0x55ec7b710ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b0039a70 0x7f09b003bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0ad001a6a0 tx=0x7f0ad004c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0adfd9f640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b70ea30 0x55ec7b710ec0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 realm 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b711a40 con 0x55ec7b70ea30 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b712310 con 0x55ec7b70ea30 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b7126b0 con 0x55ec7b70ea30 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b713410 0x55ec7b715800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b715e50 con 0x55ec7b713410 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae0da1640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b713410 0x55ec7b715800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.141+0000 7f0ae0da1640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b713410 0x55ec7b715800 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:24.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae2a9a9c0 20 searching for the correct realm 2024-09-12T16:52:24.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ec7b717d30 0x55ec7b71a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71a7e0 con 0x55ec7b717d30 2024-09-12T16:52:24.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ec7b717d30 0x55ec7b71a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ec7b717d30 0x55ec7b71a160 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae05a0640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ad0017050 0x7f0ad004d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71a7e0 con 0x7f0ad0017050 2024-09-12T16:52:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ad0017050 0x7f0ad004d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ad0017050 0x7f0ad004d320 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71a7e0 con 0x55ec7b713410 2024-09-12T16:52:24.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71a7e0 con 0x55ec7b70ea30 2024-09-12T16:52:24.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71a7e0 con 0x55ec7b70ea30 2024-09-12T16:52:24.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b713410 2024-09-12T16:52:24.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b713410 2024-09-12T16:52:24.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x7f0ad0017050 2024-09-12T16:52:24.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b717d30 2024-09-12T16:52:24.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.145+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b70ea30 2024-09-12T16:52:24.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b713410 2024-09-12T16:52:24.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b70ea30 2024-09-12T16:52:24.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x7f0ad0017050 2024-09-12T16:52:24.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b717d30 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b717d30 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b713410 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b717d30 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b717d30 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b70ea30 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b70ea30 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.149+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b713410 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b717d30 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x7f0ad0017050 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b70ea30 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b713410 2024-09-12T16:52:24.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b717d30 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b713410 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x7f0ad0017050 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b717d30 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b713410 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x55ec7b70ea30 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0ad40cd040 con 0x7f0ad0017050 2024-09-12T16:52:24.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae2a9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:24.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae2a9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:24.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae2a9a9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:24.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae2a9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:24.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae2a9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:24.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae2a9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:24.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.153+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b7167a0 con 0x55ec7b70ea30 2024-09-12T16:52:24.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b716b90 con 0x55ec7b70ea30 2024-09-12T16:52:24.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b716b90 con 0x55ec7b70ea30 2024-09-12T16:52:24.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:24.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 zone default found 2024-09-12T16:52:24.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 4 Realm: () 2024-09-12T16:52:24.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:24.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:24.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:24.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 zonegroup default 2024-09-12T16:52:24.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b716fb0 con 0x55ec7b713410 2024-09-12T16:52:24.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71c750 con 0x55ec7b717d30 2024-09-12T16:52:24.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71cba0 con 0x55ec7b717d30 2024-09-12T16:52:24.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 started sync module instance, tier type = 2024-09-12T16:52:24.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:24.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71baf0 con 0x7f0ad0017050 2024-09-12T16:52:24.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94474171695088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71baf0 con 0x7f0ad0017050 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.157+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71d620 con 0x55ec7b70ea30 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.161+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94474171695088] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.161+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.161+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94474171699840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71baf0 con 0x55ec7b70ea30 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.161+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71e060 con 0x55ec7b717d30 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.161+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.161+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94474171702192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71e8b0 con 0x55ec7b717d30 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.161+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71f270 con 0x7f0ad0017050 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94474171699840] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94474171706816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71f1e0 con 0x7f0ad0017050 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71ffc0 con 0x55ec7b70ea30 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94474171702192] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94474171706816] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94474171704320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71fac0 con 0x55ec7b70ea30 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.165+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b720890 con 0x55ec7b713410 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.169+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94474171704320] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.169+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.169+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94474171712480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b71fac0 con 0x55ec7b713410 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.169+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b7210e0 con 0x55ec7b713410 2024-09-12T16:52:24.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.169+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94474171712480] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94474171709424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b7210e0 con 0x55ec7b713410 2024-09-12T16:52:24.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b721aa0 con 0x55ec7b713410 2024-09-12T16:52:24.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94474171717104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b721f00 con 0x55ec7b713410 2024-09-12T16:52:24.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 20 add_watcher() i=0 2024-09-12T16:52:24.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 20 add_watcher() i=1 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 20 add_watcher() i=2 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 20 add_watcher() i=3 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 20 add_watcher() i=4 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 20 add_watcher() i=5 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94474171709424] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 20 add_watcher() i=6 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94474171717104] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 20 add_watcher() i=7 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.173+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b720c30 con 0x55ec7b70ea30 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94474171714608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b722440 con 0x55ec7b70ea30 2024-09-12T16:52:24.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94474171714608] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f09967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f0ae2a9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f0ae2a9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72d880 con 0x55ec7b70ea30 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.177+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72d880 con 0x55ec7b713410 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.181+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.181+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72d880 con 0x55ec7b717d30 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.181+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.181+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72cef0 con 0x55ec7b70ea30 2024-09-12T16:52:24.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.181+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.181+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72cef0 con 0x7f0ad0017050 2024-09-12T16:52:24.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.185+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.185+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f020 con 0x55ec7b717d30 2024-09-12T16:52:24.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.185+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.185+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f020 con 0x55ec7b70ea30 2024-09-12T16:52:24.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.185+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.185+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f300 con 0x55ec7b713410 2024-09-12T16:52:24.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.189+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.189+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f300 con 0x7f0ad0017050 2024-09-12T16:52:24.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.189+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.189+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f390 con 0x55ec7b717d30 2024-09-12T16:52:24.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.193+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.193+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f390 con 0x7f0ad0017050 2024-09-12T16:52:24.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.193+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.193+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f390 con 0x55ec7b713410 2024-09-12T16:52:24.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.193+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.193+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f390 con 0x7f0ad0017050 2024-09-12T16:52:24.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.197+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.197+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f300 con 0x55ec7b713410 2024-09-12T16:52:24.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.197+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.197+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f390 con 0x55ec7b70ea30 2024-09-12T16:52:24.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.197+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'141 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.197+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f390 con 0x55ec7b717d30 2024-09-12T16:52:24.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.201+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.201+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f420 con 0x7f0ad0017050 2024-09-12T16:52:24.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.201+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.201+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f420 con 0x55ec7b717d30 2024-09-12T16:52:24.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.201+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.201+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f480 con 0x55ec7b70ea30 2024-09-12T16:52:24.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.205+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.205+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f480 con 0x55ec7b70ea30 2024-09-12T16:52:24.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.205+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'142 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.205+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f480 con 0x55ec7b717d30 2024-09-12T16:52:24.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.209+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.209+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f4c0 con 0x7f0ad0017050 2024-09-12T16:52:24.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.209+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.209+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f500 con 0x55ec7b717d30 2024-09-12T16:52:24.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.209+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.209+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f540 con 0x55ec7b717d30 2024-09-12T16:52:24.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.213+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.213+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f580 con 0x55ec7b717d30 2024-09-12T16:52:24.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.213+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.213+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f580 con 0x55ec7b717d30 2024-09-12T16:52:24.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.213+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.213+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f5c0 con 0x55ec7b713410 2024-09-12T16:52:24.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.217+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.217+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f600 con 0x55ec7b717d30 2024-09-12T16:52:24.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.217+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.217+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f600 con 0x55ec7b713410 2024-09-12T16:52:24.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.221+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.221+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f600 con 0x55ec7b717d30 2024-09-12T16:52:24.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.225+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.225+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f600 con 0x55ec7b713410 2024-09-12T16:52:24.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.225+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.225+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72f640 con 0x7f0ad0017050 2024-09-12T16:52:24.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f09957e2640 20 reqs_thread_entry: start 2024-09-12T16:52:24.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:24.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 Filter name: none 2024-09-12T16:52:24.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0906ffd640 20 reqs_thread_entry: start 2024-09-12T16:52:24.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:24.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b72c140 con 0x7f0ad0017050 2024-09-12T16:52:24.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:24.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:24.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:24.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:24.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:95 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b74c1d0 con 0x55ec7b713410 2024-09-12T16:52:24.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(95 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:24.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:24.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 get_obj_state: octx=0x7f0ad40c5040 obj=myfoo:four state=0x55ec7b74cc38 s->prefetch_data=0 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:96 3.7s0 3:e0c582ee:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b74deb0 con 0x55ec7b717d30 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(96 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 10 manifest: total_size = 4 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 get_obj_state: setting s->obj_tag to 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.3883182133915104091 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 get_obj_state: octx=0x7f0ad40c5040 obj=myfoo:four state=0x55ec7b74cc38 s->prefetch_data=0 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ec7b74cc38 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6 2024-09-12T16:52:24.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:97 4.31 4:8cce304c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b7528d0 con 0x55ec7b70ea30 2024-09-12T16:52:24.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(97 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.229+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 3.7s0 3:e0c582ee:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b7528d0 con 0x55ec7b717d30 2024-09-12T16:52:24.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.233+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(98 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.233+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 4.31 4:8cce304c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x55ec7b70ea30 2024-09-12T16:52:24.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.233+0000 7f09967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.233+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94474171714608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x55ec7b70ea30 2024-09-12T16:52:24.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.233+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(99 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.233+0000 7f09bf7fe640 20 handle_completion(): completion ok for obj=four 2024-09-12T16:52:24.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94474171714608] v32'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94474171695088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b720c30 con 0x7f0ad0017050 2024-09-12T16:52:24.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94474171695088] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0ae2a9a9c0 20 remove_watcher() i=0 2024-09-12T16:52:24.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0ae2a9a9c0 2 removed watcher, disabling cache 2024-09-12T16:52:24.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94474171699840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x55ec7b70ea30 2024-09-12T16:52:24.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94474171699840] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0ae2a9a9c0 20 remove_watcher() i=1 2024-09-12T16:52:24.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.237+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94474171702192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x55ec7b717d30 2024-09-12T16:52:24.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.241+0000 7f0ae05a0640 1 -- 172.21.15.151:0/3371671161 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94474171702192] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad0036040 con 0x55ec7b717d30 2024-09-12T16:52:24.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.241+0000 7f0ae2a9a9c0 20 remove_watcher() i=2 2024-09-12T16:52:24.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.241+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94474171706816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x7f0ad0017050 2024-09-12T16:52:24.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.241+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94474171706816] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x7f0ad0017050 2024-09-12T16:52:24.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.241+0000 7f0ae2a9a9c0 20 remove_watcher() i=3 2024-09-12T16:52:24.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.241+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94474171704320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x55ec7b70ea30 2024-09-12T16:52:24.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.245+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94474171704320] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad40aba40 con 0x55ec7b70ea30 2024-09-12T16:52:24.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.245+0000 7f0ae2a9a9c0 20 remove_watcher() i=4 2024-09-12T16:52:24.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.245+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94474171712480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x55ec7b713410 2024-09-12T16:52:24.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.245+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94474171712480] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.245+0000 7f0ae2a9a9c0 20 remove_watcher() i=5 2024-09-12T16:52:24.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.245+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94474171709424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x55ec7b713410 2024-09-12T16:52:24.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94474171709424] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 20 remove_watcher() i=6 2024-09-12T16:52:24.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94474171717104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec7b753360 con 0x55ec7b713410 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae0da1640 1 -- 172.21.15.151:0/3371671161 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94474171717104] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ad802a070 con 0x55ec7b713410 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 20 remove_watcher() i=7 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b713410 msgr2=0x55ec7b715800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b713410 0x55ec7b715800 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b70ea30 msgr2=0x55ec7b710ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b70ea30 0x55ec7b710ec0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ad0017050 msgr2=0x7f0ad004d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ad0017050 0x7f0ad004d320 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ec7b717d30 msgr2=0x55ec7b71a160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ec7b717d30 0x55ec7b71a160 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b0039a70 msgr2=0x7f09b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b0039a70 0x7f09b003bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0ad001a6a0 tx=0x7f0ad004c000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 msgr2=0x55ec7b703730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0adfd9f640 1 -- 172.21.15.151:0/3371671161 reap_dead start 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b703730 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8008fd0 tx=0x7f0ad8050860 comp rx=0 tx=0).stop 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 shutdown_connections 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/3371671161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6fd300 0x55ec7b703730 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 >> 172.21.15.151:0/3371671161 conn(0x55ec7b6f86c0 msgr2=0x55ec7b6fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 shutdown_connections 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.249+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/3371671161 wait complete. 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/332888696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 msgr2=0x7f09b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/332888696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55ec7b6dc940 tx=0x7f0ad0018d60 comp rx=0 tx=0).stop 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/332888696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6ef910 msgr2=0x55ec7b6efd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/332888696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6ef910 0x55ec7b6efd30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55ec7b6d6210 tx=0x7f0ad800af40 comp rx=0 tx=0).stop 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/332888696 shutdown_connections 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/332888696 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/332888696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b6ef910 0x55ec7b6efd30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/332888696 >> 172.21.15.151:0/332888696 conn(0x55ec7b6e52c0 msgr2=0x55ec7b6e56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/332888696 shutdown_connections 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/332888696 wait complete. 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b6de7a0 msgr2=0x55ec7b6e0b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b6de7a0 0x55ec7b6e0b90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b5e6340 msgr2=0x55ec7b6dbff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b5e6340 0x55ec7b6dbff0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c8039ac0 msgr2=0x7f09c803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c8039ac0 0x7f09c803bf80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40ad000 tx=0x7f0ad40a5070 comp rx=0 tx=0).stop 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 msgr2=0x55ec7b6d4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6d4e80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55ec7b6ce740 tx=0x7f0ad0000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 shutdown_connections 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ec7b6de7a0 0x55ec7b6e0b90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ec7b5e6340 0x55ec7b6dbff0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c8039ac0 0x7f09c803bf80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 --2- 172.21.15.151:0/4040789438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ec7b5561f0 0x55ec7b6d4e80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 >> 172.21.15.151:0/4040789438 conn(0x55ec7b5dc910 msgr2=0x55ec7b6c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 shutdown_connections 2024-09-12T16:52:24.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.253+0000 7f0ae2a9a9c0 1 -- 172.21.15.151:0/4040789438 wait complete. 2024-09-12T16:52:24.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T16:52:24.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T16:52:24.264 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T16:52:24.335 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:24.335 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:24.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f00034649c0 1 Processor -- start 2024-09-12T16:52:24.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f00034649c0 1 -- start start 2024-09-12T16:52:24.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f00034649c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55bb968c8350 0x55bb968ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f00034649c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb967789c0 con 0x55bb96838200 2024-09-12T16:52:24.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f00034649c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55bb967c86d0 con 0x55bb968c8350 2024-09-12T16:52:24.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f0000769640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55bb968c8350 0x55bb968ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f0000f6a640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55bb96838200 0x55bb968c6c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42724/0 (socket says 172.21.15.151:42724) 2024-09-12T16:52:24.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f0000f6a640 1 -- 172.21.15.151:0/909460191 learned_addr learned my addr 172.21.15.151:0/909460191 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:24.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f0000769640 1 -- 172.21.15.151:0/909460191 >> v1:172.21.15.122:6789/0 conn(0x55bb96838200 legacy=0x55bb968c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.333+0000 7f0000769640 1 -- 172.21.15.151:0/909460191 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9676cca0 con 0x55bb968c8350 2024-09-12T16:52:24.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7f0000769640 1 --2- 172.21.15.151:0/909460191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb968c8350 0x55bb968ca740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effe800a480 tx=0x7effe801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c60258ea735062 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7efffff68640 1 -- 172.21.15.151:0/909460191 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe80af070 con 0x55bb968c8350 2024-09-12T16:52:24.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7efffff68640 1 -- 172.21.15.151:0/909460191 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe80aa530 con 0x55bb968c8350 2024-09-12T16:52:24.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7efffff68640 1 -- 172.21.15.151:0/909460191 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe80aa830 con 0x55bb968c8350 2024-09-12T16:52:24.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7f00034649c0 1 -- 172.21.15.151:0/909460191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb968c8350 msgr2=0x55bb968ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7f00034649c0 1 --2- 172.21.15.151:0/909460191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb968c8350 0x55bb968ca740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effe800a480 tx=0x7effe801b280 comp rx=0 tx=0).stop 2024-09-12T16:52:24.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7f00034649c0 1 -- 172.21.15.151:0/909460191 shutdown_connections 2024-09-12T16:52:24.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7f00034649c0 1 --2- 172.21.15.151:0/909460191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb968c8350 0x55bb968ca740 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7f00034649c0 1 -- 172.21.15.151:0/909460191 >> 172.21.15.151:0/909460191 conn(0x55bb968be920 msgr2=0x55bb968c0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7f00034649c0 1 -- 172.21.15.151:0/909460191 shutdown_connections 2024-09-12T16:52:24.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.337+0000 7f00034649c0 1 -- 172.21.15.151:0/909460191 wait complete. 2024-09-12T16:52:24.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.349+0000 7f00034649c0 1 Processor -- start 2024-09-12T16:52:24.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.349+0000 7f00034649c0 1 -- start start 2024-09-12T16:52:24.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.349+0000 7f00034649c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb969af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.349+0000 7f00034649c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb967cc680 con 0x55bb96838200 2024-09-12T16:52:24.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.349+0000 7f0000f6a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb969af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.349+0000 7f0000f6a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb969af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34278/0 (socket says 172.21.15.151:34278) 2024-09-12T16:52:24.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.349+0000 7f0000f6a640 1 -- 172.21.15.151:0/4074017113 learned_addr learned my addr 172.21.15.151:0/4074017113 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f0000f6a640 1 -- 172.21.15.151:0/4074017113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb96747da0 con 0x55bb96838200 2024-09-12T16:52:24.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f0000f6a640 1 --2- 172.21.15.151:0/4074017113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb969af7c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efff80017b0 tx=0x7efff8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b229b170d5efdba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7efeeee0d640 1 -- 172.21.15.151:0/4074017113 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff80044f0 con 0x55bb96838200 2024-09-12T16:52:24.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7efeeee0d640 1 -- 172.21.15.151:0/4074017113 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff80046b0 con 0x55bb96838200 2024-09-12T16:52:24.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7efeeee0d640 1 -- 172.21.15.151:0/4074017113 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff8004a10 con 0x55bb96838200 2024-09-12T16:52:24.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- 172.21.15.151:0/4074017113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 msgr2=0x55bb969af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 --2- 172.21.15.151:0/4074017113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb969af7c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efff80017b0 tx=0x7efff8001c70 comp rx=0 tx=0).stop 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- 172.21.15.151:0/4074017113 shutdown_connections 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 --2- 172.21.15.151:0/4074017113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb969af7c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- 172.21.15.151:0/4074017113 >> 172.21.15.151:0/4074017113 conn(0x55bb968be920 msgr2=0x55bb969ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- 172.21.15.151:0/4074017113 shutdown_connections 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- 172.21.15.151:0/4074017113 wait complete. 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 Processor -- start 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- start start 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb968c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb9676ea50 con 0x55bb96838200 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f0000f6a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb968c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f0000f6a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb968c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34292/0 (socket says 172.21.15.151:34292) 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f0000f6a640 1 -- 172.21.15.151:0/63625923 learned_addr learned my addr 172.21.15.151:0/63625923 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f0000f6a640 1 -- 172.21.15.151:0/63625923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb968c4870 con 0x55bb96838200 2024-09-12T16:52:24.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f0000f6a640 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb968c4310 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efff80012f0 tx=0x7efff8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7efeed60a640 1 -- 172.21.15.151:0/63625923 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff8013820 con 0x55bb96838200 2024-09-12T16:52:24.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb968c2c50 con 0x55bb96838200 2024-09-12T16:52:24.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7efeed60a640 1 -- 172.21.15.151:0/63625923 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff80139c0 con 0x55bb96838200 2024-09-12T16:52:24.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7efeed60a640 1 -- 172.21.15.151:0/63625923 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff8013ca0 con 0x55bb96838200 2024-09-12T16:52:24.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.353+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb968c31e0 con 0x55bb96838200 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7efeed60a640 1 -- 172.21.15.151:0/63625923 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efff8010070 con 0x55bb96838200 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7efeed60a640 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efee8039a70 0x7efee803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7efeed60a640 1 -- 172.21.15.151:0/63625923 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efff8018070 con 0x55bb96838200 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f0000769640 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efee8039a70 0x7efee803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb968c8350 0x55bb969c0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969c0780 con 0x55bb968c8350 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f000176b640 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb968c8350 0x55bb969c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f0000769640 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efee8039a70 0x7efee803bf30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7effe80ac000 tx=0x7effe80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f000176b640 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb968c8350 0x55bb969c0240 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f000176b640 1 -- 172.21.15.151:0/63625923 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efff00083f0 con 0x55bb968c8350 2024-09-12T16:52:24.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969c0ba0 con 0x55bb968c8350 2024-09-12T16:52:24.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f000176b640 1 -- 172.21.15.151:0/63625923 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efff00083f0 con 0x55bb968c8350 2024-09-12T16:52:24.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969c29b0 0x55bb969c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969c5470 con 0x55bb969c29b0 2024-09-12T16:52:24.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f0000f6a640 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969c29b0 0x55bb969c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.357+0000 7f0000f6a640 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969c29b0 0x55bb969c4da0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f0000f6a640 1 -- 172.21.15.151:0/63625923 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efff801b030 con 0x55bb969c29b0 2024-09-12T16:52:24.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969c1850 con 0x55bb968c8350 2024-09-12T16:52:24.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f000176b640 1 -- 172.21.15.151:0/63625923 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efff00083f0 con 0x55bb968c8350 2024-09-12T16:52:24.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969c1cd0 con 0x55bb968c8350 2024-09-12T16:52:24.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f000176b640 1 -- 172.21.15.151:0/63625923 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efff00083f0 con 0x55bb968c8350 2024-09-12T16:52:24.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f00034649c0 1 Processor -- start 2024-09-12T16:52:24.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f00034649c0 1 -- start start 2024-09-12T16:52:24.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f00034649c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969d3b00 0x55bb969d3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f00034649c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb967d9450 con 0x55bb969d3b00 2024-09-12T16:52:24.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f000176b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969d3b00 0x55bb969d3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f000176b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969d3b00 0x55bb969d3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34306/0 (socket says 172.21.15.151:34306) 2024-09-12T16:52:24.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f000176b640 1 -- 172.21.15.151:0/3204728837 learned_addr learned my addr 172.21.15.151:0/3204728837 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f000176b640 1 -- 172.21.15.151:0/3204728837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb969d4560 con 0x55bb969d3b00 2024-09-12T16:52:24.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f000176b640 1 --2- 172.21.15.151:0/3204728837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969d3b00 0x55bb969d3f20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55bb968c3bf0 tx=0x7efff000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7efee67fc640 1 -- 172.21.15.151:0/3204728837 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0007e00 con 0x55bb969d3b00 2024-09-12T16:52:24.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f00034649c0 1 -- 172.21.15.151:0/3204728837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb969d4dc0 con 0x55bb969d3b00 2024-09-12T16:52:24.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7efee67fc640 1 -- 172.21.15.151:0/3204728837 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff001e020 con 0x55bb969d3b00 2024-09-12T16:52:24.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7efee67fc640 1 -- 172.21.15.151:0/3204728837 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0019550 con 0x55bb969d3b00 2024-09-12T16:52:24.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.361+0000 7f00034649c0 1 -- 172.21.15.151:0/3204728837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb969d5330 con 0x55bb969d3b00 2024-09-12T16:52:24.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7efee67fc640 1 -- 172.21.15.151:0/3204728837 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efff0016040 con 0x55bb969d3b00 2024-09-12T16:52:24.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7efee67fc640 1 --2- 172.21.15.151:0/3204728837 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efed8039ac0 0x7efed803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7efee67fc640 1 -- 172.21.15.151:0/3204728837 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efff001f030 con 0x55bb969d3b00 2024-09-12T16:52:24.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f0000f6a640 1 --2- 172.21.15.151:0/3204728837 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efed8039ac0 0x7efed803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 Processor -- start 2024-09-12T16:52:24.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- start start 2024-09-12T16:52:24.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f0000f6a640 1 --2- 172.21.15.151:0/3204728837 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efed8039ac0 0x7efed803bf80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55bb968c3580 tx=0x7efff8014f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb969b0010 con 0x55bb969e1470 2024-09-12T16:52:24.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f000176b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f000176b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34322/0 (socket says 172.21.15.151:34322) 2024-09-12T16:52:24.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f000176b640 1 -- 172.21.15.151:0/300351083 learned_addr learned my addr 172.21.15.151:0/300351083 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f000176b640 1 -- 172.21.15.151:0/300351083 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb969e1e40 con 0x55bb969e1470 2024-09-12T16:52:24.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f000176b640 1 --2- 172.21.15.151:0/300351083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e1850 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7efff0050950 tx=0x7efff0017780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3eb68797885255d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7efed7fff640 1 -- 172.21.15.151:0/300351083 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff001d040 con 0x55bb969e1470 2024-09-12T16:52:24.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7efed7fff640 1 -- 172.21.15.151:0/300351083 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff0018c90 con 0x55bb969e1470 2024-09-12T16:52:24.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7efed7fff640 1 -- 172.21.15.151:0/300351083 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0052110 con 0x55bb969e1470 2024-09-12T16:52:24.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- 172.21.15.151:0/300351083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 msgr2=0x55bb969e1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 --2- 172.21.15.151:0/300351083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e1850 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7efff0050950 tx=0x7efff0017780 comp rx=0 tx=0).stop 2024-09-12T16:52:24.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- 172.21.15.151:0/300351083 shutdown_connections 2024-09-12T16:52:24.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 --2- 172.21.15.151:0/300351083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e1850 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- 172.21.15.151:0/300351083 >> 172.21.15.151:0/300351083 conn(0x55bb969dc890 msgr2=0x55bb969daad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- 172.21.15.151:0/300351083 shutdown_connections 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- 172.21.15.151:0/300351083 wait complete. 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 Processor -- start 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- start start 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.365+0000 7f00034649c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb969e03c0 con 0x55bb969e1470 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f000176b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f000176b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34326/0 (socket says 172.21.15.151:34326) 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 learned_addr learned my addr 172.21.15.151:0/40744162 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb969e7e40 con 0x55bb969e1470 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f000176b640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e78e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efff000afd0 tx=0x7efff00508b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7efed67fc640 1 -- 172.21.15.151:0/40744162 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff001d030 con 0x55bb969e1470 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb969e80d0 con 0x55bb969e1470 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7efed67fc640 1 -- 172.21.15.151:0/40744162 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff0031030 con 0x55bb969e1470 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7efed67fc640 1 -- 172.21.15.151:0/40744162 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff003b060 con 0x55bb969e1470 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb969e8a80 con 0x55bb969e1470 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7efed67fc640 1 -- 172.21.15.151:0/40744162 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efff003ead0 con 0x55bb969e1470 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7efed67fc640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efecc039a20 0x7efecc03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7efed67fc640 1 -- 172.21.15.151:0/40744162 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efff0024030 con 0x55bb969e1470 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f0000f6a640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efecc039a20 0x7efecc03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb969f2be0 0x55bb969f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969f57c0 con 0x55bb969f2be0 2024-09-12T16:52:24.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f0000769640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb969f2be0 0x55bb969f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f0000f6a640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efecc039a20 0x7efecc03bee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efff801dfd0 tx=0x7efff8041000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f0000769640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb969f2be0 0x55bb969f5070 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 20 realm 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969f5b90 con 0x55bb969f2be0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969f6460 con 0x55bb969f2be0 2024-09-12T16:52:24.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.369+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969f6800 con 0x55bb969f2be0 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f00034649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969f72b0 0x55bb969f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969f9e00 con 0x55bb969f72b0 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f000176b640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969f72b0 0x55bb969f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f000176b640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969f72b0 0x55bb969f96a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f00034649c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:24.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f00034649c0 20 searching for the correct realm 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bb969fbda0 0x55bb969fe260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000f6a640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bb969fbda0 0x55bb969fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000f6a640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bb969fbda0 0x55bb969fe260 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000f6a640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efff8046040 0x7efff80123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x7efff8046040 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000769640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efff8046040 0x7efff80123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000769640 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efff8046040 0x7efff80123c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.373+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f2be0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f2be0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x7efff8046040 2024-09-12T16:52:24.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f2be0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f2be0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x7efff8046040 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.377+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f2be0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f2be0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x7efff8046040 2024-09-12T16:52:24.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f2be0 2024-09-12T16:52:24.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.381+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x7efff8046040 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969fbda0 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f72b0 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x55bb969f2be0 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fe930 con 0x7efff8046040 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fa7c0 con 0x55bb969f2be0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fac10 con 0x55bb969f2be0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fb0f0 con 0x55bb969f2be0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 zone default found 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 4 Realm: () 2024-09-12T16:52:24.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 zonegroup default 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fedb0 con 0x55bb969f72b0 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a00cd0 con 0x55bb969fbda0 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.385+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a011c0 con 0x55bb969fbda0 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f00034649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f00034649c0 20 started sync module instance, tier type = 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f00034649c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fffe0 con 0x7efff8046040 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94264174314720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fffe0 con 0x7efff8046040 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a01cd0 con 0x55bb969f2be0 2024-09-12T16:52:24.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94264174314720] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94264174319552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fffe0 con 0x55bb969f2be0 2024-09-12T16:52:24.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.389+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a02710 con 0x55bb969fbda0 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.393+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94264174319552] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.393+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.393+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94264174312240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb969fff50 con 0x55bb969fbda0 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.393+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a034a0 con 0x7efff8046040 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.393+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.393+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94264174325680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a03880 con 0x7efff8046040 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.393+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a04370 con 0x55bb969f2be0 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.393+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94264174312240] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.397+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94264174325680] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.397+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.397+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94264174329408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a033d0 con 0x55bb969f2be0 2024-09-12T16:52:24.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.397+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a04c10 con 0x55bb969f72b0 2024-09-12T16:52:24.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.397+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94264174329408] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.397+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.397+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94264174331744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a033d0 con 0x55bb969f72b0 2024-09-12T16:52:24.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.397+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a05460 con 0x55bb969f72b0 2024-09-12T16:52:24.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94264174331744] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94264174324480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a05460 con 0x55bb969f72b0 2024-09-12T16:52:24.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a05ea0 con 0x55bb969f72b0 2024-09-12T16:52:24.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94264174324480] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94264174333872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a05e60 con 0x55bb969f72b0 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 20 add_watcher() i=0 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 20 add_watcher() i=1 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 20 add_watcher() i=2 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 20 add_watcher() i=3 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 20 add_watcher() i=4 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 20 add_watcher() i=5 2024-09-12T16:52:24.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.401+0000 7f00034649c0 20 add_watcher() i=6 2024-09-12T16:52:24.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94264174333872] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 20 add_watcher() i=7 2024-09-12T16:52:24.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:24.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a092f0 con 0x55bb969f2be0 2024-09-12T16:52:24.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94264174336368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a06810 con 0x55bb969f2be0 2024-09-12T16:52:24.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94264174336368] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7efeb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 5 note: GC not initialized 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7efeb67e4640 20 reqs_thread_entry: start 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 20 Filter name: none 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7efeaf7fe640 20 reqs_thread_entry: start 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.405+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a2c550 con 0x7efff8046040 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a2cde0 con 0x55bb969f72b0 2024-09-12T16:52:24.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a2cfa0 con 0x7efff8046040 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a2e3f0 con 0x55bb969f72b0 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(65 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:52:24.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 4.3a 4:5d9d5add:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a2fce0 con 0x55bb969fbda0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 4.12 4:495b7da7:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a326f0 con 0x55bb969f2be0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 4.e 4:71891b96:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a35170 con 0x7efff8046040 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 4.3b 4:dcb0fad2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a37ae0 con 0x55bb969fbda0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 4.1 4:81b1f111:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a37ae0 con 0x7efff8046040 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 4.12 4:4a346742:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a3cb20 con 0x55bb969f2be0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 4.31 4:8cce304c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a3f9e0 con 0x55bb969f2be0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 4.3 4:c37d83ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a428a0 con 0x55bb969f2be0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:74 4.3b 4:dcbe27d2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a456d0 con 0x55bb969fbda0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 4.3d 4:bf8db400:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a48540 con 0x55bb969fbda0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 4.2f 4:f7089978:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a4b400 con 0x55bb969f2be0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(69 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(67 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(68 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(71 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.5 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(73 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(74 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.8 [call out=128b] v0'0 uv8 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(75 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(72 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.409+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(70 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.413+0000 7efeb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.413+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94264174336368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a48540 con 0x55bb969f2be0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.413+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94264174336368] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.413+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94264174314720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a484c0 con 0x7efff8046040 2024-09-12T16:52:24.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.413+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94264174314720] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.413+0000 7f00034649c0 20 remove_watcher() i=0 2024-09-12T16:52:24.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.413+0000 7f00034649c0 2 removed watcher, disabling cache 2024-09-12T16:52:24.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.413+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94264174319552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a004c0 con 0x55bb969f2be0 2024-09-12T16:52:24.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.417+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94264174319552] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.417+0000 7f00034649c0 20 remove_watcher() i=1 2024-09-12T16:52:24.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.417+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94264174312240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a017c0 con 0x55bb969fbda0 2024-09-12T16:52:24.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.417+0000 7f0000f6a640 1 -- 172.21.15.151:0/40744162 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94264174312240] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff801b030 con 0x55bb969fbda0 2024-09-12T16:52:24.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.417+0000 7f00034649c0 20 remove_watcher() i=2 2024-09-12T16:52:24.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.417+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94264174325680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a017c0 con 0x7efff8046040 2024-09-12T16:52:24.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.421+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94264174325680] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x7efff8046040 2024-09-12T16:52:24.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.421+0000 7f00034649c0 20 remove_watcher() i=3 2024-09-12T16:52:24.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.421+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94264174329408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a02fb0 con 0x55bb969f2be0 2024-09-12T16:52:24.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.421+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94264174329408] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe80a8070 con 0x55bb969f2be0 2024-09-12T16:52:24.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.421+0000 7f00034649c0 20 remove_watcher() i=4 2024-09-12T16:52:24.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.421+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94264174331744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a017c0 con 0x55bb969f72b0 2024-09-12T16:52:24.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94264174331744] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 20 remove_watcher() i=5 2024-09-12T16:52:24.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94264174324480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a02fb0 con 0x55bb969f72b0 2024-09-12T16:52:24.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94264174324480] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 20 remove_watcher() i=6 2024-09-12T16:52:24.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94264174333872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb96a04760 con 0x55bb969f72b0 2024-09-12T16:52:24.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f000176b640 1 -- 172.21.15.151:0/40744162 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94264174333872] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff002a070 con 0x55bb969f72b0 2024-09-12T16:52:24.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 20 remove_watcher() i=7 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969f72b0 msgr2=0x55bb969f96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969f72b0 0x55bb969f96a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb969f2be0 msgr2=0x55bb969f5070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb969f2be0 0x55bb969f5070 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efff8046040 msgr2=0x7efff80123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efff8046040 0x7efff80123c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bb969fbda0 msgr2=0x55bb969fe260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.425+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bb969fbda0 0x55bb969fe260 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efecc039a20 msgr2=0x7efecc03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efecc039a20 0x7efecc03bee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efff801dfd0 tx=0x7efff8041000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f0000769640 1 -- 172.21.15.151:0/40744162 reap_dead start 2024-09-12T16:52:24.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 msgr2=0x55bb969e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e78e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efff000afd0 tx=0x7efff00508b0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 shutdown_connections 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/40744162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969e1470 0x55bb969e78e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 >> 172.21.15.151:0/40744162 conn(0x55bb969dc890 msgr2=0x55bb969daaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 shutdown_connections 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/40744162 wait complete. 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/3204728837 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efed8039ac0 msgr2=0x7efed803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/3204728837 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efed8039ac0 0x7efed803bf80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55bb968c3580 tx=0x7efff8014f20 comp rx=0 tx=0).stop 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/3204728837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969d3b00 msgr2=0x55bb969d3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/3204728837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969d3b00 0x55bb969d3f20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55bb968c3bf0 tx=0x7efff000af40 comp rx=0 tx=0).stop 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/3204728837 shutdown_connections 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/3204728837 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efed8039ac0 0x7efed803bf80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/3204728837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb969d3b00 0x55bb969d3f20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/3204728837 >> 172.21.15.151:0/3204728837 conn(0x55bb969c94b0 msgr2=0x55bb969c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/3204728837 shutdown_connections 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/3204728837 wait complete. 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969c29b0 msgr2=0x55bb969c4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969c29b0 0x55bb969c4da0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb968c8350 msgr2=0x55bb969c0240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb968c8350 0x55bb969c0240 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efee8039a70 msgr2=0x7efee803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efee8039a70 0x7efee803bf30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7effe80ac000 tx=0x7effe80a5000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 msgr2=0x55bb968c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb968c4310 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efff80012f0 tx=0x7efff8000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 shutdown_connections 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bb969c29b0 0x55bb969c4da0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bb968c8350 0x55bb969c0240 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efee8039a70 0x7efee803bf30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 --2- 172.21.15.151:0/63625923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb96838200 0x55bb968c4310 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 >> 172.21.15.151:0/63625923 conn(0x55bb968be920 msgr2=0x55bb969a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 shutdown_connections 2024-09-12T16:52:24.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.429+0000 7f00034649c0 1 -- 172.21.15.151:0/63625923 wait complete. 2024-09-12T16:52:24.441 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2480af9e-559e-4103-b02c-bfde6a0f7fec","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","marker":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T16:52:23.731801Z","creation_time":"2024-09-12T16:52:19.907293Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-12T16:52:24.442 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T16:52:23.731801Z', 'creation_time': '2024-09-12T16:52:19.907293Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-12T16:52:24.442 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-12T16:52:24.442 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-12T16:52:24.442 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-12T16:52:24.511 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:24.511 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:24.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745e0e39c0 1 Processor -- start 2024-09-12T16:52:24.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745e0e39c0 1 -- start start 2024-09-12T16:52:24.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745e0e39c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56094d18d0a0 0x56094d18f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745e0e39c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56094d03d9c0 con 0x56094d188f50 2024-09-12T16:52:24.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745e0e39c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56094d08d6d0 con 0x56094d18d0a0 2024-09-12T16:52:24.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745b3e8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56094d18d0a0 0x56094d18f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745bbe9640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x56094d188f50 0x56094d189330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42728/0 (socket says 172.21.15.151:42728) 2024-09-12T16:52:24.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745bbe9640 1 -- 172.21.15.151:0/2459019618 learned_addr learned my addr 172.21.15.151:0/2459019618 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:24.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745b3e8640 1 -- 172.21.15.151:0/2459019618 >> v1:172.21.15.122:6789/0 conn(0x56094d188f50 legacy=0x56094d189330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.509+0000 7f745b3e8640 1 -- 172.21.15.151:0/2459019618 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094d031ca0 con 0x56094d18d0a0 2024-09-12T16:52:24.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745b3e8640 1 --2- 172.21.15.151:0/2459019618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d18d0a0 0x56094d18f490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f744400a480 tx=0x7f744401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246a327ede89fcb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745abe7640 1 -- 172.21.15.151:0/2459019618 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74440aa570 con 0x56094d18d0a0 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745abe7640 1 -- 172.21.15.151:0/2459019618 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74440af070 con 0x56094d18d0a0 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745abe7640 1 -- 172.21.15.151:0/2459019618 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74440aa860 con 0x56094d18d0a0 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2459019618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d18d0a0 msgr2=0x56094d18f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/2459019618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d18d0a0 0x56094d18f490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f744400a480 tx=0x7f744401b310 comp rx=0 tx=0).stop 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2459019618 shutdown_connections 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/2459019618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d18d0a0 0x56094d18f490 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2459019618 >> 172.21.15.151:0/2459019618 conn(0x56094d184a70 msgr2=0x56094d186e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2459019618 shutdown_connections 2024-09-12T16:52:24.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.513+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2459019618 wait complete. 2024-09-12T16:52:24.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.525+0000 7f745e0e39c0 1 Processor -- start 2024-09-12T16:52:24.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.525+0000 7f745e0e39c0 1 -- start start 2024-09-12T16:52:24.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.525+0000 7f745e0e39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d0ff260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.525+0000 7f745e0e39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56094d091680 con 0x56094d188f50 2024-09-12T16:52:24.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d0ff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d0ff260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34346/0 (socket says 172.21.15.151:34346) 2024-09-12T16:52:24.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 -- 172.21.15.151:0/877714568 learned_addr learned my addr 172.21.15.151:0/877714568 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 -- 172.21.15.151:0/877714568 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094d00cda0 con 0x56094d188f50 2024-09-12T16:52:24.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 --2- 172.21.15.151:0/877714568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d0ff260 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f744c001e00 tx=0x7f744c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32c1654da2fbf24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f7349e0b640 1 -- 172.21.15.151:0/877714568 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c012020 con 0x56094d188f50 2024-09-12T16:52:24.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f7349e0b640 1 -- 172.21.15.151:0/877714568 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c00e690 con 0x56094d188f50 2024-09-12T16:52:24.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f7349e0b640 1 -- 172.21.15.151:0/877714568 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c00ea10 con 0x56094d188f50 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 -- 172.21.15.151:0/877714568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 msgr2=0x56094d0ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/877714568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d0ff260 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f744c001e00 tx=0x7f744c00b6d0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 -- 172.21.15.151:0/877714568 shutdown_connections 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/877714568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d0ff260 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 -- 172.21.15.151:0/877714568 >> 172.21.15.151:0/877714568 conn(0x56094d184a70 msgr2=0x56094d2702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 -- 172.21.15.151:0/877714568 shutdown_connections 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 -- 172.21.15.151:0/877714568 wait complete. 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 Processor -- start 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 -- start start 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d27df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745e0e39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56094d033a50 con 0x56094d188f50 2024-09-12T16:52:24.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d27df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d27df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34360/0 (socket says 172.21.15.151:34360) 2024-09-12T16:52:24.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 -- 172.21.15.151:0/3087445310 learned_addr learned my addr 172.21.15.151:0/3087445310 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 -- 172.21.15.151:0/3087445310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094d27e4e0 con 0x56094d188f50 2024-09-12T16:52:24.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.529+0000 7f745bbe9640 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d27df80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x56094d0fedc0 tx=0x7f744c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f7343fff640 1 -- 172.21.15.151:0/3087445310 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c012030 con 0x56094d188f50 2024-09-12T16:52:24.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56094d27e770 con 0x56094d188f50 2024-09-12T16:52:24.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f7343fff640 1 -- 172.21.15.151:0/3087445310 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c01a750 con 0x56094d188f50 2024-09-12T16:52:24.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f7343fff640 1 -- 172.21.15.151:0/3087445310 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c01aa50 con 0x56094d188f50 2024-09-12T16:52:24.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094d27f120 con 0x56094d188f50 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f7343fff640 1 -- 172.21.15.151:0/3087445310 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f744c015020 con 0x56094d188f50 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f7343fff640 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7344039a70 0x7f734403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f7343fff640 1 -- 172.21.15.151:0/3087445310 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f744c020030 con 0x56094d188f50 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745b3e8640 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7344039a70 0x7f734403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d18d0a0 0x56094d2850f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d285630 con 0x56094d18d0a0 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745c3ea640 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d18d0a0 0x56094d2850f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745b3e8640 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7344039a70 0x7f734403bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74440ae000 tx=0x7f74440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745c3ea640 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d18d0a0 0x56094d2850f0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745c3ea640 1 -- 172.21.15.151:0/3087445310 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f745400a4d0 con 0x56094d18d0a0 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d285a80 con 0x56094d18d0a0 2024-09-12T16:52:24.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745c3ea640 1 -- 172.21.15.151:0/3087445310 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f745400a4d0 con 0x56094d18d0a0 2024-09-12T16:52:24.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d287890 0x56094d289c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d28a350 con 0x56094d287890 2024-09-12T16:52:24.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745bbe9640 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d287890 0x56094d289c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.533+0000 7f745bbe9640 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d287890 0x56094d289c80 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745bbe9640 1 -- 172.21.15.151:0/3087445310 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f744c008030 con 0x56094d287890 2024-09-12T16:52:24.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d286730 con 0x56094d18d0a0 2024-09-12T16:52:24.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745c3ea640 1 -- 172.21.15.151:0/3087445310 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f745400a4d0 con 0x56094d18d0a0 2024-09-12T16:52:24.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d286bd0 con 0x56094d18d0a0 2024-09-12T16:52:24.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745c3ea640 1 -- 172.21.15.151:0/3087445310 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f745400a4d0 con 0x56094d18d0a0 2024-09-12T16:52:24.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745e0e39c0 1 Processor -- start 2024-09-12T16:52:24.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745e0e39c0 1 -- start start 2024-09-12T16:52:24.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745e0e39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2989c0 0x56094d298de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745e0e39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56094d09e450 con 0x56094d2989c0 2024-09-12T16:52:24.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745c3ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2989c0 0x56094d298de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745c3ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2989c0 0x56094d298de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34376/0 (socket says 172.21.15.151:34376) 2024-09-12T16:52:24.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745c3ea640 1 -- 172.21.15.151:0/2576278058 learned_addr learned my addr 172.21.15.151:0/2576278058 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745c3ea640 1 -- 172.21.15.151:0/2576278058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094d299420 con 0x56094d2989c0 2024-09-12T16:52:24.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745c3ea640 1 --2- 172.21.15.151:0/2576278058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2989c0 0x56094d298de0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x56094d2800a0 tx=0x7f7454018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f73417fa640 1 -- 172.21.15.151:0/2576278058 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454014450 con 0x56094d2989c0 2024-09-12T16:52:24.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2576278058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56094d299c80 con 0x56094d2989c0 2024-09-12T16:52:24.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f73417fa640 1 -- 172.21.15.151:0/2576278058 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74540145f0 con 0x56094d2989c0 2024-09-12T16:52:24.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f73417fa640 1 -- 172.21.15.151:0/2576278058 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454014910 con 0x56094d2989c0 2024-09-12T16:52:24.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.537+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2576278058 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094d29a1f0 con 0x56094d2989c0 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f73417fa640 1 -- 172.21.15.151:0/2576278058 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7454011040 con 0x56094d2989c0 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f73417fa640 1 --2- 172.21.15.151:0/2576278058 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7334039a70 0x7f733403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f73417fa640 1 -- 172.21.15.151:0/2576278058 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f745401e070 con 0x56094d2989c0 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745bbe9640 1 --2- 172.21.15.151:0/2576278058 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7334039a70 0x7f733403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 Processor -- start 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 -- start start 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745bbe9640 1 --2- 172.21.15.151:0/2576278058 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7334039a70 0x7f733403bf30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x56094d27f410 tx=0x7f744c02c950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56094d0ffab0 con 0x56094d2a52d0 2024-09-12T16:52:24.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745c3ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745c3ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2a56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34384/0 (socket says 172.21.15.151:34384) 2024-09-12T16:52:24.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745c3ea640 1 -- 172.21.15.151:0/73533970 learned_addr learned my addr 172.21.15.151:0/73533970 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745c3ea640 1 -- 172.21.15.151:0/73533970 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094d2a5c80 con 0x56094d2a52d0 2024-09-12T16:52:24.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745c3ea640 1 --2- 172.21.15.151:0/73533970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2a56b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7454016fd0 tx=0x7f7454001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2638177f403d7236 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f733affd640 1 -- 172.21.15.151:0/73533970 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454028070 con 0x56094d2a52d0 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f733affd640 1 -- 172.21.15.151:0/73533970 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7454022dc0 con 0x56094d2a52d0 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f733affd640 1 -- 172.21.15.151:0/73533970 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74540167c0 con 0x56094d2a52d0 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 -- 172.21.15.151:0/73533970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 msgr2=0x56094d2a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/73533970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2a56b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7454016fd0 tx=0x7f7454001450 comp rx=0 tx=0).stop 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 -- 172.21.15.151:0/73533970 shutdown_connections 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/73533970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2a56b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 -- 172.21.15.151:0/73533970 >> 172.21.15.151:0/73533970 conn(0x56094d2a1700 msgr2=0x56094d29f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 -- 172.21.15.151:0/73533970 shutdown_connections 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 -- 172.21.15.151:0/73533970 wait complete. 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.541+0000 7f745e0e39c0 1 Processor -- start 2024-09-12T16:52:24.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 1 -- start start 2024-09-12T16:52:24.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56094d2a62e0 con 0x56094d2a52d0 2024-09-12T16:52:24.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745c3ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745c3ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2ac780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34402/0 (socket says 172.21.15.151:34402) 2024-09-12T16:52:24.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 learned_addr learned my addr 172.21.15.151:0/1251809595 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094d2acce0 con 0x56094d2a52d0 2024-09-12T16:52:24.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745c3ea640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2ac780 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7454001490 tx=0x7f74540506d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f73397fa640 1 -- 172.21.15.151:0/1251809595 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454032030 con 0x56094d2a52d0 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56094d2acf70 con 0x56094d2a52d0 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094d2ad920 con 0x56094d2a52d0 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f73397fa640 1 -- 172.21.15.151:0/1251809595 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745404f280 con 0x56094d2a52d0 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f73397fa640 1 -- 172.21.15.151:0/1251809595 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454050880 con 0x56094d2a52d0 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f73397fa640 1 -- 172.21.15.151:0/1251809595 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7454035070 con 0x56094d2a52d0 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f73397fa640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7324039a70 0x7f732403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f73397fa640 1 -- 172.21.15.151:0/1251809595 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7454033070 con 0x56094d2a52d0 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745bbe9640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7324039a70 0x7f732403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d2b7c40 0x56094d2ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2ba820 con 0x56094d2b7c40 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745b3e8640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d2b7c40 0x56094d2ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745bbe9640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7324039a70 0x7f732403bf30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f744c00b710 tx=0x7f744c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745b3e8640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d2b7c40 0x56094d2ba0d0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 20 realm 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.545+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bac50 con 0x56094d2b7c40 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bb520 con 0x56094d2b7c40 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bb8c0 con 0x56094d2b7c40 2024-09-12T16:52:24.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d2bc620 0x56094d2bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bef50 con 0x56094d2bc620 2024-09-12T16:52:24.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745c3ea640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d2bc620 0x56094d2bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745c3ea640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d2bc620 0x56094d2bea10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 20 searching for the correct realm 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56094d2c0ea0 0x56094d2c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745bbe9640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56094d2c0ea0 0x56094d2c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745bbe9640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56094d2c0ea0 0x56094d2c3360 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745bbe9640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f744c017050 0x7f744c04d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x7f744c017050 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745b3e8640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f744c017050 0x7f744c04d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745b3e8640 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f744c017050 0x7f744c04d3b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.549+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2b7c40 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2b7c40 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x7f744c017050 2024-09-12T16:52:24.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2b7c40 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2b7c40 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.553+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x7f744c017050 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2b7c40 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2b7c40 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x7f744c017050 2024-09-12T16:52:24.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2b7c40 2024-09-12T16:52:24.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.557+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x7f744c017050 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2c0ea0 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2bc620 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x56094d2b7c40 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3a30 con 0x7f744c017050 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bf8a0 con 0x56094d2b7c40 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2b7c40 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.561+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c01d0 con 0x56094d2b7c40 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 zone default found 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 4 Realm: () 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:24.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 zonegroup default 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c3eb0 con 0x56094d2bc620 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c60f0 con 0x56094d2c0ea0 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c6490 con 0x56094d2c0ea0 2024-09-12T16:52:24.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 started sync module instance, tier type = 2024-09-12T16:52:24.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:24.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c5530 con 0x7f744c017050 2024-09-12T16:52:24.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94597949446704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c5530 con 0x7f744c017050 2024-09-12T16:52:24.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c6e50 con 0x56094d2b7c40 2024-09-12T16:52:24.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.565+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94597949446704] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.569+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.569+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94597949450928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c5530 con 0x56094d2b7c40 2024-09-12T16:52:24.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.569+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c7860 con 0x56094d2c0ea0 2024-09-12T16:52:24.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.569+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94597949450928] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.569+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.569+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94597949444224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c54a0 con 0x56094d2c0ea0 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.569+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c8560 con 0x7f744c017050 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.573+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.573+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94597949456832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c8e00 con 0x7f744c017050 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.573+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c97c0 con 0x56094d2b7c40 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.573+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94597949444224] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.573+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94597949456832] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.573+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.573+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94597949461264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c8d70 con 0x56094d2b7c40 2024-09-12T16:52:24.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.573+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c9730 con 0x56094d2bc620 2024-09-12T16:52:24.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.577+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94597949461264] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.577+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.577+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94597949458928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2ca060 con 0x56094d2bc620 2024-09-12T16:52:24.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.577+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2ca8f0 con 0x56094d2bc620 2024-09-12T16:52:24.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.577+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.577+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94597949464672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2caf80 con 0x56094d2bc620 2024-09-12T16:52:24.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.577+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2cb940 con 0x56094d2bc620 2024-09-12T16:52:24.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.577+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94597949458928] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94597949463472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2cb940 con 0x56094d2bc620 2024-09-12T16:52:24.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 add_watcher() i=0 2024-09-12T16:52:24.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 add_watcher() i=1 2024-09-12T16:52:24.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 add_watcher() i=2 2024-09-12T16:52:24.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 add_watcher() i=3 2024-09-12T16:52:24.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 add_watcher() i=4 2024-09-12T16:52:24.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 add_watcher() i=5 2024-09-12T16:52:24.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94597949464672] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 add_watcher() i=6 2024-09-12T16:52:24.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94597949463472] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 add_watcher() i=7 2024-09-12T16:52:24.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:24.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56094d2ce970 con 0x56094d2b7c40 2024-09-12T16:52:24.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94597949469840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2cbd60 con 0x56094d2b7c40 2024-09-12T16:52:24.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94597949469840] v32'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f7311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:24.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:24.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.581+0000 7f745e0e39c0 5 note: GC not initialized 2024-09-12T16:52:24.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f7310fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:24.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745e0e39c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:24.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745e0e39c0 20 Filter name: none 2024-09-12T16:52:24.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f728a7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:24.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2f1120 con 0x56094d2bc620 2024-09-12T16:52:24.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c9730 con 0x56094d2bc620 2024-09-12T16:52:24.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c9730 con 0x56094d2c0ea0 2024-09-12T16:52:24.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c54a0 con 0x56094d2bc620 2024-09-12T16:52:24.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.585+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c54a0 con 0x56094d2b7c40 2024-09-12T16:52:24.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x7f744c017050 2024-09-12T16:52:24.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x7f744c017050 2024-09-12T16:52:24.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x7f744c017050 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'13 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2b7c40 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2b7c40 2024-09-12T16:52:24.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.589+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2b7c40 2024-09-12T16:52:24.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x7f744c017050 2024-09-12T16:52:24.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x7f744c017050 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2b7c40 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2bc620 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x7f744c017050 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2bc620 2024-09-12T16:52:24.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.593+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2c0ea0 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2b7c40 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x7f744c017050 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56094d2bfcf0 con 0x56094d2bc620 2024-09-12T16:52:24.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.600 INFO:teuthology.orchestra.run.smithi151.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-12T16:52:24.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f7311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.597+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94597949469840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2ef420 con 0x56094d2b7c40 2024-09-12T16:52:24.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94597949469840] v32'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94597949446704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2f0a80 con 0x7f744c017050 2024-09-12T16:52:24.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94597949446704] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745e0e39c0 20 remove_watcher() i=0 2024-09-12T16:52:24.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745e0e39c0 2 removed watcher, disabling cache 2024-09-12T16:52:24.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94597949450928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c5a30 con 0x56094d2b7c40 2024-09-12T16:52:24.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94597949450928] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745e0e39c0 20 remove_watcher() i=1 2024-09-12T16:52:24.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.601+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94597949444224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c6ab0 con 0x56094d2c0ea0 2024-09-12T16:52:24.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.605+0000 7f745bbe9640 1 -- 172.21.15.151:0/1251809595 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94597949444224] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c008030 con 0x56094d2c0ea0 2024-09-12T16:52:24.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.605+0000 7f745e0e39c0 20 remove_watcher() i=2 2024-09-12T16:52:24.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.605+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94597949456832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2f0a80 con 0x7f744c017050 2024-09-12T16:52:24.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.605+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94597949456832] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x7f744c017050 2024-09-12T16:52:24.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.605+0000 7f745e0e39c0 20 remove_watcher() i=3 2024-09-12T16:52:24.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.605+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94597949461264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c81c0 con 0x56094d2b7c40 2024-09-12T16:52:24.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94597949461264] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74440a8070 con 0x56094d2b7c40 2024-09-12T16:52:24.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745e0e39c0 20 remove_watcher() i=4 2024-09-12T16:52:24.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94597949458928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c81c0 con 0x56094d2bc620 2024-09-12T16:52:24.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94597949458928] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745e0e39c0 20 remove_watcher() i=5 2024-09-12T16:52:24.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94597949464672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c81c0 con 0x56094d2bc620 2024-09-12T16:52:24.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94597949464672] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745e0e39c0 20 remove_watcher() i=6 2024-09-12T16:52:24.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.609+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94597949463472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56094d2c81c0 con 0x56094d2bc620 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745c3ea640 1 -- 172.21.15.151:0/1251809595 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94597949463472] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454049d70 con 0x56094d2bc620 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 20 remove_watcher() i=7 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d2bc620 msgr2=0x56094d2bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d2bc620 0x56094d2bea10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d2b7c40 msgr2=0x56094d2ba0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d2b7c40 0x56094d2ba0d0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f744c017050 msgr2=0x7f744c04d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f744c017050 0x7f744c04d3b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56094d2c0ea0 msgr2=0x56094d2c3360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56094d2c0ea0 0x56094d2c3360 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7324039a70 msgr2=0x7f732403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7324039a70 0x7f732403bf30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f744c00b710 tx=0x7f744c02f000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745b3e8640 1 -- 172.21.15.151:0/1251809595 reap_dead start 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 msgr2=0x56094d2ac780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2ac780 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7454001490 tx=0x7f74540506d0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 shutdown_connections 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/1251809595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2a52d0 0x56094d2ac780 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 >> 172.21.15.151:0/1251809595 conn(0x56094d2a1700 msgr2=0x56094d29f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 shutdown_connections 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/1251809595 wait complete. 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2576278058 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7334039a70 msgr2=0x7f733403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/2576278058 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7334039a70 0x7f733403bf30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x56094d27f410 tx=0x7f744c02c950 comp rx=0 tx=0).stop 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2576278058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2989c0 msgr2=0x56094d298de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/2576278058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2989c0 0x56094d298de0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x56094d2800a0 tx=0x7f7454018830 comp rx=0 tx=0).stop 2024-09-12T16:52:24.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2576278058 shutdown_connections 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/2576278058 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7334039a70 0x7f733403bf30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/2576278058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d2989c0 0x56094d298de0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2576278058 >> 172.21.15.151:0/2576278058 conn(0x56094d28e370 msgr2=0x56094d28e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2576278058 shutdown_connections 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/2576278058 wait complete. 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d287890 msgr2=0x56094d289c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d287890 0x56094d289c80 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d18d0a0 msgr2=0x56094d2850f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d18d0a0 0x56094d2850f0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7344039a70 msgr2=0x7f734403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7344039a70 0x7f734403bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74440ae000 tx=0x7f74440a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 msgr2=0x56094d27df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d27df80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x56094d0fedc0 tx=0x7f744c000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 shutdown_connections 2024-09-12T16:52:24.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56094d287890 0x56094d289c80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56094d18d0a0 0x56094d2850f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7344039a70 0x7f734403bf30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 --2- 172.21.15.151:0/3087445310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094d188f50 0x56094d27df80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 >> 172.21.15.151:0/3087445310 conn(0x56094d184a70 msgr2=0x56094d0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 shutdown_connections 2024-09-12T16:52:24.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.613+0000 7f745e0e39c0 1 -- 172.21.15.151:0/3087445310 wait complete. 2024-09-12T16:52:24.626 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-12T16:52:24.627 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-12T16:52:24.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-12T16:52:24.627 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-12T16:52:24.703 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:24.704 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:24.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f068b5a59c0 1 Processor -- start 2024-09-12T16:52:24.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f068b5a59c0 1 -- start start 2024-09-12T16:52:24.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f068b5a59c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e214014350 0x55e214016740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f068b5a59c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e213ec29c0 con 0x55e214010200 2024-09-12T16:52:24.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f068b5a59c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55e213f126d0 con 0x55e214014350 2024-09-12T16:52:24.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f06888aa640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e214014350 0x55e214016740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f06890ab640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55e214010200 0x55e2140105e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42740/0 (socket says 172.21.15.151:42740) 2024-09-12T16:52:24.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f06890ab640 1 -- 172.21.15.151:0/1005385938 learned_addr learned my addr 172.21.15.151:0/1005385938 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:24.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f06888aa640 1 -- 172.21.15.151:0/1005385938 >> v1:172.21.15.122:6789/0 conn(0x55e214010200 legacy=0x55e2140105e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.701+0000 7f06888aa640 1 -- 172.21.15.151:0/1005385938 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e213eb6ca0 con 0x55e214014350 2024-09-12T16:52:24.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f06888aa640 1 --2- 172.21.15.151:0/1005385938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214014350 0x55e214016740 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f067400a480 tx=0x7f067401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415b0f0b7d068576 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f0683fff640 1 -- 172.21.15.151:0/1005385938 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06740aa570 con 0x55e214014350 2024-09-12T16:52:24.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f0683fff640 1 -- 172.21.15.151:0/1005385938 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06740af070 con 0x55e214014350 2024-09-12T16:52:24.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f0683fff640 1 -- 172.21.15.151:0/1005385938 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06740aa860 con 0x55e214014350 2024-09-12T16:52:24.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1005385938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214014350 msgr2=0x55e214016740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1005385938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214014350 0x55e214016740 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f067400a480 tx=0x7f067401b310 comp rx=0 tx=0).stop 2024-09-12T16:52:24.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1005385938 shutdown_connections 2024-09-12T16:52:24.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1005385938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214014350 0x55e214016740 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1005385938 >> 172.21.15.151:0/1005385938 conn(0x55e213f83b10 msgr2=0x55e213f83f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1005385938 shutdown_connections 2024-09-12T16:52:24.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.705+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1005385938 wait complete. 2024-09-12T16:52:24.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 Processor -- start 2024-09-12T16:52:24.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- start start 2024-09-12T16:52:24.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e2140fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e213f16680 con 0x55e214010200 2024-09-12T16:52:24.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f06890ab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e2140fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f06890ab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e2140fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34428/0 (socket says 172.21.15.151:34428) 2024-09-12T16:52:24.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f06890ab640 1 -- 172.21.15.151:0/646794498 learned_addr learned my addr 172.21.15.151:0/646794498 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f06890ab640 1 -- 172.21.15.151:0/646794498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e213e91da0 con 0x55e214010200 2024-09-12T16:52:24.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f06890ab640 1 --2- 172.21.15.151:0/646794498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e2140fb8a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f067c001e00 tx=0x7f067c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5f190827500985 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f0577606640 1 -- 172.21.15.151:0/646794498 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c012020 con 0x55e214010200 2024-09-12T16:52:24.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f0577606640 1 -- 172.21.15.151:0/646794498 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c00e690 con 0x55e214010200 2024-09-12T16:52:24.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f0577606640 1 -- 172.21.15.151:0/646794498 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c00ea10 con 0x55e214010200 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- 172.21.15.151:0/646794498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 msgr2=0x55e2140fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/646794498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e2140fb8a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f067c001e00 tx=0x7f067c00b6d0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- 172.21.15.151:0/646794498 shutdown_connections 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/646794498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e2140fb8a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- 172.21.15.151:0/646794498 >> 172.21.15.151:0/646794498 conn(0x55e213f83b10 msgr2=0x55e2140f74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- 172.21.15.151:0/646794498 shutdown_connections 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- 172.21.15.151:0/646794498 wait complete. 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 Processor -- start 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- start start 2024-09-12T16:52:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e214102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.721+0000 7f068b5a59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e213eb8a50 con 0x55e214010200 2024-09-12T16:52:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06890ab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e214102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06890ab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e214102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34444/0 (socket says 172.21.15.151:34444) 2024-09-12T16:52:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06890ab640 1 -- 172.21.15.151:0/3267681650 learned_addr learned my addr 172.21.15.151:0/3267681650 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06890ab640 1 -- 172.21.15.151:0/3267681650 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2141034f0 con 0x55e214010200 2024-09-12T16:52:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06890ab640 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e214102f90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x55e2140fc830 tx=0x7f067c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f0575e03640 1 -- 172.21.15.151:0/3267681650 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c012030 con 0x55e214010200 2024-09-12T16:52:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e214103780 con 0x55e214010200 2024-09-12T16:52:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f0575e03640 1 -- 172.21.15.151:0/3267681650 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c001460 con 0x55e214010200 2024-09-12T16:52:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f0575e03640 1 -- 172.21.15.151:0/3267681650 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c01a7a0 con 0x55e214010200 2024-09-12T16:52:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e214104130 con 0x55e214010200 2024-09-12T16:52:24.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f0575e03640 1 -- 172.21.15.151:0/3267681650 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f067c015020 con 0x55e214010200 2024-09-12T16:52:24.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f0575e03640 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0570039ac0 0x7f057003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f0575e03640 1 -- 172.21.15.151:0/3267681650 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f067c020030 con 0x55e214010200 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06888aa640 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0570039ac0 0x7f057003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e214014350 0x55e21410a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21410a640 con 0x55e214014350 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06898ac640 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e214014350 0x55e21410a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06888aa640 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0570039ac0 0x7f057003bf80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f06740ae000 tx=0x7f06740a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.725+0000 7f06898ac640 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e214014350 0x55e21410a100 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06898ac640 1 -- 172.21.15.151:0/3267681650 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f068400a4d0 con 0x55e214014350 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2141044a0 con 0x55e214014350 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06898ac640 1 -- 172.21.15.151:0/3267681650 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f068400a4d0 con 0x55e214014350 2024-09-12T16:52:24.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e21410c8e0 0x55e21410ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21410f3a0 con 0x55e21410c8e0 2024-09-12T16:52:24.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06890ab640 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e21410c8e0 0x55e21410ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06890ab640 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e21410c8e0 0x55e21410ecd0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06890ab640 1 -- 172.21.15.151:0/3267681650 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f067c008030 con 0x55e21410c8e0 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21410b780 con 0x55e214014350 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06898ac640 1 -- 172.21.15.151:0/3267681650 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f068400a4d0 con 0x55e214014350 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21410bc20 con 0x55e214014350 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06898ac640 1 -- 172.21.15.151:0/3267681650 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f068400a4d0 con 0x55e214014350 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 Processor -- start 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 -- start start 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21411da10 0x55e21411de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f068b5a59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e213f23450 con 0x55e21411da10 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06898ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21411da10 0x55e21411de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06898ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21411da10 0x55e21411de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34454/0 (socket says 172.21.15.151:34454) 2024-09-12T16:52:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.729+0000 7f06898ac640 1 -- 172.21.15.151:0/3628840513 learned_addr learned my addr 172.21.15.151:0/3628840513 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06898ac640 1 -- 172.21.15.151:0/3628840513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21411e470 con 0x55e21411da10 2024-09-12T16:52:24.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06898ac640 1 --2- 172.21.15.151:0/3628840513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21411da10 0x55e21411de30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55e2141050f0 tx=0x7f0684018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f056effd640 1 -- 172.21.15.151:0/3628840513 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0684014450 con 0x55e21411da10 2024-09-12T16:52:24.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f056effd640 1 -- 172.21.15.151:0/3628840513 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06840145f0 con 0x55e21411da10 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f056effd640 1 -- 172.21.15.151:0/3628840513 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0684014910 con 0x55e21411da10 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3628840513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e21411ecd0 con 0x55e21411da10 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3628840513 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e21411f240 con 0x55e21411da10 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f056effd640 1 -- 172.21.15.151:0/3628840513 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0684011040 con 0x55e21411da10 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f056effd640 1 --2- 172.21.15.151:0/3628840513 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0560039a70 0x7f056003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f056effd640 1 -- 172.21.15.151:0/3628840513 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f068401e070 con 0x55e21411da10 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06890ab640 1 --2- 172.21.15.151:0/3628840513 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0560039a70 0x7f056003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f068b5a59c0 1 Processor -- start 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06890ab640 1 --2- 172.21.15.151:0/3628840513 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0560039a70 0x7f056003bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55e21410aa50 tx=0x7f067c00c630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f068b5a59c0 1 -- start start 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f068b5a59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e21412b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f068b5a59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e2140fc0f0 con 0x55e21412b340 2024-09-12T16:52:24.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06898ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e21412b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06898ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e21412b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34468/0 (socket says 172.21.15.151:34468) 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06898ac640 1 -- 172.21.15.151:0/3716257834 learned_addr learned my addr 172.21.15.151:0/3716257834 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06898ac640 1 -- 172.21.15.151:0/3716257834 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21412bd30 con 0x55e21412b340 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.733+0000 7f06898ac640 1 --2- 172.21.15.151:0/3716257834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e21412b740 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0684050740 tx=0x7f0684011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40f3d9b38f1dbdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f056cff9640 1 -- 172.21.15.151:0/3716257834 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0684028070 con 0x55e21412b340 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f056cff9640 1 -- 172.21.15.151:0/3716257834 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06840520d0 con 0x55e21412b340 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f056cff9640 1 -- 172.21.15.151:0/3716257834 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06840167c0 con 0x55e21412b340 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3716257834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 msgr2=0x55e21412b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3716257834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e21412b740 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0684050740 tx=0x7f0684011a80 comp rx=0 tx=0).stop 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3716257834 shutdown_connections 2024-09-12T16:52:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3716257834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e21412b740 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3716257834 >> 172.21.15.151:0/3716257834 conn(0x55e214126760 msgr2=0x55e2141249a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3716257834 shutdown_connections 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3716257834 wait complete. 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 Processor -- start 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- start start 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e2141317c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e21412a290 con 0x55e21412b340 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f06898ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e2141317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f06898ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e2141317c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34476/0 (socket says 172.21.15.151:34476) 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 learned_addr learned my addr 172.21.15.151:0/1091298934 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e214131d20 con 0x55e21412b340 2024-09-12T16:52:24.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f06898ac640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e2141317c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0684022ff0 tx=0x7f06840506a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f055effd640 1 -- 172.21.15.151:0/1091298934 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0684032030 con 0x55e21412b340 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e214131fb0 con 0x55e21412b340 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f055effd640 1 -- 172.21.15.151:0/1091298934 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06840520d0 con 0x55e21412b340 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e214132960 con 0x55e21412b340 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f055effd640 1 -- 172.21.15.151:0/1091298934 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0684050850 con 0x55e21412b340 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.737+0000 7f055effd640 1 -- 172.21.15.151:0/1091298934 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0684035070 con 0x55e21412b340 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f055effd640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0554039a70 0x7f055403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f055effd640 1 -- 172.21.15.151:0/1091298934 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0684033070 con 0x55e21412b340 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06890ab640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0554039a70 0x7f055403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e21413cd30 0x55e21413f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21413f910 con 0x55e21413cd30 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06888aa640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e21413cd30 0x55e21413f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06890ab640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0554039a70 0x7f055403bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f067c04eb30 tx=0x7f067c04b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06888aa640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e21413cd30 0x55e21413f1c0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 realm 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21413fd40 con 0x55e21413cd30 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214140610 con 0x55e21413cd30 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2141409b0 con 0x55e21413cd30 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e214141710 0x55e214143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214144110 con 0x55e214141710 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06898ac640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e214141710 0x55e214143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06898ac640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e214141710 0x55e214143b00 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:24.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 20 searching for the correct realm 2024-09-12T16:52:24.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e214145ff0 0x55e214148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06890ab640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e214145ff0 0x55e214148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.741+0000 7f06890ab640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e214145ff0 0x55e214148460 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06890ab640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f067c017050 0x7f067c00c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x7f067c017050 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f067c017050 0x7f067c00c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f067c017050 0x7f067c00c760 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e21413cd30 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e21413cd30 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x7f067c017050 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e21413cd30 2024-09-12T16:52:24.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.745+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e21413cd30 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x7f067c017050 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e21413cd30 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e21413cd30 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.749+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x7f067c017050 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e21413cd30 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x7f067c017050 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214145ff0 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e214141710 2024-09-12T16:52:24.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x55e21413cd30 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e214148b30 con 0x7f067c017050 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f068b5a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f068b5a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f068b5a59c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f068b5a59c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f068b5a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f068b5a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.753+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214144a60 con 0x55e21413cd30 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214144670 con 0x55e21413cd30 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2141453d0 con 0x55e21413cd30 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 zone default found 2024-09-12T16:52:24.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 4 Realm: () 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 zonegroup default 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214148fb0 con 0x55e214141710 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21414b1f0 con 0x55e214145ff0 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21414b590 con 0x55e214145ff0 2024-09-12T16:52:24.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 started sync module instance, tier type = 2024-09-12T16:52:24.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:24.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414a6d0 con 0x7f067c017050 2024-09-12T16:52:24.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94429487868928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414a6d0 con 0x7f067c017050 2024-09-12T16:52:24.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.757+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414c0d0 con 0x55e21413cd30 2024-09-12T16:52:24.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.761+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94429487868928] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.761+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.761+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94429487872928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414a6d0 con 0x55e21413cd30 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.761+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414cae0 con 0x55e214145ff0 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.761+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94429487872928] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.761+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.761+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94429487866400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414a640 con 0x55e214145ff0 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.761+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414d830 con 0x7f067c017050 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.765+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.765+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94429487879312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414dee0 con 0x7f067c017050 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.765+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414ea00 con 0x55e21413cd30 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.765+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94429487879312] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.765+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94429487866400] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.765+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.765+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94429487877840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414e9c0 con 0x55e21413cd30 2024-09-12T16:52:24.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.765+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414f2a0 con 0x55e214141710 2024-09-12T16:52:24.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.769+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94429487877840] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.769+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.769+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94429487885808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414e9c0 con 0x55e214141710 2024-09-12T16:52:24.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.769+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414faf0 con 0x55e214141710 2024-09-12T16:52:24.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.769+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.769+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94429487887936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e21414ff70 con 0x55e214141710 2024-09-12T16:52:24.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.769+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e214150a80 con 0x55e214141710 2024-09-12T16:52:24.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.769+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94429487885808] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94429487887936] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94429487888992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e214150a40 con 0x55e214141710 2024-09-12T16:52:24.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 20 add_watcher() i=0 2024-09-12T16:52:24.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 20 add_watcher() i=1 2024-09-12T16:52:24.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 20 add_watcher() i=2 2024-09-12T16:52:24.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 20 add_watcher() i=3 2024-09-12T16:52:24.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 20 add_watcher() i=4 2024-09-12T16:52:24.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 20 add_watcher() i=5 2024-09-12T16:52:24.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 20 add_watcher() i=6 2024-09-12T16:52:24.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94429487888992] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 20 add_watcher() i=7 2024-09-12T16:52:24.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:24.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e21414e4d0 con 0x55e21413cd30 2024-09-12T16:52:24.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.773+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94429487883472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e214150ed0 con 0x55e21413cd30 2024-09-12T16:52:24.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94429487883472] v32'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f053f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:24.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 5 note: GC not initialized 2024-09-12T16:52:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f053e7e4640 20 reqs_thread_entry: start 2024-09-12T16:52:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 Filter name: none 2024-09-12T16:52:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f04affff640 20 reqs_thread_entry: start 2024-09-12T16:52:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214176be0 con 0x55e21413cd30 2024-09-12T16:52:24.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:24.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:24.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:24.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:24.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214176640 con 0x7f067c017050 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 disabling bucket name=myfoo 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214176640 con 0x7f067c017050 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e214178dc0 con 0x55e214141710 2024-09-12T16:52:24.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(65 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:24.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:24.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:24.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:24.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:24.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:24.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.777+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e214181340 con 0x55e214141710 2024-09-12T16:52:24.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(66 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:24.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:24.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:24.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1, ofs0, ns] 2024-09-12T16:52:24.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94429488057712 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2141800e0 con 0x55e21413cd30 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== watch-notify(notify (1) cookie 94429487872928 notify 137438953497 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55e213eb6ca0 con 0x55e21413cd30 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f056cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94429487872928 notifier 4593 bl.length()=760 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f056cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f056cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f056cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(67 notify.1 [notify cookie 94429488057712 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f056cff9640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f054c003eb0 con 0x55e21413cd30 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== watch-notify(notify_complete (2) cookie 94429488057712 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f06740d8c40 con 0x55e21413cd30 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_sources= new_sources= 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential sources added=[] removed=[] 2024-09-12T16:52:24.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_dests= new_dests= 2024-09-12T16:52:24.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential dests added=[] removed=[] 2024-09-12T16:52:24.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e214178d70 con 0x55e21413cd30 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94429488057712 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2141796e0 con 0x55e21413cd30 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== watch-notify(notify (1) cookie 94429487877840 notify 137438953498 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f06740d8c40 con 0x55e21413cd30 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f055ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94429487877840 notifier 4593 bl.length()=567 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f055ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f055ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:24.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(70 notify.4 [notify cookie 94429488057712 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f055ffff640 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f04bc003440 con 0x55e21413cd30 2024-09-12T16:52:24.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.781+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== watch-notify(notify_complete (2) cookie 94429488057712 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f06740e05e0 con 0x55e21413cd30 2024-09-12T16:52:24.788 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:24.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.785+0000 7f053f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.785+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94429487883472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x55e21413cd30 2024-09-12T16:52:24.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.785+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94429487883472] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.785+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94429487868928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x7f067c017050 2024-09-12T16:52:24.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.785+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94429487868928] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.785+0000 7f068b5a59c0 20 remove_watcher() i=0 2024-09-12T16:52:24.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.785+0000 7f068b5a59c0 2 removed watcher, disabling cache 2024-09-12T16:52:24.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.785+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94429487872928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x55e21413cd30 2024-09-12T16:52:24.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94429487872928] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f068b5a59c0 20 remove_watcher() i=1 2024-09-12T16:52:24.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94429487866400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x55e214145ff0 2024-09-12T16:52:24.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f06890ab640 1 -- 172.21.15.151:0/1091298934 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94429487866400] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f067c036040 con 0x55e214145ff0 2024-09-12T16:52:24.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f068b5a59c0 20 remove_watcher() i=2 2024-09-12T16:52:24.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94429487879312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x7f067c017050 2024-09-12T16:52:24.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94429487879312] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x7f067c017050 2024-09-12T16:52:24.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f068b5a59c0 20 remove_watcher() i=3 2024-09-12T16:52:24.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.789+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94429487877840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x55e21413cd30 2024-09-12T16:52:24.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.793+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94429487877840] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06740a8070 con 0x55e21413cd30 2024-09-12T16:52:24.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.793+0000 7f068b5a59c0 20 remove_watcher() i=4 2024-09-12T16:52:24.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.793+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94429487885808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x55e214141710 2024-09-12T16:52:24.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.793+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94429487885808] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.793+0000 7f068b5a59c0 20 remove_watcher() i=5 2024-09-12T16:52:24.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.793+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94429487887936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x55e214141710 2024-09-12T16:52:24.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.797+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94429487887936] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.797+0000 7f068b5a59c0 20 remove_watcher() i=6 2024-09-12T16:52:24.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.797+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94429487888992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2141749f0 con 0x55e214141710 2024-09-12T16:52:24.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f06898ac640 1 -- 172.21.15.151:0/1091298934 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94429487888992] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f068402a070 con 0x55e214141710 2024-09-12T16:52:24.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 20 remove_watcher() i=7 2024-09-12T16:52:24.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e214141710 msgr2=0x55e214143b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e214141710 0x55e214143b00 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e21413cd30 msgr2=0x55e21413f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e21413cd30 0x55e21413f1c0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f067c017050 msgr2=0x7f067c00c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f067c017050 0x7f067c00c760 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e214145ff0 msgr2=0x55e214148460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e214145ff0 0x55e214148460 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0554039a70 msgr2=0x7f055403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0554039a70 0x7f055403bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f067c04eb30 tx=0x7f067c04b000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f06888aa640 1 -- 172.21.15.151:0/1091298934 reap_dead start 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 msgr2=0x55e2141317c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e2141317c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0684022ff0 tx=0x7f06840506a0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 shutdown_connections 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/1091298934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21412b340 0x55e2141317c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 >> 172.21.15.151:0/1091298934 conn(0x55e214126760 msgr2=0x55e214124970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 shutdown_connections 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/1091298934 wait complete. 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3628840513 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0560039a70 msgr2=0x7f056003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3628840513 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0560039a70 0x7f056003bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55e21410aa50 tx=0x7f067c00c630 comp rx=0 tx=0).stop 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3628840513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21411da10 msgr2=0x55e21411de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3628840513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21411da10 0x55e21411de30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55e2141050f0 tx=0x7f0684018830 comp rx=0 tx=0).stop 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3628840513 shutdown_connections 2024-09-12T16:52:24.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3628840513 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0560039a70 0x7f056003bf30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3628840513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e21411da10 0x55e21411de30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3628840513 >> 172.21.15.151:0/3628840513 conn(0x55e2141133c0 msgr2=0x55e2141137a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3628840513 shutdown_connections 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3628840513 wait complete. 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e21410c8e0 msgr2=0x55e21410ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e21410c8e0 0x55e21410ecd0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e214014350 msgr2=0x55e21410a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e214014350 0x55e21410a100 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0570039ac0 msgr2=0x7f057003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0570039ac0 0x7f057003bf80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f06740ae000 tx=0x7f06740a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 msgr2=0x55e214102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e214102f90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x55e2140fc830 tx=0x7f067c000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 shutdown_connections 2024-09-12T16:52:24.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e21410c8e0 0x55e21410ecd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e214014350 0x55e21410a100 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0570039ac0 0x7f057003bf80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 --2- 172.21.15.151:0/3267681650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e214010200 0x55e214102f90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 >> 172.21.15.151:0/3267681650 conn(0x55e213f83b10 msgr2=0x55e2140f5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 shutdown_connections 2024-09-12T16:52:24.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.801+0000 7f068b5a59c0 1 -- 172.21.15.151:0/3267681650 wait complete. 2024-09-12T16:52:24.813 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:24.814 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-12T16:52:24.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-12T16:52:24.815 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-12T16:52:24.880 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:24.881 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:24.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.877+0000 7f666e8cf9c0 1 Processor -- start 2024-09-12T16:52:24.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.877+0000 7f666e8cf9c0 1 -- start start 2024-09-12T16:52:24.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.877+0000 7f666e8cf9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a517b59200 0x55a517be7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.877+0000 7f666e8cf9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a517a999c0 con 0x55a517be8170 2024-09-12T16:52:24.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.877+0000 7f666e8cf9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55a517ae96d0 con 0x55a517b59200 2024-09-12T16:52:24.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666c3d5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a517b59200 0x55a517be7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f6663bd4640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55a517be8170 0x55a517bea560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:42752/0 (socket says 172.21.15.151:42752) 2024-09-12T16:52:24.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666c3d5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a517b59200 0x55a517be7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34484/0 (socket says 172.21.15.151:34484) 2024-09-12T16:52:24.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f6663bd4640 1 -- 172.21.15.151:0/3113486227 learned_addr learned my addr 172.21.15.151:0/3113486227 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:52:24.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666c3d5640 1 -- 172.21.15.151:0/3113486227 >> v1:172.21.15.122:6789/0 conn(0x55a517be8170 legacy=0x55a517bea560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666c3d5640 1 -- 172.21.15.151:0/3113486227 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a517a8dca0 con 0x55a517b59200 2024-09-12T16:52:24.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666bbd4640 1 -- 172.21.15.151:0/3113486227 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49840328 0 0) 0x55a517a999c0 con 0x55a517be8170 2024-09-12T16:52:24.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666c3d5640 1 --2- 172.21.15.151:0/3113486227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517be7c30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f665400a480 tx=0x7f665401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d2374a370f8275 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666bbd4640 1 -- 172.21.15.151:0/3113486227 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66540af070 con 0x55a517b59200 2024-09-12T16:52:24.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666bbd4640 1 -- 172.21.15.151:0/3113486227 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66540aa530 con 0x55a517b59200 2024-09-12T16:52:24.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666bbd4640 1 -- 172.21.15.151:0/3113486227 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66540aa830 con 0x55a517b59200 2024-09-12T16:52:24.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/3113486227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 msgr2=0x55a517be7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.881+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/3113486227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517be7c30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f665400a480 tx=0x7f665401b280 comp rx=0 tx=0).stop 2024-09-12T16:52:24.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.885+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/3113486227 shutdown_connections 2024-09-12T16:52:24.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.885+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/3113486227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517be7c30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.885+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/3113486227 >> 172.21.15.151:0/3113486227 conn(0x55a517bdf920 msgr2=0x55a517be1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.885+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/3113486227 shutdown_connections 2024-09-12T16:52:24.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.885+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/3113486227 wait complete. 2024-09-12T16:52:24.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 Processor -- start 2024-09-12T16:52:24.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- start start 2024-09-12T16:52:24.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a517aed680 con 0x55a517b59200 2024-09-12T16:52:24.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666c3d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666c3d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34492/0 (socket says 172.21.15.151:34492) 2024-09-12T16:52:24.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666c3d5640 1 -- 172.21.15.151:0/790388935 learned_addr learned my addr 172.21.15.151:0/790388935 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666c3d5640 1 -- 172.21.15.151:0/790388935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a517a68da0 con 0x55a517b59200 2024-09-12T16:52:24.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666c3d5640 1 --2- 172.21.15.151:0/790388935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd0600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6654018eb0 tx=0x7f6654003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9a9f85ce5460d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f655a60c640 1 -- 172.21.15.151:0/790388935 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66540ba070 con 0x55a517b59200 2024-09-12T16:52:24.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f655a60c640 1 -- 172.21.15.151:0/790388935 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66540aa6e0 con 0x55a517b59200 2024-09-12T16:52:24.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f655a60c640 1 -- 172.21.15.151:0/790388935 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66540af040 con 0x55a517b59200 2024-09-12T16:52:24.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/790388935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 msgr2=0x55a517cd0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/790388935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd0600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6654018eb0 tx=0x7f6654003030 comp rx=0 tx=0).stop 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/790388935 shutdown_connections 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/790388935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd0600 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/790388935 >> 172.21.15.151:0/790388935 conn(0x55a517bdf920 msgr2=0x55a517ccc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/790388935 shutdown_connections 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/790388935 wait complete. 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 Processor -- start 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- start start 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666e8cf9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a517a8fa50 con 0x55a517b59200 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666c3d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666c3d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34506/0 (socket says 172.21.15.151:34506) 2024-09-12T16:52:24.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.897+0000 7f666c3d5640 1 -- 172.21.15.151:0/1338415341 learned_addr learned my addr 172.21.15.151:0/1338415341 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666c3d5640 1 -- 172.21.15.151:0/1338415341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a517cd8100 con 0x55a517b59200 2024-09-12T16:52:24.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666c3d5640 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd7ba0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6654000c10 tx=0x7f6654018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f6558e09640 1 -- 172.21.15.151:0/1338415341 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66540c3070 con 0x55a517b59200 2024-09-12T16:52:24.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a517cd8390 con 0x55a517b59200 2024-09-12T16:52:24.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f6558e09640 1 -- 172.21.15.151:0/1338415341 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66540b5470 con 0x55a517b59200 2024-09-12T16:52:24.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f6558e09640 1 -- 172.21.15.151:0/1338415341 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66540af070 con 0x55a517b59200 2024-09-12T16:52:24.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a517cd8d40 con 0x55a517b59200 2024-09-12T16:52:24.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f6558e09640 1 -- 172.21.15.151:0/1338415341 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f66540b5750 con 0x55a517b59200 2024-09-12T16:52:24.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f6558e09640 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6554039ac0 0x7f655403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f6558e09640 1 -- 172.21.15.151:0/1338415341 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f66540eab80 con 0x55a517b59200 2024-09-12T16:52:24.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f6663bd4640 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6554039ac0 0x7f655403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517be8170 0x55a517cded10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517cdf250 con 0x55a517be8170 2024-09-12T16:52:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666cbd6640 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517be8170 0x55a517cded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f6663bd4640 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6554039ac0 0x7f655403bf80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f665c000c10 tx=0x7f665c0013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666cbd6640 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517be8170 0x55a517cded10 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666cbd6640 1 -- 172.21.15.151:0/1338415341 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f666400a4d0 con 0x55a517be8170 2024-09-12T16:52:24.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.901+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517cdf680 con 0x55a517be8170 2024-09-12T16:52:24.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666cbd6640 1 -- 172.21.15.151:0/1338415341 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f666400a4d0 con 0x55a517be8170 2024-09-12T16:52:24.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517ce1490 0x55a517ce3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517ce3f50 con 0x55a517ce1490 2024-09-12T16:52:24.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666c3d5640 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517ce1490 0x55a517ce3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666c3d5640 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517ce1490 0x55a517ce3880 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666c3d5640 1 -- 172.21.15.151:0/1338415341 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66540c5070 con 0x55a517ce1490 2024-09-12T16:52:24.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517ce0330 con 0x55a517be8170 2024-09-12T16:52:24.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666cbd6640 1 -- 172.21.15.151:0/1338415341 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f666400a4d0 con 0x55a517be8170 2024-09-12T16:52:24.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517ce07b0 con 0x55a517be8170 2024-09-12T16:52:24.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666cbd6640 1 -- 172.21.15.151:0/1338415341 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f666400a4d0 con 0x55a517be8170 2024-09-12T16:52:24.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666e8cf9c0 1 Processor -- start 2024-09-12T16:52:24.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666e8cf9c0 1 -- start start 2024-09-12T16:52:24.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666e8cf9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cf25e0 0x55a517cf2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666e8cf9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a517afa450 con 0x55a517cf25e0 2024-09-12T16:52:24.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666cbd6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cf25e0 0x55a517cf2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666cbd6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cf25e0 0x55a517cf2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34524/0 (socket says 172.21.15.151:34524) 2024-09-12T16:52:24.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666cbd6640 1 -- 172.21.15.151:0/930823218 learned_addr learned my addr 172.21.15.151:0/930823218 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.905+0000 7f666cbd6640 1 -- 172.21.15.151:0/930823218 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a517cf3040 con 0x55a517cf25e0 2024-09-12T16:52:24.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666cbd6640 1 --2- 172.21.15.151:0/930823218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cf25e0 0x55a517cf2a00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55a517cd9c60 tx=0x7f6664018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f6551ffb640 1 -- 172.21.15.151:0/930823218 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6664014450 con 0x55a517cf25e0 2024-09-12T16:52:24.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f6551ffb640 1 -- 172.21.15.151:0/930823218 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66640145f0 con 0x55a517cf25e0 2024-09-12T16:52:24.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/930823218 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a517cf38a0 con 0x55a517cf25e0 2024-09-12T16:52:24.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f6551ffb640 1 -- 172.21.15.151:0/930823218 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6664014910 con 0x55a517cf25e0 2024-09-12T16:52:24.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/930823218 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a517cf3e10 con 0x55a517cf25e0 2024-09-12T16:52:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f6551ffb640 1 -- 172.21.15.151:0/930823218 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6664011040 con 0x55a517cf25e0 2024-09-12T16:52:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f6551ffb640 1 --2- 172.21.15.151:0/930823218 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6544039a70 0x7f654403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f6551ffb640 1 -- 172.21.15.151:0/930823218 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f666401e070 con 0x55a517cf25e0 2024-09-12T16:52:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666c3d5640 1 --2- 172.21.15.151:0/930823218 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6544039a70 0x7f654403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666e8cf9c0 1 Processor -- start 2024-09-12T16:52:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666e8cf9c0 1 -- start start 2024-09-12T16:52:24.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666c3d5640 1 --2- 172.21.15.151:0/930823218 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6544039a70 0x7f654403bf30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55a517cd90b0 tx=0x7f66540c8b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666e8cf9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666e8cf9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a517cd0d90 con 0x55a517cffef0 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666cbd6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666cbd6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d002f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34526/0 (socket says 172.21.15.151:34526) 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666cbd6640 1 -- 172.21.15.151:0/959906427 learned_addr learned my addr 172.21.15.151:0/959906427 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666cbd6640 1 -- 172.21.15.151:0/959906427 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a517d008e0 con 0x55a517cffef0 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.909+0000 7f666cbd6640 1 --2- 172.21.15.151:0/959906427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d002f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f66640505b0 tx=0x7f6664011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d18bb4790fc5a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f654b7fe640 1 -- 172.21.15.151:0/959906427 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6664028070 con 0x55a517cffef0 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f654b7fe640 1 -- 172.21.15.151:0/959906427 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f666402b350 con 0x55a517cffef0 2024-09-12T16:52:24.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f654b7fe640 1 -- 172.21.15.151:0/959906427 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6664016440 con 0x55a517cffef0 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/959906427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 msgr2=0x55a517d002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/959906427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d002f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f66640505b0 tx=0x7f6664011a80 comp rx=0 tx=0).stop 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/959906427 shutdown_connections 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/959906427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d002f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/959906427 >> 172.21.15.151:0/959906427 conn(0x55a517cfb310 msgr2=0x55a517cf9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/959906427 shutdown_connections 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/959906427 wait complete. 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 Processor -- start 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- start start 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d063d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a517cfee40 con 0x55a517cffef0 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666cbd6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666cbd6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34528/0 (socket says 172.21.15.151:34528) 2024-09-12T16:52:24.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 learned_addr learned my addr 172.21.15.151:0/1109789935 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:24.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a517d06930 con 0x55a517cffef0 2024-09-12T16:52:24.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666cbd6640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d063d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6664050510 tx=0x7f6664050540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f6549ffb640 1 -- 172.21.15.151:0/1109789935 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f666402b350 con 0x55a517cffef0 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a517d06bc0 con 0x55a517cffef0 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f6549ffb640 1 -- 172.21.15.151:0/1109789935 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6664032070 con 0x55a517cffef0 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a517d07570 con 0x55a517cffef0 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f6549ffb640 1 -- 172.21.15.151:0/1109789935 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6664016440 con 0x55a517cffef0 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.913+0000 7f6549ffb640 1 -- 172.21.15.151:0/1109789935 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6664001d10 con 0x55a517cffef0 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f6549ffb640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f653c039a70 0x7f653c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f6549ffb640 1 -- 172.21.15.151:0/1109789935 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f666400e040 con 0x55a517cffef0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666c3d5640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f653c039a70 0x7f653c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517d118c0 0x55a517d13d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d144a0 con 0x55a517d118c0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f6663bd4640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517d118c0 0x55a517d13d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666c3d5640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f653c039a70 0x7f653c03bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6654018eb0 tx=0x7f66540dc000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f6663bd4640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517d118c0 0x55a517d13d50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f665c00f600 con 0x55a517d118c0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 realm 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d10cd0 con 0x55a517d118c0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f665c00f600 con 0x55a517d118c0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d14fa0 con 0x55a517d118c0 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f665c00f600 con 0x55a517d118c0 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d15870 con 0x55a517d118c0 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f665c00f600 con 0x55a517d118c0 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517d16290 0x55a517d18680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d18df0 con 0x55a517d16290 2024-09-12T16:52:24.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666cbd6640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517d16290 0x55a517d18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666cbd6640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517d16290 0x55a517d18680 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 20 searching for the correct realm 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a517d1ad40 0x55a517d1d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666c3d5640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a517d1ad40 0x55a517d1d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.917+0000 7f666c3d5640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a517d1ad40 0x55a517d1d170 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666c3d5640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66540f7040 0x7f66540c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x7f66540f7040 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66540f7040 0x7f66540c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66540f7040 0x7f66540c75d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c00f600 con 0x7f66540f7040 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d118c0 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c00f600 con 0x55a517d118c0 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d118c0 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x7f66540f7040 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d118c0 2024-09-12T16:52:24.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.921+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d118c0 2024-09-12T16:52:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x7f66540f7040 2024-09-12T16:52:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d118c0 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d118c0 2024-09-12T16:52:24.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.925+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x7f66540f7040 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d118c0 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x7f66540f7040 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d1ad40 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d16290 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x55a517d118c0 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1d7f0 con 0x7f66540f7040 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d197b0 con 0x55a517d118c0 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.929+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d193c0 con 0x55a517d118c0 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1a160 con 0x55a517d118c0 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 zone default found 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 4 Realm: () 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 zonegroup default 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1dc70 con 0x55a517d16290 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1feb0 con 0x55a517d1ad40 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d20250 con 0x55a517d1ad40 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 started sync module instance, tier type = 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1f340 con 0x7f66540f7040 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94167557601424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1f340 con 0x7f66540f7040 2024-09-12T16:52:24.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d20db0 con 0x55a517d118c0 2024-09-12T16:52:24.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.933+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94167557601424] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.937+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.937+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94167557605504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1f340 con 0x55a517d118c0 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.937+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d217c0 con 0x55a517d1ad40 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.937+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94167557605504] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.937+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.937+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94167557598864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1f2b0 con 0x55a517d1ad40 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.937+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d22510 con 0x7f66540f7040 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.941+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.941+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94167557611888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d22be0 con 0x7f66540f7040 2024-09-12T16:52:24.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.941+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d236d0 con 0x55a517d118c0 2024-09-12T16:52:24.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.941+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94167557611888] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.941+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94167557598864] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.941+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.941+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94167557610416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d23690 con 0x55a517d118c0 2024-09-12T16:52:24.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.941+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d23af0 con 0x55a517d16290 2024-09-12T16:52:24.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.945+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94167557610416] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.945+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.945+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94167557613104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d23af0 con 0x55a517d16290 2024-09-12T16:52:24.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.945+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d24410 con 0x55a517d16290 2024-09-12T16:52:24.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.945+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.945+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94167557619040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d248c0 con 0x55a517d16290 2024-09-12T16:52:24.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.945+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d253b0 con 0x55a517d16290 2024-09-12T16:52:24.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94167557613104] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94167557619040] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94167557623424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d243d0 con 0x55a517d16290 2024-09-12T16:52:24.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 20 add_watcher() i=0 2024-09-12T16:52:24.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 20 add_watcher() i=1 2024-09-12T16:52:24.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 20 add_watcher() i=2 2024-09-12T16:52:24.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 20 add_watcher() i=3 2024-09-12T16:52:24.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 20 add_watcher() i=4 2024-09-12T16:52:24.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 20 add_watcher() i=5 2024-09-12T16:52:24.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 20 add_watcher() i=6 2024-09-12T16:52:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94167557623424] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 20 add_watcher() i=7 2024-09-12T16:52:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.949+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d283a0 con 0x55a517d118c0 2024-09-12T16:52:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94167557616032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d25820 con 0x55a517d118c0 2024-09-12T16:52:24.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94167557616032] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f6522fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 5 note: GC not initialized 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f6521fe3640 20 reqs_thread_entry: start 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 Filter name: none 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f651affd640 20 reqs_thread_entry: start 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d4b4f0 con 0x55a517d118c0 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d4df80 con 0x7f66540f7040 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 enabling bucket name=myfoo 2024-09-12T16:52:24.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d4bf60 con 0x7f66540f7040 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 : miss 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.953+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d4e860 con 0x55a517d16290 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(65 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 2024-09-12T16:52:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 8.1e 8:7b1c8b14:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d55d30 con 0x55a517d16290 2024-09-12T16:52:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(66 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1, ofs0, ns] 2024-09-12T16:52:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94167557793744 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d514a0 con 0x55a517d118c0 2024-09-12T16:52:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== watch-notify(notify (1) cookie 94167557605504 notify 137438953499 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f665c018040 con 0x55a517d118c0 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f654b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94167557605504 notifier 4600 bl.length()=760 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f654b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 info.flags=0x17 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f654b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1 to cache LRU end 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f654b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(67 notify.1 [notify cookie 94167557793744 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f654b7fe640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6530003eb0 con 0x55a517d118c0 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== watch-notify(notify_complete (2) cookie 94167557793744 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f665c00a040 con 0x55a517d118c0 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_sources= new_sources= 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential sources added=[] removed=[] 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): orig_dests= new_dests= 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 20 handle_bi_update(): bucket=:myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1]): potential dests added=[] removed=[] 2024-09-12T16:52:24.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.957+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d4e7d0 con 0x55a517d118c0 2024-09-12T16:52:24.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f666e8cf9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f666e8cf9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f666e8cf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94167557793744 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a517d536d0 con 0x55a517d118c0 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== watch-notify(notify (1) cookie 94167557610416 notify 137438953500 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f665c00a040 con 0x55a517d118c0 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f654b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94167557610416 notifier 4600 bl.length()=567 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f654b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f654b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f654b7fe640 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6530003eb0 con 0x55a517d118c0 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(70 notify.4 [notify cookie 94167557793744 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== watch-notify(notify_complete (2) cookie 94167557793744 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f665c02fdf0 con 0x55a517d118c0 2024-09-12T16:52:24.965 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:24.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f6522fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:24.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94167557616032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d492d0 con 0x55a517d118c0 2024-09-12T16:52:24.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94167557616032] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.961+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94167557601424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d492d0 con 0x7f66540f7040 2024-09-12T16:52:24.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.965+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94167557601424] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.965+0000 7f666e8cf9c0 20 remove_watcher() i=0 2024-09-12T16:52:24.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.965+0000 7f666e8cf9c0 2 removed watcher, disabling cache 2024-09-12T16:52:24.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.965+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94167557605504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d492d0 con 0x55a517d118c0 2024-09-12T16:52:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.965+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94167557605504] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.965+0000 7f666e8cf9c0 20 remove_watcher() i=1 2024-09-12T16:52:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.965+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94167557598864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d492d0 con 0x55a517d1ad40 2024-09-12T16:52:24.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f666c3d5640 1 -- 172.21.15.151:0/1109789935 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94167557598864] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66540dc070 con 0x55a517d1ad40 2024-09-12T16:52:24.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f666e8cf9c0 20 remove_watcher() i=2 2024-09-12T16:52:24.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94167557611888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1ee90 con 0x7f66540f7040 2024-09-12T16:52:24.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94167557611888] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x7f66540f7040 2024-09-12T16:52:24.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f666e8cf9c0 20 remove_watcher() i=3 2024-09-12T16:52:24.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94167557610416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d492d0 con 0x55a517d118c0 2024-09-12T16:52:24.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94167557610416] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f665c02b040 con 0x55a517d118c0 2024-09-12T16:52:24.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f666e8cf9c0 20 remove_watcher() i=4 2024-09-12T16:52:24.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.969+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94167557613104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d22170 con 0x55a517d16290 2024-09-12T16:52:24.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.973+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94167557613104] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.973+0000 7f666e8cf9c0 20 remove_watcher() i=5 2024-09-12T16:52:24.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.973+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94167557619040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d1ee90 con 0x55a517d16290 2024-09-12T16:52:24.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.973+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94167557619040] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.973+0000 7f666e8cf9c0 20 remove_watcher() i=6 2024-09-12T16:52:24.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.973+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94167557623424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a517d492d0 con 0x55a517d16290 2024-09-12T16:52:24.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666cbd6640 1 -- 172.21.15.151:0/1109789935 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94167557623424] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f666404a050 con 0x55a517d16290 2024-09-12T16:52:24.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 20 remove_watcher() i=7 2024-09-12T16:52:24.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517d16290 msgr2=0x55a517d18680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517d16290 0x55a517d18680 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517d118c0 msgr2=0x55a517d13d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517d118c0 0x55a517d13d50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66540f7040 msgr2=0x7f66540c75d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f66540f7040 0x7f66540c75d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a517d1ad40 msgr2=0x55a517d1d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a517d1ad40 0x55a517d1d170 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f653c039a70 msgr2=0x7f653c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f653c039a70 0x7f653c03bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6654018eb0 tx=0x7f66540dc000 comp rx=0 tx=0).stop 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f6663bd4640 1 -- 172.21.15.151:0/1109789935 reap_dead start 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 msgr2=0x55a517d063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d063d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6664050510 tx=0x7f6664050540 comp rx=0 tx=0).stop 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 shutdown_connections 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1109789935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cffef0 0x55a517d063d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 >> 172.21.15.151:0/1109789935 conn(0x55a517cfb310 msgr2=0x55a517cf9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 shutdown_connections 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1109789935 wait complete. 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/930823218 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6544039a70 msgr2=0x7f654403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/930823218 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6544039a70 0x7f654403bf30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55a517cd90b0 tx=0x7f66540c8b80 comp rx=0 tx=0).stop 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/930823218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cf25e0 msgr2=0x55a517cf2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/930823218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cf25e0 0x55a517cf2a00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55a517cd9c60 tx=0x7f6664018830 comp rx=0 tx=0).stop 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/930823218 shutdown_connections 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/930823218 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6544039a70 0x7f654403bf30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/930823218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517cf25e0 0x55a517cf2a00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/930823218 >> 172.21.15.151:0/930823218 conn(0x55a517ce7f90 msgr2=0x55a517ce8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/930823218 shutdown_connections 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/930823218 wait complete. 2024-09-12T16:52:24.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517ce1490 msgr2=0x55a517ce3880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517ce1490 0x55a517ce3880 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517be8170 msgr2=0x55a517cded10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517be8170 0x55a517cded10 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6554039ac0 msgr2=0x7f655403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6554039ac0 0x7f655403bf80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f665c000c10 tx=0x7f665c0013c0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 msgr2=0x55a517cd7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd7ba0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6654000c10 tx=0x7f6654018020 comp rx=0 tx=0).stop 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 shutdown_connections 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a517ce1490 0x55a517ce3880 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a517be8170 0x55a517cded10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6554039ac0 0x7f655403bf80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 --2- 172.21.15.151:0/1338415341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a517b59200 0x55a517cd7ba0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:24.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 >> 172.21.15.151:0/1338415341 conn(0x55a517bdf920 msgr2=0x55a517ccaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:24.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 shutdown_connections 2024-09-12T16:52:24.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:24.977+0000 7f666e8cf9c0 1 -- 172.21.15.151:0/1338415341 wait complete. 2024-09-12T16:52:24.991 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:25.000 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T16:52:25.368 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-12T16:52:25.384 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:40.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-12T16:52:40.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-12T16:52:40.385 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-12T16:52:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:40.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc0a07809c0 1 Processor -- start 2024-09-12T16:52:40.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc0a07809c0 1 -- start start 2024-09-12T16:52:40.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc0a07809c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a69e273e00 0x55a69e2741e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc0a07809c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a69e1299c0 con 0x55a69e276fe0 2024-09-12T16:52:40.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc0a07809c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55a69e1796d0 con 0x55a69e273e00 2024-09-12T16:52:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc09e286640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a69e273e00 0x55a69e2741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc09e286640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a69e273e00 0x55a69e2741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60266/0 (socket says 172.21.15.151:60266) 2024-09-12T16:52:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc09da85640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55a69e276fe0 0x55a69e2793d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:47214/0 (socket says 172.21.15.151:47214) 2024-09-12T16:52:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc09e286640 1 -- 172.21.15.151:0/1119785250 learned_addr learned my addr 172.21.15.151:0/1119785250 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc09e286640 1 -- 172.21.15.151:0/1119785250 >> v1:172.21.15.122:6789/0 conn(0x55a69e276fe0 legacy=0x55a69e2793d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc09e286640 1 -- 172.21.15.151:0/1119785250 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69e11dca0 con 0x55a69e273e00 2024-09-12T16:52:40.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.425+0000 7fc09e286640 1 --2- 172.21.15.151:0/1119785250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e2741e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc09800a7a0 tx=0x7fc09801d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8742cde848e4255 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc09d284640 1 -- 172.21.15.151:0/1119785250 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0980b3070 con 0x55a69e273e00 2024-09-12T16:52:40.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc09d284640 1 -- 172.21.15.151:0/1119785250 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0980a6720 con 0x55a69e273e00 2024-09-12T16:52:40.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc09d284640 1 -- 172.21.15.151:0/1119785250 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0980a6a20 con 0x55a69e273e00 2024-09-12T16:52:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1119785250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 msgr2=0x55a69e2741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1119785250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e2741e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc09800a7a0 tx=0x7fc09801d800 comp rx=0 tx=0).stop 2024-09-12T16:52:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1119785250 shutdown_connections 2024-09-12T16:52:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1119785250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e2741e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1119785250 >> 172.21.15.151:0/1119785250 conn(0x55a69e26f920 msgr2=0x55a69e271d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1119785250 shutdown_connections 2024-09-12T16:52:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.429+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1119785250 wait complete. 2024-09-12T16:52:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 Processor -- start 2024-09-12T16:52:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 -- start start 2024-09-12T16:52:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e35e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a69e17d680 con 0x55a69e273e00 2024-09-12T16:52:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc09e286640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e35e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc09e286640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e35e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60276/0 (socket says 172.21.15.151:60276) 2024-09-12T16:52:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc09e286640 1 -- 172.21.15.151:0/223950735 learned_addr learned my addr 172.21.15.151:0/223950735 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc09e286640 1 -- 172.21.15.151:0/223950735 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69e0f8da0 con 0x55a69e273e00 2024-09-12T16:52:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc09e286640 1 --2- 172.21.15.151:0/223950735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e35e5d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc0980b1040 tx=0x7fc0980033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b6cdf1063d9a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fbf8c608640 1 -- 172.21.15.151:0/223950735 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0980b3070 con 0x55a69e273e00 2024-09-12T16:52:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fbf8c608640 1 -- 172.21.15.151:0/223950735 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0980b4040 con 0x55a69e273e00 2024-09-12T16:52:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fbf8c608640 1 -- 172.21.15.151:0/223950735 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0980a6c70 con 0x55a69e273e00 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 -- 172.21.15.151:0/223950735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 msgr2=0x55a69e35e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/223950735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e35e5d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc0980b1040 tx=0x7fc0980033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 -- 172.21.15.151:0/223950735 shutdown_connections 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/223950735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e35e5d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 -- 172.21.15.151:0/223950735 >> 172.21.15.151:0/223950735 conn(0x55a69e26f920 msgr2=0x55a69e35a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 -- 172.21.15.151:0/223950735 shutdown_connections 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.445+0000 7fc0a07809c0 1 -- 172.21.15.151:0/223950735 wait complete. 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc0a07809c0 1 Processor -- start 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc0a07809c0 1 -- start start 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc0a07809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e365b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc0a07809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a69e11fa50 con 0x55a69e273e00 2024-09-12T16:52:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc09e286640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e365b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc09e286640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e365b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60282/0 (socket says 172.21.15.151:60282) 2024-09-12T16:52:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc09e286640 1 -- 172.21.15.151:0/2870842729 learned_addr learned my addr 172.21.15.151:0/2870842729 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc09e286640 1 -- 172.21.15.151:0/2870842729 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69e366060 con 0x55a69e273e00 2024-09-12T16:52:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc09e286640 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e365b00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc09801b430 tx=0x7fc09801a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fbf8ae05640 1 -- 172.21.15.151:0/2870842729 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0980c5070 con 0x55a69e273e00 2024-09-12T16:52:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fbf8ae05640 1 -- 172.21.15.151:0/2870842729 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0980aedd0 con 0x55a69e273e00 2024-09-12T16:52:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a69e3662f0 con 0x55a69e273e00 2024-09-12T16:52:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fbf8ae05640 1 -- 172.21.15.151:0/2870842729 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0980b8530 con 0x55a69e273e00 2024-09-12T16:52:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a69e366ca0 con 0x55a69e273e00 2024-09-12T16:52:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fbf8ae05640 1 -- 172.21.15.151:0/2870842729 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc0980c8070 con 0x55a69e273e00 2024-09-12T16:52:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fbf8ae05640 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf84039a70 0x7fbf8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fbf8ae05640 1 -- 172.21.15.151:0/2870842729 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc0980bd070 con 0x55a69e273e00 2024-09-12T16:52:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc09da85640 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf84039a70 0x7fbf8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e276fe0 0x55a69e36cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.449+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e36d1b0 con 0x55a69e276fe0 2024-09-12T16:52:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09ea87640 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e276fe0 0x55a69e36cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09da85640 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf84039a70 0x7fbf8403bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc094001e40 tx=0x7fc0940013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09ea87640 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e276fe0 0x55a69e36cc70 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09ea87640 1 -- 172.21.15.151:0/2870842729 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0900083f0 con 0x55a69e276fe0 2024-09-12T16:52:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e367020 con 0x55a69e276fe0 2024-09-12T16:52:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09ea87640 1 -- 172.21.15.151:0/2870842729 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc0900083f0 con 0x55a69e276fe0 2024-09-12T16:52:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e36f470 0x55a69e371860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e371f30 con 0x55a69e36f470 2024-09-12T16:52:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09e286640 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e36f470 0x55a69e371860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09e286640 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e36f470 0x55a69e371860 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09e286640 1 -- 172.21.15.151:0/2870842729 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e36f470 2024-09-12T16:52:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e36e2e0 con 0x55a69e276fe0 2024-09-12T16:52:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09ea87640 1 -- 172.21.15.151:0/2870842729 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc0900083f0 con 0x55a69e276fe0 2024-09-12T16:52:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e36e780 con 0x55a69e276fe0 2024-09-12T16:52:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.453+0000 7fc09ea87640 1 -- 172.21.15.151:0/2870842729 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc0900083f0 con 0x55a69e276fe0 2024-09-12T16:52:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc0a07809c0 1 Processor -- start 2024-09-12T16:52:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc0a07809c0 1 -- start start 2024-09-12T16:52:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc0a07809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e380580 0x55a69e3809a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc0a07809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a69e18a450 con 0x55a69e380580 2024-09-12T16:52:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc09ea87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e380580 0x55a69e3809a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc09ea87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e380580 0x55a69e3809a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60288/0 (socket says 172.21.15.151:60288) 2024-09-12T16:52:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc09ea87640 1 -- 172.21.15.151:0/2041177826 learned_addr learned my addr 172.21.15.151:0/2041177826 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc09ea87640 1 -- 172.21.15.151:0/2041177826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69e380fe0 con 0x55a69e380580 2024-09-12T16:52:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc09ea87640 1 --2- 172.21.15.151:0/2041177826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e380580 0x55a69e3809a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55a69e367c00 tx=0x7fc09000aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fbf83fff640 1 -- 172.21.15.151:0/2041177826 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc090007d40 con 0x55a69e380580 2024-09-12T16:52:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fbf83fff640 1 -- 172.21.15.151:0/2041177826 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09001e020 con 0x55a69e380580 2024-09-12T16:52:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2041177826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a69e381840 con 0x55a69e380580 2024-09-12T16:52:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fbf83fff640 1 -- 172.21.15.151:0/2041177826 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc090019590 con 0x55a69e380580 2024-09-12T16:52:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2041177826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a69e381db0 con 0x55a69e380580 2024-09-12T16:52:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fbf83fff640 1 -- 172.21.15.151:0/2041177826 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc090016040 con 0x55a69e380580 2024-09-12T16:52:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fbf83fff640 1 --2- 172.21.15.151:0/2041177826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf78039a70 0x7fbf7803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fbf83fff640 1 -- 172.21.15.151:0/2041177826 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc09001f030 con 0x55a69e380580 2024-09-12T16:52:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.457+0000 7fc09e286640 1 --2- 172.21.15.151:0/2041177826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf78039a70 0x7fbf7803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 Processor -- start 2024-09-12T16:52:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- start start 2024-09-12T16:52:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09e286640 1 --2- 172.21.15.151:0/2041177826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf78039a70 0x7fbf7803bf30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0980c9d20 tx=0x7fc0980c0780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e3927c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a69e35ed60 con 0x55a69e3923c0 2024-09-12T16:52:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e3927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e3927c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60294/0 (socket says 172.21.15.151:60294) 2024-09-12T16:52:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 -- 172.21.15.151:0/2922460745 learned_addr learned my addr 172.21.15.151:0/2922460745 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 -- 172.21.15.151:0/2922460745 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69e392db0 con 0x55a69e3923c0 2024-09-12T16:52:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 --2- 172.21.15.151:0/2922460745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e3927c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc0900236e0 tx=0x7fc090050bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2247be6a9f5880c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fbf81ffb640 1 -- 172.21.15.151:0/2922460745 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc09001d030 con 0x55a69e3923c0 2024-09-12T16:52:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fbf81ffb640 1 -- 172.21.15.151:0/2922460745 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09004d020 con 0x55a69e3923c0 2024-09-12T16:52:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fbf81ffb640 1 -- 172.21.15.151:0/2922460745 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc090017bd0 con 0x55a69e3923c0 2024-09-12T16:52:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2922460745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 msgr2=0x55a69e3927c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2922460745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e3927c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc0900236e0 tx=0x7fc090050bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2922460745 shutdown_connections 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2922460745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e3927c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2922460745 >> 172.21.15.151:0/2922460745 conn(0x55a69e389330 msgr2=0x55a69e387570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2922460745 shutdown_connections 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2922460745 wait complete. 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 Processor -- start 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- start start 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e398840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc0a07809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a69e391320 con 0x55a69e3923c0 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e398840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e398840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60298/0 (socket says 172.21.15.151:60298) 2024-09-12T16:52:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 learned_addr learned my addr 172.21.15.151:0/1219022047 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.461+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69e398da0 con 0x55a69e3923c0 2024-09-12T16:52:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc09ea87640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e398840 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc09004f7c0 tx=0x7fc090050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fbf6ffff640 1 -- 172.21.15.151:0/1219022047 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc090031070 con 0x55a69e3923c0 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a69e399030 con 0x55a69e3923c0 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fbf6ffff640 1 -- 172.21.15.151:0/1219022047 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc090044030 con 0x55a69e3923c0 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fbf6ffff640 1 -- 172.21.15.151:0/1219022047 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0900521a0 con 0x55a69e3923c0 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a69e399030 con 0x55a69e3923c0 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fbf6ffff640 1 -- 172.21.15.151:0/1219022047 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc090034070 con 0x55a69e3923c0 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fbf6ffff640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf68039ac0 0x7fbf6803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fbf6ffff640 1 -- 172.21.15.151:0/1219022047 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc09004e030 con 0x55a69e3923c0 2024-09-12T16:52:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc09e286640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf68039ac0 0x7fbf6803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e3a39c0 0x55a69e3a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3a65a0 con 0x55a69e3a39c0 2024-09-12T16:52:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc09da85640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e3a39c0 0x55a69e3a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc09e286640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf68039ac0 0x7fbf6803bf80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc0980a7f90 tx=0x7fc0980e1000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc09da85640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e3a39c0 0x55a69e3a5e50 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09400f620 con 0x55a69e3a39c0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 20 realm 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3a2d70 con 0x55a69e3a39c0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09400f620 con 0x55a69e3a39c0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3a7080 con 0x55a69e3a39c0 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09400f620 con 0x55a69e3a39c0 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.465+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3a7950 con 0x55a69e3a39c0 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc09400f620 con 0x55a69e3a39c0 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc0a07809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e3a8290 0x55a69e3aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3aadc0 con 0x55a69e3a8290 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09ea87640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e3a8290 0x55a69e3aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09ea87640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e3a8290 0x55a69e3aa680 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc0a07809c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc0a07809c0 20 searching for the correct realm 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a69e3acd50 0x55a69e3af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09e286640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a69e3acd50 0x55a69e3af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09e286640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a69e3acd50 0x55a69e3af1e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09e286640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc0980ca070 0x7fc0980ec370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x7fc0980ca070 2024-09-12T16:52:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09da85640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc0980ca070 0x7fc0980ec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09da85640 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc0980ca070 0x7fc0980ec370 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09400f620 con 0x7fc0980ca070 2024-09-12T16:52:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.469+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a39c0 2024-09-12T16:52:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09400f620 con 0x55a69e3a39c0 2024-09-12T16:52:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a39c0 2024-09-12T16:52:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x7fc0980ca070 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a39c0 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a39c0 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.473+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x7fc0980ca070 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a39c0 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a39c0 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x7fc0980ca070 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a39c0 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.477+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x7fc0980ca070 2024-09-12T16:52:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3acd50 2024-09-12T16:52:40.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a8290 2024-09-12T16:52:40.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x55a69e3a39c0 2024-09-12T16:52:40.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3af8b0 con 0x7fc0980ca070 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc0a07809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc0a07809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc0a07809c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc0a07809c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc0a07809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc0a07809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.481+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3ab710 con 0x55a69e3a39c0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3abb60 con 0x55a69e3a39c0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3ac040 con 0x55a69e3a39c0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 zone default found 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 4 Realm: () 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 zonegroup default 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3afd30 con 0x55a69e3a8290 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b1c50 con 0x55a69e3acd50 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b2120 con 0x55a69e3acd50 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 started sync module instance, tier type = 2024-09-12T16:52:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b0f60 con 0x7fc0980ca070 2024-09-12T16:52:40.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94174107604064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b0f60 con 0x7fc0980ca070 2024-09-12T16:52:40.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.485+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b2c20 con 0x55a69e3a39c0 2024-09-12T16:52:40.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.489+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94174107604064] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.489+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.489+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94174107608816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b0f60 con 0x55a69e3a39c0 2024-09-12T16:52:40.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.489+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b3630 con 0x55a69e3acd50 2024-09-12T16:52:40.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94174107608816] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94174107601584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b0ed0 con 0x55a69e3acd50 2024-09-12T16:52:40.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b4330 con 0x7fc0980ca070 2024-09-12T16:52:40.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94174107615120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b4a20 con 0x7fc0980ca070 2024-09-12T16:52:40.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b5520 con 0x55a69e3a39c0 2024-09-12T16:52:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94174107601584] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94174107615120] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94174107619344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b54e0 con 0x55a69e3a39c0 2024-09-12T16:52:40.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.493+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b5940 con 0x55a69e3a8290 2024-09-12T16:52:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.497+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94174107619344] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.497+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.497+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94174107613648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b5d30 con 0x55a69e3a8290 2024-09-12T16:52:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.497+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b66f0 con 0x55a69e3a8290 2024-09-12T16:52:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94174107624272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b6e40 con 0x55a69e3a8290 2024-09-12T16:52:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b7960 con 0x55a69e3a8290 2024-09-12T16:52:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94174107613648] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94174107624272] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94174107628592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b6890 con 0x55a69e3a8290 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 20 add_watcher() i=0 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 20 add_watcher() i=1 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 20 add_watcher() i=2 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 20 add_watcher() i=3 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 20 add_watcher() i=4 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 20 add_watcher() i=5 2024-09-12T16:52:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.501+0000 7fc0a07809c0 20 add_watcher() i=6 2024-09-12T16:52:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94174107628592] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc0a07809c0 20 add_watcher() i=7 2024-09-12T16:52:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc0a07809c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3ba950 con 0x55a69e3a39c0 2024-09-12T16:52:40.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94174107616368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b7e00 con 0x55a69e3a39c0 2024-09-12T16:52:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94174107616368] v34'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fbf54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc0a07809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc0a07809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.505+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3bcc50 con 0x55a69e3a39c0 2024-09-12T16:52:40.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.509+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.509+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c33d0 con 0x55a69e3a8290 2024-09-12T16:52:40.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.513+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.513+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c33d0 con 0x55a69e3acd50 2024-09-12T16:52:40.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.513+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.513+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c3c20 con 0x55a69e3a39c0 2024-09-12T16:52:40.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.513+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'154 uv152 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.513+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c28a0 con 0x7fc0980ca070 2024-09-12T16:52:40.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.517+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.517+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2870 con 0x55a69e3acd50 2024-09-12T16:52:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.517+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.517+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2870 con 0x55a69e3a39c0 2024-09-12T16:52:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.517+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.517+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2870 con 0x55a69e3a8290 2024-09-12T16:52:40.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.521+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.521+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x7fc0980ca070 2024-09-12T16:52:40.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.521+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.521+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.525+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.525+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x7fc0980ca070 2024-09-12T16:52:40.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.525+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.525+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3a8290 2024-09-12T16:52:40.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.529+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.529+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x7fc0980ca070 2024-09-12T16:52:40.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.529+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.529+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3a8290 2024-09-12T16:52:40.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.533+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.533+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3a39c0 2024-09-12T16:52:40.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.533+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'155 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.533+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.533+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.533+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x7fc0980ca070 2024-09-12T16:52:40.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.537+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.537+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.537+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.537+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3a39c0 2024-09-12T16:52:40.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.541+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.541+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3a39c0 2024-09-12T16:52:40.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.541+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'156 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.541+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.541+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.541+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x7fc0980ca070 2024-09-12T16:52:40.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.545+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.545+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.545+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.545+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.549+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.549+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.549+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.549+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.549+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.553+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3a8290 2024-09-12T16:52:40.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.553+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.553+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.557+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.557+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3a8290 2024-09-12T16:52:40.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.557+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.557+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3acd50 2024-09-12T16:52:40.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.561+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.561+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x55a69e3a8290 2024-09-12T16:52:40.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.561+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.561+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c2980 con 0x7fc0980ca070 2024-09-12T16:52:40.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fbecf7fe640 20 reqs_thread_entry: start 2024-09-12T16:52:40.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fc0a07809c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:40.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fc0a07809c0 20 Filter name: none 2024-09-12T16:52:40.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fbecd7fa640 20 reqs_thread_entry: start 2024-09-12T16:52:40.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e01c0 con 0x55a69e3a39c0 2024-09-12T16:52:40.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c17d0 con 0x55a69e3a39c0 2024-09-12T16:52:40.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.565+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e01c0 con 0x55a69e3a39c0 2024-09-12T16:52:40.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e01c0 con 0x55a69e3a8290 2024-09-12T16:52:40.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c17d0 con 0x55a69e3a8290 2024-09-12T16:52:40.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e01c0 con 0x55a69e3a8290 2024-09-12T16:52:40.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e01c0 con 0x55a69e3acd50 2024-09-12T16:52:40.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c17d0 con 0x55a69e3acd50 2024-09-12T16:52:40.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e01c0 con 0x55a69e3acd50 2024-09-12T16:52:40.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.569+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e01c0 con 0x55a69e3a39c0 2024-09-12T16:52:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv152 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3c17d0 con 0x55a69e3a39c0 2024-09-12T16:52:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv152 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e01c0 con 0x55a69e3a39c0 2024-09-12T16:52:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(105 gc.3 [call out=1702b] v0'0 uv152 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x7fc0980ca070 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.573+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a39c0 2024-09-12T16:52:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a39c0 2024-09-12T16:52:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a39c0 2024-09-12T16:52:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a8290 2024-09-12T16:52:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x7fc0980ca070 2024-09-12T16:52:40.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.577+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x7fc0980ca070 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.581+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a8290 2024-09-12T16:52:40.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x7fc0980ca070 2024-09-12T16:52:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.585+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a8290 2024-09-12T16:52:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a39c0 2024-09-12T16:52:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a39c0 2024-09-12T16:52:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a39c0 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.589+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x7fc0980ca070 2024-09-12T16:52:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a39c0 2024-09-12T16:52:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.593+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a39c0 2024-09-12T16:52:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x7fc0980ca070 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.597+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.601+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a8290 2024-09-12T16:52:40.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.605+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a8290 2024-09-12T16:52:40.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3acd50 2024-09-12T16:52:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3acd50 2024-09-12T16:52:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.609+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x55a69e3a8290 2024-09-12T16:52:40.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x55a69e3a8290 2024-09-12T16:52:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3dfd10 con 0x7fc0980ca070 2024-09-12T16:52:40.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3e0d20 con 0x7fc0980ca070 2024-09-12T16:52:40.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.613+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.617+0000 7fbf54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.617+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94174107616368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3bfe70 con 0x55a69e3a39c0 2024-09-12T16:52:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.617+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94174107616368] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.617+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94174107604064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3bfe70 con 0x7fc0980ca070 2024-09-12T16:52:40.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.621+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94174107604064] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.621+0000 7fc0a07809c0 20 remove_watcher() i=0 2024-09-12T16:52:40.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.621+0000 7fc0a07809c0 2 removed watcher, disabling cache 2024-09-12T16:52:40.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.621+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94174107608816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b1460 con 0x55a69e3a39c0 2024-09-12T16:52:40.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.621+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94174107608816] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.621+0000 7fc0a07809c0 20 remove_watcher() i=1 2024-09-12T16:52:40.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.621+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94174107601584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b1460 con 0x55a69e3acd50 2024-09-12T16:52:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.625+0000 7fc09e286640 1 -- 172.21.15.151:0/1219022047 <== osd.3 v2:172.21.15.151:6808/987175333 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94174107601584] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0980d1070 con 0x55a69e3acd50 2024-09-12T16:52:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.625+0000 7fc0a07809c0 20 remove_watcher() i=2 2024-09-12T16:52:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.625+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94174107615120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b1460 con 0x7fc0980ca070 2024-09-12T16:52:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.625+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.2 v2:172.21.15.151:6800/1197700885 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94174107615120] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x7fc0980ca070 2024-09-12T16:52:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.625+0000 7fc0a07809c0 20 remove_watcher() i=3 2024-09-12T16:52:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.625+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94174107619344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b3f90 con 0x55a69e3a39c0 2024-09-12T16:52:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.629+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 <== osd.1 v2:172.21.15.151:6816/883447514 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94174107619344] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09402b040 con 0x55a69e3a39c0 2024-09-12T16:52:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.629+0000 7fc0a07809c0 20 remove_watcher() i=4 2024-09-12T16:52:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.629+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94174107613648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b1460 con 0x55a69e3a8290 2024-09-12T16:52:40.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.629+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94174107613648] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.629+0000 7fc0a07809c0 20 remove_watcher() i=5 2024-09-12T16:52:40.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.629+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94174107624272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b5010 con 0x55a69e3a8290 2024-09-12T16:52:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.633+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94174107624272] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.633+0000 7fc0a07809c0 20 remove_watcher() i=6 2024-09-12T16:52:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.633+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94174107628592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a69e3b3f90 con 0x55a69e3a8290 2024-09-12T16:52:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc09ea87640 1 -- 172.21.15.151:0/1219022047 <== osd.0 v2:172.21.15.122:6800/3868153603 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94174107628592] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09003d070 con 0x55a69e3a8290 2024-09-12T16:52:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 20 remove_watcher() i=7 2024-09-12T16:52:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e3a8290 msgr2=0x55a69e3aa680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e3a8290 0x55a69e3aa680 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e3a39c0 msgr2=0x55a69e3a5e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e3a39c0 0x55a69e3a5e50 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc0980ca070 msgr2=0x7fc0980ec370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc0980ca070 0x7fc0980ec370 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a69e3acd50 msgr2=0x55a69e3af1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a69e3acd50 0x55a69e3af1e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf68039ac0 msgr2=0x7fbf6803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf68039ac0 0x7fbf6803bf80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc0980a7f90 tx=0x7fc0980e1000 comp rx=0 tx=0).stop 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc09da85640 1 -- 172.21.15.151:0/1219022047 reap_dead start 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 msgr2=0x55a69e398840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e398840 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc09004f7c0 tx=0x7fc090050880 comp rx=0 tx=0).stop 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 shutdown_connections 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/1219022047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e3923c0 0x55a69e398840 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 >> 172.21.15.151:0/1219022047 conn(0x55a69e389330 msgr2=0x55a69e387540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 shutdown_connections 2024-09-12T16:52:40.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/1219022047 wait complete. 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2041177826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf78039a70 msgr2=0x7fbf7803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2041177826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf78039a70 0x7fbf7803bf30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0980c9d20 tx=0x7fc0980c0780 comp rx=0 tx=0).stop 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2041177826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e380580 msgr2=0x55a69e3809a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2041177826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e380580 0x55a69e3809a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55a69e367c00 tx=0x7fc09000aed0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2041177826 shutdown_connections 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2041177826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf78039a70 0x7fbf7803bf30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2041177826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e380580 0x55a69e3809a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2041177826 >> 172.21.15.151:0/2041177826 conn(0x55a69e375f30 msgr2=0x55a69e376310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2041177826 shutdown_connections 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2041177826 wait complete. 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e36f470 msgr2=0x55a69e371860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e36f470 0x55a69e371860 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e276fe0 msgr2=0x55a69e36cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e276fe0 0x55a69e36cc70 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf84039a70 msgr2=0x7fbf8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf84039a70 0x7fbf8403bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc094001e40 tx=0x7fc0940013a0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 msgr2=0x55a69e365b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.637+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e365b00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc09801b430 tx=0x7fc09801a5a0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.641+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 shutdown_connections 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.641+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a69e36f470 0x55a69e371860 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.641+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a69e276fe0 0x55a69e36cc70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.641+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbf84039a70 0x7fbf8403bf30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.641+0000 7fc0a07809c0 1 --2- 172.21.15.151:0/2870842729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a69e273e00 0x55a69e365b00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.641+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 >> 172.21.15.151:0/2870842729 conn(0x55a69e26f920 msgr2=0x55a69e358ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.641+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 shutdown_connections 2024-09-12T16:52:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.641+0000 7fc0a07809c0 1 -- 172.21.15.151:0/2870842729 wait complete. 2024-09-12T16:52:40.656 INFO:teuthology.orchestra.run.smithi151.stdout:[{"tag":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.14580877744905938365\u0000","time":"2024-09-12T16:52:40.381425+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_7","key":"","instance":""}]}] 2024-09-12T16:52:40.656 DEBUG:tasks.util.rgw: json result: [{'tag': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.14580877744905938365\x00', 'time': '2024-09-12T16:52:40.381425+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_7', 'key': '', 'instance': ''}]}] 2024-09-12T16:52:40.657 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-12T16:52:40.657 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-12T16:52:40.657 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-12T16:52:40.732 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:40.732 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:40.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.729+0000 7f64b42c79c0 1 Processor -- start 2024-09-12T16:52:40.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.729+0000 7f64b42c79c0 1 -- start start 2024-09-12T16:52:40.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.729+0000 7f64b42c79c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d5671b210 0x564d567abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.729+0000 7f64b42c79c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d5665b9c0 con 0x564d5671b5f0 2024-09-12T16:52:40.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.729+0000 7f64b42c79c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x564d566ab6d0 con 0x564d5671b210 2024-09-12T16:52:40.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b1dcd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d5671b210 0x564d567abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b1dcd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d5671b210 0x564d567abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60304/0 (socket says 172.21.15.151:60304) 2024-09-12T16:52:40.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b1dcd640 1 -- 172.21.15.151:0/967667161 learned_addr learned my addr 172.21.15.151:0/967667161 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b15cc640 1 --1- 172.21.15.151:0/967667161 >> v1:172.21.15.122:6789/0 conn(0x564d5671b5f0 0x564d567ae510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:47218/0 (socket says 172.21.15.151:47218) 2024-09-12T16:52:40.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b1dcd640 1 -- 172.21.15.151:0/967667161 >> v1:172.21.15.122:6789/0 conn(0x564d5671b5f0 legacy=0x564d567ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b1dcd640 1 -- 172.21.15.151:0/967667161 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d5664fca0 con 0x564d5671b210 2024-09-12T16:52:40.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/967667161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d567abfc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f64a400a4e0 tx=0x7f64a401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c467730c35c9bf6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b0dcb640 1 -- 172.21.15.151:0/967667161 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a40aa540 con 0x564d5671b210 2024-09-12T16:52:40.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b0dcb640 1 -- 172.21.15.151:0/967667161 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a40aa6e0 con 0x564d5671b210 2024-09-12T16:52:40.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.733+0000 7f64b0dcb640 1 -- 172.21.15.151:0/967667161 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a40aaa40 con 0x564d5671b210 2024-09-12T16:52:40.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.737+0000 7f64b42c79c0 1 -- 172.21.15.151:0/967667161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 msgr2=0x564d567abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.737+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/967667161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d567abfc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f64a400a4e0 tx=0x7f64a401b090 comp rx=0 tx=0).stop 2024-09-12T16:52:40.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.737+0000 7f64b42c79c0 1 -- 172.21.15.151:0/967667161 shutdown_connections 2024-09-12T16:52:40.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.737+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/967667161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d567abfc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.737+0000 7f64b42c79c0 1 -- 172.21.15.151:0/967667161 >> 172.21.15.151:0/967667161 conn(0x564d567a18f0 msgr2=0x564d567a3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.737+0000 7f64b42c79c0 1 -- 172.21.15.151:0/967667161 shutdown_connections 2024-09-12T16:52:40.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.737+0000 7f64b42c79c0 1 -- 172.21.15.151:0/967667161 wait complete. 2024-09-12T16:52:40.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 Processor -- start 2024-09-12T16:52:40.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 -- start start 2024-09-12T16:52:40.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d56894850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d566af680 con 0x564d5671b210 2024-09-12T16:52:40.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b1dcd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d56894850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b1dcd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d56894850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60312/0 (socket says 172.21.15.151:60312) 2024-09-12T16:52:40.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b1dcd640 1 -- 172.21.15.151:0/878116526 learned_addr learned my addr 172.21.15.151:0/878116526 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b1dcd640 1 -- 172.21.15.151:0/878116526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d5662ada0 con 0x564d5671b210 2024-09-12T16:52:40.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/878116526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d56894850 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f64a40ac040 tx=0x7f64a40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823584fc0687b5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f639fe07640 1 -- 172.21.15.151:0/878116526 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a40b9030 con 0x564d5671b210 2024-09-12T16:52:40.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f639fe07640 1 -- 172.21.15.151:0/878116526 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a40aaa40 con 0x564d5671b210 2024-09-12T16:52:40.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f639fe07640 1 -- 172.21.15.151:0/878116526 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a40aad20 con 0x564d5671b210 2024-09-12T16:52:40.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 -- 172.21.15.151:0/878116526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 msgr2=0x564d56894850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/878116526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d56894850 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f64a40ac040 tx=0x7f64a40033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 -- 172.21.15.151:0/878116526 shutdown_connections 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/878116526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d56894850 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 -- 172.21.15.151:0/878116526 >> 172.21.15.151:0/878116526 conn(0x564d567a18f0 msgr2=0x564d568904a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 -- 172.21.15.151:0/878116526 shutdown_connections 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 -- 172.21.15.151:0/878116526 wait complete. 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.753+0000 7f64b42c79c0 1 Processor -- start 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b42c79c0 1 -- start start 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b42c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d5689be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b42c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d56651a50 con 0x564d5671b210 2024-09-12T16:52:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b1dcd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d5689be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b1dcd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d5689be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60320/0 (socket says 172.21.15.151:60320) 2024-09-12T16:52:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b1dcd640 1 -- 172.21.15.151:0/41621113 learned_addr learned my addr 172.21.15.151:0/41621113 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b1dcd640 1 -- 172.21.15.151:0/41621113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d5689c360 con 0x564d5671b210 2024-09-12T16:52:40.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d5689be00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f64a4003430 tx=0x7f64a4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f639e604640 1 -- 172.21.15.151:0/41621113 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a40b9070 con 0x564d5671b210 2024-09-12T16:52:40.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f639e604640 1 -- 172.21.15.151:0/41621113 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a40c2070 con 0x564d5671b210 2024-09-12T16:52:40.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d5689c5f0 con 0x564d5671b210 2024-09-12T16:52:40.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f639e604640 1 -- 172.21.15.151:0/41621113 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64a40b5ca0 con 0x564d5671b210 2024-09-12T16:52:40.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d5689cfa0 con 0x564d5671b210 2024-09-12T16:52:40.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f639e604640 1 -- 172.21.15.151:0/41621113 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f64a40b3040 con 0x564d5671b210 2024-09-12T16:52:40.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f639e604640 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6398039ac0 0x7f639803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f639e604640 1 -- 172.21.15.151:0/41621113 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f64a40ba070 con 0x564d5671b210 2024-09-12T16:52:40.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b15cc640 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6398039ac0 0x7f639803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d5671b5f0 0x564d568a2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568a34b0 con 0x564d5671b5f0 2024-09-12T16:52:40.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.757+0000 7f64b25ce640 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d5671b5f0 0x564d568a2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b15cc640 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6398039ac0 0x7f639803bf80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64a8001e90 tx=0x7f64a80013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b25ce640 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d5671b5f0 0x564d568a2f70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b25ce640 1 -- 172.21.15.151:0/41621113 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64ac0083f0 con 0x564d5671b5f0 2024-09-12T16:52:40.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568a3920 con 0x564d5671b5f0 2024-09-12T16:52:40.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b25ce640 1 -- 172.21.15.151:0/41621113 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64ac0083f0 con 0x564d5671b5f0 2024-09-12T16:52:40.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568a5730 0x564d568a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568a81f0 con 0x564d568a5730 2024-09-12T16:52:40.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568a5730 0x564d568a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568a5730 0x564d568a7b20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b1dcd640 1 -- 172.21.15.151:0/41621113 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568a5730 2024-09-12T16:52:40.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568a45d0 con 0x564d5671b5f0 2024-09-12T16:52:40.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b25ce640 1 -- 172.21.15.151:0/41621113 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64ac0083f0 con 0x564d5671b5f0 2024-09-12T16:52:40.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568a4a50 con 0x564d5671b5f0 2024-09-12T16:52:40.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.761+0000 7f64b25ce640 1 -- 172.21.15.151:0/41621113 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f64ac0083f0 con 0x564d5671b5f0 2024-09-12T16:52:40.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b42c79c0 1 Processor -- start 2024-09-12T16:52:40.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b42c79c0 1 -- start start 2024-09-12T16:52:40.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b42c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568b6880 0x564d568b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b42c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d566bc450 con 0x564d568b6880 2024-09-12T16:52:40.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b25ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568b6880 0x564d568b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b25ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568b6880 0x564d568b6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60322/0 (socket says 172.21.15.151:60322) 2024-09-12T16:52:40.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b25ce640 1 -- 172.21.15.151:0/3694647432 learned_addr learned my addr 172.21.15.151:0/3694647432 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b25ce640 1 -- 172.21.15.151:0/3694647432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d568b72e0 con 0x564d568b6880 2024-09-12T16:52:40.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b25ce640 1 --2- 172.21.15.151:0/3694647432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568b6880 0x564d568b6ca0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x564d5689d190 tx=0x7f64ac00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f63977fe640 1 -- 172.21.15.151:0/3694647432 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac007d10 con 0x564d568b6880 2024-09-12T16:52:40.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f63977fe640 1 -- 172.21.15.151:0/3694647432 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac01e020 con 0x564d568b6880 2024-09-12T16:52:40.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b42c79c0 1 -- 172.21.15.151:0/3694647432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d568b7b40 con 0x564d568b6880 2024-09-12T16:52:40.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f63977fe640 1 -- 172.21.15.151:0/3694647432 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac019420 con 0x564d568b6880 2024-09-12T16:52:40.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b42c79c0 1 -- 172.21.15.151:0/3694647432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d568b80b0 con 0x564d568b6880 2024-09-12T16:52:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f63977fe640 1 -- 172.21.15.151:0/3694647432 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f64ac016040 con 0x564d568b6880 2024-09-12T16:52:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f63977fe640 1 --2- 172.21.15.151:0/3694647432 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f638c039ac0 0x7f638c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f63977fe640 1 -- 172.21.15.151:0/3694647432 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f64ac01f030 con 0x564d568b6880 2024-09-12T16:52:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/3694647432 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f638c039ac0 0x7f638c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.765+0000 7f64b42c79c0 1 Processor -- start 2024-09-12T16:52:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- start start 2024-09-12T16:52:40.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/3694647432 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f638c039ac0 0x7f638c03bf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564d5689d250 tx=0x7f64a40e8e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d56894fe0 con 0x564d568c3180 2024-09-12T16:52:40.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60324/0 (socket says 172.21.15.151:60324) 2024-09-12T16:52:40.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 -- 172.21.15.151:0/4169884046 learned_addr learned my addr 172.21.15.151:0/4169884046 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 -- 172.21.15.151:0/4169884046 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d568c3b30 con 0x564d568c3180 2024-09-12T16:52:40.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 --2- 172.21.15.151:0/4169884046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568c3560 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f64ac050860 tx=0x7f64ac022e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cd669dc8e59d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f63957fa640 1 -- 172.21.15.151:0/4169884046 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac01d040 con 0x564d568c3180 2024-09-12T16:52:40.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f63957fa640 1 -- 172.21.15.151:0/4169884046 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac017bd0 con 0x564d568c3180 2024-09-12T16:52:40.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f63957fa640 1 -- 172.21.15.151:0/4169884046 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac04f3f0 con 0x564d568c3180 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- 172.21.15.151:0/4169884046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 msgr2=0x564d568c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/4169884046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568c3560 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f64ac050860 tx=0x7f64ac022e50 comp rx=0 tx=0).stop 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- 172.21.15.151:0/4169884046 shutdown_connections 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/4169884046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568c3560 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- 172.21.15.151:0/4169884046 >> 172.21.15.151:0/4169884046 conn(0x564d568bf5b0 msgr2=0x564d568bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- 172.21.15.151:0/4169884046 shutdown_connections 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- 172.21.15.151:0/4169884046 wait complete. 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 Processor -- start 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- start start 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b42c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d568c4190 con 0x564d568c3180 2024-09-12T16:52:40.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60336/0 (socket says 172.21.15.151:60336) 2024-09-12T16:52:40.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 learned_addr learned my addr 172.21.15.151:0/2300679691 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:40.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.769+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d568cac10 con 0x564d568c3180 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b25ce640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568ca6b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x564d568be540 tx=0x7f64ac0507f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f63837fe640 1 -- 172.21.15.151:0/2300679691 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac048040 con 0x564d568c3180 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f63837fe640 1 -- 172.21.15.151:0/2300679691 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac031070 con 0x564d568c3180 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d568caea0 con 0x564d568c3180 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f63837fe640 1 -- 172.21.15.151:0/2300679691 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac01d040 con 0x564d568c3180 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d568cb850 con 0x564d568c3180 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f63837fe640 1 -- 172.21.15.151:0/2300679691 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f64ac015d50 con 0x564d568c3180 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f63837fe640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f637c039a70 0x7f637c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f63837fe640 1 -- 172.21.15.151:0/2300679691 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f64ac037020 con 0x564d568c3180 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f637c039a70 0x7f637c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d568d59c0 0x564d568d7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568d85a0 con 0x564d568d59c0 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b15cc640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d568d59c0 0x564d568d7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f637c039a70 0x7f637c03bf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f64a40c4860 tx=0x7f64a40d1000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b15cc640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d568d59c0 0x564d568d7e50 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64a800f660 con 0x564d568d59c0 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 20 realm 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568d4e20 con 0x564d568d59c0 2024-09-12T16:52:40.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64a800f660 con 0x564d568d59c0 2024-09-12T16:52:40.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568d90f0 con 0x564d568d59c0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64a800f660 con 0x564d568d59c0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.773+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568d99c0 con 0x564d568d59c0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64a800f660 con 0x564d568d59c0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b42c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568da3e0 0x564d568dc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568dcec0 con 0x564d568da3e0 2024-09-12T16:52:40.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b25ce640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568da3e0 0x564d568dc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b25ce640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568da3e0 0x564d568dc7d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b42c79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b42c79c0 20 searching for the correct realm 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d568dee10 0x564d568e1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d568dee10 0x564d568e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d568dee10 0x564d568e1240 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b1dcd640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f64a40be6e0 0x7f64a4004610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x7f64a40be6e0 2024-09-12T16:52:40.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b15cc640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f64a40be6e0 0x7f64a4004610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b15cc640 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f64a40be6e0 0x7f64a4004610 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a800f660 con 0x7f64a40be6e0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.777+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568d59c0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a800f660 con 0x564d568d59c0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568d59c0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x7f64a40be6e0 2024-09-12T16:52:40.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568d59c0 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.781+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568d59c0 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x7f64a40be6e0 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568d59c0 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568d59c0 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.785+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x7f64a40be6e0 2024-09-12T16:52:40.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568d59c0 2024-09-12T16:52:40.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x7f64a40be6e0 2024-09-12T16:52:40.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568dee10 2024-09-12T16:52:40.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568da3e0 2024-09-12T16:52:40.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.789+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x564d568d59c0 2024-09-12T16:52:40.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1910 con 0x7f64a40be6e0 2024-09-12T16:52:40.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:40.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:40.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568dd880 con 0x564d568d59c0 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568de120 con 0x564d568d59c0 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568dd4c0 con 0x564d568d59c0 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 zone default found 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 4 Realm: () 2024-09-12T16:52:40.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 zonegroup default 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568e1d90 con 0x564d568da3e0 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568e4070 con 0x564d568dee10 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:40.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568e4410 con 0x564d568dee10 2024-09-12T16:52:40.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:40.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 started sync module instance, tier type = 2024-09-12T16:52:40.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:40.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.793+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e3500 con 0x7f64a40be6e0 2024-09-12T16:52:40.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.797+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.797+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94890164632096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e3500 con 0x7f64a40be6e0 2024-09-12T16:52:40.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.797+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e4ef0 con 0x564d568d59c0 2024-09-12T16:52:40.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.797+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94890164632096] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.797+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.797+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94890164636128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e3500 con 0x564d568d59c0 2024-09-12T16:52:40.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.797+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e5900 con 0x564d568dee10 2024-09-12T16:52:40.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94890164636128] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94890164629584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e3470 con 0x564d568dee10 2024-09-12T16:52:40.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e6640 con 0x7f64a40be6e0 2024-09-12T16:52:40.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94890164642128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e6ee0 con 0x7f64a40be6e0 2024-09-12T16:52:40.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e78a0 con 0x564d568d59c0 2024-09-12T16:52:40.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94890164629584] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.801+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94890164642128] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.805+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.805+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94890164646896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e7810 con 0x564d568d59c0 2024-09-12T16:52:40.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.805+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e6e30 con 0x564d568da3e0 2024-09-12T16:52:40.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.805+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94890164646896] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.805+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.805+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94890164644224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e6da0 con 0x564d568da3e0 2024-09-12T16:52:40.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.805+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e85f0 con 0x564d568da3e0 2024-09-12T16:52:40.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94890164650304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e8a10 con 0x564d568da3e0 2024-09-12T16:52:40.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e9530 con 0x564d568da3e0 2024-09-12T16:52:40.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94890164644224] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94890164650304] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94890164654080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e85a0 con 0x564d568da3e0 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 20 add_watcher() i=0 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 20 add_watcher() i=1 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 20 add_watcher() i=2 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 20 add_watcher() i=3 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 20 add_watcher() i=4 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 20 add_watcher() i=5 2024-09-12T16:52:40.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.809+0000 7f64b42c79c0 20 add_watcher() i=6 2024-09-12T16:52:40.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94890164654080] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b42c79c0 20 add_watcher() i=7 2024-09-12T16:52:40.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b42c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:40.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568ec630 con 0x564d568d59c0 2024-09-12T16:52:40.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94890164649024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568e9ab0 con 0x564d568d59c0 2024-09-12T16:52:40.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94890164649024] v34'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f6367fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:40.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b42c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:40.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b42c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:40.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.813+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4d80 con 0x564d568d59c0 2024-09-12T16:52:40.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.817+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.817+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4d80 con 0x564d568da3e0 2024-09-12T16:52:40.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.821+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.821+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4d80 con 0x564d568dee10 2024-09-12T16:52:40.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.821+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.821+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f5830 con 0x564d568d59c0 2024-09-12T16:52:40.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.821+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'159 uv152 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.821+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f5dc0 con 0x7f64a40be6e0 2024-09-12T16:52:40.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.825+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.825+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6250 con 0x564d568dee10 2024-09-12T16:52:40.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.825+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.825+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6250 con 0x564d568d59c0 2024-09-12T16:52:40.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.825+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.825+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6250 con 0x564d568da3e0 2024-09-12T16:52:40.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.829+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.829+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f62e0 con 0x7f64a40be6e0 2024-09-12T16:52:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.829+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.829+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f62e0 con 0x564d568dee10 2024-09-12T16:52:40.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.833+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.833+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f68d0 con 0x7f64a40be6e0 2024-09-12T16:52:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.833+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.833+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6870 con 0x564d568da3e0 2024-09-12T16:52:40.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.837+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.837+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6870 con 0x7f64a40be6e0 2024-09-12T16:52:40.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.837+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.837+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6850 con 0x564d568da3e0 2024-09-12T16:52:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.841+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.841+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6820 con 0x564d568d59c0 2024-09-12T16:52:40.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.841+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'160 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.841+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6820 con 0x564d568dee10 2024-09-12T16:52:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.845+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.845+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6820 con 0x7f64a40be6e0 2024-09-12T16:52:40.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.845+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.845+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6820 con 0x564d568dee10 2024-09-12T16:52:40.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.845+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.845+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6820 con 0x564d568d59c0 2024-09-12T16:52:40.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.849+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.849+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6820 con 0x564d568d59c0 2024-09-12T16:52:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.849+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'161 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.849+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6820 con 0x564d568dee10 2024-09-12T16:52:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.853+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.853+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6820 con 0x7f64a40be6e0 2024-09-12T16:52:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.853+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.853+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6860 con 0x564d568dee10 2024-09-12T16:52:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.857+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.857+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6860 con 0x564d568dee10 2024-09-12T16:52:40.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.857+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.857+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f68c0 con 0x564d568dee10 2024-09-12T16:52:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.857+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.857+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f68b0 con 0x564d568dee10 2024-09-12T16:52:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.861+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.861+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f6910 con 0x564d568da3e0 2024-09-12T16:52:40.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.861+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.861+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f68f0 con 0x564d568dee10 2024-09-12T16:52:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.865+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.865+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f68f0 con 0x564d568da3e0 2024-09-12T16:52:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.865+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.865+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f68f0 con 0x564d568dee10 2024-09-12T16:52:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.869+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.869+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f68f0 con 0x564d568da3e0 2024-09-12T16:52:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.873+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.873+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f68f0 con 0x7f64a40be6e0 2024-09-12T16:52:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.873+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.873+0000 7f6366fe5640 20 reqs_thread_entry: start 2024-09-12T16:52:40.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.873+0000 7f64b42c79c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:40.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.873+0000 7f64b42c79c0 20 Filter name: none 2024-09-12T16:52:40.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.873+0000 7f6364fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:40.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-12T16:52:40.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:94 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(94 gc.5 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:95 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(95 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:96 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(96 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(97 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(98 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.877+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:99 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== osd_op_reply(99 gc.5 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-12T16:52:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:100 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(100 gc.6 [call] v34'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:101 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(101 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:102 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(102 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:103 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(103 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:104 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(104 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.881+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.885+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(105 gc.6 [call] v34'24 uv24 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.885+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-12T16:52:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.885+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:106 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(106 gc.7 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:107 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(107 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:108 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(108 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:109 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(109 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:110 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(110 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.889+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:111 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(111 gc.7 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-12T16:52:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:112 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(112 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:113 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(113 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:114 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(114 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.893+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:115 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(115 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:116 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(116 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:117 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(117 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-12T16:52:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.897+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:118 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(118 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:119 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(119 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:120 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== osd_op_reply(120 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 35 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 36 ==== osd_op_reply(122 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 37 ==== osd_op_reply(123 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-12T16:52:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.901+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 24 ==== osd_op_reply(124 gc.10 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 25 ==== osd_op_reply(125 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 26 ==== osd_op_reply(126 gc.10 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:127 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 27 ==== osd_op_reply(127 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:128 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 28 ==== osd_op_reply(128 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:129 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 29 ==== osd_op_reply(129 gc.10 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.905+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-12T16:52:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.909+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:130 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.909+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(130 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.909+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:131 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.909+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(131 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:132 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== osd_op_reply(132 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:133 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== osd_op_reply(133 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:134 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(134 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.913+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:135 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.917+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(135 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.917+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-12T16:52:40.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.917+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:136 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.917+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 30 ==== osd_op_reply(136 gc.12 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:137 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 31 ==== osd_op_reply(137 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:138 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 32 ==== osd_op_reply(138 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:139 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 33 ==== osd_op_reply(139 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:140 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 34 ==== osd_op_reply(140 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:141 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 35 ==== osd_op_reply(141 gc.12 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-12T16:52:40.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.921+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:142 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.925+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== osd_op_reply(142 gc.13 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.925+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:143 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.925+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(143 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.925+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.925+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:144 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.925+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(144 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.925+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:145 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.929+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(145 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.929+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.929+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:146 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.929+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(146 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.929+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.929+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:147 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:40.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== osd_op_reply(147 gc.13 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:40.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-12T16:52:40.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:148 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(148 gc.14 [call] v34'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:149 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(149 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:150 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(150 gc.14 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:151 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(151 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.933+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:152 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.937+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(152 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.937+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.937+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:153 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.937+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 39 ==== osd_op_reply(153 gc.14 [call] v34'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.937+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-12T16:52:40.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.937+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:154 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 38 ==== osd_op_reply(154 gc.15 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:155 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 39 ==== osd_op_reply(155 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:156 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 40 ==== osd_op_reply(156 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:157 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 41 ==== osd_op_reply(157 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:158 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 42 ==== osd_op_reply(158 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.941+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:159 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 43 ==== osd_op_reply(159 gc.15 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-12T16:52:40.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:160 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 36 ==== osd_op_reply(160 gc.16 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:161 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 37 ==== osd_op_reply(161 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:162 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 38 ==== osd_op_reply(162 gc.16 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:163 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 39 ==== osd_op_reply(163 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:164 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 40 ==== osd_op_reply(164 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.945+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:165 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 41 ==== osd_op_reply(165 gc.16 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-12T16:52:40.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:166 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 44 ==== osd_op_reply(166 gc.17 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:167 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 45 ==== osd_op_reply(167 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:168 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 46 ==== osd_op_reply(168 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.949+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:169 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 47 ==== osd_op_reply(169 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:170 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 48 ==== osd_op_reply(170 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:171 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 49 ==== osd_op_reply(171 gc.17 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-12T16:52:40.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.953+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:172 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 40 ==== osd_op_reply(172 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:173 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 41 ==== osd_op_reply(173 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:174 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 42 ==== osd_op_reply(174 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:175 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 43 ==== osd_op_reply(175 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:176 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.957+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 44 ==== osd_op_reply(176 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.961+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.961+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:177 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.961+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 45 ==== osd_op_reply(177 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.961+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-12T16:52:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.961+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:178 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 46 ==== osd_op_reply(178 gc.19 [call] v34'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:179 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 47 ==== osd_op_reply(179 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:180 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 48 ==== osd_op_reply(180 gc.19 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:181 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 49 ==== osd_op_reply(181 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:182 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 50 ==== osd_op_reply(182 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.965+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:183 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:40.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.969+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 51 ==== osd_op_reply(183 gc.19 [call] v34'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:40.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.969+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-12T16:52:40.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.969+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:184 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.969+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 50 ==== osd_op_reply(184 gc.20 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.969+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:185 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 51 ==== osd_op_reply(185 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:186 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 52 ==== osd_op_reply(186 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:187 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 53 ==== osd_op_reply(187 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:188 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 54 ==== osd_op_reply(188 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:189 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 55 ==== osd_op_reply(189 gc.20 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-12T16:52:40.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.973+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:190 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 42 ==== osd_op_reply(190 gc.21 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:191 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 43 ==== osd_op_reply(191 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:192 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 44 ==== osd_op_reply(192 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:193 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 45 ==== osd_op_reply(193 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:194 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 46 ==== osd_op_reply(194 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.977+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:195 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.981+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 47 ==== osd_op_reply(195 gc.21 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.981+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-12T16:52:40.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.981+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:196 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.981+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 56 ==== osd_op_reply(196 gc.22 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.981+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:197 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.981+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 57 ==== osd_op_reply(197 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.981+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:198 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 58 ==== osd_op_reply(198 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:199 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 59 ==== osd_op_reply(199 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:200 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 60 ==== osd_op_reply(200 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:201 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 61 ==== osd_op_reply(201 gc.22 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-12T16:52:40.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.985+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:202 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 62 ==== osd_op_reply(202 gc.23 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:203 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 63 ==== osd_op_reply(203 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:204 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 64 ==== osd_op_reply(204 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:205 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 65 ==== osd_op_reply(205 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:206 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 66 ==== osd_op_reply(206 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.989+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:207 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.993+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 67 ==== osd_op_reply(207 gc.23 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.993+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-12T16:52:40.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.993+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:208 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.993+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 68 ==== osd_op_reply(208 gc.24 [call] v34'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.993+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:209 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.993+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 69 ==== osd_op_reply(209 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.993+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:210 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 70 ==== osd_op_reply(210 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:211 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 71 ==== osd_op_reply(211 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:40.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:212 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:40.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 72 ==== osd_op_reply(212 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:40.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:40.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:213 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 73 ==== osd_op_reply(213 gc.24 [call] v34'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-12T16:52:41.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:40.997+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:214 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 74 ==== osd_op_reply(214 gc.25 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:215 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 75 ==== osd_op_reply(215 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:216 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 76 ==== osd_op_reply(216 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:217 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 77 ==== osd_op_reply(217 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:218 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 78 ==== osd_op_reply(218 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.001+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:219 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.005+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 79 ==== osd_op_reply(219 gc.25 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.005+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-12T16:52:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.005+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:220 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 43 ==== osd_op_reply(220 gc.26 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:221 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 44 ==== osd_op_reply(221 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:222 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 45 ==== osd_op_reply(222 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:223 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 46 ==== osd_op_reply(223 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.009+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:224 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.013+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 47 ==== osd_op_reply(224 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.013+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.013+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:225 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.013+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 48 ==== osd_op_reply(225 gc.26 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.013+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-12T16:52:41.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.013+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:226 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 80 ==== osd_op_reply(226 gc.27 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:227 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 81 ==== osd_op_reply(227 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:228 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 82 ==== osd_op_reply(228 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:229 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 83 ==== osd_op_reply(229 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:230 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 84 ==== osd_op_reply(230 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.017+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:231 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.021+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 85 ==== osd_op_reply(231 gc.27 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.021+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-12T16:52:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.021+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:232 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.021+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 49 ==== osd_op_reply(232 gc.28 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.021+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:233 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.021+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 50 ==== osd_op_reply(233 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.021+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.021+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:234 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.025+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 51 ==== osd_op_reply(234 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.025+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:235 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.025+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 52 ==== osd_op_reply(235 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.025+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.025+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:236 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.025+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 53 ==== osd_op_reply(236 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.025+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.025+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:237 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.029+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 54 ==== osd_op_reply(237 gc.28 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.029+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-12T16:52:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.029+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:238 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.029+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 86 ==== osd_op_reply(238 gc.29 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.029+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:239 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.029+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 87 ==== osd_op_reply(239 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.029+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.029+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:240 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 88 ==== osd_op_reply(240 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:241 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 89 ==== osd_op_reply(241 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:242 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 90 ==== osd_op_reply(242 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:243 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 91 ==== osd_op_reply(243 gc.29 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-12T16:52:41.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.033+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:244 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.037+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 55 ==== osd_op_reply(244 gc.30 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.037+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:245 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.037+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 56 ==== osd_op_reply(245 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.037+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.037+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:246 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.041+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 57 ==== osd_op_reply(246 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.041+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:247 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.041+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 58 ==== osd_op_reply(247 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.041+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.041+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:248 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.041+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 59 ==== osd_op_reply(248 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.041+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.041+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:249 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 60 ==== osd_op_reply(249 gc.30 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-12T16:52:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:250 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 48 ==== osd_op_reply(250 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:251 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 49 ==== osd_op_reply(251 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:252 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 50 ==== osd_op_reply(252 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.045+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:253 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.049+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 51 ==== osd_op_reply(253 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.049+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.049+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:254 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.049+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 52 ==== osd_op_reply(254 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.049+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.049+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:255 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x7f64a40be6e0 2024-09-12T16:52:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 53 ==== osd_op_reply(255 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-12T16:52:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:256 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 52 ==== osd_op_reply(256 gc.0 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:257 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 53 ==== osd_op_reply(257 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:258 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 54 ==== osd_op_reply(258 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:259 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 55 ==== osd_op_reply(259 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.053+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:260 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.057+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 56 ==== osd_op_reply(260 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.057+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.057+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:261 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.057+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 57 ==== osd_op_reply(261 gc.0 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.057+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-12T16:52:41.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.057+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:262 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.061+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 61 ==== osd_op_reply(262 gc.1 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.061+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:263 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.061+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 62 ==== osd_op_reply(263 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.061+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.061+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:264 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.061+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 63 ==== osd_op_reply(264 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.061+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:265 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.065+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 64 ==== osd_op_reply(265 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.065+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.065+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:266 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.065+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 65 ==== osd_op_reply(266 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.065+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.065+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:267 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568da3e0 2024-09-12T16:52:41.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 66 ==== osd_op_reply(267 gc.1 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-12T16:52:41.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:268 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 92 ==== osd_op_reply(268 gc.2 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:269 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 93 ==== osd_op_reply(269 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:270 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 94 ==== osd_op_reply(270 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.069+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:271 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 95 ==== osd_op_reply(271 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:272 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 96 ==== osd_op_reply(272 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:273 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568dee10 2024-09-12T16:52:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 97 ==== osd_op_reply(273 gc.2 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-12T16:52:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.073+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:274 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 58 ==== osd_op_reply(274 gc.3 [call] v34'166 uv166 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:275 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 59 ==== osd_op_reply(275 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:276 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 60 ==== osd_op_reply(276 gc.3 [call out=24b] v0'0 uv166 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:277 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 61 ==== osd_op_reply(277 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.077+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:278 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d568f4810 con 0x564d568d59c0 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 62 ==== osd_op_reply(278 gc.3 [call out=1702b] v0'0 uv166 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 20 garbage collection: RGWGC::process iterating over entry tag='1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.14580877744905938365', time=2024-09-12T16:52:40.381425+0000, chain.objs.size()=7 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_1 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:279 3.2cs0 3:350b0403:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d569134c0 con 0x564d568dee10 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_2 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:280 3.es0 3:732bd01a:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d56915e50 con 0x7f64a40be6e0 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_3 2024-09-12T16:52:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:281 3.27s0 3:e5335c6e:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d56915e50 con 0x564d568da3e0 2024-09-12T16:52:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_4 2024-09-12T16:52:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:282 3.2es0 3:77391d95:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_5 2024-09-12T16:52:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:283 3.2fs0 3:f78c3295:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568dee10 2024-09-12T16:52:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_6 2024-09-12T16:52:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:284 3.26s0 3:64e0ba9c:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691fdb0 con 0x7f64a40be6e0 2024-09-12T16:52:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_7 2024-09-12T16:52:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.081+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:285 3.3fs0 3:fc9d2d42:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d56922ad0 con 0x7f64a40be6e0 2024-09-12T16:52:41.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.085+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 98 ==== osd_op_reply(279 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.085+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 54 ==== osd_op_reply(285 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.089+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 55 ==== osd_op_reply(280 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.089+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 67 ==== osd_op_reply(281 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_3 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.089+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 56 ==== osd_op_reply(282 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.089+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 57 ==== osd_op_reply(284 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.093+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 99 ==== osd_op_reply(283 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1__shadow_.a28u7Ol-yd0EceBHMYDi4Y3Z8eE5Iug_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.093+0000 7f64b42c79c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T16:52:41.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.093+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:286 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568d59c0 2024-09-12T16:52:41.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.097+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 63 ==== osd_op_reply(286 gc.3 [call] v34'167 uv167 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.097+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:287 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568d59c0 2024-09-12T16:52:41.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.097+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 64 ==== osd_op_reply(287 gc.3 [call] v34'168 uv168 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x564d568d59c0 2024-09-12T16:52:41.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.097+0000 7f64b42c79c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-12T16:52:41.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.097+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:288 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 58 ==== osd_op_reply(288 gc.4 [call] v34'54 uv54 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:289 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 59 ==== osd_op_reply(289 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:290 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 60 ==== osd_op_reply(290 gc.4 [call out=24b] v0'0 uv54 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:291 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 61 ==== osd_op_reply(291 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:52:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:292 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 62 ==== osd_op_reply(292 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f64a802b040 con 0x7f64a40be6e0 2024-09-12T16:52:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b42c79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:52:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.101+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:293 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.105+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 63 ==== osd_op_reply(293 gc.4 [call] v34'55 uv55 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64a8048040 con 0x7f64a40be6e0 2024-09-12T16:52:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.105+0000 7f6367fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.105+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94890164649024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568d59c0 2024-09-12T16:52:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.109+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94890164649024] v34'169 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64a8048040 con 0x564d568d59c0 2024-09-12T16:52:41.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.109+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94890164632096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.109+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94890164632096] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a8048040 con 0x7f64a40be6e0 2024-09-12T16:52:41.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.109+0000 7f64b42c79c0 20 remove_watcher() i=0 2024-09-12T16:52:41.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.109+0000 7f64b42c79c0 2 removed watcher, disabling cache 2024-09-12T16:52:41.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.109+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94890164636128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568d59c0 2024-09-12T16:52:41.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.113+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94890164636128] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a8048040 con 0x564d568d59c0 2024-09-12T16:52:41.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.113+0000 7f64b42c79c0 20 remove_watcher() i=1 2024-09-12T16:52:41.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.113+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94890164629584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568dee10 2024-09-12T16:52:41.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.117+0000 7f64b1dcd640 1 -- 172.21.15.151:0/2300679691 <== osd.3 v2:172.21.15.151:6808/987175333 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94890164629584] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a40beca0 con 0x564d568dee10 2024-09-12T16:52:41.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.117+0000 7f64b42c79c0 20 remove_watcher() i=2 2024-09-12T16:52:41.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.117+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94890164642128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x7f64a40be6e0 2024-09-12T16:52:41.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.117+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.2 v2:172.21.15.151:6800/1197700885 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94890164642128] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a8048040 con 0x7f64a40be6e0 2024-09-12T16:52:41.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.117+0000 7f64b42c79c0 20 remove_watcher() i=3 2024-09-12T16:52:41.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.117+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94890164646896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568d59c0 2024-09-12T16:52:41.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.121+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 <== osd.1 v2:172.21.15.151:6816/883447514 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94890164646896] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64a8048040 con 0x564d568d59c0 2024-09-12T16:52:41.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.121+0000 7f64b42c79c0 20 remove_watcher() i=4 2024-09-12T16:52:41.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.121+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94890164644224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568da3e0 2024-09-12T16:52:41.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.121+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94890164644224] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.121+0000 7f64b42c79c0 20 remove_watcher() i=5 2024-09-12T16:52:41.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.121+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94890164650304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568da3e0 2024-09-12T16:52:41.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.125+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94890164650304] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.125+0000 7f64b42c79c0 20 remove_watcher() i=6 2024-09-12T16:52:41.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.125+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94890164654080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d5691adf0 con 0x564d568da3e0 2024-09-12T16:52:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b25ce640 1 -- 172.21.15.151:0/2300679691 <== osd.0 v2:172.21.15.122:6800/3868153603 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94890164654080] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac02a070 con 0x564d568da3e0 2024-09-12T16:52:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 20 remove_watcher() i=7 2024-09-12T16:52:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568da3e0 msgr2=0x564d568dc7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568da3e0 0x564d568dc7d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d568d59c0 msgr2=0x564d568d7e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d568d59c0 0x564d568d7e50 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f64a40be6e0 msgr2=0x7f64a4004610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f64a40be6e0 0x7f64a4004610 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d568dee10 msgr2=0x564d568e1240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d568dee10 0x564d568e1240 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f637c039a70 msgr2=0x7f637c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f637c039a70 0x7f637c03bf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f64a40c4860 tx=0x7f64a40d1000 comp rx=0 tx=0).stop 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 msgr2=0x564d568ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568ca6b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x564d568be540 tx=0x7f64ac0507f0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b15cc640 1 -- 172.21.15.151:0/2300679691 reap_dead start 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 shutdown_connections 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/2300679691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568c3180 0x564d568ca6b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 >> 172.21.15.151:0/2300679691 conn(0x564d568bf5b0 msgr2=0x564d568bd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 shutdown_connections 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/2300679691 wait complete. 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/3694647432 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f638c039ac0 msgr2=0x7f638c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/3694647432 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f638c039ac0 0x7f638c03bf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564d5689d250 tx=0x7f64a40e8e30 comp rx=0 tx=0).stop 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/3694647432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568b6880 msgr2=0x564d568b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/3694647432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568b6880 0x564d568b6ca0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x564d5689d190 tx=0x7f64ac00aed0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/3694647432 shutdown_connections 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/3694647432 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f638c039ac0 0x7f638c03bf80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/3694647432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d568b6880 0x564d568b6ca0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/3694647432 >> 172.21.15.151:0/3694647432 conn(0x564d568ac230 msgr2=0x564d568ac610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/3694647432 shutdown_connections 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/3694647432 wait complete. 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568a5730 msgr2=0x564d568a7b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568a5730 0x564d568a7b20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d5671b5f0 msgr2=0x564d568a2f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d5671b5f0 0x564d568a2f70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6398039ac0 msgr2=0x7f639803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6398039ac0 0x7f639803bf80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64a8001e90 tx=0x7f64a80013f0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 msgr2=0x564d5689be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d5689be00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f64a4003430 tx=0x7f64a4017e30 comp rx=0 tx=0).stop 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 shutdown_connections 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d568a5730 0x564d568a7b20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d5671b5f0 0x564d568a2f70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6398039ac0 0x7f639803bf80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 --2- 172.21.15.151:0/41621113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d5671b210 0x564d5689be00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 >> 172.21.15.151:0/41621113 conn(0x564d567a18f0 msgr2=0x564d5688ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 shutdown_connections 2024-09-12T16:52:41.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.129+0000 7f64b42c79c0 1 -- 172.21.15.151:0/41621113 wait complete. 2024-09-12T16:52:41.148 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-12T16:52:41.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-12T16:52:41.148 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-12T16:52:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:41.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d964c79c0 1 Processor -- start 2024-09-12T16:52:41.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d964c79c0 1 -- start start 2024-09-12T16:52:41.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d964c79c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5588d405f710 0x5588d4061b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d964c79c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5588d3f119c0 con 0x5588d4062040 2024-09-12T16:52:41.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d964c79c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5588d3f616d0 con 0x5588d405f710 2024-09-12T16:52:41.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d93fcd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5588d405f710 0x5588d4061b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d93fcd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5588d405f710 0x5588d4061b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60338/0 (socket says 172.21.15.151:60338) 2024-09-12T16:52:41.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d93fcd640 1 -- 172.21.15.151:0/3343276512 learned_addr learned my addr 172.21.15.151:0/3343276512 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d93fcd640 1 -- 172.21.15.151:0/3343276512 >> v1:172.21.15.122:6789/0 conn(0x5588d4062040 legacy=0x5588d4064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.225+0000 7f1d93fcd640 1 -- 172.21.15.151:0/3343276512 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d3f05ca0 con 0x5588d405f710 2024-09-12T16:52:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/3343276512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4061b00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00a5c0 tx=0x7f1d7c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff1258c61ec8500 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d92fcb640 1 -- 172.21.15.151:0/3343276512 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c0a6070 con 0x5588d405f710 2024-09-12T16:52:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d92fcb640 1 -- 172.21.15.151:0/3343276512 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0af070 con 0x5588d405f710 2024-09-12T16:52:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d92fcb640 1 -- 172.21.15.151:0/3343276512 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c0aa5c0 con 0x5588d405f710 2024-09-12T16:52:41.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3343276512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 msgr2=0x5588d4061b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/3343276512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4061b00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00a5c0 tx=0x7f1d7c01b340 comp rx=0 tx=0).stop 2024-09-12T16:52:41.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3343276512 shutdown_connections 2024-09-12T16:52:41.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/3343276512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4061b00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3343276512 >> 172.21.15.151:0/3343276512 conn(0x5588d3fd2aa0 msgr2=0x5588d3fd2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3343276512 shutdown_connections 2024-09-12T16:52:41.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.229+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3343276512 wait complete. 2024-09-12T16:52:41.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d964c79c0 1 Processor -- start 2024-09-12T16:52:41.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d964c79c0 1 -- start start 2024-09-12T16:52:41.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d964c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d964c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588d3f65680 con 0x5588d405f710 2024-09-12T16:52:41.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d93fcd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d93fcd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d414a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60346/0 (socket says 172.21.15.151:60346) 2024-09-12T16:52:41.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d93fcd640 1 -- 172.21.15.151:0/3801112431 learned_addr learned my addr 172.21.15.151:0/3801112431 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d93fcd640 1 -- 172.21.15.151:0/3801112431 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d3ee0da0 con 0x5588d405f710 2024-09-12T16:52:41.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/3801112431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d414a8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0ac040 tx=0x7f1d7c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b10259ad5f7871 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.245+0000 7f1c80e19640 1 -- 172.21.15.151:0/3801112431 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c0aa9b0 con 0x5588d405f710 2024-09-12T16:52:41.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1c80e19640 1 -- 172.21.15.151:0/3801112431 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0aab50 con 0x5588d405f710 2024-09-12T16:52:41.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1c80e19640 1 -- 172.21.15.151:0/3801112431 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c0bd3f0 con 0x5588d405f710 2024-09-12T16:52:41.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3801112431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 msgr2=0x5588d414a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/3801112431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d414a8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0ac040 tx=0x7f1d7c003030 comp rx=0 tx=0).stop 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3801112431 shutdown_connections 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/3801112431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d414a8f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3801112431 >> 172.21.15.151:0/3801112431 conn(0x5588d3fd2aa0 msgr2=0x5588d4146590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3801112431 shutdown_connections 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3801112431 wait complete. 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 Processor -- start 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- start start 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588d3f07a50 con 0x5588d405f710 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d93fcd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d93fcd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60356/0 (socket says 172.21.15.151:60356) 2024-09-12T16:52:41.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2320266813 learned_addr learned my addr 172.21.15.151:0/2320266813 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2320266813 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d4152390 con 0x5588d405f710 2024-09-12T16:52:41.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4151e30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0199f0 tx=0x7f1d7c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1c7f616640 1 -- 172.21.15.151:0/2320266813 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c0c6690 con 0x5588d405f710 2024-09-12T16:52:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588d4152620 con 0x5588d405f710 2024-09-12T16:52:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1c7f616640 1 -- 172.21.15.151:0/2320266813 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0cc070 con 0x5588d405f710 2024-09-12T16:52:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1c7f616640 1 -- 172.21.15.151:0/2320266813 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c0c6980 con 0x5588d405f710 2024-09-12T16:52:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.249+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d4152fd0 con 0x5588d405f710 2024-09-12T16:52:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1c7f616640 1 -- 172.21.15.151:0/2320266813 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d7c0c6c30 con 0x5588d405f710 2024-09-12T16:52:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1c7f616640 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c78039a70 0x7f1c7803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1c7f616640 1 -- 172.21.15.151:0/2320266813 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1d7c0ebd00 con 0x5588d405f710 2024-09-12T16:52:41.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d937cc640 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c78039a70 0x7f1c7803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d4062040 0x5588d4158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41594e0 con 0x5588d4062040 2024-09-12T16:52:41.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d947ce640 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d4062040 0x5588d4158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d937cc640 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c78039a70 0x7f1c7803bf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1d84001e60 tx=0x7f1d840013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d947ce640 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d4062040 0x5588d4158fa0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d947ce640 1 -- 172.21.15.151:0/2320266813 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x5588d4062040 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d4153420 con 0x5588d4062040 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d947ce640 1 -- 172.21.15.151:0/2320266813 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x5588d4062040 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d415b7a0 0x5588d415db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d415e280 con 0x5588d415b7a0 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d415b7a0 0x5588d415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.253+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d415b7a0 0x5588d415db90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2320266813 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d415b7a0 2024-09-12T16:52:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d415a640 con 0x5588d4062040 2024-09-12T16:52:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d947ce640 1 -- 172.21.15.151:0/2320266813 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x5588d4062040 2024-09-12T16:52:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d415aab0 con 0x5588d4062040 2024-09-12T16:52:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d947ce640 1 -- 172.21.15.151:0/2320266813 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x5588d4062040 2024-09-12T16:52:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d964c79c0 1 Processor -- start 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d964c79c0 1 -- start start 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d964c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d416c930 0x5588d416cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d964c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588d3f72450 con 0x5588d416c930 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d947ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d416c930 0x5588d416cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d947ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d416c930 0x5588d416cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60362/0 (socket says 172.21.15.151:60362) 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d947ce640 1 -- 172.21.15.151:0/3918180168 learned_addr learned my addr 172.21.15.151:0/3918180168 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d947ce640 1 -- 172.21.15.151:0/3918180168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d416d390 con 0x5588d416c930 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d947ce640 1 --2- 172.21.15.151:0/3918180168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d416c930 0x5588d416cd50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5588d4153f60 tx=0x7f1d8c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1c7ce11640 1 -- 172.21.15.151:0/3918180168 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d8c014450 con 0x5588d416c930 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3918180168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588d416dbf0 con 0x5588d416c930 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1c7ce11640 1 -- 172.21.15.151:0/3918180168 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d8c0145f0 con 0x5588d416c930 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1c7ce11640 1 -- 172.21.15.151:0/3918180168 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d8c014910 con 0x5588d416c930 2024-09-12T16:52:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.257+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3918180168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d416e160 con 0x5588d416c930 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1c7ce11640 1 -- 172.21.15.151:0/3918180168 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d8c011040 con 0x5588d416c930 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1c7ce11640 1 --2- 172.21.15.151:0/3918180168 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c6c039a70 0x7f1c6c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1c7ce11640 1 -- 172.21.15.151:0/3918180168 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1d8c01e070 con 0x5588d416c930 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/3918180168 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c6c039a70 0x7f1c6c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 Processor -- start 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 -- start start 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/3918180168 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c6c039a70 0x7f1c6c03bf30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5588d41598f0 tx=0x7f1d7c0dd040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d417a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588d414b060 con 0x5588d417a2a0 2024-09-12T16:52:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d947ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d417a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d947ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d417a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60372/0 (socket says 172.21.15.151:60372) 2024-09-12T16:52:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d947ce640 1 -- 172.21.15.151:0/2132480160 learned_addr learned my addr 172.21.15.151:0/2132480160 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d947ce640 1 -- 172.21.15.151:0/2132480160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d417ac70 con 0x5588d417a2a0 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d947ce640 1 --2- 172.21.15.151:0/2132480160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d417a680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0505b0 tx=0x7f1d8c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e96aa5af0bb36ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1c767fc640 1 -- 172.21.15.151:0/2132480160 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d8c028070 con 0x5588d417a2a0 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1c767fc640 1 -- 172.21.15.151:0/2132480160 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d8c02b350 con 0x5588d417a2a0 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1c767fc640 1 -- 172.21.15.151:0/2132480160 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d8c016440 con 0x5588d417a2a0 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2132480160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 msgr2=0x5588d417a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2132480160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d417a680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0505b0 tx=0x7f1d8c011a80 comp rx=0 tx=0).stop 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2132480160 shutdown_connections 2024-09-12T16:52:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2132480160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d417a680 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2132480160 >> 172.21.15.151:0/2132480160 conn(0x5588d4175660 msgr2=0x5588d41738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2132480160 shutdown_connections 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.261+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2132480160 wait complete. 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 1 Processor -- start 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 1 -- start start 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d4180700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588d4179190 con 0x5588d417a2a0 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d947ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d4180700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d947ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d4180700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60380/0 (socket says 172.21.15.151:60380) 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 learned_addr learned my addr 172.21.15.151:0/2902943136 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588d4180c60 con 0x5588d417a2a0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d947ce640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d4180700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c050510 tx=0x7f1d8c050540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1c74ff9640 1 -- 172.21.15.151:0/2902943136 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d8c02b350 con 0x5588d417a2a0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588d4180ef0 con 0x5588d417a2a0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1c74ff9640 1 -- 172.21.15.151:0/2902943136 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d8c032070 con 0x5588d417a2a0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1c74ff9640 1 -- 172.21.15.151:0/2902943136 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d8c04f280 con 0x5588d417a2a0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588d41818a0 con 0x5588d417a2a0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1c74ff9640 1 -- 172.21.15.151:0/2902943136 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d8c001d10 con 0x5588d417a2a0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1c74ff9640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5c039a70 0x7f1c5c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1c74ff9640 1 -- 172.21.15.151:0/2902943136 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1d8c00e040 con 0x5588d417a2a0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5c039a70 0x7f1c5c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d418bbc0 0x5588d418e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.265+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d418e7a0 con 0x5588d418bbc0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d937cc640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d418bbc0 0x5588d418e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5c039a70 0x7f1c5c03bf30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0bcfd0 tx=0x7f1d7c0ef040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d937cc640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d418bbc0 0x5588d418e050 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d8400d040 con 0x5588d418bbc0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 realm 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d418afd0 con 0x5588d418bbc0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d8400d040 con 0x5588d418bbc0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d418f2a0 con 0x5588d418bbc0 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d8400d040 con 0x5588d418bbc0 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d418fb70 con 0x5588d418bbc0 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d8400d040 con 0x5588d418bbc0 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d4190470 0x5588d4192860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d4192fd0 con 0x5588d4190470 2024-09-12T16:52:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d947ce640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d4190470 0x5588d4192860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d947ce640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d4190470 0x5588d4192860 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 20 searching for the correct realm 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588d4194f70 0x5588d4197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d4194f70 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.269+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588d4194f70 0x5588d4197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588d4194f70 0x5588d4197430 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d93fcd640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1d7c009040 0x7f1d7c0c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x7f1d7c009040 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d937cc640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1d7c009040 0x7f1d7c0c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d937cc640 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1d7c009040 0x7f1d7c0c78f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8400d040 con 0x7f1d7c009040 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d4190470 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d418bbc0 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8400d040 con 0x5588d418bbc0 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d418bbc0 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d4190470 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d4190470 2024-09-12T16:52:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.273+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x7f1d7c009040 2024-09-12T16:52:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d4194f70 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d418bbc0 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d4190470 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d418bbc0 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x7f1d7c009040 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588d4197b00 con 0x5588d4194f70 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4194f70 2024-09-12T16:52:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4190470 2024-09-12T16:52:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4194f70 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4194f70 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.277+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d418bbc0 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d418bbc0 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4190470 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4194f70 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x7f1d7c009040 2024-09-12T16:52:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d418bbc0 2024-09-12T16:52:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4190470 2024-09-12T16:52:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4194f70 2024-09-12T16:52:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4190470 2024-09-12T16:52:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.281+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x7f1d7c009040 2024-09-12T16:52:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4194f70 2024-09-12T16:52:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d4190470 2024-09-12T16:52:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x5588d418bbc0 2024-09-12T16:52:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d7c106040 con 0x7f1d7c009040 2024-09-12T16:52:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d4193990 con 0x5588d418bbc0 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d4193e10 con 0x5588d418bbc0 2024-09-12T16:52:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d4194230 con 0x5588d418bbc0 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 zone default found 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 4 Realm: () 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 zonegroup default 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d4194230 con 0x5588d4190470 2024-09-12T16:52:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.285+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d4199e20 con 0x5588d4194f70 2024-09-12T16:52:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d419a1c0 con 0x5588d4194f70 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 20 started sync module instance, tier type = 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d4199260 con 0x7f1d7c009040 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94046162360240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d4199260 con 0x7f1d7c009040 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419abc0 con 0x5588d418bbc0 2024-09-12T16:52:41.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.289+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94046162360240] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.293+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.293+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94046162364112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d4199260 con 0x5588d418bbc0 2024-09-12T16:52:41.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.293+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419b4a0 con 0x5588d4194f70 2024-09-12T16:52:41.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.293+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94046162364112] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.293+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.293+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94046162357680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41991d0 con 0x5588d4194f70 2024-09-12T16:52:41.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.293+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419c200 con 0x7f1d7c009040 2024-09-12T16:52:41.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.297+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.297+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94046162369776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419caa0 con 0x7f1d7c009040 2024-09-12T16:52:41.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.297+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419d4a0 con 0x5588d418bbc0 2024-09-12T16:52:41.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.297+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94046162357680] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.297+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94046162369776] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.297+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.297+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94046162368576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419c570 con 0x5588d418bbc0 2024-09-12T16:52:41.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.297+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419dd70 con 0x5588d4190470 2024-09-12T16:52:41.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.301+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94046162368576] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.301+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.301+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94046162376896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419c570 con 0x5588d4190470 2024-09-12T16:52:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.301+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419e5c0 con 0x5588d4190470 2024-09-12T16:52:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.301+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.301+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94046162379024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419e9e0 con 0x5588d4190470 2024-09-12T16:52:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.301+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419f500 con 0x5588d4190470 2024-09-12T16:52:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.301+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94046162376896] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94046162379024] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94046162382800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419e570 con 0x5588d4190470 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 20 add_watcher() i=0 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 20 add_watcher() i=1 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 20 add_watcher() i=2 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 20 add_watcher() i=3 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 20 add_watcher() i=4 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 20 add_watcher() i=5 2024-09-12T16:52:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 20 add_watcher() i=6 2024-09-12T16:52:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94046162382800] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 20 add_watcher() i=7 2024-09-12T16:52:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a2600 con 0x5588d418bbc0 2024-09-12T16:52:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.305+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94046162374576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419fa80 con 0x5588d418bbc0 2024-09-12T16:52:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.309+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94046162374576] v34'170 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.309+0000 7f1c497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.309+0000 7f1d964c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.309+0000 7f1d964c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.309+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a47a0 con 0x5588d418bbc0 2024-09-12T16:52:41.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.309+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.309+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41aaf20 con 0x5588d4190470 2024-09-12T16:52:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.313+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.313+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41aaf20 con 0x5588d4194f70 2024-09-12T16:52:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.313+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.313+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ab300 con 0x5588d418bbc0 2024-09-12T16:52:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.317+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'171 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.317+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ab740 con 0x7f1d7c009040 2024-09-12T16:52:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.317+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'56 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.317+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41aa3c0 con 0x5588d4194f70 2024-09-12T16:52:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.317+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.317+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41aa3c0 con 0x5588d418bbc0 2024-09-12T16:52:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.321+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.321+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41aa3c0 con 0x5588d4190470 2024-09-12T16:52:41.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.321+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.321+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41aa510 con 0x7f1d7c009040 2024-09-12T16:52:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.325+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.325+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41aa660 con 0x5588d4194f70 2024-09-12T16:52:41.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.325+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.325+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x7f1d7c009040 2024-09-12T16:52:41.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.325+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.325+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4190470 2024-09-12T16:52:41.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.329+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.329+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x7f1d7c009040 2024-09-12T16:52:41.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.329+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.329+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4190470 2024-09-12T16:52:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.333+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.333+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d418bbc0 2024-09-12T16:52:41.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.333+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'172 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.333+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4194f70 2024-09-12T16:52:41.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.337+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.337+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x7f1d7c009040 2024-09-12T16:52:41.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.337+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.337+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4194f70 2024-09-12T16:52:41.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.341+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.341+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d418bbc0 2024-09-12T16:52:41.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.341+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.341+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d418bbc0 2024-09-12T16:52:41.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.341+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'173 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.341+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4194f70 2024-09-12T16:52:41.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.345+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.345+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x7f1d7c009040 2024-09-12T16:52:41.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.345+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.345+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4194f70 2024-09-12T16:52:41.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.349+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.349+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4194f70 2024-09-12T16:52:41.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.349+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.349+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4194f70 2024-09-12T16:52:41.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.349+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.349+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4194f70 2024-09-12T16:52:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.353+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.353+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4190470 2024-09-12T16:52:41.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.353+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.353+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4194f70 2024-09-12T16:52:41.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.357+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.357+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac280 con 0x5588d4190470 2024-09-12T16:52:41.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.357+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.357+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac280 con 0x5588d4194f70 2024-09-12T16:52:41.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.361+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.361+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac250 con 0x5588d4190470 2024-09-12T16:52:41.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41ac270 con 0x7f1d7c009040 2024-09-12T16:52:41.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1bc3fff640 20 reqs_thread_entry: start 2024-09-12T16:52:41.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1d964c79c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:41.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1d964c79c0 20 Filter name: none 2024-09-12T16:52:41.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1bc1ffb640 20 reqs_thread_entry: start 2024-09-12T16:52:41.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d418bbc0 2024-09-12T16:52:41.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.365+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a8ea0 con 0x5588d418bbc0 2024-09-12T16:52:41.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.369+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv168 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv55 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv24 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.373+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d418bbc0 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x5588d418bbc0 2024-09-12T16:52:41.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4190470 2024-09-12T16:52:41.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4190470 2024-09-12T16:52:41.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x7f1d7c009040 2024-09-12T16:52:41.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x7f1d7c009040 2024-09-12T16:52:41.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.377+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.381+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d8402a040 con 0x7f1d7c009040 2024-09-12T16:52:41.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.385+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.389+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d418bbc0 2024-09-12T16:52:41.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d418bbc0 2024-09-12T16:52:41.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d418bbc0 2024-09-12T16:52:41.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d418bbc0 2024-09-12T16:52:41.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.393+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x7f1d7c009040 2024-09-12T16:52:41.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x7f1d7c009040 2024-09-12T16:52:41.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.397+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4190470 2024-09-12T16:52:41.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.401+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4190470 2024-09-12T16:52:41.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.405+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4190470 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4190470 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4194f70 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4194f70 2024-09-12T16:52:41.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.409+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4190470 2024-09-12T16:52:41.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d4190470 2024-09-12T16:52:41.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x5588d4190470 2024-09-12T16:52:41.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x7f1d7c009040 2024-09-12T16:52:41.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x7f1d7c009040 2024-09-12T16:52:41.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.413+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588d41c7c10 con 0x7f1d7c009040 2024-09-12T16:52:41.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.417+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.417+0000 7f1c497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:41.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.417+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94046162374576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41a9350 con 0x5588d418bbc0 2024-09-12T16:52:41.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.417+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94046162374576] v34'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.417+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94046162360240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419cfb0 con 0x7f1d7c009040 2024-09-12T16:52:41.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.421+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94046162360240] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.421+0000 7f1d964c79c0 20 remove_watcher() i=0 2024-09-12T16:52:41.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.421+0000 7f1d964c79c0 2 removed watcher, disabling cache 2024-09-12T16:52:41.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.421+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94046162364112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41997b0 con 0x5588d418bbc0 2024-09-12T16:52:41.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.421+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94046162364112] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.421+0000 7f1d964c79c0 20 remove_watcher() i=1 2024-09-12T16:52:41.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.421+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94046162357680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41997b0 con 0x5588d4194f70 2024-09-12T16:52:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.425+0000 7f1d93fcd640 1 -- 172.21.15.151:0/2902943136 <== osd.3 v2:172.21.15.151:6808/987175333 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94046162357680] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c0b3d10 con 0x5588d4194f70 2024-09-12T16:52:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.425+0000 7f1d964c79c0 20 remove_watcher() i=2 2024-09-12T16:52:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.425+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94046162369776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d4198db0 con 0x7f1d7c009040 2024-09-12T16:52:41.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.425+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.2 v2:172.21.15.151:6800/1197700885 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94046162369776] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d84048040 con 0x7f1d7c009040 2024-09-12T16:52:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.425+0000 7f1d964c79c0 20 remove_watcher() i=3 2024-09-12T16:52:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.425+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94046162368576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d41997b0 con 0x5588d418bbc0 2024-09-12T16:52:41.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.429+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 <== osd.1 v2:172.21.15.151:6816/883447514 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94046162368576] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d84048040 con 0x5588d418bbc0 2024-09-12T16:52:41.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.429+0000 7f1d964c79c0 20 remove_watcher() i=4 2024-09-12T16:52:41.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.429+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94046162376896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419bcf0 con 0x5588d4190470 2024-09-12T16:52:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.429+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94046162376896] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.429+0000 7f1d964c79c0 20 remove_watcher() i=5 2024-09-12T16:52:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.429+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94046162379024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d4198db0 con 0x5588d4190470 2024-09-12T16:52:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.433+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94046162379024] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.433+0000 7f1d964c79c0 20 remove_watcher() i=6 2024-09-12T16:52:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.433+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94046162382800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588d419b840 con 0x5588d4190470 2024-09-12T16:52:41.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d947ce640 1 -- 172.21.15.151:0/2902943136 <== osd.0 v2:172.21.15.122:6800/3868153603 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94046162382800] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c04a050 con 0x5588d4190470 2024-09-12T16:52:41.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 20 remove_watcher() i=7 2024-09-12T16:52:41.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d4190470 msgr2=0x5588d4192860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d4190470 0x5588d4192860 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d418bbc0 msgr2=0x5588d418e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d418bbc0 0x5588d418e050 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1d7c009040 msgr2=0x7f1d7c0c78f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1d7c009040 0x7f1d7c0c78f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588d4194f70 msgr2=0x5588d4197430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5588d4194f70 0x5588d4197430 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5c039a70 msgr2=0x7f1c5c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c5c039a70 0x7f1c5c03bf30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0bcfd0 tx=0x7f1d7c0ef040 comp rx=0 tx=0).stop 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 msgr2=0x5588d4180700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d937cc640 1 -- 172.21.15.151:0/2902943136 reap_dead start 2024-09-12T16:52:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d4180700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c050510 tx=0x7f1d8c050540 comp rx=0 tx=0).stop 2024-09-12T16:52:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 shutdown_connections 2024-09-12T16:52:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2902943136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d417a2a0 0x5588d4180700 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 >> 172.21.15.151:0/2902943136 conn(0x5588d4175660 msgr2=0x5588d4173870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 shutdown_connections 2024-09-12T16:52:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2902943136 wait complete. 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3918180168 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c6c039a70 msgr2=0x7f1c6c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/3918180168 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c6c039a70 0x7f1c6c03bf30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5588d41598f0 tx=0x7f1d7c0dd040 comp rx=0 tx=0).stop 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3918180168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d416c930 msgr2=0x5588d416cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/3918180168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d416c930 0x5588d416cd50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x5588d4153f60 tx=0x7f1d8c018830 comp rx=0 tx=0).stop 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3918180168 shutdown_connections 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/3918180168 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c6c039a70 0x7f1c6c03bf30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/3918180168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d416c930 0x5588d416cd50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3918180168 >> 172.21.15.151:0/3918180168 conn(0x5588d41622e0 msgr2=0x5588d41626c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3918180168 shutdown_connections 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/3918180168 wait complete. 2024-09-12T16:52:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d415b7a0 msgr2=0x5588d415db90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d415b7a0 0x5588d415db90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d4062040 msgr2=0x5588d4158fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d4062040 0x5588d4158fa0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c78039a70 msgr2=0x7f1c7803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c78039a70 0x7f1c7803bf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1d84001e60 tx=0x7f1d840013e0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 msgr2=0x5588d4151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4151e30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0199f0 tx=0x7f1d7c0180e0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 shutdown_connections 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5588d415b7a0 0x5588d415db90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5588d4062040 0x5588d4158fa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1c78039a70 0x7f1c7803bf30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 --2- 172.21.15.151:0/2320266813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588d405f710 0x5588d4151e30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 >> 172.21.15.151:0/2320266813 conn(0x5588d3fd2aa0 msgr2=0x5588d4145020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 shutdown_connections 2024-09-12T16:52:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.437+0000 7f1d964c79c0 1 -- 172.21.15.151:0/2320266813 wait complete. 2024-09-12T16:52:41.452 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-12T16:52:41.452 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T16:52:41.452 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T16:52:41.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T16:52:41.453 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T16:52:41.530 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:41.531 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:41.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f94908bc9c0 1 Processor -- start 2024-09-12T16:52:41.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f94908bc9c0 1 -- start start 2024-09-12T16:52:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f94908bc9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55cafab44350 0x55cafab46740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f94908bc9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cafa9f29c0 con 0x55cafab40200 2024-09-12T16:52:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f94908bc9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55cafaa426d0 con 0x55cafab44350 2024-09-12T16:52:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f948dbc1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55cafab44350 0x55cafab46740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f948dbc1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55cafab44350 0x55cafab46740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60382/0 (socket says 172.21.15.151:60382) 2024-09-12T16:52:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f948dbc1640 1 -- 172.21.15.151:0/2987439899 learned_addr learned my addr 172.21.15.151:0/2987439899 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f948e3c2640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55cafab40200 0x55cafab405e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:47224/0 (socket says 172.21.15.151:47224) 2024-09-12T16:52:41.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f948dbc1640 1 -- 172.21.15.151:0/2987439899 >> v1:172.21.15.122:6789/0 conn(0x55cafab40200 legacy=0x55cafab405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.529+0000 7f948dbc1640 1 -- 172.21.15.151:0/2987439899 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafa9e6ca0 con 0x55cafab44350 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f948dbc1640 1 --2- 172.21.15.151:0/2987439899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab44350 0x55cafab46740 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f948400a5c0 tx=0x7f948401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191e93ef688aad26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f948d3c0640 1 -- 172.21.15.151:0/2987439899 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94840a9590 con 0x55cafab44350 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f948d3c0640 1 -- 172.21.15.151:0/2987439899 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94840ae070 con 0x55cafab44350 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f948d3c0640 1 -- 172.21.15.151:0/2987439899 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94840a9880 con 0x55cafab44350 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f94908bc9c0 1 -- 172.21.15.151:0/2987439899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab44350 msgr2=0x55cafab46740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/2987439899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab44350 0x55cafab46740 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f948400a5c0 tx=0x7f948401b3d0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f94908bc9c0 1 -- 172.21.15.151:0/2987439899 shutdown_connections 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/2987439899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab44350 0x55cafab46740 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f94908bc9c0 1 -- 172.21.15.151:0/2987439899 >> 172.21.15.151:0/2987439899 conn(0x55cafaab3b10 msgr2=0x55cafaab3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f94908bc9c0 1 -- 172.21.15.151:0/2987439899 shutdown_connections 2024-09-12T16:52:41.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.533+0000 7f94908bc9c0 1 -- 172.21.15.151:0/2987439899 wait complete. 2024-09-12T16:52:41.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f94908bc9c0 1 Processor -- start 2024-09-12T16:52:41.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f94908bc9c0 1 -- start start 2024-09-12T16:52:41.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f94908bc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac2b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f94908bc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cafaa46680 con 0x55cafab40200 2024-09-12T16:52:41.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f948e3c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac2b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f948e3c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac2b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60398/0 (socket says 172.21.15.151:60398) 2024-09-12T16:52:41.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f948e3c2640 1 -- 172.21.15.151:0/237369925 learned_addr learned my addr 172.21.15.151:0/237369925 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f948e3c2640 1 -- 172.21.15.151:0/237369925 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafa9c1da0 con 0x55cafab40200 2024-09-12T16:52:41.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.549+0000 7f948e3c2640 1 --2- 172.21.15.151:0/237369925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac2b8a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9480001680 tx=0x7f9480001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf017e579a21aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f937c608640 1 -- 172.21.15.151:0/237369925 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9480013420 con 0x55cafab40200 2024-09-12T16:52:41.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f937c608640 1 -- 172.21.15.151:0/237369925 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94800135c0 con 0x55cafab40200 2024-09-12T16:52:41.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f937c608640 1 -- 172.21.15.151:0/237369925 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94800138e0 con 0x55cafab40200 2024-09-12T16:52:41.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- 172.21.15.151:0/237369925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 msgr2=0x55cafac2b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/237369925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac2b8a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9480001680 tx=0x7f9480001b40 comp rx=0 tx=0).stop 2024-09-12T16:52:41.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- 172.21.15.151:0/237369925 shutdown_connections 2024-09-12T16:52:41.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/237369925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac2b8a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- 172.21.15.151:0/237369925 >> 172.21.15.151:0/237369925 conn(0x55cafaab3b10 msgr2=0x55cafac274e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- 172.21.15.151:0/237369925 shutdown_connections 2024-09-12T16:52:41.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- 172.21.15.151:0/237369925 wait complete. 2024-09-12T16:52:41.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 Processor -- start 2024-09-12T16:52:41.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- start start 2024-09-12T16:52:41.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac32f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cafa9e8a50 con 0x55cafab40200 2024-09-12T16:52:41.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f948e3c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac32f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f948e3c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac32f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60400/0 (socket says 172.21.15.151:60400) 2024-09-12T16:52:41.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f948e3c2640 1 -- 172.21.15.151:0/1563888827 learned_addr learned my addr 172.21.15.151:0/1563888827 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f948e3c2640 1 -- 172.21.15.151:0/1563888827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafac334a0 con 0x55cafab40200 2024-09-12T16:52:41.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f948e3c2640 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac32f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55cafac2c830 tx=0x7f9480000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f937ae05640 1 -- 172.21.15.151:0/1563888827 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94800037a0 con 0x55cafab40200 2024-09-12T16:52:41.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f937ae05640 1 -- 172.21.15.151:0/1563888827 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9480023070 con 0x55cafab40200 2024-09-12T16:52:41.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cafac33730 con 0x55cafab40200 2024-09-12T16:52:41.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f937ae05640 1 -- 172.21.15.151:0/1563888827 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9480003ad0 con 0x55cafab40200 2024-09-12T16:52:41.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.553+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cafac340e0 con 0x55cafab40200 2024-09-12T16:52:41.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f937ae05640 1 -- 172.21.15.151:0/1563888827 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9480010070 con 0x55cafab40200 2024-09-12T16:52:41.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f937ae05640 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9374039ac0 0x7f937403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f937ae05640 1 -- 172.21.15.151:0/1563888827 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f94800502e0 con 0x55cafab40200 2024-09-12T16:52:41.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f948dbc1640 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9374039ac0 0x7f937403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafab44350 0x55cafac3a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac3a5f0 con 0x55cafab44350 2024-09-12T16:52:41.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f948ebc3640 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafab44350 0x55cafac3a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f948dbc1640 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9374039ac0 0x7f937403bf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94840ad000 tx=0x7f94840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f948ebc3640 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafab44350 0x55cafac3a0b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f948ebc3640 1 -- 172.21.15.151:0/1563888827 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94880083f0 con 0x55cafab44350 2024-09-12T16:52:41.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac3aa40 con 0x55cafab44350 2024-09-12T16:52:41.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f948ebc3640 1 -- 172.21.15.151:0/1563888827 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94880083f0 con 0x55cafab44350 2024-09-12T16:52:41.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac3c850 0x55cafac3ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac3f310 con 0x55cafac3c850 2024-09-12T16:52:41.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.557+0000 7f948e3c2640 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac3c850 0x55cafac3ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948e3c2640 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac3c850 0x55cafac3ec40 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948e3c2640 1 -- 172.21.15.151:0/1563888827 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f948000f030 con 0x55cafac3c850 2024-09-12T16:52:41.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac3b6f0 con 0x55cafab44350 2024-09-12T16:52:41.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948ebc3640 1 -- 172.21.15.151:0/1563888827 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94880083f0 con 0x55cafab44350 2024-09-12T16:52:41.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac3bb90 con 0x55cafab44350 2024-09-12T16:52:41.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948ebc3640 1 -- 172.21.15.151:0/1563888827 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94880083f0 con 0x55cafab44350 2024-09-12T16:52:41.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f94908bc9c0 1 Processor -- start 2024-09-12T16:52:41.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f94908bc9c0 1 -- start start 2024-09-12T16:52:41.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f94908bc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac4d980 0x55cafac4dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f94908bc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cafaa53450 con 0x55cafac4d980 2024-09-12T16:52:41.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948ebc3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac4d980 0x55cafac4dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948ebc3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac4d980 0x55cafac4dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60414/0 (socket says 172.21.15.151:60414) 2024-09-12T16:52:41.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948ebc3640 1 -- 172.21.15.151:0/1120570958 learned_addr learned my addr 172.21.15.151:0/1120570958 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948ebc3640 1 -- 172.21.15.151:0/1120570958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafac4e3e0 con 0x55cafac4d980 2024-09-12T16:52:41.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f948ebc3640 1 --2- 172.21.15.151:0/1120570958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac4d980 0x55cafac4dda0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55cafac35060 tx=0x7f948800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f9373fff640 1 -- 172.21.15.151:0/1120570958 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488007e00 con 0x55cafac4d980 2024-09-12T16:52:41.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1120570958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cafac4ec40 con 0x55cafac4d980 2024-09-12T16:52:41.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f9373fff640 1 -- 172.21.15.151:0/1120570958 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948801e020 con 0x55cafac4d980 2024-09-12T16:52:41.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f9373fff640 1 -- 172.21.15.151:0/1120570958 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488019590 con 0x55cafac4d980 2024-09-12T16:52:41.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.561+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1120570958 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cafac4f1b0 con 0x55cafac4d980 2024-09-12T16:52:41.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f9373fff640 1 -- 172.21.15.151:0/1120570958 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9488016040 con 0x55cafac4d980 2024-09-12T16:52:41.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f9373fff640 1 --2- 172.21.15.151:0/1120570958 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9368039a70 0x7f936803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f9373fff640 1 -- 172.21.15.151:0/1120570958 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f948801f030 con 0x55cafac4d980 2024-09-12T16:52:41.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f948e3c2640 1 --2- 172.21.15.151:0/1120570958 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9368039a70 0x7f936803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f94908bc9c0 1 Processor -- start 2024-09-12T16:52:41.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f94908bc9c0 1 -- start start 2024-09-12T16:52:41.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f948e3c2640 1 --2- 172.21.15.151:0/1120570958 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9368039a70 0x7f936803bf30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55cafac343d0 tx=0x7f948004e500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f94908bc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac5b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f94908bc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cafac2c0f0 con 0x55cafac5b2c0 2024-09-12T16:52:41.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f948ebc3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac5b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f948ebc3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac5b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60418/0 (socket says 172.21.15.151:60418) 2024-09-12T16:52:41.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f948ebc3640 1 -- 172.21.15.151:0/538538236 learned_addr learned my addr 172.21.15.151:0/538538236 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f948ebc3640 1 -- 172.21.15.151:0/538538236 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafac5bcb0 con 0x55cafac5b2c0 2024-09-12T16:52:41.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f948ebc3640 1 --2- 172.21.15.151:0/538538236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac5b6c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9488050970 tx=0x7f9488017bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1811f5d3a5fce5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f9371ffb640 1 -- 172.21.15.151:0/538538236 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f948801d040 con 0x55cafac5b2c0 2024-09-12T16:52:41.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f9371ffb640 1 -- 172.21.15.151:0/538538236 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9488019c50 con 0x55cafac5b2c0 2024-09-12T16:52:41.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.565+0000 7f9371ffb640 1 -- 172.21.15.151:0/538538236 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488022cc0 con 0x55cafac5b2c0 2024-09-12T16:52:41.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- 172.21.15.151:0/538538236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 msgr2=0x55cafac5b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/538538236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac5b6c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9488050970 tx=0x7f9488017bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- 172.21.15.151:0/538538236 shutdown_connections 2024-09-12T16:52:41.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/538538236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac5b6c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- 172.21.15.151:0/538538236 >> 172.21.15.151:0/538538236 conn(0x55cafac566e0 msgr2=0x55cafac54920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- 172.21.15.151:0/538538236 shutdown_connections 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- 172.21.15.151:0/538538236 wait complete. 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 Processor -- start 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- start start 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac61730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cafac5a210 con 0x55cafac5b2c0 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f948ebc3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac61730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f948ebc3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac61730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60432/0 (socket says 172.21.15.151:60432) 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 learned_addr learned my addr 172.21.15.151:0/3755198002 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafac61c90 con 0x55cafac5b2c0 2024-09-12T16:52:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f948ebc3640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac61730 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9488017c10 tx=0x7f9488050900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f935ffff640 1 -- 172.21.15.151:0/3755198002 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f948801d070 con 0x55cafac5b2c0 2024-09-12T16:52:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cafac61f20 con 0x55cafac5b2c0 2024-09-12T16:52:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f935ffff640 1 -- 172.21.15.151:0/3755198002 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9488031030 con 0x55cafac5b2c0 2024-09-12T16:52:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f935ffff640 1 -- 172.21.15.151:0/3755198002 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9488048040 con 0x55cafac5b2c0 2024-09-12T16:52:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cafac628d0 con 0x55cafac5b2c0 2024-09-12T16:52:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.569+0000 7f935ffff640 1 -- 172.21.15.151:0/3755198002 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9488015c20 con 0x55cafac5b2c0 2024-09-12T16:52:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f935ffff640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9358039ac0 0x7f935803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f935ffff640 1 -- 172.21.15.151:0/3755198002 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9488037d40 con 0x55cafac5b2c0 2024-09-12T16:52:41.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948e3c2640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9358039ac0 0x7f935803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafac6ca50 0x55cafac6eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac6f630 con 0x55cafac6ca50 2024-09-12T16:52:41.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948dbc1640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafac6ca50 0x55cafac6eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948e3c2640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9358039ac0 0x7f935803bf80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f94800127d0 tx=0x7f9480047390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948dbc1640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafac6ca50 0x55cafac6eee0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 realm 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac6fa60 con 0x55cafac6ca50 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac70330 con 0x55cafac6ca50 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac706d0 con 0x55cafac6ca50 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac71430 0x55cafac73820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac73e30 con 0x55cafac71430 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948ebc3640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac71430 0x55cafac73820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948ebc3640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac71430 0x55cafac73820 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:41.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 20 searching for the correct realm 2024-09-12T16:52:41.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cafac75d10 0x55cafac78180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.573+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948e3c2640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cafac75d10 0x55cafac78180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948e3c2640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cafac75d10 0x55cafac78180 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948e3c2640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f948004e980 0x7f9480047440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x7f948004e980 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948dbc1640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f948004e980 0x7f9480047440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948dbc1640 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f948004e980 0x7f9480047440 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac6ca50 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac6ca50 2024-09-12T16:52:41.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.577+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x7f948004e980 2024-09-12T16:52:41.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac6ca50 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac6ca50 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x7f948004e980 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.581+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac6ca50 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac6ca50 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x7f948004e980 2024-09-12T16:52:41.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac6ca50 2024-09-12T16:52:41.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.585+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x7f948004e980 2024-09-12T16:52:41.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac75d10 2024-09-12T16:52:41.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac71430 2024-09-12T16:52:41.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x55cafac6ca50 2024-09-12T16:52:41.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cafac78850 con 0x7f948004e980 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac74780 con 0x55cafac6ca50 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac74390 con 0x55cafac6ca50 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac75070 con 0x55cafac6ca50 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 zone default found 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 4 Realm: () 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 zonegroup default 2024-09-12T16:52:41.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.589+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac75070 con 0x55cafac71430 2024-09-12T16:52:41.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7abf0 con 0x55cafac75d10 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7af90 con 0x55cafac75d10 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 20 started sync module instance, tier type = 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7a080 con 0x7f948004e980 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94330279142784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7a080 con 0x7f948004e980 2024-09-12T16:52:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7ba70 con 0x55cafac6ca50 2024-09-12T16:52:41.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.593+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94330279142784] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.597+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.597+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94330279146848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7a080 con 0x55cafac6ca50 2024-09-12T16:52:41.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.597+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7c480 con 0x55cafac75d10 2024-09-12T16:52:41.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.597+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94330279146848] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.597+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.597+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94330279140304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac79ff0 con 0x55cafac75d10 2024-09-12T16:52:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.597+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7d1d0 con 0x7f948004e980 2024-09-12T16:52:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.601+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.601+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94330279153200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7da70 con 0x7f948004e980 2024-09-12T16:52:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.601+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7e430 con 0x55cafac6ca50 2024-09-12T16:52:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.601+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94330279140304] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.601+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94330279153200] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.601+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.601+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94330279157632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7d9e0 con 0x55cafac6ca50 2024-09-12T16:52:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.601+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7e3a0 con 0x55cafac71430 2024-09-12T16:52:41.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.605+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94330279157632] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.605+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.605+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94330279155264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7ecd0 con 0x55cafac71430 2024-09-12T16:52:41.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.605+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7f520 con 0x55cafac71430 2024-09-12T16:52:41.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.605+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.605+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94330279161552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7f9a0 con 0x55cafac71430 2024-09-12T16:52:41.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.605+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac804c0 con 0x55cafac71430 2024-09-12T16:52:41.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.605+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94330279155264] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94330279161552] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94330279165840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7f3f0 con 0x55cafac71430 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 20 add_watcher() i=0 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 20 add_watcher() i=1 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 20 add_watcher() i=2 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 20 add_watcher() i=3 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 20 add_watcher() i=4 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 20 add_watcher() i=5 2024-09-12T16:52:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 20 add_watcher() i=6 2024-09-12T16:52:41.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94330279165840] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 20 add_watcher() i=7 2024-09-12T16:52:41.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:41.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac834b0 con 0x55cafac6ca50 2024-09-12T16:52:41.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.609+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94330279159760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac80960 con 0x55cafac6ca50 2024-09-12T16:52:41.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.613+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94330279159760] v34'175 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.613+0000 7f93457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:41.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.613+0000 7f94908bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:41.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.613+0000 7f94908bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:41.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.613+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8bd00 con 0x55cafac6ca50 2024-09-12T16:52:41.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.613+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.613+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8bd00 con 0x55cafac71430 2024-09-12T16:52:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.617+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.617+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8bd00 con 0x55cafac75d10 2024-09-12T16:52:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.617+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.617+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8c720 con 0x55cafac6ca50 2024-09-12T16:52:41.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.621+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'176 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.621+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8cd30 con 0x7f948004e980 2024-09-12T16:52:41.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.621+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.621+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d2a0 con 0x55cafac75d10 2024-09-12T16:52:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.621+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.621+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d2a0 con 0x55cafac6ca50 2024-09-12T16:52:41.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.625+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.625+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d700 con 0x55cafac71430 2024-09-12T16:52:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.625+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.625+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d620 con 0x7f948004e980 2024-09-12T16:52:41.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.629+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.629+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d600 con 0x55cafac75d10 2024-09-12T16:52:41.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.629+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.629+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d600 con 0x7f948004e980 2024-09-12T16:52:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.629+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.629+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d510 con 0x55cafac71430 2024-09-12T16:52:41.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.633+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.633+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d5a0 con 0x7f948004e980 2024-09-12T16:52:41.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.633+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.633+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8cec0 con 0x55cafac71430 2024-09-12T16:52:41.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.637+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.637+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8cfb0 con 0x55cafac6ca50 2024-09-12T16:52:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.637+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'177 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.637+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8cfb0 con 0x55cafac75d10 2024-09-12T16:52:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.641+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.641+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d040 con 0x7f948004e980 2024-09-12T16:52:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.641+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.641+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8d040 con 0x55cafac75d10 2024-09-12T16:52:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.641+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.641+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8cfe0 con 0x55cafac6ca50 2024-09-12T16:52:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.645+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.645+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8cfe0 con 0x55cafac6ca50 2024-09-12T16:52:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.645+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'178 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.645+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8cfe0 con 0x55cafac75d10 2024-09-12T16:52:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.649+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.649+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x7f948004e980 2024-09-12T16:52:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.649+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.649+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac75d10 2024-09-12T16:52:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.653+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.653+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac75d10 2024-09-12T16:52:41.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.653+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.653+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac75d10 2024-09-12T16:52:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.653+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.653+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac75d10 2024-09-12T16:52:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.657+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.657+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac71430 2024-09-12T16:52:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.657+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.657+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac75d10 2024-09-12T16:52:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.661+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.661+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac71430 2024-09-12T16:52:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.661+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.661+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac75d10 2024-09-12T16:52:41.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.665+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.665+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x55cafac71430 2024-09-12T16:52:41.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.665+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.665+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8db30 con 0x7f948004e980 2024-09-12T16:52:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f933f7fe640 20 reqs_thread_entry: start 2024-09-12T16:52:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 20 Filter name: none 2024-09-12T16:52:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f933d7fa640 20 reqs_thread_entry: start 2024-09-12T16:52:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafac8b490 con 0x55cafac6ca50 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.669+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cafacaafb0 con 0x7f948004e980 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.673+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T16:52:41.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.673+0000 7f93457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:41.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.673+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94330279159760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac85ca0 con 0x55cafac6ca50 2024-09-12T16:52:41.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.673+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94330279159760] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.673+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94330279142784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7e7d0 con 0x7f948004e980 2024-09-12T16:52:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.673+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94330279142784] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.677+0000 7f94908bc9c0 20 remove_watcher() i=0 2024-09-12T16:52:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.677+0000 7f94908bc9c0 2 removed watcher, disabling cache 2024-09-12T16:52:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.677+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94330279146848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7e7d0 con 0x55cafac6ca50 2024-09-12T16:52:41.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.677+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94330279146848] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.677+0000 7f94908bc9c0 20 remove_watcher() i=1 2024-09-12T16:52:41.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.677+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94330279140304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7e7d0 con 0x55cafac75d10 2024-09-12T16:52:41.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f948e3c2640 1 -- 172.21.15.151:0/3755198002 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94330279140304] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948003c070 con 0x55cafac75d10 2024-09-12T16:52:41.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f94908bc9c0 20 remove_watcher() i=2 2024-09-12T16:52:41.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94330279153200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac79bd0 con 0x7f948004e980 2024-09-12T16:52:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94330279153200] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x7f948004e980 2024-09-12T16:52:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f94908bc9c0 20 remove_watcher() i=3 2024-09-12T16:52:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94330279157632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7e7d0 con 0x55cafac6ca50 2024-09-12T16:52:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94330279157632] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94840a99f0 con 0x55cafac6ca50 2024-09-12T16:52:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f94908bc9c0 20 remove_watcher() i=4 2024-09-12T16:52:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.681+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94330279155264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7ce30 con 0x55cafac71430 2024-09-12T16:52:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.685+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94330279155264] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.685+0000 7f94908bc9c0 20 remove_watcher() i=5 2024-09-12T16:52:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.685+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94330279161552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac79bd0 con 0x55cafac71430 2024-09-12T16:52:41.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94330279161552] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 20 remove_watcher() i=6 2024-09-12T16:52:41.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94330279165840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cafac7df80 con 0x55cafac71430 2024-09-12T16:52:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f948ebc3640 1 -- 172.21.15.151:0/3755198002 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94330279165840] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f948803d070 con 0x55cafac71430 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 20 remove_watcher() i=7 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac71430 msgr2=0x55cafac73820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac71430 0x55cafac73820 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafac6ca50 msgr2=0x55cafac6eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafac6ca50 0x55cafac6eee0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f948004e980 msgr2=0x7f9480047440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f948004e980 0x7f9480047440 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cafac75d10 msgr2=0x55cafac78180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cafac75d10 0x55cafac78180 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9358039ac0 msgr2=0x7f935803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9358039ac0 0x7f935803bf80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f94800127d0 tx=0x7f9480047390 comp rx=0 tx=0).stop 2024-09-12T16:52:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 msgr2=0x55cafac61730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac61730 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9488017c10 tx=0x7f9488050900 comp rx=0 tx=0).stop 2024-09-12T16:52:41.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f948dbc1640 1 -- 172.21.15.151:0/3755198002 reap_dead start 2024-09-12T16:52:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 shutdown_connections 2024-09-12T16:52:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/3755198002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac5b2c0 0x55cafac61730 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 >> 172.21.15.151:0/3755198002 conn(0x55cafac566e0 msgr2=0x55cafac548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 shutdown_connections 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/3755198002 wait complete. 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1120570958 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9368039a70 msgr2=0x7f936803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1120570958 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9368039a70 0x7f936803bf30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55cafac343d0 tx=0x7f948004e500 comp rx=0 tx=0).stop 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1120570958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac4d980 msgr2=0x55cafac4dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1120570958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac4d980 0x55cafac4dda0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55cafac35060 tx=0x7f948800af40 comp rx=0 tx=0).stop 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1120570958 shutdown_connections 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1120570958 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9368039a70 0x7f936803bf30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1120570958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafac4d980 0x55cafac4dda0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1120570958 >> 172.21.15.151:0/1120570958 conn(0x55cafac43330 msgr2=0x55cafac43710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1120570958 shutdown_connections 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.689+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1120570958 wait complete. 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac3c850 msgr2=0x55cafac3ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac3c850 0x55cafac3ec40 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafab44350 msgr2=0x55cafac3a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafab44350 0x55cafac3a0b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9374039ac0 msgr2=0x7f937403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9374039ac0 0x7f937403bf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94840ad000 tx=0x7f94840a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 msgr2=0x55cafac32f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac32f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55cafac2c830 tx=0x7f9480000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 shutdown_connections 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cafac3c850 0x55cafac3ec40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cafab44350 0x55cafac3a0b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9374039ac0 0x7f937403bf80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 --2- 172.21.15.151:0/1563888827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cafab40200 0x55cafac32f40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 >> 172.21.15.151:0/1563888827 conn(0x55cafaab3b10 msgr2=0x55cafac25f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 shutdown_connections 2024-09-12T16:52:41.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.693+0000 7f94908bc9c0 1 -- 172.21.15.151:0/1563888827 wait complete. 2024-09-12T16:52:41.705 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T16:52:41.719 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-12T16:52:41.727 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:41.769 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:41.794 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:41.844 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-12T16:52:41.860 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:41.860 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T16:52:41.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T16:52:41.860 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-12T16:52:41.908 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:41.908 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:41.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.905+0000 7f073d2dd9c0 1 Processor -- start 2024-09-12T16:52:41.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.905+0000 7f073d2dd9c0 1 -- start start 2024-09-12T16:52:41.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.905+0000 7f073d2dd9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a6461737a0 0x55a646172370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.905+0000 7f073d2dd9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a6460b19c0 con 0x55a646173270 2024-09-12T16:52:41.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.905+0000 7f073d2dd9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55a6461016d0 con 0x55a6461737a0 2024-09-12T16:52:41.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.905+0000 7f073a5e2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a6461737a0 0x55a646172370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.905+0000 7f073a5e2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a6461737a0 0x55a646172370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60434/0 (socket says 172.21.15.151:60434) 2024-09-12T16:52:41.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.905+0000 7f073a5e2640 1 -- 172.21.15.151:0/2699856979 learned_addr learned my addr 172.21.15.151:0/2699856979 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073a5e2640 1 -- 172.21.15.151:0/2699856979 >> v1:172.21.15.122:6789/0 conn(0x55a646173270 legacy=0x55a646171c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073a5e2640 1 -- 172.21.15.151:0/2699856979 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6460a5ca0 con 0x55a6461737a0 2024-09-12T16:52:41.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073a5e2640 1 --2- 172.21.15.151:0/2699856979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6461737a0 0x55a646172370 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f072400a5c0 tx=0x7f072401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1c00b97e7af7e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f0739de1640 1 -- 172.21.15.151:0/2699856979 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07240b0070 con 0x55a6461737a0 2024-09-12T16:52:41.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f0739de1640 1 -- 172.21.15.151:0/2699856979 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07240ab540 con 0x55a6461737a0 2024-09-12T16:52:41.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f0739de1640 1 -- 172.21.15.151:0/2699856979 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07240ab840 con 0x55a6461737a0 2024-09-12T16:52:41.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/2699856979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6461737a0 msgr2=0x55a646172370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/2699856979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6461737a0 0x55a646172370 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f072400a5c0 tx=0x7f072401b280 comp rx=0 tx=0).stop 2024-09-12T16:52:41.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/2699856979 shutdown_connections 2024-09-12T16:52:41.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/2699856979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6461737a0 0x55a646172370 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/2699856979 >> 172.21.15.151:0/2699856979 conn(0x55a6461f8a90 msgr2=0x55a6461faeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/2699856979 shutdown_connections 2024-09-12T16:52:41.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.909+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/2699856979 wait complete. 2024-09-12T16:52:41.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.925+0000 7f073d2dd9c0 1 Processor -- start 2024-09-12T16:52:41.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.925+0000 7f073d2dd9c0 1 -- start start 2024-09-12T16:52:41.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.925+0000 7f073d2dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462eac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.925+0000 7f073d2dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a646105680 con 0x55a646173270 2024-09-12T16:52:41.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462eac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60446/0 (socket says 172.21.15.151:60446) 2024-09-12T16:52:41.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 -- 172.21.15.151:0/4266176883 learned_addr learned my addr 172.21.15.151:0/4266176883 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 -- 172.21.15.151:0/4266176883 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a646080da0 con 0x55a646173270 2024-09-12T16:52:41.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 --2- 172.21.15.151:0/4266176883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462eac10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f072c001680 tx=0x7f072c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64c6f2c6eff4442 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f0628e09640 1 -- 172.21.15.151:0/4266176883 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f072c016070 con 0x55a646173270 2024-09-12T16:52:41.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f0628e09640 1 -- 172.21.15.151:0/4266176883 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c00f660 con 0x55a646173270 2024-09-12T16:52:41.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f0628e09640 1 -- 172.21.15.151:0/4266176883 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f072c00f980 con 0x55a646173270 2024-09-12T16:52:41.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/4266176883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 msgr2=0x55a6462eac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/4266176883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462eac10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f072c001680 tx=0x7f072c001b40 comp rx=0 tx=0).stop 2024-09-12T16:52:41.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/4266176883 shutdown_connections 2024-09-12T16:52:41.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/4266176883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462eac10 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/4266176883 >> 172.21.15.151:0/4266176883 conn(0x55a6461f8a90 msgr2=0x55a6462e6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/4266176883 shutdown_connections 2024-09-12T16:52:41.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/4266176883 wait complete. 2024-09-12T16:52:41.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 Processor -- start 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 -- start start 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073d2dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a6460a7a50 con 0x55a646173270 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462f22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60448/0 (socket says 172.21.15.151:60448) 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 -- 172.21.15.151:0/1902966316 learned_addr learned my addr 172.21.15.151:0/1902966316 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 -- 172.21.15.151:0/1902966316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6462f2840 con 0x55a646173270 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.929+0000 7f073ade3640 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462f22e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55a6462ebba0 tx=0x7f072c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f0627606640 1 -- 172.21.15.151:0/1902966316 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f072c016040 con 0x55a646173270 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f0627606640 1 -- 172.21.15.151:0/1902966316 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c022070 con 0x55a646173270 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6462f2ad0 con 0x55a646173270 2024-09-12T16:52:41.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f0627606640 1 -- 172.21.15.151:0/1902966316 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f072c006330 con 0x55a646173270 2024-09-12T16:52:41.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6462f3480 con 0x55a646173270 2024-09-12T16:52:41.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f0627606640 1 -- 172.21.15.151:0/1902966316 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f072c011510 con 0x55a646173270 2024-09-12T16:52:41.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f0627606640 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0620039c10 0x7f062003c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f0627606640 1 -- 172.21.15.151:0/1902966316 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f072c04fd80 con 0x55a646173270 2024-09-12T16:52:41.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073a5e2640 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0620039c10 0x7f062003c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a6461737a0 0x55a6462f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6462f9990 con 0x55a6461737a0 2024-09-12T16:52:41.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073b5e4640 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a6461737a0 0x55a6462f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073a5e2640 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0620039c10 0x7f062003c0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07240ad000 tx=0x7f07240a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073b5e4640 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a6461737a0 0x55a6462f9450 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073b5e4640 1 -- 172.21.15.151:0/1902966316 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07340083f0 con 0x55a6461737a0 2024-09-12T16:52:41.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6462f9de0 con 0x55a6461737a0 2024-09-12T16:52:41.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073b5e4640 1 -- 172.21.15.151:0/1902966316 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07340083f0 con 0x55a6461737a0 2024-09-12T16:52:41.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6462fbbf0 0x55a6462fdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.933+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6462fe6b0 con 0x55a6462fbbf0 2024-09-12T16:52:41.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073ade3640 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6462fbbf0 0x55a6462fdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073ade3640 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6462fbbf0 0x55a6462fdfe0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073ade3640 1 -- 172.21.15.151:0/1902966316 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f072c00f070 con 0x55a6462fbbf0 2024-09-12T16:52:41.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6462faa90 con 0x55a6461737a0 2024-09-12T16:52:41.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073b5e4640 1 -- 172.21.15.151:0/1902966316 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07340083f0 con 0x55a6461737a0 2024-09-12T16:52:41.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6462faf30 con 0x55a6461737a0 2024-09-12T16:52:41.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073b5e4640 1 -- 172.21.15.151:0/1902966316 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07340083f0 con 0x55a6461737a0 2024-09-12T16:52:41.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073d2dd9c0 1 Processor -- start 2024-09-12T16:52:41.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073d2dd9c0 1 -- start start 2024-09-12T16:52:41.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073d2dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a64630cd20 0x55a64630d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073d2dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a646112450 con 0x55a64630cd20 2024-09-12T16:52:41.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073b5e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a64630cd20 0x55a64630d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073b5e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a64630cd20 0x55a64630d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60462/0 (socket says 172.21.15.151:60462) 2024-09-12T16:52:41.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073b5e4640 1 -- 172.21.15.151:0/3755950849 learned_addr learned my addr 172.21.15.151:0/3755950849 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.937+0000 7f073b5e4640 1 -- 172.21.15.151:0/3755950849 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a64630d780 con 0x55a64630cd20 2024-09-12T16:52:41.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073b5e4640 1 --2- 172.21.15.151:0/3755950849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a64630cd20 0x55a64630d140 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55a6462f4400 tx=0x7f073400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f0624e01640 1 -- 172.21.15.151:0/3755950849 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0734007e00 con 0x55a64630cd20 2024-09-12T16:52:41.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f0624e01640 1 -- 172.21.15.151:0/3755950849 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073401e020 con 0x55a64630cd20 2024-09-12T16:52:41.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3755950849 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a64630dfe0 con 0x55a64630cd20 2024-09-12T16:52:41.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f0624e01640 1 -- 172.21.15.151:0/3755950849 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0734019590 con 0x55a64630cd20 2024-09-12T16:52:41.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3755950849 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a64630e550 con 0x55a64630cd20 2024-09-12T16:52:41.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f0624e01640 1 -- 172.21.15.151:0/3755950849 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0734016040 con 0x55a64630cd20 2024-09-12T16:52:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f0624e01640 1 --2- 172.21.15.151:0/3755950849 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0614039a70 0x7f061403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f0624e01640 1 -- 172.21.15.151:0/3755950849 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f073401f030 con 0x55a64630cd20 2024-09-12T16:52:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073ade3640 1 --2- 172.21.15.151:0/3755950849 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0614039a70 0x7f061403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073d2dd9c0 1 Processor -- start 2024-09-12T16:52:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073d2dd9c0 1 -- start start 2024-09-12T16:52:41.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073ade3640 1 --2- 172.21.15.151:0/3755950849 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0614039a70 0x7f061403bf30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55a6462f3770 tx=0x7f072c024fb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073d2dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a6463199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073d2dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a6462eb460 con 0x55a6463195e0 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073b5e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a6463199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073b5e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a6463199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60476/0 (socket says 172.21.15.151:60476) 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073b5e4640 1 -- 172.21.15.151:0/205503567 learned_addr learned my addr 172.21.15.151:0/205503567 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073b5e4640 1 -- 172.21.15.151:0/205503567 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a646319f90 con 0x55a6463195e0 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.941+0000 7f073b5e4640 1 --2- 172.21.15.151:0/205503567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a6463199c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0734023fb0 tx=0x7f0734015df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5087be04bd7b590 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f061e7fc640 1 -- 172.21.15.151:0/205503567 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f073401d040 con 0x55a6463195e0 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f061e7fc640 1 -- 172.21.15.151:0/205503567 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07340234b0 con 0x55a6463195e0 2024-09-12T16:52:41.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f061e7fc640 1 -- 172.21.15.151:0/205503567 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0734019c50 con 0x55a6463195e0 2024-09-12T16:52:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/205503567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 msgr2=0x55a6463199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/205503567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a6463199c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0734023fb0 tx=0x7f0734015df0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/205503567 shutdown_connections 2024-09-12T16:52:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/205503567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a6463199c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/205503567 >> 172.21.15.151:0/205503567 conn(0x55a646315a10 msgr2=0x55a646313c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/205503567 shutdown_connections 2024-09-12T16:52:41.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/205503567 wait complete. 2024-09-12T16:52:41.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 Processor -- start 2024-09-12T16:52:41.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 -- start start 2024-09-12T16:52:41.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a646320ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a64631a5f0 con 0x55a6463195e0 2024-09-12T16:52:41.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073b5e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a646320ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073b5e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a646320ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60478/0 (socket says 172.21.15.151:60478) 2024-09-12T16:52:41.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 learned_addr learned my addr 172.21.15.151:0/3825953241 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a646321010 con 0x55a6463195e0 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073b5e4640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a646320ab0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0734017e40 tx=0x7f07340508e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f061cff9640 1 -- 172.21.15.151:0/3825953241 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f073401d070 con 0x55a6463195e0 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f061cff9640 1 -- 172.21.15.151:0/3825953241 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0734049040 con 0x55a6463195e0 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6463212a0 con 0x55a6463195e0 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.945+0000 7f061cff9640 1 -- 172.21.15.151:0/3825953241 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f073404f210 con 0x55a6463195e0 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a646321c50 con 0x55a6463195e0 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f061cff9640 1 -- 172.21.15.151:0/3825953241 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f073404f3b0 con 0x55a6463195e0 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f061cff9640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0604039ac0 0x7f060403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f061cff9640 1 -- 172.21.15.151:0/3825953241 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0734038d50 con 0x55a6463195e0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073ade3640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0604039ac0 0x7f060403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a64632bdd0 0x55a64632e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a64632e9e0 con 0x55a64632bdd0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073a5e2640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a64632bdd0 0x55a64632e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073ade3640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0604039ac0 0x7f060403bf80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f072c027620 tx=0x7f072c042000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073a5e2640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a64632bdd0 0x55a64632e290 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 realm 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a64632ee10 con 0x55a64632bdd0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a64632f6e0 con 0x55a64632bdd0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a64632fa80 con 0x55a64632bdd0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6463307e0 0x55a646332bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.949+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6463331e0 con 0x55a6463307e0 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073b5e4640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6463307e0 0x55a646332bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073b5e4640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6463307e0 0x55a646332bd0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073d2dd9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073d2dd9c0 20 searching for the correct realm 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a646335130 0x55a646337540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073ade3640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a646335130 0x55a646337540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073ade3640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a646335130 0x55a646337540 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073ade3640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f072c046fa0 0x7f072c026840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x7f072c046fa0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073a5e2640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f072c046fa0 0x7f072c026840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073a5e2640 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f072c046fa0 0x7f072c026840 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.953+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a64632bdd0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a64632bdd0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x7f072c046fa0 2024-09-12T16:52:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a64632bdd0 2024-09-12T16:52:41.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a64632bdd0 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x7f072c046fa0 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.957+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a64632bdd0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a64632bdd0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x7f072c046fa0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.961+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a64632bdd0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x7f072c046fa0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a646335130 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a6463307e0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x55a64632bdd0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a646337bc0 con 0x7f072c046fa0 2024-09-12T16:52:41.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073d2dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073d2dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073d2dd9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073d2dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073d2dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073d2dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.965+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a646333ba0 con 0x55a64632bdd0 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a646333f90 con 0x55a64632bdd0 2024-09-12T16:52:41.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a646333f90 con 0x55a64632bdd0 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 zone default found 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 4 Realm: () 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:41.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 zonegroup default 2024-09-12T16:52:41.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6463343b0 con 0x55a6463307e0 2024-09-12T16:52:41.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a646339a60 con 0x55a646335130 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a646339ea0 con 0x55a646335130 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 started sync module instance, tier type = 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a646338ed0 con 0x7f072c046fa0 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94172630717440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a646338ed0 con 0x7f072c046fa0 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.969+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633a9d0 con 0x55a64632bdd0 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.973+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94172630717440] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.973+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.973+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94172630721696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a646338ed0 con 0x55a64632bdd0 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.973+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633b3e0 con 0x55a646335130 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.973+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94172630721696] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94172630714912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a646338e40 con 0x55a646335130 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633c130 con 0x7f072c046fa0 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94172630728080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633c800 con 0x7f072c046fa0 2024-09-12T16:52:41.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633d320 con 0x55a64632bdd0 2024-09-12T16:52:41.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94172630714912] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94172630728080] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94172630732272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633d2e0 con 0x55a64632bdd0 2024-09-12T16:52:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.977+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633d710 con 0x55a6463307e0 2024-09-12T16:52:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.981+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94172630732272] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.981+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.981+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94172630729296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633db00 con 0x55a6463307e0 2024-09-12T16:52:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.981+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633e3b0 con 0x55a6463307e0 2024-09-12T16:52:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94172630729296] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94172630726608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633e590 con 0x55a6463307e0 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633ee20 con 0x55a6463307e0 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94172630726608] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94172630735536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633f000 con 0x55a6463307e0 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 20 add_watcher() i=0 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 20 add_watcher() i=1 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 20 add_watcher() i=2 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 20 add_watcher() i=3 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 20 add_watcher() i=4 2024-09-12T16:52:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 20 add_watcher() i=5 2024-09-12T16:52:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.985+0000 7f073d2dd9c0 20 add_watcher() i=6 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94172630735536] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 20 add_watcher() i=7 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6463423d0 con 0x55a64632bdd0 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94172630740720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633f7c0 con 0x55a64632bdd0 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94172630740720] v34'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f05f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 5 note: GC not initialized 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f05f0fe1640 20 reqs_thread_entry: start 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 20 Filter name: none 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f05e9ffb640 20 reqs_thread_entry: start 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a646365a60 con 0x7f072c046fa0 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:41.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:41.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:41.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 : miss 2024-09-12T16:52:41.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:41.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.989+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.1f 8:f80c5cb4:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6463674c0 con 0x7f072c046fa0 2024-09-12T16:52:41.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(63 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 info.flags=0x17 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 to cache LRU end 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 20 get_obj_state: octx=0x7f07240058f0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55a646369bb8 s->prefetch_data=0 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 3.13s0 3:c8a2c8dc:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a64636abe0 con 0x55a646335130 2024-09-12T16:52:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:41.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 10 manifest: total_size = 5 2024-09-12T16:52:41.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 20 get_obj_state: setting s->obj_tag to _I_MgAx3DyixoqGdu4hS428jcu2zohnd 2024-09-12T16:52:42.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f05f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:42.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94172630740720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64636a5f0 con 0x55a64632bdd0 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94172630740720] v34'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.993+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94172630717440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64636a5f0 con 0x7f072c046fa0 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.997+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94172630717440] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.997+0000 7f073d2dd9c0 20 remove_watcher() i=0 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.997+0000 7f073d2dd9c0 2 removed watcher, disabling cache 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.997+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94172630721696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a646339400 con 0x55a64632bdd0 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.997+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94172630721696] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.997+0000 7f073d2dd9c0 20 remove_watcher() i=1 2024-09-12T16:52:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:41.997+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94172630714912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633a4a0 con 0x55a646335130 2024-09-12T16:52:42.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.001+0000 7f073ade3640 1 -- 172.21.15.151:0/3825953241 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94172630714912] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f072c03a070 con 0x55a646335130 2024-09-12T16:52:42.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.001+0000 7f073d2dd9c0 20 remove_watcher() i=2 2024-09-12T16:52:42.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.001+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94172630728080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a646339400 con 0x7f072c046fa0 2024-09-12T16:52:42.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.001+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94172630728080] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x7f072c046fa0 2024-09-12T16:52:42.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.001+0000 7f073d2dd9c0 20 remove_watcher() i=3 2024-09-12T16:52:42.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.001+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94172630732272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a646338a20 con 0x55a64632bdd0 2024-09-12T16:52:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.005+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94172630732272] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07240b3040 con 0x55a64632bdd0 2024-09-12T16:52:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.005+0000 7f073d2dd9c0 20 remove_watcher() i=4 2024-09-12T16:52:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.005+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94172630729296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633a4a0 con 0x55a6463307e0 2024-09-12T16:52:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.005+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94172630729296] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.005+0000 7f073d2dd9c0 20 remove_watcher() i=5 2024-09-12T16:52:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.005+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94172630726608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a64633bd90 con 0x55a6463307e0 2024-09-12T16:52:42.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94172630726608] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:42.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 20 remove_watcher() i=6 2024-09-12T16:52:42.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94172630735536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a646339400 con 0x55a6463307e0 2024-09-12T16:52:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073b5e4640 1 -- 172.21.15.151:0/3825953241 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94172630735536] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f073403e070 con 0x55a6463307e0 2024-09-12T16:52:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 20 remove_watcher() i=7 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6463307e0 msgr2=0x55a646332bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6463307e0 0x55a646332bd0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a64632bdd0 msgr2=0x55a64632e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a64632bdd0 0x55a64632e290 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f072c046fa0 msgr2=0x7f072c026840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f072c046fa0 0x7f072c026840 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a646335130 msgr2=0x55a646337540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a646335130 0x55a646337540 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0604039ac0 msgr2=0x7f060403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.009+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0604039ac0 0x7f060403bf80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f072c027620 tx=0x7f072c042000 comp rx=0 tx=0).stop 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 msgr2=0x55a646320ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3825953241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a6463195e0 0x55a646320ab0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0734017e40 tx=0x7f07340508e0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073a5e2640 1 -- 172.21.15.151:0/3825953241 reap_dead start 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 shutdown_connections 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 >> 172.21.15.151:0/3825953241 conn(0x55a646315a10 msgr2=0x55a646313c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 shutdown_connections 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3825953241 wait complete. 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3755950849 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0614039a70 msgr2=0x7f061403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3755950849 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0614039a70 0x7f061403bf30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55a6462f3770 tx=0x7f072c024fb0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3755950849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a64630cd20 msgr2=0x55a64630d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3755950849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a64630cd20 0x55a64630d140 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55a6462f4400 tx=0x7f073400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3755950849 shutdown_connections 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3755950849 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0614039a70 0x7f061403bf30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/3755950849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a64630cd20 0x55a64630d140 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3755950849 >> 172.21.15.151:0/3755950849 conn(0x55a6463026d0 msgr2=0x55a646302ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3755950849 shutdown_connections 2024-09-12T16:52:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/3755950849 wait complete. 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6462fbbf0 msgr2=0x55a6462fdfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6462fbbf0 0x55a6462fdfe0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a6461737a0 msgr2=0x55a6462f9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a6461737a0 0x55a6462f9450 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0620039c10 msgr2=0x7f062003c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0620039c10 0x7f062003c0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07240ad000 tx=0x7f07240a5040 comp rx=0 tx=0).stop 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 msgr2=0x55a6462f22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462f22e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55a6462ebba0 tx=0x7f072c000f50 comp rx=0 tx=0).stop 2024-09-12T16:52:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 shutdown_connections 2024-09-12T16:52:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a6462fbbf0 0x55a6462fdfe0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a6461737a0 0x55a6462f9450 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0620039c10 0x7f062003c0d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 --2- 172.21.15.151:0/1902966316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a646173270 0x55a6462f22e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 >> 172.21.15.151:0/1902966316 conn(0x55a6461f8a90 msgr2=0x55a6462e52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 shutdown_connections 2024-09-12T16:52:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.013+0000 7f073d2dd9c0 1 -- 172.21.15.151:0/1902966316 wait complete. 2024-09-12T16:52:42.026 INFO:teuthology.orchestra.run.smithi151.stdout:fooFoofooFooFULL_CONTROL 2024-09-12T16:52:42.027 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-12T16:52:42.030 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-12T16:52:42.037 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:42.038 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T16:52:42.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T16:52:42.038 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-12T16:52:42.110 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:42.110 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:42.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84938f99c0 1 Processor -- start 2024-09-12T16:52:42.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84938f99c0 1 -- start start 2024-09-12T16:52:42.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84938f99c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55cfb0659df0 0x55cfb065a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84938f99c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cfb050f9c0 con 0x55cfb065cfd0 2024-09-12T16:52:42.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84938f99c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55cfb055f6d0 con 0x55cfb0659df0 2024-09-12T16:52:42.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84913ff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55cfb0659df0 0x55cfb065a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84913ff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55cfb0659df0 0x55cfb065a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60488/0 (socket says 172.21.15.151:60488) 2024-09-12T16:52:42.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84913ff640 1 -- 172.21.15.151:0/2377109191 learned_addr learned my addr 172.21.15.151:0/2377109191 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84913ff640 1 -- 172.21.15.151:0/2377109191 >> v1:172.21.15.122:6789/0 conn(0x55cfb065cfd0 legacy=0x55cfb065f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.109+0000 7f84913ff640 1 -- 172.21.15.151:0/2377109191 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb0503ca0 con 0x55cfb0659df0 2024-09-12T16:52:42.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f84913ff640 1 --2- 172.21.15.151:0/2377109191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb065a1d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f848c00a4e0 tx=0x7f848c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b598e033b914268 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f848bfff640 1 -- 172.21.15.151:0/2377109191 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c0aa540 con 0x55cfb0659df0 2024-09-12T16:52:42.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f848bfff640 1 -- 172.21.15.151:0/2377109191 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c0aa6e0 con 0x55cfb0659df0 2024-09-12T16:52:42.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f848bfff640 1 -- 172.21.15.151:0/2377109191 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c0aaa40 con 0x55cfb0659df0 2024-09-12T16:52:42.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f84938f99c0 1 -- 172.21.15.151:0/2377109191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 msgr2=0x55cfb065a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f84938f99c0 1 --2- 172.21.15.151:0/2377109191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb065a1d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f848c00a4e0 tx=0x7f848c01b090 comp rx=0 tx=0).stop 2024-09-12T16:52:42.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f84938f99c0 1 -- 172.21.15.151:0/2377109191 shutdown_connections 2024-09-12T16:52:42.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f84938f99c0 1 --2- 172.21.15.151:0/2377109191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb065a1d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f84938f99c0 1 -- 172.21.15.151:0/2377109191 >> 172.21.15.151:0/2377109191 conn(0x55cfb0655910 msgr2=0x55cfb0657d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f84938f99c0 1 -- 172.21.15.151:0/2377109191 shutdown_connections 2024-09-12T16:52:42.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.113+0000 7f84938f99c0 1 -- 172.21.15.151:0/2377109191 wait complete. 2024-09-12T16:52:42.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84938f99c0 1 Processor -- start 2024-09-12T16:52:42.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84938f99c0 1 -- start start 2024-09-12T16:52:42.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84938f99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb05ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84938f99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0563680 con 0x55cfb0659df0 2024-09-12T16:52:42.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84913ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb05ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84913ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb05ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60502/0 (socket says 172.21.15.151:60502) 2024-09-12T16:52:42.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84913ff640 1 -- 172.21.15.151:0/1341528418 learned_addr learned my addr 172.21.15.151:0/1341528418 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84913ff640 1 -- 172.21.15.151:0/1341528418 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb04deda0 con 0x55cfb0659df0 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f84913ff640 1 --2- 172.21.15.151:0/1341528418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb05ced40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f848c019740 tx=0x7f848c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b16d443033801ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.129+0000 7f837f606640 1 -- 172.21.15.151:0/1341528418 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c0b9070 con 0x55cfb0659df0 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f837f606640 1 -- 172.21.15.151:0/1341528418 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c0aaa90 con 0x55cfb0659df0 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f837f606640 1 -- 172.21.15.151:0/1341528418 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c0aad70 con 0x55cfb0659df0 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- 172.21.15.151:0/1341528418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 msgr2=0x55cfb05ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 --2- 172.21.15.151:0/1341528418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb05ced40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f848c019740 tx=0x7f848c0033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- 172.21.15.151:0/1341528418 shutdown_connections 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 --2- 172.21.15.151:0/1341528418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0659df0 0x55cfb05ced40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- 172.21.15.151:0/1341528418 >> 172.21.15.151:0/1341528418 conn(0x55cfb0655910 msgr2=0x55cfb0741250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- 172.21.15.151:0/1341528418 shutdown_connections 2024-09-12T16:52:42.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- 172.21.15.151:0/1341528418 wait complete. 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 Processor -- start 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- start start 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb065cfd0 0x55cfb074dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0505a50 con 0x55cfb065cfd0 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84913ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb065cfd0 0x55cfb074dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84913ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb065cfd0 0x55cfb074dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60508/0 (socket says 172.21.15.151:60508) 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84913ff640 1 -- 172.21.15.151:0/4210420859 learned_addr learned my addr 172.21.15.151:0/4210420859 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84913ff640 1 -- 172.21.15.151:0/4210420859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb074e510 con 0x55cfb065cfd0 2024-09-12T16:52:42.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84913ff640 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb065cfd0 0x55cfb074dfb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f848c000f90 tx=0x7f848c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f837de03640 1 -- 172.21.15.151:0/4210420859 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c0b9070 con 0x55cfb065cfd0 2024-09-12T16:52:42.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfb074e7a0 con 0x55cfb065cfd0 2024-09-12T16:52:42.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f837de03640 1 -- 172.21.15.151:0/4210420859 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c0b6a40 con 0x55cfb065cfd0 2024-09-12T16:52:42.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f837de03640 1 -- 172.21.15.151:0/4210420859 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848c0b6d20 con 0x55cfb065cfd0 2024-09-12T16:52:42.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.133+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb074f060 con 0x55cfb065cfd0 2024-09-12T16:52:42.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f837de03640 1 -- 172.21.15.151:0/4210420859 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f848c0b3040 con 0x55cfb065cfd0 2024-09-12T16:52:42.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f837de03640 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8378039a70 0x7f837803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f837de03640 1 -- 172.21.15.151:0/4210420859 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f848c0c3070 con 0x55cfb065cfd0 2024-09-12T16:52:42.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f8490bfe640 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8378039a70 0x7f837803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0753020 0x55cfb0755410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0755950 con 0x55cfb0753020 2024-09-12T16:52:42.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f8491c00640 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0753020 0x55cfb0755410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f8490bfe640 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8378039a70 0x7f837803bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f847c001e60 tx=0x7f847c0013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f8491c00640 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0753020 0x55cfb0755410 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f8491c00640 1 -- 172.21.15.151:0/4210420859 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84840083f0 con 0x55cfb0753020 2024-09-12T16:52:42.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0755d70 con 0x55cfb0753020 2024-09-12T16:52:42.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f8491c00640 1 -- 172.21.15.151:0/4210420859 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84840083f0 con 0x55cfb0753020 2024-09-12T16:52:42.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb0757b80 0x55cfb0759f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb075a640 con 0x55cfb0757b80 2024-09-12T16:52:42.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f84913ff640 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb0757b80 0x55cfb0759f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.137+0000 7f84913ff640 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb0757b80 0x55cfb0759f70 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84913ff640 1 -- 172.21.15.151:0/4210420859 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb0757b80 2024-09-12T16:52:42.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0756a20 con 0x55cfb0753020 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8491c00640 1 -- 172.21.15.151:0/4210420859 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84840083f0 con 0x55cfb0753020 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0756ec0 con 0x55cfb0753020 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8491c00640 1 -- 172.21.15.151:0/4210420859 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f84840083f0 con 0x55cfb0753020 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84938f99c0 1 Processor -- start 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84938f99c0 1 -- start start 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84938f99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0746c00 0x55cfb07454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84938f99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0570450 con 0x55cfb0746c00 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8491c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0746c00 0x55cfb07454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8491c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0746c00 0x55cfb07454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60518/0 (socket says 172.21.15.151:60518) 2024-09-12T16:52:42.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8491c00640 1 -- 172.21.15.151:0/1399511686 learned_addr learned my addr 172.21.15.151:0/1399511686 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8491c00640 1 -- 172.21.15.151:0/1399511686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb0747120 con 0x55cfb0746c00 2024-09-12T16:52:42.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8491c00640 1 --2- 172.21.15.151:0/1399511686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0746c00 0x55cfb07454a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x55cfb074ff90 tx=0x7f848400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8376ffd640 1 -- 172.21.15.151:0/1399511686 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8484007e00 con 0x55cfb0746c00 2024-09-12T16:52:42.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8376ffd640 1 -- 172.21.15.151:0/1399511686 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848401e020 con 0x55cfb0746c00 2024-09-12T16:52:42.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84938f99c0 1 -- 172.21.15.151:0/1399511686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfb07459e0 con 0x55cfb0746c00 2024-09-12T16:52:42.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f8376ffd640 1 -- 172.21.15.151:0/1399511686 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8484019590 con 0x55cfb0746c00 2024-09-12T16:52:42.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.141+0000 7f84938f99c0 1 -- 172.21.15.151:0/1399511686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb0745f50 con 0x55cfb0746c00 2024-09-12T16:52:42.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8376ffd640 1 -- 172.21.15.151:0/1399511686 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8484016040 con 0x55cfb0746c00 2024-09-12T16:52:42.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8376ffd640 1 --2- 172.21.15.151:0/1399511686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8368039ac0 0x7f836803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8376ffd640 1 -- 172.21.15.151:0/1399511686 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f848401f030 con 0x55cfb0746c00 2024-09-12T16:52:42.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84913ff640 1 --2- 172.21.15.151:0/1399511686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8368039ac0 0x7f836803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 Processor -- start 2024-09-12T16:52:42.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 -- start start 2024-09-12T16:52:42.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb0778b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cfb05cf4d0 con 0x55cfb07787a0 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84913ff640 1 --2- 172.21.15.151:0/1399511686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8368039ac0 0x7f836803bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55cfb074f350 tx=0x7f848c0a3be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8491c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb0778b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8491c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb0778b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60534/0 (socket says 172.21.15.151:60534) 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8491c00640 1 -- 172.21.15.151:0/3177553821 learned_addr learned my addr 172.21.15.151:0/3177553821 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8491c00640 1 -- 172.21.15.151:0/3177553821 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb0779170 con 0x55cfb07787a0 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8491c00640 1 --2- 172.21.15.151:0/3177553821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb0778b80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8484023fb0 tx=0x7f8484015df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a5fbf45be9ff98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8374ff9640 1 -- 172.21.15.151:0/3177553821 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848401d040 con 0x55cfb07787a0 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8374ff9640 1 -- 172.21.15.151:0/3177553821 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8484017470 con 0x55cfb07787a0 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f8374ff9640 1 -- 172.21.15.151:0/3177553821 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8484019d80 con 0x55cfb07787a0 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 -- 172.21.15.151:0/3177553821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 msgr2=0x55cfb0778b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 --2- 172.21.15.151:0/3177553821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb0778b80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8484023fb0 tx=0x7f8484015df0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 -- 172.21.15.151:0/3177553821 shutdown_connections 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 --2- 172.21.15.151:0/3177553821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb0778b80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 -- 172.21.15.151:0/3177553821 >> 172.21.15.151:0/3177553821 conn(0x55cfb0773bc0 msgr2=0x55cfb0771e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 -- 172.21.15.151:0/3177553821 shutdown_connections 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.145+0000 7f84938f99c0 1 -- 172.21.15.151:0/3177553821 wait complete. 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f84938f99c0 1 Processor -- start 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f84938f99c0 1 -- start start 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f84938f99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb077ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f84938f99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cfb07776f0 con 0x55cfb07787a0 2024-09-12T16:52:42.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8491c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb077ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8491c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb077ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60550/0 (socket says 172.21.15.151:60550) 2024-09-12T16:52:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 learned_addr learned my addr 172.21.15.151:0/852777350 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb077f1e0 con 0x55cfb07787a0 2024-09-12T16:52:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8491c00640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb077ec80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8484023fb0 tx=0x7f84840508e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8366ffd640 1 -- 172.21.15.151:0/852777350 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848401d070 con 0x55cfb07787a0 2024-09-12T16:52:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfb077f470 con 0x55cfb07787a0 2024-09-12T16:52:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8366ffd640 1 -- 172.21.15.151:0/852777350 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8484049040 con 0x55cfb07787a0 2024-09-12T16:52:42.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8366ffd640 1 -- 172.21.15.151:0/852777350 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f848404f420 con 0x55cfb07787a0 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb077fe20 con 0x55cfb07787a0 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8366ffd640 1 -- 172.21.15.151:0/852777350 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8484050a90 con 0x55cfb07787a0 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8366ffd640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f835c039a70 0x7f835c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f8366ffd640 1 -- 172.21.15.151:0/852777350 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8484038d50 con 0x55cfb07787a0 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.149+0000 7f84913ff640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f835c039a70 0x7f835c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0789f50 0x55cfb078c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb078cb60 con 0x55cfb0789f50 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8490bfe640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0789f50 0x55cfb078c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84913ff640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f835c039a70 0x7f835c03bf30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f848c0a9f90 tx=0x7f848c0eb000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8490bfe640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0789f50 0x55cfb078c410 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f847c00d040 con 0x55cfb0789f50 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 realm 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07892e0 con 0x55cfb0789f50 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f847c00d040 con 0x55cfb0789f50 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb078d650 con 0x55cfb0789f50 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f847c00d040 con 0x55cfb0789f50 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb078df20 con 0x55cfb0789f50 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f847c00d040 con 0x55cfb0789f50 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb078e940 0x55cfb0790d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0791470 con 0x55cfb078e940 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8491c00640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb078e940 0x55cfb0790d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8491c00640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb078e940 0x55cfb0790d30 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 20 searching for the correct realm 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cfb07933c0 0x55cfb07957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.153+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f84913ff640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cfb07933c0 0x55cfb07957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f84913ff640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cfb07933c0 0x55cfb07957f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f84913ff640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55cfb0659df0 0x7f848c0a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0659df0 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8490bfe640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55cfb0659df0 0x7f848c0a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8490bfe640 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55cfb0659df0 0x7f848c0a93c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c00d040 con 0x55cfb0659df0 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0789f50 2024-09-12T16:52:42.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c00d040 con 0x55cfb0789f50 2024-09-12T16:52:42.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0789f50 2024-09-12T16:52:42.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.157+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0659df0 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0789f50 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0789f50 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0659df0 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.161+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0789f50 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0789f50 2024-09-12T16:52:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0659df0 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0789f50 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.165+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0659df0 2024-09-12T16:52:42.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb07933c0 2024-09-12T16:52:42.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb078e940 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0789f50 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0795ec0 con 0x55cfb0659df0 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:42.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0791e30 con 0x55cfb0789f50 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07926d0 con 0x55cfb0789f50 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0791a70 con 0x55cfb0789f50 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 zone default found 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 4 Realm: () 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 zonegroup default 2024-09-12T16:52:42.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.169+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07926d0 con 0x55cfb078e940 2024-09-12T16:52:42.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0798230 con 0x55cfb07933c0 2024-09-12T16:52:42.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07985d0 con 0x55cfb07933c0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 20 started sync module instance, tier type = 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07976c0 con 0x55cfb0659df0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94350507342864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07976c0 con 0x55cfb0659df0 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0799090 con 0x55cfb0789f50 2024-09-12T16:52:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.173+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94350507342864] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.177+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.177+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94350507346816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07976c0 con 0x55cfb0789f50 2024-09-12T16:52:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.177+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0799aa0 con 0x55cfb07933c0 2024-09-12T16:52:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.177+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94350507346816] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.177+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.177+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94350507340304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb0797630 con 0x55cfb07933c0 2024-09-12T16:52:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.177+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079a7a0 con 0x55cfb0659df0 2024-09-12T16:52:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.181+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.181+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94350507353088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079aeb0 con 0x55cfb0659df0 2024-09-12T16:52:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.181+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079b9d0 con 0x55cfb0789f50 2024-09-12T16:52:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.181+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94350507340304] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.181+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94350507353088] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.181+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.181+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94350507357344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079b990 con 0x55cfb0789f50 2024-09-12T16:52:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.181+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079bdc0 con 0x55cfb078e940 2024-09-12T16:52:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.185+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94350507357344] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.185+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.185+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94350507354368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079c160 con 0x55cfb078e940 2024-09-12T16:52:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.185+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079cb20 con 0x55cfb078e940 2024-09-12T16:52:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.185+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94350507354368] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.185+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.185+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94350507351616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079cb20 con 0x55cfb078e940 2024-09-12T16:52:42.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.185+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079d4e0 con 0x55cfb078e940 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94350507351616] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94350507364400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079d450 con 0x55cfb078e940 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 20 add_watcher() i=0 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 20 add_watcher() i=1 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 20 add_watcher() i=2 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 20 add_watcher() i=3 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 20 add_watcher() i=4 2024-09-12T16:52:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 20 add_watcher() i=5 2024-09-12T16:52:42.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 20 add_watcher() i=6 2024-09-12T16:52:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94350507364400] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 20 add_watcher() i=7 2024-09-12T16:52:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07a0930 con 0x55cfb0789f50 2024-09-12T16:52:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.189+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94350507361904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb079de80 con 0x55cfb0789f50 2024-09-12T16:52:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94350507361904] v34'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f83477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 5 note: GC not initialized 2024-09-12T16:52:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f83467e4640 20 reqs_thread_entry: start 2024-09-12T16:52:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 Filter name: none 2024-09-12T16:52:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f82b7fff640 20 reqs_thread_entry: start 2024-09-12T16:52:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c4200 con 0x55cfb0659df0 2024-09-12T16:52:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 : miss 2024-09-12T16:52:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.1f 8:f80c5cb4:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c5c90 con 0x55cfb0659df0 2024-09-12T16:52:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(63 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 info.flags=0x17 2024-09-12T16:52:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 to cache LRU end 2024-09-12T16:52:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 2024-09-12T16:52:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 get_obj_state: octx=0x55cfb0778b80 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55cfb07c8388 s->prefetch_data=0 2024-09-12T16:52:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 3.13s0 3:c8a2c8dc:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c9310 con 0x55cfb07933c0 2024-09-12T16:52:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 10 manifest: total_size = 5 2024-09-12T16:52:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.193+0000 7f84938f99c0 20 get_obj_state: setting s->obj_tag to _abMfkMUC6MNND99MClRcKhFy7NmbUER 2024-09-12T16:52:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.197+0000 7f83477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.197+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94350507361904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c8e50 con 0x55cfb0789f50 2024-09-12T16:52:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.197+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94350507361904] v34'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.197+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94350507342864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c8e50 con 0x55cfb0659df0 2024-09-12T16:52:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.197+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94350507342864] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.197+0000 7f84938f99c0 20 remove_watcher() i=0 2024-09-12T16:52:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.197+0000 7f84938f99c0 2 removed watcher, disabling cache 2024-09-12T16:52:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.197+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94350507346816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c9310 con 0x55cfb0789f50 2024-09-12T16:52:42.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.201+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94350507346816] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.201+0000 7f84938f99c0 20 remove_watcher() i=1 2024-09-12T16:52:42.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.201+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94350507340304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c9310 con 0x55cfb07933c0 2024-09-12T16:52:42.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.201+0000 7f84913ff640 1 -- 172.21.15.151:0/852777350 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94350507340304] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848c0c6de0 con 0x55cfb07933c0 2024-09-12T16:52:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.201+0000 7f84938f99c0 20 remove_watcher() i=2 2024-09-12T16:52:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.201+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94350507353088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c9310 con 0x55cfb0659df0 2024-09-12T16:52:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.205+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94350507353088] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0659df0 2024-09-12T16:52:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.205+0000 7f84938f99c0 20 remove_watcher() i=3 2024-09-12T16:52:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.205+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94350507357344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c9310 con 0x55cfb0789f50 2024-09-12T16:52:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.205+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94350507357344] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f847c02a040 con 0x55cfb0789f50 2024-09-12T16:52:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.205+0000 7f84938f99c0 20 remove_watcher() i=4 2024-09-12T16:52:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.205+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94350507354368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c9310 con 0x55cfb078e940 2024-09-12T16:52:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.209+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94350507354368] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.209+0000 7f84938f99c0 20 remove_watcher() i=5 2024-09-12T16:52:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.209+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94350507351616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c9310 con 0x55cfb078e940 2024-09-12T16:52:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.209+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94350507351616] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.209+0000 7f84938f99c0 20 remove_watcher() i=6 2024-09-12T16:52:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.209+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94350507364400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cfb07c9310 con 0x55cfb078e940 2024-09-12T16:52:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f8491c00640 1 -- 172.21.15.151:0/852777350 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94350507364400] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f848403e070 con 0x55cfb078e940 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 20 remove_watcher() i=7 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb078e940 msgr2=0x55cfb0790d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb078e940 0x55cfb0790d30 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0789f50 msgr2=0x55cfb078c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0789f50 0x55cfb078c410 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55cfb0659df0 msgr2=0x7f848c0a93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55cfb0659df0 0x7f848c0a93c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cfb07933c0 msgr2=0x55cfb07957f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55cfb07933c0 0x55cfb07957f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f835c039a70 msgr2=0x7f835c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f835c039a70 0x7f835c03bf30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f848c0a9f90 tx=0x7f848c0eb000 comp rx=0 tx=0).stop 2024-09-12T16:52:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 msgr2=0x55cfb077ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f8490bfe640 1 -- 172.21.15.151:0/852777350 reap_dead start 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb077ec80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8484023fb0 tx=0x7f84840508e0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 shutdown_connections 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/852777350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb07787a0 0x55cfb077ec80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 >> 172.21.15.151:0/852777350 conn(0x55cfb0773bc0 msgr2=0x55cfb0771dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 shutdown_connections 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/852777350 wait complete. 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/1399511686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8368039ac0 msgr2=0x7f836803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/1399511686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8368039ac0 0x7f836803bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55cfb074f350 tx=0x7f848c0a3be0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/1399511686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0746c00 msgr2=0x55cfb07454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/1399511686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0746c00 0x55cfb07454a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x55cfb074ff90 tx=0x7f848400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/1399511686 shutdown_connections 2024-09-12T16:52:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/1399511686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8368039ac0 0x7f836803bf80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/1399511686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb0746c00 0x55cfb07454a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/1399511686 >> 172.21.15.151:0/1399511686 conn(0x55cfb075e660 msgr2=0x55cfb075ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/1399511686 shutdown_connections 2024-09-12T16:52:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/1399511686 wait complete. 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb0757b80 msgr2=0x55cfb0759f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb0757b80 0x55cfb0759f70 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0753020 msgr2=0x55cfb0755410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0753020 0x55cfb0755410 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8378039a70 msgr2=0x7f837803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8378039a70 0x7f837803bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f847c001e60 tx=0x7f847c0013e0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb065cfd0 msgr2=0x55cfb074dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb065cfd0 0x55cfb074dfb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f848c000f90 tx=0x7f848c017e30 comp rx=0 tx=0).stop 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 shutdown_connections 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55cfb0757b80 0x55cfb0759f70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55cfb0753020 0x55cfb0755410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8378039a70 0x7f837803bf30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 --2- 172.21.15.151:0/4210420859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cfb065cfd0 0x55cfb074dfb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 >> 172.21.15.151:0/4210420859 conn(0x55cfb0655910 msgr2=0x55cfb073fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 shutdown_connections 2024-09-12T16:52:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.213+0000 7f84938f99c0 1 -- 172.21.15.151:0/4210420859 wait complete. 2024-09-12T16:52:42.228 INFO:teuthology.orchestra.run.smithi151.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-12T16:52:42.229 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-12T16:52:42.231 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-12T16:52:42.256 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:42.365 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-12T16:52:42.366 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-12T16:52:42.366 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T16:52:42.366 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-12T16:52:42.366 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-12T16:52:42.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-12T16:52:42.367 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-12T16:52:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:42.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f0557a749c0 1 Processor -- start 2024-09-12T16:52:42.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f0557a749c0 1 -- start start 2024-09-12T16:52:42.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f0557a749c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d90ff1f700 0x55d90ff21af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f0557a749c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d90fdd19c0 con 0x55d90ff22030 2024-09-12T16:52:42.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f0557a749c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55d90fe216d0 con 0x55d90ff1f700 2024-09-12T16:52:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f055557a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d90ff1f700 0x55d90ff21af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f055557a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d90ff1f700 0x55d90ff21af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60552/0 (socket says 172.21.15.151:60552) 2024-09-12T16:52:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f055557a640 1 -- 172.21.15.151:0/614809643 learned_addr learned my addr 172.21.15.151:0/614809643 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f0554d79640 1 --1- 172.21.15.151:0/614809643 >> v1:172.21.15.122:6789/0 conn(0x55d90ff22030 0x55d90ff24420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:47238/0 (socket says 172.21.15.151:47238) 2024-09-12T16:52:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f055557a640 1 -- 172.21.15.151:0/614809643 >> v1:172.21.15.122:6789/0 conn(0x55d90ff22030 legacy=0x55d90ff24420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.405+0000 7f055557a640 1 -- 172.21.15.151:0/614809643 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90fdc5ca0 con 0x55d90ff1f700 2024-09-12T16:52:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f055557a640 1 --2- 172.21.15.151:0/614809643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d90ff21af0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f055000a4e0 tx=0x7f055001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12388c2e3451ada server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0547fff640 1 -- 172.21.15.151:0/614809643 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05500aa540 con 0x55d90ff1f700 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0547fff640 1 -- 172.21.15.151:0/614809643 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05500aa6e0 con 0x55d90ff1f700 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0547fff640 1 -- 172.21.15.151:0/614809643 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05500aaa40 con 0x55d90ff1f700 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0557a749c0 1 -- 172.21.15.151:0/614809643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 msgr2=0x55d90ff21af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0557a749c0 1 --2- 172.21.15.151:0/614809643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d90ff21af0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f055000a4e0 tx=0x7f055001b090 comp rx=0 tx=0).stop 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0557a749c0 1 -- 172.21.15.151:0/614809643 shutdown_connections 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0557a749c0 1 --2- 172.21.15.151:0/614809643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d90ff21af0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0557a749c0 1 -- 172.21.15.151:0/614809643 >> 172.21.15.151:0/614809643 conn(0x55d90fe92a90 msgr2=0x55d90fe92ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0557a749c0 1 -- 172.21.15.151:0/614809643 shutdown_connections 2024-09-12T16:52:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.409+0000 7f0557a749c0 1 -- 172.21.15.151:0/614809643 wait complete. 2024-09-12T16:52:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.425+0000 7f0557a749c0 1 Processor -- start 2024-09-12T16:52:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.425+0000 7f0557a749c0 1 -- start start 2024-09-12T16:52:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.425+0000 7f0557a749c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d91000a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.425+0000 7f0557a749c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d90fe25680 con 0x55d90ff1f700 2024-09-12T16:52:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.425+0000 7f055557a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d91000a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d91000a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60568/0 (socket says 172.21.15.151:60568) 2024-09-12T16:52:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 -- 172.21.15.151:0/3981427004 learned_addr learned my addr 172.21.15.151:0/3981427004 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 -- 172.21.15.151:0/3981427004 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90fda0da0 con 0x55d90ff1f700 2024-09-12T16:52:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 --2- 172.21.15.151:0/3981427004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d91000a880 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0550018cc0 tx=0x7f05500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbd49623545609a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0443606640 1 -- 172.21.15.151:0/3981427004 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05500b9070 con 0x55d90ff1f700 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0443606640 1 -- 172.21.15.151:0/3981427004 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05500aaa80 con 0x55d90ff1f700 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0443606640 1 -- 172.21.15.151:0/3981427004 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05500aad60 con 0x55d90ff1f700 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 -- 172.21.15.151:0/3981427004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 msgr2=0x55d91000a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 --2- 172.21.15.151:0/3981427004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d91000a880 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0550018cc0 tx=0x7f05500033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 -- 172.21.15.151:0/3981427004 shutdown_connections 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 --2- 172.21.15.151:0/3981427004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d91000a880 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 -- 172.21.15.151:0/3981427004 >> 172.21.15.151:0/3981427004 conn(0x55d90fe92a90 msgr2=0x55d910006500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 -- 172.21.15.151:0/3981427004 shutdown_connections 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 -- 172.21.15.151:0/3981427004 wait complete. 2024-09-12T16:52:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 Processor -- start 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 -- start start 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d910011dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f0557a749c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d90fdc7a50 con 0x55d90ff1f700 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d910011dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d910011dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60574/0 (socket says 172.21.15.151:60574) 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 -- 172.21.15.151:0/4003314527 learned_addr learned my addr 172.21.15.151:0/4003314527 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 -- 172.21.15.151:0/4003314527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d910012320 con 0x55d90ff1f700 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.429+0000 7f055557a640 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d910011dc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0550018cc0 tx=0x7f0550017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0441e03640 1 -- 172.21.15.151:0/4003314527 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05500b9070 con 0x55d90ff1f700 2024-09-12T16:52:42.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9100125b0 con 0x55d90ff1f700 2024-09-12T16:52:42.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0441e03640 1 -- 172.21.15.151:0/4003314527 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05500b5b10 con 0x55d90ff1f700 2024-09-12T16:52:42.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0441e03640 1 -- 172.21.15.151:0/4003314527 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05500b5df0 con 0x55d90ff1f700 2024-09-12T16:52:42.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d910012f10 con 0x55d90ff1f700 2024-09-12T16:52:42.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0441e03640 1 -- 172.21.15.151:0/4003314527 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f05500b3040 con 0x55d90ff1f700 2024-09-12T16:52:42.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0441e03640 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f043c039a70 0x7f043c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0441e03640 1 -- 172.21.15.151:0/4003314527 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f05500c4070 con 0x55d90ff1f700 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0554d79640 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f043c039a70 0x7f043c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d90ff22030 0x55d910018ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910019420 con 0x55d90ff22030 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0555d7b640 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d90ff22030 0x55d910018ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0554d79640 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f043c039a70 0x7f043c03bf30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f054c001e90 tx=0x7f054c0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0555d7b640 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d90ff22030 0x55d910018ee0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0555d7b640 1 -- 172.21.15.151:0/4003314527 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05480083f0 con 0x55d90ff22030 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910013350 con 0x55d90ff22030 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0555d7b640 1 -- 172.21.15.151:0/4003314527 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05480083f0 con 0x55d90ff22030 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d91001b730 0x55d91001db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91001e210 con 0x55d91001b730 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.433+0000 7f055557a640 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d91001b730 0x55d91001db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f055557a640 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d91001b730 0x55d91001db20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f055557a640 1 -- 172.21.15.151:0/4003314527 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05500cd060 con 0x55d91001b730 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91001a5d0 con 0x55d90ff22030 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0555d7b640 1 -- 172.21.15.151:0/4003314527 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05480083f0 con 0x55d90ff22030 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91001a9d0 con 0x55d90ff22030 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0555d7b640 1 -- 172.21.15.151:0/4003314527 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05480083f0 con 0x55d90ff22030 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0557a749c0 1 Processor -- start 2024-09-12T16:52:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0557a749c0 1 -- start start 2024-09-12T16:52:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0557a749c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91002c840 0x55d91002cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0557a749c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d90fe32450 con 0x55d91002c840 2024-09-12T16:52:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0555d7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91002c840 0x55d91002cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0555d7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91002c840 0x55d91002cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60586/0 (socket says 172.21.15.151:60586) 2024-09-12T16:52:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0555d7b640 1 -- 172.21.15.151:0/3624549141 learned_addr learned my addr 172.21.15.151:0/3624549141 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0555d7b640 1 -- 172.21.15.151:0/3624549141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d91002d2a0 con 0x55d91002c840 2024-09-12T16:52:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f0555d7b640 1 --2- 172.21.15.151:0/3624549141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91002c840 0x55d91002cc60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55d910013100 tx=0x7f054800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f043affd640 1 -- 172.21.15.151:0/3624549141 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0548010d90 con 0x55d91002c840 2024-09-12T16:52:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.437+0000 7f043affd640 1 -- 172.21.15.151:0/3624549141 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054801f020 con 0x55d91002c840 2024-09-12T16:52:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0557a749c0 1 -- 172.21.15.151:0/3624549141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d91002db00 con 0x55d91002c840 2024-09-12T16:52:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f043affd640 1 -- 172.21.15.151:0/3624549141 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f054801a5a0 con 0x55d91002c840 2024-09-12T16:52:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0557a749c0 1 -- 172.21.15.151:0/3624549141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d91002e070 con 0x55d91002c840 2024-09-12T16:52:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f043affd640 1 -- 172.21.15.151:0/3624549141 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0548013030 con 0x55d91002c840 2024-09-12T16:52:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f043affd640 1 --2- 172.21.15.151:0/3624549141 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f042c039ac0 0x7f042c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f043affd640 1 -- 172.21.15.151:0/3624549141 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0548020030 con 0x55d91002c840 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f055557a640 1 --2- 172.21.15.151:0/3624549141 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f042c039ac0 0x7f042c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0557a749c0 1 Processor -- start 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0557a749c0 1 -- start start 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f055557a640 1 --2- 172.21.15.151:0/3624549141 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f042c039ac0 0x7f042c03bf80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f055001aec0 tx=0x7f05500b5f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0557a749c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d91003a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0557a749c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d91000b010 con 0x55d91003a090 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0555d7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d91003a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0555d7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d91003a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60600/0 (socket says 172.21.15.151:60600) 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0555d7b640 1 -- 172.21.15.151:0/1554160666 learned_addr learned my addr 172.21.15.151:0/1554160666 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0555d7b640 1 -- 172.21.15.151:0/1554160666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d91003aa80 con 0x55d91003a090 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0555d7b640 1 --2- 172.21.15.151:0/1554160666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d91003a490 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0548050bd0 tx=0x7f0548018790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e9b644add6c6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0438ff9640 1 -- 172.21.15.151:0/1554160666 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0548048070 con 0x55d91003a090 2024-09-12T16:52:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0438ff9640 1 -- 172.21.15.151:0/1554160666 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0548019e10 con 0x55d91003a090 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.441+0000 7f0438ff9640 1 -- 172.21.15.151:0/1554160666 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f054801e040 con 0x55d91003a090 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- 172.21.15.151:0/1554160666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 msgr2=0x55d91003a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 --2- 172.21.15.151:0/1554160666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d91003a490 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0548050bd0 tx=0x7f0548018790 comp rx=0 tx=0).stop 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- 172.21.15.151:0/1554160666 shutdown_connections 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 --2- 172.21.15.151:0/1554160666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d91003a490 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- 172.21.15.151:0/1554160666 >> 172.21.15.151:0/1554160666 conn(0x55d9100354d0 msgr2=0x55d910033710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- 172.21.15.151:0/1554160666 shutdown_connections 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- 172.21.15.151:0/1554160666 wait complete. 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 Processor -- start 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- start start 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d9100405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d910038fe0 con 0x55d91003a090 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0555d7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d9100405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0555d7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d9100405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60612/0 (socket says 172.21.15.151:60612) 2024-09-12T16:52:42.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 learned_addr learned my addr 172.21.15.151:0/2571188434 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d910040b40 con 0x55d91003a090 2024-09-12T16:52:42.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0555d7b640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d9100405e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f05480187d0 tx=0x7f0548050b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f042affd640 1 -- 172.21.15.151:0/2571188434 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f054801e050 con 0x55d91003a090 2024-09-12T16:52:42.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d910040dd0 con 0x55d91003a090 2024-09-12T16:52:42.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f042affd640 1 -- 172.21.15.151:0/2571188434 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0548019e10 con 0x55d91003a090 2024-09-12T16:52:42.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f042affd640 1 -- 172.21.15.151:0/2571188434 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0548048040 con 0x55d91003a090 2024-09-12T16:52:42.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d910040dd0 con 0x55d91003a090 2024-09-12T16:52:42.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f042affd640 1 -- 172.21.15.151:0/2571188434 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0548043d10 con 0x55d91003a090 2024-09-12T16:52:42.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f042affd640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0420039a70 0x7f042003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f042affd640 1 -- 172.21.15.151:0/2571188434 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f054803ad60 con 0x55d91003a090 2024-09-12T16:52:42.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.445+0000 7f055557a640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0420039a70 0x7f042003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d91004b740 0x55d91004dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91004e350 con 0x55d91004b740 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0554d79640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d91004b740 0x55d91004dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f055557a640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0420039a70 0x7f042003bf30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05500bdfd0 tx=0x7f05500db000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0554d79640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d91004b740 0x55d91004dc00 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f054c00f660 con 0x55d91004b740 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 realm 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91004aa90 con 0x55d91004b740 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f054c00f660 con 0x55d91004b740 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91004ee50 con 0x55d91004b740 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f054c00f660 con 0x55d91004b740 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91004f720 con 0x55d91004b740 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f054c00f660 con 0x55d91004b740 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d910050140 0x55d910052530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910052c20 con 0x55d910050140 2024-09-12T16:52:42.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0555d7b640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d910050140 0x55d910052530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0555d7b640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d910050140 0x55d910052530 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 20 searching for the correct realm 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d910054b70 0x55d910056fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.449+0000 7f055557a640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d910054b70 0x55d910056fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f055557a640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d910054b70 0x55d910056fa0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f055557a640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f05500f7040 0x7f05500c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x7f05500f7040 2024-09-12T16:52:42.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0554d79640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f05500f7040 0x7f05500c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0554d79640 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f05500f7040 0x7f05500c7860 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c00f660 con 0x7f05500f7040 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d91004b740 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c00f660 con 0x55d91004b740 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d91004b740 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.453+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x7f05500f7040 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d91004b740 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d91004b740 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x7f05500f7040 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.457+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d91004b740 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d91004b740 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x7f05500f7040 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d91004b740 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.461+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x7f05500f7040 2024-09-12T16:52:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910054b70 2024-09-12T16:52:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d910050140 2024-09-12T16:52:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x55d91004b740 2024-09-12T16:52:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d910057670 con 0x7f05500f7040 2024-09-12T16:52:42.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:42.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:42.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:42.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:42.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:42.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:42.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100535e0 con 0x55d91004b740 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910053a60 con 0x55d91004b740 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910053180 con 0x55d91004b740 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 zone default found 2024-09-12T16:52:42.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 4 Realm: () 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 zonegroup default 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.465+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910057af0 con 0x55d910050140 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910059d30 con 0x55d910054b70 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91005a0d0 con 0x55d910054b70 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 20 started sync module instance, tier type = 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100591c0 con 0x7f05500f7040 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94390765065920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100591c0 con 0x7f05500f7040 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005ab40 con 0x55d91004b740 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.469+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94390765065920] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.473+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.473+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94390765069904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100591c0 con 0x55d91004b740 2024-09-12T16:52:42.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.473+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005b550 con 0x55d910054b70 2024-09-12T16:52:42.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.473+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94390765069904] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.473+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.473+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94390765063440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910059130 con 0x55d910054b70 2024-09-12T16:52:42.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.473+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005c2a0 con 0x7f05500f7040 2024-09-12T16:52:42.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.477+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.477+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94390765076256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005cb40 con 0x7f05500f7040 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.477+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005d500 con 0x55d91004b740 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.477+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94390765063440] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.477+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94390765076256] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.477+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.477+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94390765080656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005cab0 con 0x55d91004b740 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.477+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005d470 con 0x55d910050140 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.481+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94390765080656] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.481+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.481+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94390765078016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005ddd0 con 0x55d910050140 2024-09-12T16:52:42.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.481+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005e620 con 0x55d910050140 2024-09-12T16:52:42.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.481+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94390765078016] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.481+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.481+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94390765085040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005ea40 con 0x55d910050140 2024-09-12T16:52:42.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.481+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005f400 con 0x55d910050140 2024-09-12T16:52:42.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94390765085040] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94390765086368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005f400 con 0x55d910050140 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 20 add_watcher() i=0 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 20 add_watcher() i=1 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 20 add_watcher() i=2 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 20 add_watcher() i=3 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 20 add_watcher() i=4 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 20 add_watcher() i=5 2024-09-12T16:52:42.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 20 add_watcher() i=6 2024-09-12T16:52:42.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94390765086368] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 20 add_watcher() i=7 2024-09-12T16:52:42.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:42.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910062840 con 0x55d91004b740 2024-09-12T16:52:42.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.485+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94390765101552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005f5c0 con 0x55d91004b740 2024-09-12T16:52:42.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.489+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94390765101552] v34'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.489+0000 7f040b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:42.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.489+0000 7f0557a749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:42.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.489+0000 7f0557a749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:42.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.489+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006b060 con 0x55d91004b740 2024-09-12T16:52:42.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.489+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.489+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006b670 con 0x55d910050140 2024-09-12T16:52:42.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.493+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.493+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006b630 con 0x55d910054b70 2024-09-12T16:52:42.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.493+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.493+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100613f0 con 0x55d91004b740 2024-09-12T16:52:42.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.497+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'185 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.497+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910060f40 con 0x7f05500f7040 2024-09-12T16:52:42.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.497+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.497+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910060f40 con 0x55d910054b70 2024-09-12T16:52:42.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.497+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.497+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910060f40 con 0x55d91004b740 2024-09-12T16:52:42.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.501+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.501+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910061010 con 0x55d910050140 2024-09-12T16:52:42.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.501+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.501+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910060fd0 con 0x7f05500f7040 2024-09-12T16:52:42.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.505+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.505+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910060fd0 con 0x55d910054b70 2024-09-12T16:52:42.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.505+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.505+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x7f05500f7040 2024-09-12T16:52:42.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.505+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.505+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x55d910050140 2024-09-12T16:52:42.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.509+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.509+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x7f05500f7040 2024-09-12T16:52:42.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.509+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.509+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x55d910050140 2024-09-12T16:52:42.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.513+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.513+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x55d91004b740 2024-09-12T16:52:42.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.513+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'186 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.513+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x55d910054b70 2024-09-12T16:52:42.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.517+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.517+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x7f05500f7040 2024-09-12T16:52:42.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.517+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.517+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x55d910054b70 2024-09-12T16:52:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.517+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.517+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x55d91004b740 2024-09-12T16:52:42.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.521+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.521+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x55d91004b740 2024-09-12T16:52:42.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.521+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'187 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.521+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006c9e0 con 0x55d910054b70 2024-09-12T16:52:42.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.525+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.525+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006ca20 con 0x7f05500f7040 2024-09-12T16:52:42.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.525+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.525+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006ca50 con 0x55d910054b70 2024-09-12T16:52:42.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.525+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.525+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006ca50 con 0x55d910054b70 2024-09-12T16:52:42.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.525+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.529+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006cab0 con 0x55d910054b70 2024-09-12T16:52:42.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.529+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.529+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006ca70 con 0x55d910054b70 2024-09-12T16:52:42.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.529+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.529+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006cab0 con 0x55d910050140 2024-09-12T16:52:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.533+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.533+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006caf0 con 0x55d910054b70 2024-09-12T16:52:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.533+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.533+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006cab0 con 0x55d910050140 2024-09-12T16:52:42.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.537+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.537+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006cab0 con 0x55d910054b70 2024-09-12T16:52:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.537+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.537+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006caf0 con 0x55d910050140 2024-09-12T16:52:42.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.541+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.541+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91006cab0 con 0x7f05500f7040 2024-09-12T16:52:42.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.541+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.541+0000 7f040a7e4640 20 reqs_thread_entry: start 2024-09-12T16:52:42.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.541+0000 7f0557a749c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:42.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.541+0000 7f0557a749c0 20 Filter name: none 2024-09-12T16:52:42.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.541+0000 7f037bfff640 20 reqs_thread_entry: start 2024-09-12T16:52:42.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:52:42.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910069330 con 0x7f05500f7040 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 : miss 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 8.1f 8:f80c5cb4:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100896c0 con 0x7f05500f7040 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(95 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 info.flags=0x17 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 to cache LRU end 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 4.12 4:49f01fc3:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106c70 con 0x55d91004b740 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(96 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:97 4.35 4:ac16aa34:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106c70 con 0x55d91004b740 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(97 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:98 4.7 4:e2e84190:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106c70 con 0x55d910050140 2024-09-12T16:52:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(98 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2 [call out=429b] v0'0 uv4 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-12T16:52:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 4.3c 4:3f46b89c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106cb0 con 0x55d91004b740 2024-09-12T16:52:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(99 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.545+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:100 4.18 4:1951a725:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106cb0 con 0x7f05500f7040 2024-09-12T16:52:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(100 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:101 4.3c 4:3c76684f:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106cb0 con 0x55d91004b740 2024-09-12T16:52:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(101 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 4.26 4:6483f818:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106cb0 con 0x55d910050140 2024-09-12T16:52:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(102 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6 [call out=428b] v0'0 uv5 ondisk = 0) ==== 194+0+428 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0557a749c0 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-12T16:52:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 4.7 4:e17c76b2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106cb0 con 0x55d910050140 2024-09-12T16:52:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(103 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:104 4.1c 4:3a0a0308:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106cb0 con 0x55d910050140 2024-09-12T16:52:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(104 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0557a749c0 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-12T16:52:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.549+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:105 4.6 4:62e5722e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106cb0 con 0x55d910054b70 2024-09-12T16:52:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(105 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:106 4.12 4:492b2a68:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910106cb0 con 0x55d91004b740 2024-09-12T16:52:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(106 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 [call out=701b] v0'0 uv18 ondisk = 0) ==== 195+0+701 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-12T16:52:42.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-12T16:52:42.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:107 3.1es0 3:7b300be3:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910104600 con 0x55d910050140 2024-09-12T16:52:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(107 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 10 manifest: total_size = 6 2024-09-12T16:52:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 20 get_obj_state: setting s->obj_tag to 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5450613897347237963 2024-09-12T16:52:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 20 prepare_atomic_modification: state is not atomic. state=0x55d910106108 2024-09-12T16:52:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2 2024-09-12T16:52:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.553+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:108 4.7 4:e2e84190:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008e760 con 0x55d910050140 2024-09-12T16:52:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.557+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(108 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.557+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:109 3.1es0 3:7b300be3:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008e760 con 0x55d910050140 2024-09-12T16:52:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.557+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(109 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_9c8454ddf7aa50116496bac348d7550d [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.557+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:110 4.7 4:e2e84190:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008f1f0 con 0x55d910050140 2024-09-12T16:52:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.557+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.557+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:111 3.30s0 3:0dde2c9f:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91008fe20 con 0x55d910054b70 2024-09-12T16:52:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(111 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0557a749c0 10 manifest: total_size = 3 2024-09-12T16:52:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0557a749c0 20 get_obj_state: setting s->obj_tag to 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.368468580870906041 2024-09-12T16:52:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0557a749c0 20 prepare_atomic_modification: state is not atomic. state=0x55d910106108 2024-09-12T16:52:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0557a749c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6 2024-09-12T16:52:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:112 4.26 4:6483f818:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008fe20 con 0x55d910050140 2024-09-12T16:52:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(110 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0438ff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-12T16:52:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== osd_op_reply(112 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.561+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:113 3.30s0 3:0dde2c9f:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008f970 con 0x55d910054b70 2024-09-12T16:52:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(113 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:114 4.26 4:6483f818:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008fe20 con 0x55d910050140 2024-09-12T16:52:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:115 3.25s0 3:a515e85f:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91008fe20 con 0x55d91004b740 2024-09-12T16:52:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(115 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 10 manifest: total_size = 4 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 20 get_obj_state: setting s->obj_tag to 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.6530413052864348263 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 20 prepare_atomic_modification: state is not atomic. state=0x55d910106108 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:116 4.1c 4:3a0a0308:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008fe20 con 0x55d910050140 2024-09-12T16:52:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== osd_op_reply(114 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.565+0000 7f042bfff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-12T16:52:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.569+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(116 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.569+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:117 3.25s0 3:a515e85f:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008fe20 con 0x55d91004b740 2024-09-12T16:52:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.569+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(117 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.569+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:118 4.1c 4:3a0a0308:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008fd70 con 0x55d910050140 2024-09-12T16:52:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.569+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.569+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:119 3.16s0 3:68bbf353:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910090fe0 con 0x7f05500f7040 2024-09-12T16:52:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(119 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0557a749c0 10 manifest: total_size = 5 2024-09-12T16:52:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0557a749c0 20 get_obj_state: setting s->obj_tag to 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.1567233471830288857 2024-09-12T16:52:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0557a749c0 20 prepare_atomic_modification: state is not atomic. state=0x55d910106108 2024-09-12T16:52:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0557a749c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 2024-09-12T16:52:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:120 4.12 4:492b2a68:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910095140 con 0x55d91004b740 2024-09-12T16:52:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(120 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 [stat,call,call] v34'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:121 3.16s0 3:68bbf353:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910095140 con 0x7f05500f7040 2024-09-12T16:52:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(118 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.573+0000 7f0438ff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-12T16:52:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(121 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:122 4.12 4:492b2a68:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910095140 con 0x55d91004b740 2024-09-12T16:52:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:123 3.13s0 3:c8a2c8dc:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910090fe0 con 0x55d910054b70 2024-09-12T16:52:42.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(123 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 10 manifest: total_size = 5 2024-09-12T16:52:42.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 20 get_obj_state: setting s->obj_tag to _abMfkMUC6MNND99MClRcKhFy7NmbUER 2024-09-12T16:52:42.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 20 get_obj_state: octx=0x55d91003a470 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d910106108 s->prefetch_data=0 2024-09-12T16:52:42.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 20 prepare_atomic_modification: state is not atomic. state=0x55d910106108 2024-09-12T16:52:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 2024-09-12T16:52:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:124 4.12 4:492b2a68:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910090b30 con 0x55d91004b740 2024-09-12T16:52:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(122 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 [stat,call,call] v34'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f042bfff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-12T16:52:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(124 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 [stat,call,call] v34'21 uv21 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.577+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:125 3.13s0 3:c8a2c8dc:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910090b30 con 0x55d910054b70 2024-09-12T16:52:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(125 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:126 4.12 4:492b2a68:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910091410 con 0x55d91004b740 2024-09-12T16:52:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 20 list_objects_ordered: starting attempt 1 2024-09-12T16:52:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T16:52:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:127 4.12 4:49f01fc3:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910091160 con 0x55d91004b740 2024-09-12T16:52:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:128 4.35 4:ac16aa34:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910105f20 con 0x55d91004b740 2024-09-12T16:52:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:129 4.7 4:e2e84190:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9101063d0 con 0x55d910050140 2024-09-12T16:52:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:130 4.3c 4:3f46b89c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9101063d0 con 0x55d91004b740 2024-09-12T16:52:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:131 4.18 4:1951a725:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91009d0f0 con 0x7f05500f7040 2024-09-12T16:52:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:132 4.3c 4:3c76684f:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91009fef0 con 0x55d91004b740 2024-09-12T16:52:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:133 4.26 4:6483f818:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100a29c0 con 0x55d910050140 2024-09-12T16:52:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:134 4.7 4:e17c76b2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91009d0f0 con 0x55d910050140 2024-09-12T16:52:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:135 4.1c 4:3a0a0308:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100a29c0 con 0x55d910050140 2024-09-12T16:52:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:136 4.6 4:62e5722e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100aa240 con 0x55d910054b70 2024-09-12T16:52:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:137 4.12 4:492b2a68:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100aa240 con 0x55d91004b740 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(128 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 39 ==== osd_op_reply(130 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(131 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 40 ==== osd_op_reply(132 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== osd_op_reply(136 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== osd_op_reply(129 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(133 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(135 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 41 ==== osd_op_reply(127 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.581+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 42 ==== osd_op_reply(126 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 [stat,call,call] v34'22 uv22 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0438ff9640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-12T16:52:42.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(134 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 43 ==== osd_op_reply(137 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 [call out=128b] v0'0 uv22 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T16:52:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T16:52:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T16:52:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T16:52:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5])"; uploads.size()=0; is_truncated=0 2024-09-12T16:52:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:138 4.12 4:49f01fc3:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91009d0f0 con 0x55d91004b740 2024-09-12T16:52:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:139 4.35 4:ac16aa34:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100aa240 con 0x55d91004b740 2024-09-12T16:52:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:140 4.7 4:e2e84190:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910091140 con 0x55d910050140 2024-09-12T16:52:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:141 4.3c 4:3f46b89c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910104830 con 0x55d91004b740 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:142 4.18 4:1951a725:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100a03e0 con 0x7f05500f7040 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:143 4.3c 4:3c76684f:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91009d0f0 con 0x55d91004b740 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:144 4.26 4:6483f818:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910094050 con 0x55d910050140 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:145 4.7 4:e17c76b2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100aa240 con 0x55d910050140 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:146 4.1c 4:3a0a0308:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100a7350 con 0x55d910050140 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:147 4.6 4:62e5722e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910104830 con 0x55d910054b70 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:148 4.12 4:492b2a68:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d91009d0f0 con 0x55d91004b740 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 44 ==== osd_op_reply(138 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 45 ==== osd_op_reply(139 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 24 ==== osd_op_reply(142 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(147 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 46 ==== osd_op_reply(141 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 47 ==== osd_op_reply(148 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 [call out=128b] v0'0 uv22 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 48 ==== osd_op_reply(143 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(144 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== osd_op_reply(140 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 43 ==== osd_op_reply(146 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 44 ==== osd_op_reply(145 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100aa240 con 0x7f05500f7040 2024-09-12T16:52:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 25 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.585+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910091140 con 0x7f05500f7040 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 26 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0557a749c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0557a749c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94390765292336 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9100a03e0 con 0x55d910050140 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 45 ==== watch-notify(notify (1) cookie 94390765085040 notify 146028888076 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55d910060fd0 con 0x55d910050140 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f042bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94390765085040 notifier 4649 bl.length()=149 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f042bfff640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f03880032d0 con 0x55d910050140 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 46 ==== osd_op_reply(151 notify.6 [notify cookie 94390765292336 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 47 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 48 ==== watch-notify(notify_complete (2) cookie 94390765292336 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d91003aa80 con 0x55d910050140 2024-09-12T16:52:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.589+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:153 8.1f 8:f80c5cb4:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910104830 con 0x7f05500f7040 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 27 ==== osd_op_reply(153 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 from cache 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5, ofs0, ns] 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:154 7.0 7:05bf5b68:::notify.1:head [notify cookie 94390765292336 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910104830 con 0x55d91004b740 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 49 ==== watch-notify(notify (1) cookie 94390765069904 notify 146028888097 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55d9100694f0 con 0x55d91004b740 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0438ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94390765069904 notifier 4649 bl.length()=206 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 50 ==== osd_op_reply(154 notify.1 [notify cookie 94390765292336 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0438ff9640 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:155 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0418003d70 con 0x55d91004b740 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 51 ==== osd_op_reply(155 notify.1 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 52 ==== watch-notify(notify_complete (2) cookie 94390765292336 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d910061790 con 0x55d91004b740 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:156 4.12 4:49f01fc3:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910104830 con 0x55d91004b740 2024-09-12T16:52:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:157 4.35 4:ac16aa34:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910105f20 con 0x55d91004b740 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:158 4.7 4:e2e84190:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100915f0 con 0x55d910050140 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:159 4.3c 4:3f46b89c:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910068120 con 0x55d91004b740 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:160 4.18 4:1951a725:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100a78e0 con 0x7f05500f7040 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:161 4.3c 4:3c76684f:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100a81b0 con 0x55d91004b740 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:162 4.26 4:6483f818:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100886b0 con 0x55d910050140 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:163 4.7 4:e17c76b2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910104830 con 0x55d910050140 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:164 4.1c 4:3a0a0308:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91008c090 con 0x55d910050140 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:165 4.6 4:62e5722e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100915f0 con 0x55d910054b70 2024-09-12T16:52:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.593+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:166 4.12 4:492b2a68:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910068120 con 0x55d91004b740 2024-09-12T16:52:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 49 ==== osd_op_reply(158 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.2 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 53 ==== osd_op_reply(156 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.0 [delete] v34'23 uv23 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 50 ==== osd_op_reply(162 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 54 ==== osd_op_reply(159 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.3 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 55 ==== osd_op_reply(157 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.1 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(165 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.9 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 51 ==== osd_op_reply(164 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.8 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 56 ==== osd_op_reply(166 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.10 [delete] v34'24 uv24 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 52 ==== osd_op_reply(163 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.7 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 57 ==== osd_op_reply(161 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 28 ==== osd_op_reply(160 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5.4 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0557a749c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 : miss 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0557a749c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:167 6.1d 6:bff92e70:::pubsub..bucket.myfoo%2f1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d910104790 con 0x55d910050140 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 53 ==== osd_op_reply(167 pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0557a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0557a749c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 info.flags=0x0 2024-09-12T16:52:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0557a749c0 10 adding default.rgw.log++pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 to cache LRU end 2024-09-12T16:52:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.597+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:168 6.1d 6:bff92e70:::pubsub..bucket.myfoo%2f1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910104790 con 0x55d910050140 2024-09-12T16:52:42.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.601+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 54 ==== osd_op_reply(168 pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.5 [delete] v34'43 uv36 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.601+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910104790 con 0x7f05500f7040 2024-09-12T16:52:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.601+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 29 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.605+0000 7f040b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.605+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94390765101552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910104790 con 0x55d91004b740 2024-09-12T16:52:42.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.605+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 58 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94390765101552] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.605+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94390765065920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910104790 con 0x7f05500f7040 2024-09-12T16:52:42.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.609+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 30 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94390765065920] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.609+0000 7f0557a749c0 20 remove_watcher() i=0 2024-09-12T16:52:42.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.609+0000 7f0557a749c0 2 removed watcher, disabling cache 2024-09-12T16:52:42.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.609+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94390765069904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100596c0 con 0x55d91004b740 2024-09-12T16:52:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.609+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 59 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94390765069904] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.609+0000 7f0557a749c0 20 remove_watcher() i=1 2024-09-12T16:52:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.609+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94390765063440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100596c0 con 0x55d910054b70 2024-09-12T16:52:42.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.613+0000 7f055557a640 1 -- 172.21.15.151:0/2571188434 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94390765063440] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05500cd060 con 0x55d910054b70 2024-09-12T16:52:42.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.613+0000 7f0557a749c0 20 remove_watcher() i=2 2024-09-12T16:52:42.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.613+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94390765076256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910058d10 con 0x7f05500f7040 2024-09-12T16:52:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.613+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.2 v2:172.21.15.151:6800/1197700885 31 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94390765076256] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x7f05500f7040 2024-09-12T16:52:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.613+0000 7f0557a749c0 20 remove_watcher() i=3 2024-09-12T16:52:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.613+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94390765080656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9100596c0 con 0x55d91004b740 2024-09-12T16:52:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.617+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 <== osd.1 v2:172.21.15.151:6816/883447514 60 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94390765080656] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054c02b040 con 0x55d91004b740 2024-09-12T16:52:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.617+0000 7f0557a749c0 20 remove_watcher() i=4 2024-09-12T16:52:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.617+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94390765078016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005bf20 con 0x55d910050140 2024-09-12T16:52:42.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.617+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 55 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94390765078016] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.617+0000 7f0557a749c0 20 remove_watcher() i=5 2024-09-12T16:52:42.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.617+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94390765085040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d910058d10 con 0x55d910050140 2024-09-12T16:52:42.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.621+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 56 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94390765085040] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.621+0000 7f0557a749c0 20 remove_watcher() i=6 2024-09-12T16:52:42.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.621+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94390765086368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d91005d050 con 0x55d910050140 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0555d7b640 1 -- 172.21.15.151:0/2571188434 <== osd.0 v2:172.21.15.122:6800/3868153603 57 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94390765086368] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f054802b070 con 0x55d910050140 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 20 remove_watcher() i=7 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d910050140 msgr2=0x55d910052530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d910050140 0x55d910052530 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d91004b740 msgr2=0x55d91004dc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d91004b740 0x55d91004dc00 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f05500f7040 msgr2=0x7f05500c7860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f05500f7040 0x7f05500c7860 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d910054b70 msgr2=0x55d910056fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d910054b70 0x55d910056fa0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0420039a70 msgr2=0x7f042003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0420039a70 0x7f042003bf30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05500bdfd0 tx=0x7f05500db000 comp rx=0 tx=0).stop 2024-09-12T16:52:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 msgr2=0x55d9100405e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/2571188434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91003a090 0x55d9100405e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f05480187d0 tx=0x7f0548050b00 comp rx=0 tx=0).stop 2024-09-12T16:52:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 reap_dead start 2024-09-12T16:52:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0554d79640 1 -- 172.21.15.151:0/2571188434 reap_dead start 2024-09-12T16:52:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 shutdown_connections 2024-09-12T16:52:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 >> 172.21.15.151:0/2571188434 conn(0x55d9100354d0 msgr2=0x55d9100336e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 shutdown_connections 2024-09-12T16:52:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/2571188434 wait complete. 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/3624549141 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f042c039ac0 msgr2=0x7f042c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/3624549141 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f042c039ac0 0x7f042c03bf80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f055001aec0 tx=0x7f05500b5f90 comp rx=0 tx=0).stop 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/3624549141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91002c840 msgr2=0x55d91002cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/3624549141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91002c840 0x55d91002cc60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55d910013100 tx=0x7f054800af40 comp rx=0 tx=0).stop 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/3624549141 shutdown_connections 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/3624549141 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f042c039ac0 0x7f042c03bf80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/3624549141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d91002c840 0x55d91002cc60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/3624549141 >> 172.21.15.151:0/3624549141 conn(0x55d9100221f0 msgr2=0x55d9100225d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/3624549141 shutdown_connections 2024-09-12T16:52:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/3624549141 wait complete. 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d91001b730 msgr2=0x55d91001db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d91001b730 0x55d91001db20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d90ff22030 msgr2=0x55d910018ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d90ff22030 0x55d910018ee0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f043c039a70 msgr2=0x7f043c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f043c039a70 0x7f043c03bf30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f054c001e90 tx=0x7f054c0013f0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 msgr2=0x55d910011dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d910011dc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0550018cc0 tx=0x7f0550017e30 comp rx=0 tx=0).stop 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 shutdown_connections 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d91001b730 0x55d91001db20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d90ff22030 0x55d910018ee0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f043c039a70 0x7f043c03bf30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 --2- 172.21.15.151:0/4003314527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d90ff1f700 0x55d910011dc0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 >> 172.21.15.151:0/4003314527 conn(0x55d90fe92a90 msgr2=0x55d910004f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 shutdown_connections 2024-09-12T16:52:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.625+0000 7f0557a749c0 1 -- 172.21.15.151:0/4003314527 wait complete. 2024-09-12T16:52:42.643 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T16:52:42.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T16:52:42.644 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-12T16:52:42.725 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:42.725 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:42.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aef9119c0 1 Processor -- start 2024-09-12T16:52:42.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aef9119c0 1 -- start start 2024-09-12T16:52:42.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aef9119c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c0ac513df0 0x55c0ac5141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aef9119c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0ac3c99c0 con 0x55c0ac516fd0 2024-09-12T16:52:42.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aef9119c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55c0ac4196d0 con 0x55c0ac513df0 2024-09-12T16:52:42.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aed417640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c0ac513df0 0x55c0ac5141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aed417640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c0ac513df0 0x55c0ac5141d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60614/0 (socket says 172.21.15.151:60614) 2024-09-12T16:52:42.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aed417640 1 -- 172.21.15.151:0/3598393219 learned_addr learned my addr 172.21.15.151:0/3598393219 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aed417640 1 -- 172.21.15.151:0/3598393219 >> v1:172.21.15.122:6789/0 conn(0x55c0ac516fd0 legacy=0x55c0ac5193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.725+0000 7f0aed417640 1 -- 172.21.15.151:0/3598393219 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ac3bdca0 con 0x55c0ac513df0 2024-09-12T16:52:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0aed417640 1 --2- 172.21.15.151:0/3598393219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac5141d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a5c0 tx=0x7f0ae001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42b9d05e5f94254 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0adffff640 1 -- 172.21.15.151:0/3598393219 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00a6070 con 0x55c0ac513df0 2024-09-12T16:52:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0adffff640 1 -- 172.21.15.151:0/3598393219 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae00af070 con 0x55c0ac513df0 2024-09-12T16:52:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0adffff640 1 -- 172.21.15.151:0/3598393219 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00aa5c0 con 0x55c0ac513df0 2024-09-12T16:52:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3598393219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 msgr2=0x55c0ac5141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3598393219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac5141d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a5c0 tx=0x7f0ae001b340 comp rx=0 tx=0).stop 2024-09-12T16:52:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3598393219 shutdown_connections 2024-09-12T16:52:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3598393219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac5141d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3598393219 >> 172.21.15.151:0/3598393219 conn(0x55c0ac50f910 msgr2=0x55c0ac511d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3598393219 shutdown_connections 2024-09-12T16:52:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.729+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3598393219 wait complete. 2024-09-12T16:52:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 Processor -- start 2024-09-12T16:52:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 -- start start 2024-09-12T16:52:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac488d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c0ac41d680 con 0x55c0ac513df0 2024-09-12T16:52:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aed417640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac488d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aed417640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac488d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60626/0 (socket says 172.21.15.151:60626) 2024-09-12T16:52:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aed417640 1 -- 172.21.15.151:0/2604273623 learned_addr learned my addr 172.21.15.151:0/2604273623 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aed417640 1 -- 172.21.15.151:0/2604273623 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ac398da0 con 0x55c0ac513df0 2024-09-12T16:52:42.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aed417640 1 --2- 172.21.15.151:0/2604273623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac488d40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0018f70 tx=0x7f0ae0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a19b98115a99c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f09db606640 1 -- 172.21.15.151:0/2604273623 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00aa8b0 con 0x55c0ac513df0 2024-09-12T16:52:42.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f09db606640 1 -- 172.21.15.151:0/2604273623 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae00aaa50 con 0x55c0ac513df0 2024-09-12T16:52:42.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f09db606640 1 -- 172.21.15.151:0/2604273623 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00aad30 con 0x55c0ac513df0 2024-09-12T16:52:42.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 -- 172.21.15.151:0/2604273623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 msgr2=0x55c0ac488d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/2604273623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac488d40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0018f70 tx=0x7f0ae0003030 comp rx=0 tx=0).stop 2024-09-12T16:52:42.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 -- 172.21.15.151:0/2604273623 shutdown_connections 2024-09-12T16:52:42.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/2604273623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac488d40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 -- 172.21.15.151:0/2604273623 >> 172.21.15.151:0/2604273623 conn(0x55c0ac50f910 msgr2=0x55c0ac5fb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 -- 172.21.15.151:0/2604273623 shutdown_connections 2024-09-12T16:52:42.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.745+0000 7f0aef9119c0 1 -- 172.21.15.151:0/2604273623 wait complete. 2024-09-12T16:52:42.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aef9119c0 1 Processor -- start 2024-09-12T16:52:42.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aef9119c0 1 -- start start 2024-09-12T16:52:42.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aef9119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac600b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aef9119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c0ac3bfa50 con 0x55c0ac513df0 2024-09-12T16:52:42.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aed417640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac600b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aed417640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac600b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60636/0 (socket says 172.21.15.151:60636) 2024-09-12T16:52:42.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aed417640 1 -- 172.21.15.151:0/4279482596 learned_addr learned my addr 172.21.15.151:0/4279482596 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aed417640 1 -- 172.21.15.151:0/4279482596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ac6010a0 con 0x55c0ac513df0 2024-09-12T16:52:42.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aed417640 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac600b40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0018f70 tx=0x7f0ae00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f09d9e03640 1 -- 172.21.15.151:0/4279482596 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00c6690 con 0x55c0ac513df0 2024-09-12T16:52:42.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0ac5ff480 con 0x55c0ac513df0 2024-09-12T16:52:42.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f09d9e03640 1 -- 172.21.15.151:0/4279482596 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae00c6830 con 0x55c0ac513df0 2024-09-12T16:52:42.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ac5ffa10 con 0x55c0ac513df0 2024-09-12T16:52:42.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f09d9e03640 1 -- 172.21.15.151:0/4279482596 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00c6b10 con 0x55c0ac513df0 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f09d9e03640 1 -- 172.21.15.151:0/4279482596 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ae00ce030 con 0x55c0ac513df0 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f09d9e03640 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09d4039ac0 0x7f09d403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f09d9e03640 1 -- 172.21.15.151:0/4279482596 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ae00cc020 con 0x55c0ac513df0 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aecc16640 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09d4039ac0 0x7f09d403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac516fd0 0x55c0ac611010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.749+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac611550 con 0x55c0ac516fd0 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aedc18640 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac516fd0 0x55c0ac611010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aecc16640 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09d4039ac0 0x7f09d403bf80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4001e60 tx=0x7f0ae40013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aedc18640 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac516fd0 0x55c0ac611010 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aedc18640 1 -- 172.21.15.151:0/4279482596 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ae800a4d0 con 0x55c0ac516fd0 2024-09-12T16:52:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac611950 con 0x55c0ac516fd0 2024-09-12T16:52:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aedc18640 1 -- 172.21.15.151:0/4279482596 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ae800a4d0 con 0x55c0ac516fd0 2024-09-12T16:52:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac613760 0x55c0ac615b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac616240 con 0x55c0ac613760 2024-09-12T16:52:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aed417640 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac613760 0x55c0ac615b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aed417640 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac613760 0x55c0ac615b50 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aed417640 1 -- 172.21.15.151:0/4279482596 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ae00d0b20 con 0x55c0ac613760 2024-09-12T16:52:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac612600 con 0x55c0ac516fd0 2024-09-12T16:52:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aedc18640 1 -- 172.21.15.151:0/4279482596 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ae800a4d0 con 0x55c0ac516fd0 2024-09-12T16:52:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac612aa0 con 0x55c0ac516fd0 2024-09-12T16:52:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aedc18640 1 -- 172.21.15.151:0/4279482596 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ae800a4d0 con 0x55c0ac516fd0 2024-09-12T16:52:42.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.753+0000 7f0aef9119c0 1 Processor -- start 2024-09-12T16:52:42.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 -- start start 2024-09-12T16:52:42.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac6248c0 0x55c0ac624ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c0ac42a450 con 0x55c0ac6248c0 2024-09-12T16:52:42.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aedc18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac6248c0 0x55c0ac624ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aedc18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac6248c0 0x55c0ac624ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60640/0 (socket says 172.21.15.151:60640) 2024-09-12T16:52:42.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aedc18640 1 -- 172.21.15.151:0/1479470340 learned_addr learned my addr 172.21.15.151:0/1479470340 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aedc18640 1 -- 172.21.15.151:0/1479470340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ac625320 con 0x55c0ac6248c0 2024-09-12T16:52:42.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aedc18640 1 --2- 172.21.15.151:0/1479470340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac6248c0 0x55c0ac624ce0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55c0ac600710 tx=0x7f0ae8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f09d2ffd640 1 -- 172.21.15.151:0/1479470340 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae8014450 con 0x55c0ac6248c0 2024-09-12T16:52:42.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 -- 172.21.15.151:0/1479470340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0ac625b80 con 0x55c0ac6248c0 2024-09-12T16:52:42.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f09d2ffd640 1 -- 172.21.15.151:0/1479470340 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae8014610 con 0x55c0ac6248c0 2024-09-12T16:52:42.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f09d2ffd640 1 -- 172.21.15.151:0/1479470340 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae8014930 con 0x55c0ac6248c0 2024-09-12T16:52:42.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 -- 172.21.15.151:0/1479470340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ac6260f0 con 0x55c0ac6248c0 2024-09-12T16:52:42.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f09d2ffd640 1 -- 172.21.15.151:0/1479470340 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ae8011040 con 0x55c0ac6248c0 2024-09-12T16:52:42.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f09d2ffd640 1 --2- 172.21.15.151:0/1479470340 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c4039a70 0x7f09c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f09d2ffd640 1 -- 172.21.15.151:0/1479470340 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ae801e070 con 0x55c0ac6248c0 2024-09-12T16:52:42.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aed417640 1 --2- 172.21.15.151:0/1479470340 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c4039a70 0x7f09c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 Processor -- start 2024-09-12T16:52:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 -- start start 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aed417640 1 --2- 172.21.15.151:0/1479470340 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c4039a70 0x7f09c403bf30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55c0ac5ffd00 tx=0x7f0ae00dd040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.757+0000 7f0aef9119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c0ac4894d0 con 0x55c0ac631200 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60654/0 (socket says 172.21.15.151:60654) 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 -- 172.21.15.151:0/3483297541 learned_addr learned my addr 172.21.15.151:0/3483297541 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 -- 172.21.15.151:0/3483297541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ac631bb0 con 0x55c0ac631200 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 --2- 172.21.15.151:0/3483297541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6315e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8050670 tx=0x7f0ae8011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4096026d710f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f09d0ff9640 1 -- 172.21.15.151:0/3483297541 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae8052110 con 0x55c0ac631200 2024-09-12T16:52:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f09d0ff9640 1 -- 172.21.15.151:0/3483297541 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae8016440 con 0x55c0ac631200 2024-09-12T16:52:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f09d0ff9640 1 -- 172.21.15.151:0/3483297541 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae80430d0 con 0x55c0ac631200 2024-09-12T16:52:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3483297541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 msgr2=0x55c0ac6315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3483297541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6315e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8050670 tx=0x7f0ae8011e40 comp rx=0 tx=0).stop 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3483297541 shutdown_connections 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3483297541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6315e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3483297541 >> 172.21.15.151:0/3483297541 conn(0x55c0ac62d630 msgr2=0x55c0ac62b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3483297541 shutdown_connections 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3483297541 wait complete. 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 Processor -- start 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- start start 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c0ac632210 con 0x55c0ac631200 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6386d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60658/0 (socket says 172.21.15.151:60658) 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 learned_addr learned my addr 172.21.15.151:0/3080333657 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ac638c30 con 0x55c0ac631200 2024-09-12T16:52:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aedc18640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6386d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8016fd0 tx=0x7f0ae80505d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f09c2ffd640 1 -- 172.21.15.151:0/3080333657 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae8031070 con 0x55c0ac631200 2024-09-12T16:52:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f09c2ffd640 1 -- 172.21.15.151:0/3080333657 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae8052110 con 0x55c0ac631200 2024-09-12T16:52:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0ac638ec0 con 0x55c0ac631200 2024-09-12T16:52:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f09c2ffd640 1 -- 172.21.15.151:0/3080333657 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae8050ac0 con 0x55c0ac631200 2024-09-12T16:52:42.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.761+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ac638ec0 con 0x55c0ac631200 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f09c2ffd640 1 -- 172.21.15.151:0/3080333657 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ae8034070 con 0x55c0ac631200 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f09c2ffd640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f09c2ffd640 1 -- 172.21.15.151:0/3080333657 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ae8048070 con 0x55c0ac631200 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aed417640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac643830 0x55c0ac645cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac646440 con 0x55c0ac643830 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aecc16640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac643830 0x55c0ac645cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aed417640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00cfb80 tx=0x7f0ae00e6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aecc16640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac643830 0x55c0ac645cf0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ae400d040 con 0x55c0ac643830 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 realm 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac642b80 con 0x55c0ac643830 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ae400d040 con 0x55c0ac643830 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac646f40 con 0x55c0ac643830 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ae400d040 con 0x55c0ac643830 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac647810 con 0x55c0ac643830 2024-09-12T16:52:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ae400d040 con 0x55c0ac643830 2024-09-12T16:52:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac648230 0x55c0ac64a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64ad60 con 0x55c0ac648230 2024-09-12T16:52:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.765+0000 7f0aedc18640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac648230 0x55c0ac64a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aedc18640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac648230 0x55c0ac64a620 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aef9119c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:42.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aef9119c0 20 searching for the correct realm 2024-09-12T16:52:42.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c0ac64ccb0 0x55c0ac64f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac64ccb0 2024-09-12T16:52:42.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aed417640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c0ac64ccb0 0x55c0ac64f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aed417640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c0ac64ccb0 0x55c0ac64f0e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aed417640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ae0009040 0x7f0ae00bc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x7f0ae0009040 2024-09-12T16:52:42.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aecc16640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ae0009040 0x7f0ae00bc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aecc16640 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ae0009040 0x7f0ae00bc7f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae400d040 con 0x7f0ae0009040 2024-09-12T16:52:42.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac648230 2024-09-12T16:52:42.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac643830 2024-09-12T16:52:42.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae400d040 con 0x55c0ac643830 2024-09-12T16:52:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.769+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac643830 2024-09-12T16:52:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac648230 2024-09-12T16:52:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac648230 2024-09-12T16:52:42.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x7f0ae0009040 2024-09-12T16:52:42.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac64ccb0 2024-09-12T16:52:42.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac643830 2024-09-12T16:52:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac648230 2024-09-12T16:52:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac643830 2024-09-12T16:52:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x7f0ae0009040 2024-09-12T16:52:42.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64f7b0 con 0x55c0ac64ccb0 2024-09-12T16:52:42.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.773+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac64ccb0 2024-09-12T16:52:42.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac648230 2024-09-12T16:52:42.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac64ccb0 2024-09-12T16:52:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac64ccb0 2024-09-12T16:52:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac643830 2024-09-12T16:52:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac643830 2024-09-12T16:52:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac648230 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac64ccb0 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x7f0ae0009040 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac643830 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.777+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac648230 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac64ccb0 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac648230 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x7f0ae0009040 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac64ccb0 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac648230 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x55c0ac643830 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0ae0104040 con 0x7f0ae0009040 2024-09-12T16:52:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64b720 con 0x55c0ac643830 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.781+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64b360 con 0x55c0ac643830 2024-09-12T16:52:42.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64c040 con 0x55c0ac643830 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 zone default found 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 4 Realm: () 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 zonegroup default 2024-09-12T16:52:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac64c040 con 0x55c0ac648230 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac651b20 con 0x55c0ac64ccb0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac651ec0 con 0x55c0ac64ccb0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 started sync module instance, tier type = 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac650fb0 con 0x7f0ae0009040 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94286014387456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac650fb0 con 0x7f0ae0009040 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.785+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac652980 con 0x55c0ac643830 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.789+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94286014387456] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.789+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.789+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94286014391408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac650fb0 con 0x55c0ac643830 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.789+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac653390 con 0x55c0ac64ccb0 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.789+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94286014391408] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94286014384896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac650f20 con 0x55c0ac64ccb0 2024-09-12T16:52:42.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac6540e0 con 0x7f0ae0009040 2024-09-12T16:52:42.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94286014397760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac6547d0 con 0x7f0ae0009040 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac6552f0 con 0x55c0ac643830 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94286014384896] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94286014397760] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94286014401984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac6552b0 con 0x55c0ac643830 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.793+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac6556e0 con 0x55c0ac648230 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.797+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.797+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94286014399008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac655f80 con 0x55c0ac648230 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.797+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac656940 con 0x55c0ac648230 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.797+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94286014401984] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.797+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94286014399008] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.797+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.797+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94286014405328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac655ef0 con 0x55c0ac648230 2024-09-12T16:52:42.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.797+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac656df0 con 0x55c0ac648230 2024-09-12T16:52:42.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94286014409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac657210 con 0x55c0ac648230 2024-09-12T16:52:42.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 20 add_watcher() i=0 2024-09-12T16:52:42.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 20 add_watcher() i=1 2024-09-12T16:52:42.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 20 add_watcher() i=2 2024-09-12T16:52:42.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 20 add_watcher() i=3 2024-09-12T16:52:42.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 20 add_watcher() i=4 2024-09-12T16:52:42.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 20 add_watcher() i=5 2024-09-12T16:52:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94286014405328] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 20 add_watcher() i=6 2024-09-12T16:52:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94286014409024] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 20 add_watcher() i=7 2024-09-12T16:52:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac657210 con 0x55c0ac643830 2024-09-12T16:52:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.801+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94286014410080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac657180 con 0x55c0ac643830 2024-09-12T16:52:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94286014410080] v34'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f09a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 5 note: GC not initialized 2024-09-12T16:52:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f09a27e4640 20 reqs_thread_entry: start 2024-09-12T16:52:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 20 Filter name: none 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0913fff640 20 reqs_thread_entry: start 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac67d4d0 con 0x55c0ac643830 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac683540 con 0x55c0ac643830 2024-09-12T16:52:42.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.805+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aef9119c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aef9119c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aef9119c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94286014591024 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac67ef50 con 0x55c0ac643830 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94286014401984 notify 146028888098 ret 0) ==== 621+0+0 (crc 0 0 0) 0x55c0ac3c99c0 con 0x55c0ac643830 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f09d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94286014401984 notifier 4656 bl.length()=579 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f09d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f09d0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f09d0ff9640 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f09b0003eb0 con 0x55c0ac643830 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(64 notify.4 [notify cookie 94286014591024 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94286014591024 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0ae403d810 con 0x55c0ac643830 2024-09-12T16:52:42.812 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:42.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f09a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:42.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94286014410080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac67b2b0 con 0x55c0ac643830 2024-09-12T16:52:42.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94286014410080] v34'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.809+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94286014387456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac67b2b0 con 0x7f0ae0009040 2024-09-12T16:52:42.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.813+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94286014387456] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.813+0000 7f0aef9119c0 20 remove_watcher() i=0 2024-09-12T16:52:42.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.813+0000 7f0aef9119c0 2 removed watcher, disabling cache 2024-09-12T16:52:42.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.813+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94286014391408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac651500 con 0x55c0ac643830 2024-09-12T16:52:42.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.813+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94286014391408] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.813+0000 7f0aef9119c0 20 remove_watcher() i=1 2024-09-12T16:52:42.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.813+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94286014384896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac67b2b0 con 0x55c0ac64ccb0 2024-09-12T16:52:42.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.817+0000 7f0aed417640 1 -- 172.21.15.151:0/3080333657 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94286014384896] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae00f5070 con 0x55c0ac64ccb0 2024-09-12T16:52:42.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.817+0000 7f0aef9119c0 20 remove_watcher() i=2 2024-09-12T16:52:42.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.817+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94286014397760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac651500 con 0x7f0ae0009040 2024-09-12T16:52:42.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.817+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94286014397760] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x7f0ae0009040 2024-09-12T16:52:42.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.817+0000 7f0aef9119c0 20 remove_watcher() i=3 2024-09-12T16:52:42.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.817+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94286014401984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac650b00 con 0x55c0ac643830 2024-09-12T16:52:42.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.821+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94286014401984] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae402a040 con 0x55c0ac643830 2024-09-12T16:52:42.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.821+0000 7f0aef9119c0 20 remove_watcher() i=4 2024-09-12T16:52:42.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.821+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94286014399008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac653d40 con 0x55c0ac648230 2024-09-12T16:52:42.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.821+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94286014399008] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.821+0000 7f0aef9119c0 20 remove_watcher() i=5 2024-09-12T16:52:42.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.821+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94286014405328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac650b00 con 0x55c0ac648230 2024-09-12T16:52:42.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94286014405328] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 20 remove_watcher() i=6 2024-09-12T16:52:42.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94286014409024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0ac653d40 con 0x55c0ac648230 2024-09-12T16:52:42.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aedc18640 1 -- 172.21.15.151:0/3080333657 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94286014409024] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ae8033030 con 0x55c0ac648230 2024-09-12T16:52:42.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 20 remove_watcher() i=7 2024-09-12T16:52:42.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac648230 msgr2=0x55c0ac64a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac648230 0x55c0ac64a620 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac643830 msgr2=0x55c0ac645cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac643830 0x55c0ac645cf0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ae0009040 msgr2=0x7f0ae00bc7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f0ae0009040 0x7f0ae00bc7f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c0ac64ccb0 msgr2=0x55c0ac64f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c0ac64ccb0 0x55c0ac64f0e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 msgr2=0x7f09b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09b8039a70 0x7f09b803bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00cfb80 tx=0x7f0ae00e6000 comp rx=0 tx=0).stop 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 msgr2=0x55c0ac6386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/3080333657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac631200 0x55c0ac6386d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8016fd0 tx=0x7f0ae80505d0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 reap_dead start 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aecc16640 1 -- 172.21.15.151:0/3080333657 reap_dead start 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 shutdown_connections 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 >> 172.21.15.151:0/3080333657 conn(0x55c0ac62d630 msgr2=0x55c0ac62b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 shutdown_connections 2024-09-12T16:52:42.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/3080333657 wait complete. 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/1479470340 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c4039a70 msgr2=0x7f09c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/1479470340 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c4039a70 0x7f09c403bf30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55c0ac5ffd00 tx=0x7f0ae00dd040 comp rx=0 tx=0).stop 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/1479470340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac6248c0 msgr2=0x55c0ac624ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/1479470340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac6248c0 0x55c0ac624ce0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55c0ac600710 tx=0x7f0ae8018830 comp rx=0 tx=0).stop 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/1479470340 shutdown_connections 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/1479470340 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09c4039a70 0x7f09c403bf30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/1479470340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac6248c0 0x55c0ac624ce0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/1479470340 >> 172.21.15.151:0/1479470340 conn(0x55c0ac61a270 msgr2=0x55c0ac61a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/1479470340 shutdown_connections 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/1479470340 wait complete. 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac613760 msgr2=0x55c0ac615b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac613760 0x55c0ac615b50 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac516fd0 msgr2=0x55c0ac611010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac516fd0 0x55c0ac611010 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09d4039ac0 msgr2=0x7f09d403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09d4039ac0 0x7f09d403bf80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4001e60 tx=0x7f0ae40013e0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 msgr2=0x55c0ac600b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac600b40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0018f70 tx=0x7f0ae00180e0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 shutdown_connections 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c0ac613760 0x55c0ac615b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c0ac516fd0 0x55c0ac611010 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f09d4039ac0 0x7f09d403bf80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 --2- 172.21.15.151:0/4279482596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0ac513df0 0x55c0ac600b40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.825+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 >> 172.21.15.151:0/4279482596 conn(0x55c0ac50f910 msgr2=0x55c0ac5f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.829+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 shutdown_connections 2024-09-12T16:52:42.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.829+0000 7f0aef9119c0 1 -- 172.21.15.151:0/4279482596 wait complete. 2024-09-12T16:52:42.841 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:42.841 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T16:52:42.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T16:52:42.842 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-12T16:52:42.921 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:42.921 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9ddc59c0 1 Processor -- start 2024-09-12T16:52:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9ddc59c0 1 -- start start 2024-09-12T16:52:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9ddc59c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55dd4ab60700 0x55dd4ab62af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9ddc59c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dd4aa129c0 con 0x55dd4ab63030 2024-09-12T16:52:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9ddc59c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55dd4aa626d0 con 0x55dd4ab60700 2024-09-12T16:52:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9b8cb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55dd4ab60700 0x55dd4ab62af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9b8cb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55dd4ab60700 0x55dd4ab62af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60668/0 (socket says 172.21.15.151:60668) 2024-09-12T16:52:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9b8cb640 1 -- 172.21.15.151:0/3615868216 learned_addr learned my addr 172.21.15.151:0/3615868216 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9b8cb640 1 -- 172.21.15.151:0/3615868216 >> v1:172.21.15.122:6789/0 conn(0x55dd4ab63030 legacy=0x55dd4ab65420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9b8cb640 1 -- 172.21.15.151:0/3615868216 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4aa06ca0 con 0x55dd4ab60700 2024-09-12T16:52:42.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9a8c9640 1 -- 172.21.15.151:0/3615868216 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870641431 0 0) 0x55dd4aa129c0 con 0x55dd4ab63030 2024-09-12T16:52:42.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.921+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/3615868216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab60700 0x55dd4ab62af0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00a4e0 tx=0x7fba8c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523e67cf352a49cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9a8c9640 1 -- 172.21.15.151:0/3615868216 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8c0aa540 con 0x55dd4ab60700 2024-09-12T16:52:42.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9a8c9640 1 -- 172.21.15.151:0/3615868216 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c0aa6e0 con 0x55dd4ab60700 2024-09-12T16:52:42.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9a8c9640 1 -- 172.21.15.151:0/3615868216 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8c0aaa00 con 0x55dd4ab60700 2024-09-12T16:52:42.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3615868216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab60700 msgr2=0x55dd4ab62af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/3615868216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab60700 0x55dd4ab62af0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00a4e0 tx=0x7fba8c01b090 comp rx=0 tx=0).stop 2024-09-12T16:52:42.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3615868216 shutdown_connections 2024-09-12T16:52:42.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/3615868216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab60700 0x55dd4ab62af0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3615868216 >> 172.21.15.151:0/3615868216 conn(0x55dd4aad3a90 msgr2=0x55dd4aad3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3615868216 shutdown_connections 2024-09-12T16:52:42.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.925+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3615868216 wait complete. 2024-09-12T16:52:42.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 Processor -- start 2024-09-12T16:52:42.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 -- start start 2024-09-12T16:52:42.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac4b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd4aa66680 con 0x55dd4ab63030 2024-09-12T16:52:42.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9b8cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac4b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9b8cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac4b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60670/0 (socket says 172.21.15.151:60670) 2024-09-12T16:52:42.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9b8cb640 1 -- 172.21.15.151:0/67388400 learned_addr learned my addr 172.21.15.151:0/67388400 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9b8cb640 1 -- 172.21.15.151:0/67388400 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4a9e1da0 con 0x55dd4ab63030 2024-09-12T16:52:42.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/67388400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac4b850 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fba8c018cc0 tx=0x7fba8c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75b72298bdda9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fb989e0b640 1 -- 172.21.15.151:0/67388400 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8c0b9070 con 0x55dd4ab63030 2024-09-12T16:52:42.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fb989e0b640 1 -- 172.21.15.151:0/67388400 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c0aa9e0 con 0x55dd4ab63030 2024-09-12T16:52:42.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fb989e0b640 1 -- 172.21.15.151:0/67388400 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8c0aad00 con 0x55dd4ab63030 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/67388400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 msgr2=0x55dd4ac4b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/67388400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac4b850 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fba8c018cc0 tx=0x7fba8c0033b0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/67388400 shutdown_connections 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/67388400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac4b850 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/67388400 >> 172.21.15.151:0/67388400 conn(0x55dd4aad3a90 msgr2=0x55dd4ac473f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/67388400 shutdown_connections 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.941+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/67388400 wait complete. 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9ddc59c0 1 Processor -- start 2024-09-12T16:52:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9ddc59c0 1 -- start start 2024-09-12T16:52:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9ddc59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac52db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9ddc59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd4aa08a50 con 0x55dd4ab63030 2024-09-12T16:52:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9b8cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac52db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9b8cb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac52db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60672/0 (socket says 172.21.15.151:60672) 2024-09-12T16:52:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9b8cb640 1 -- 172.21.15.151:0/344834004 learned_addr learned my addr 172.21.15.151:0/344834004 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9b8cb640 1 -- 172.21.15.151:0/344834004 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4ac53310 con 0x55dd4ab63030 2024-09-12T16:52:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac52db0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fba8c01b930 tx=0x7fba8c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fb983fff640 1 -- 172.21.15.151:0/344834004 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8c0b9030 con 0x55dd4ab63030 2024-09-12T16:52:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd4ac535a0 con 0x55dd4ab63030 2024-09-12T16:52:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fb983fff640 1 -- 172.21.15.151:0/344834004 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c0b5b10 con 0x55dd4ab63030 2024-09-12T16:52:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fb983fff640 1 -- 172.21.15.151:0/344834004 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8c0b5df0 con 0x55dd4ab63030 2024-09-12T16:52:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd4ac53f30 con 0x55dd4ab63030 2024-09-12T16:52:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fb983fff640 1 -- 172.21.15.151:0/344834004 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fba8c0b3040 con 0x55dd4ab63030 2024-09-12T16:52:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fb983fff640 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb984039a70 0x7fb98403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fb983fff640 1 -- 172.21.15.151:0/344834004 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba8c0c4030 con 0x55dd4ab63030 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9b0ca640 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb984039a70 0x7fb98403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac57e70 0x55dd4ac5a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.945+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac5a7a0 con 0x55dd4ac57e70 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9c0cc640 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac57e70 0x55dd4ac5a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9b0ca640 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb984039a70 0x7fb98403bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fba84000f70 tx=0x7fba84001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9c0cc640 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac57e70 0x55dd4ac5a260 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9c0cc640 1 -- 172.21.15.151:0/344834004 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba940083f0 con 0x55dd4ac57e70 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac542f0 con 0x55dd4ac57e70 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9c0cc640 1 -- 172.21.15.151:0/344834004 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba940083f0 con 0x55dd4ac57e70 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac5ca40 0x55dd4ac5ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac5f4d0 con 0x55dd4ac5ca40 2024-09-12T16:52:42.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac5ca40 0x55dd4ac5ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac5ca40 0x55dd4ac5ee30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9b8cb640 1 -- 172.21.15.151:0/344834004 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac5ca40 2024-09-12T16:52:42.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac5b8e0 con 0x55dd4ac57e70 2024-09-12T16:52:42.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9c0cc640 1 -- 172.21.15.151:0/344834004 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba940083f0 con 0x55dd4ac57e70 2024-09-12T16:52:42.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac5bd40 con 0x55dd4ac57e70 2024-09-12T16:52:42.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.949+0000 7fba9c0cc640 1 -- 172.21.15.151:0/344834004 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba940083f0 con 0x55dd4ac57e70 2024-09-12T16:52:42.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9ddc59c0 1 Processor -- start 2024-09-12T16:52:42.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9ddc59c0 1 -- start start 2024-09-12T16:52:42.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9ddc59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac6db20 0x55dd4ac6df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9ddc59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd4aa73450 con 0x55dd4ac6db20 2024-09-12T16:52:42.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9c0cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac6db20 0x55dd4ac6df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9c0cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac6db20 0x55dd4ac6df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60684/0 (socket says 172.21.15.151:60684) 2024-09-12T16:52:42.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9c0cc640 1 -- 172.21.15.151:0/4119296190 learned_addr learned my addr 172.21.15.151:0/4119296190 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9c0cc640 1 -- 172.21.15.151:0/4119296190 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4ac6e580 con 0x55dd4ac6db20 2024-09-12T16:52:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9c0cc640 1 --2- 172.21.15.151:0/4119296190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac6db20 0x55dd4ac6df40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x55dd4ac53c20 tx=0x7fba9400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fb9817fa640 1 -- 172.21.15.151:0/4119296190 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba94007dd0 con 0x55dd4ac6db20 2024-09-12T16:52:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fb9817fa640 1 -- 172.21.15.151:0/4119296190 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba9401e020 con 0x55dd4ac6db20 2024-09-12T16:52:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/4119296190 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd4ac6ede0 con 0x55dd4ac6db20 2024-09-12T16:52:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fb9817fa640 1 -- 172.21.15.151:0/4119296190 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba94019570 con 0x55dd4ac6db20 2024-09-12T16:52:42.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/4119296190 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd4ac6f350 con 0x55dd4ac6db20 2024-09-12T16:52:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fb9817fa640 1 -- 172.21.15.151:0/4119296190 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fba94016040 con 0x55dd4ac6db20 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fb9817fa640 1 --2- 172.21.15.151:0/4119296190 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb974039ac0 0x7fb97403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fb9817fa640 1 -- 172.21.15.151:0/4119296190 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba9401f030 con 0x55dd4ac6db20 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.953+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/4119296190 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb974039ac0 0x7fb97403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 Processor -- start 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- start start 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/4119296190 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb974039ac0 0x7fb97403bf80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55dd4ac5ab70 tx=0x7fba8c0d3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac7a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd4ac4bfe0 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9c0cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac7a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9c0cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac7a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60698/0 (socket says 172.21.15.151:60698) 2024-09-12T16:52:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9c0cc640 1 -- 172.21.15.151:0/3949869941 learned_addr learned my addr 172.21.15.151:0/3949869941 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9c0cc640 1 -- 172.21.15.151:0/3949869941 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4ac7ad90 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9c0cc640 1 --2- 172.21.15.151:0/3949869941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac7a7a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fba940508a0 tx=0x7fba94022e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffb2102807ee5fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fb97affd640 1 -- 172.21.15.151:0/3949869941 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba9401d040 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fb97affd640 1 -- 172.21.15.151:0/3949869941 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba94015d00 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fb97affd640 1 -- 172.21.15.151:0/3949869941 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba94023410 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3949869941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 msgr2=0x55dd4ac7a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/3949869941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac7a7a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fba940508a0 tx=0x7fba94022e70 comp rx=0 tx=0).stop 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3949869941 shutdown_connections 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/3949869941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac7a7a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3949869941 >> 172.21.15.151:0/3949869941 conn(0x55dd4ac767f0 msgr2=0x55dd4ac74a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3949869941 shutdown_connections 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/3949869941 wait complete. 2024-09-12T16:52:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 Processor -- start 2024-09-12T16:52:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- start start 2024-09-12T16:52:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac81910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9ddc59c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd4ac7b3d0 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9c0cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac81910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9c0cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac81910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60714/0 (socket says 172.21.15.151:60714) 2024-09-12T16:52:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.957+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 learned_addr learned my addr 172.21.15.151:0/2428730826 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd4ac81e70 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9c0cc640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac81910 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba94018010 tx=0x7fba94050830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fb9797fa640 1 -- 172.21.15.151:0/2428730826 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba9401d070 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fb9797fa640 1 -- 172.21.15.151:0/2428730826 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba94049040 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd4ac82100 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fb9797fa640 1 -- 172.21.15.151:0/2428730826 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba94052240 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd4ac82ab0 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fb9797fa640 1 -- 172.21.15.151:0/2428730826 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fba940188f0 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fb9797fa640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb964039a70 0x7fb96403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fb9797fa640 1 -- 172.21.15.151:0/2428730826 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba94038d70 con 0x55dd4ac7a3c0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb964039a70 0x7fb96403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac8cbd0 0x55dd4ac8f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac8f7e0 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9b0ca640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac8cbd0 0x55dd4ac8f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb964039a70 0x7fb96403bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0e83a0 tx=0x7fba8c0dc000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9b0ca640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac8cbd0 0x55dd4ac8f090 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba84010570 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 20 realm 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac8bf20 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba84010570 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.961+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac902e0 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba84010570 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac90bb0 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba84010570 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac915d0 0x55dd4ac939c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac94100 con 0x55dd4ac915d0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9c0cc640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac915d0 0x55dd4ac939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9c0cc640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac915d0 0x55dd4ac939c0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 20 searching for the correct realm 2024-09-12T16:52:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55dd4ac96050 0x55dd4ac98480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55dd4ac96050 0x55dd4ac98480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55dd4ac96050 0x55dd4ac98480 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b8cb640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fba8c0f8040 0x7fba8c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x7fba8c0f8040 2024-09-12T16:52:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b0ca640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fba8c0f8040 0x7fba8c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:42.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b0ca640 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fba8c0f8040 0x7fba8c0b4700 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:42.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.965+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba84010570 con 0x7fba8c0f8040 2024-09-12T16:52:42.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba84010570 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x7fba8c0f8040 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.969+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x7fba8c0f8040 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.973+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x7fba8c0f8040 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x7fba8c0f8040 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac96050 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac915d0 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.977+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98b50 con 0x7fba8c0f8040 2024-09-12T16:52:42.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:42.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:42.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac94ac0 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac95360 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac94700 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 zone default found 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 4 Realm: () 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 zonegroup default 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac98fd0 con 0x55dd4ac915d0 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9b260 con 0x55dd4ac96050 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9b630 con 0x55dd4ac96050 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 started sync module instance, tier type = 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.981+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9a6f0 con 0x7fba8c0f8040 2024-09-12T16:52:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.985+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.985+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94408930864144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9a6f0 con 0x7fba8c0f8040 2024-09-12T16:52:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.985+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9c160 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.985+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94408930864144] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.985+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.985+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94408930868272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9a6f0 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.985+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9cb70 con 0x55dd4ac96050 2024-09-12T16:52:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.989+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94408930868272] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.989+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.989+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94408930861632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9a660 con 0x55dd4ac96050 2024-09-12T16:52:42.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.989+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9d870 con 0x7fba8c0f8040 2024-09-12T16:52:42.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.989+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.989+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94408930874576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9df80 con 0x7fba8c0f8040 2024-09-12T16:52:42.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.989+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9ea80 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.989+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94408930861632] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:42.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.993+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94408930874576] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:42.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.993+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.993+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94408930878832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9ea40 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.993+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9eea0 con 0x55dd4ac915d0 2024-09-12T16:52:42.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.993+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.993+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94408930875856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9f6f0 con 0x55dd4ac915d0 2024-09-12T16:52:42.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.993+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4aca00b0 con 0x55dd4ac915d0 2024-09-12T16:52:42.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.993+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94408930878832] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:42.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94408930875856] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:42.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94408930882112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9f660 con 0x55dd4ac915d0 2024-09-12T16:52:42.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4aca0560 con 0x55dd4ac915d0 2024-09-12T16:52:43.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94408930882112] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:43.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:43.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94408930884608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4aca04d0 con 0x55dd4ac915d0 2024-09-12T16:52:43.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 20 add_watcher() i=0 2024-09-12T16:52:43.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 20 add_watcher() i=1 2024-09-12T16:52:43.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 20 add_watcher() i=2 2024-09-12T16:52:43.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 20 add_watcher() i=3 2024-09-12T16:52:43.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 20 add_watcher() i=4 2024-09-12T16:52:43.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 20 add_watcher() i=5 2024-09-12T16:52:43.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:42.997+0000 7fba9ddc59c0 20 add_watcher() i=6 2024-09-12T16:52:43.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94408930884608] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:43.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9ddc59c0 20 add_watcher() i=7 2024-09-12T16:52:43.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9ddc59c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:43.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4aca3990 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94408930886128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4aca0ee0 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94408930886128] v34'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fb9527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:43.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9ddc59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:43.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9ddc59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:43.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.001+0000 7fba9ddc59c0 5 note: GC not initialized 2024-09-12T16:52:43.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fb9517e2640 20 reqs_thread_entry: start 2024-09-12T16:52:43.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:43.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 20 Filter name: none 2024-09-12T16:52:43.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fb94a7fc640 20 reqs_thread_entry: start 2024-09-12T16:52:43.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:43.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4acc6c20 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 20 rados_obj.operate() r=0 bl.length=403 2024-09-12T16:52:43.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:43.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:43.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:43.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4accccf0 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:43.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:43.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:52:43.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94408931067776 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd4acc86a0 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify (1) cookie 94408930878832 notify 146028888099 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fba8403dc80 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fb97a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94408930878832 notifier 4663 bl.length()=567 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fb97a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fb97a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fb97a7fc640 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb960003eb0 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(64 notify.4 [notify cookie 94408931067776 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.005+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== watch-notify(notify_complete (2) cookie 94408931067776 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fba8403de50 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.010 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T16:52:15.805288Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:52:15.805273Z","tags":[],"group_ids":[]} 2024-09-12T16:52:43.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.009+0000 7fb9527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:43.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.009+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94408930886128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4acc4a30 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.009+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94408930886128] v34'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.009+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94408930864144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4acc4a30 con 0x7fba8c0f8040 2024-09-12T16:52:43.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.009+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94408930864144] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:43.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.009+0000 7fba9ddc59c0 20 remove_watcher() i=0 2024-09-12T16:52:43.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.009+0000 7fba9ddc59c0 2 removed watcher, disabling cache 2024-09-12T16:52:43.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.009+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94408930868272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4acc4a30 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.013+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94408930868272] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.013+0000 7fba9ddc59c0 20 remove_watcher() i=1 2024-09-12T16:52:43.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.013+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94408930861632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4acc4a30 con 0x55dd4ac96050 2024-09-12T16:52:43.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.013+0000 7fba9b8cb640 1 -- 172.21.15.151:0/2428730826 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94408930861632] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c0eb050 con 0x55dd4ac96050 2024-09-12T16:52:43.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.013+0000 7fba9ddc59c0 20 remove_watcher() i=2 2024-09-12T16:52:43.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.013+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94408930874576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9a240 con 0x7fba8c0f8040 2024-09-12T16:52:43.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.017+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94408930874576] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x7fba8c0f8040 2024-09-12T16:52:43.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.017+0000 7fba9ddc59c0 20 remove_watcher() i=3 2024-09-12T16:52:43.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.017+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94408930878832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9a240 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.017+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94408930878832] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a040 con 0x55dd4ac8cbd0 2024-09-12T16:52:43.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.017+0000 7fba9ddc59c0 20 remove_watcher() i=4 2024-09-12T16:52:43.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.017+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94408930875856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9e570 con 0x55dd4ac915d0 2024-09-12T16:52:43.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.021+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94408930875856] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:43.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.021+0000 7fba9ddc59c0 20 remove_watcher() i=5 2024-09-12T16:52:43.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.021+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94408930882112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9a240 con 0x55dd4ac915d0 2024-09-12T16:52:43.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.021+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94408930882112] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:43.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.021+0000 7fba9ddc59c0 20 remove_watcher() i=6 2024-09-12T16:52:43.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.021+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94408930884608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd4ac9e570 con 0x55dd4ac915d0 2024-09-12T16:52:43.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9c0cc640 1 -- 172.21.15.151:0/2428730826 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94408930884608] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba9403e070 con 0x55dd4ac915d0 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 20 remove_watcher() i=7 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac915d0 msgr2=0x55dd4ac939c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac915d0 0x55dd4ac939c0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac8cbd0 msgr2=0x55dd4ac8f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac8cbd0 0x55dd4ac8f090 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fba8c0f8040 msgr2=0x7fba8c0b4700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fba8c0f8040 0x7fba8c0b4700 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55dd4ac96050 msgr2=0x55dd4ac98480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55dd4ac96050 0x55dd4ac98480 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb964039a70 msgr2=0x7fb96403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb964039a70 0x7fb96403bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0e83a0 tx=0x7fba8c0dc000 comp rx=0 tx=0).stop 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 msgr2=0x55dd4ac81910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9b0ca640 1 -- 172.21.15.151:0/2428730826 reap_dead start 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac81910 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba94018010 tx=0x7fba94050830 comp rx=0 tx=0).stop 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 shutdown_connections 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/2428730826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac7a3c0 0x55dd4ac81910 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 >> 172.21.15.151:0/2428730826 conn(0x55dd4ac767f0 msgr2=0x55dd4ac74a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 shutdown_connections 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/2428730826 wait complete. 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/4119296190 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb974039ac0 msgr2=0x7fb97403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/4119296190 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb974039ac0 0x7fb97403bf80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55dd4ac5ab70 tx=0x7fba8c0d3040 comp rx=0 tx=0).stop 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/4119296190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac6db20 msgr2=0x55dd4ac6df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/4119296190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac6db20 0x55dd4ac6df40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x55dd4ac53c20 tx=0x7fba9400af40 comp rx=0 tx=0).stop 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/4119296190 shutdown_connections 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/4119296190 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb974039ac0 0x7fb97403bf80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/4119296190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ac6db20 0x55dd4ac6df40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/4119296190 >> 172.21.15.151:0/4119296190 conn(0x55dd4ac634d0 msgr2=0x55dd4ac638b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/4119296190 shutdown_connections 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/4119296190 wait complete. 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac5ca40 msgr2=0x55dd4ac5ee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac5ca40 0x55dd4ac5ee30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac57e70 msgr2=0x55dd4ac5a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac57e70 0x55dd4ac5a260 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb984039a70 msgr2=0x7fb98403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb984039a70 0x7fb98403bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fba84000f70 tx=0x7fba84001400 comp rx=0 tx=0).stop 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 msgr2=0x55dd4ac52db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac52db0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fba8c01b930 tx=0x7fba8c017e30 comp rx=0 tx=0).stop 2024-09-12T16:52:43.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 shutdown_connections 2024-09-12T16:52:43.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55dd4ac5ca40 0x55dd4ac5ee30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55dd4ac57e70 0x55dd4ac5a260 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb984039a70 0x7fb98403bf30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 --2- 172.21.15.151:0/344834004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd4ab63030 0x55dd4ac52db0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 >> 172.21.15.151:0/344834004 conn(0x55dd4aad3a90 msgr2=0x55dd4ac45e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 shutdown_connections 2024-09-12T16:52:43.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.025+0000 7fba9ddc59c0 1 -- 172.21.15.151:0/344834004 wait complete. 2024-09-12T16:52:43.040 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T16:52:15.805288Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:52:15.805273Z', 'tags': [], 'group_ids': []} 2024-09-12T16:52:43.060 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:43.060 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T16:52:43.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T16:52:43.061 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T16:52:43.113 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:52:43.114 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8ba9b89c0 1 Processor -- start 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8ba9b89c0 1 -- start start 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8ba9b89c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55bd4975b220 0x55bd4975d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8ba9b89c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd496099c0 con 0x55bd49757710 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8ba9b89c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55bd496596d0 con 0x55bd4975b220 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8b7cbd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55bd4975b220 0x55bd4975d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8b7cbd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55bd4975b220 0x55bd4975d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60718/0 (socket says 172.21.15.151:60718) 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/58868217 learned_addr learned my addr 172.21.15.151:0/58868217 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8b84be640 1 --1- 172.21.15.151:0/58868217 >> v1:172.21.15.122:6789/0 conn(0x55bd49757710 0x55bd49759b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:47270/0 (socket says 172.21.15.151:47270) 2024-09-12T16:52:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/58868217 >> v1:172.21.15.122:6789/0 conn(0x55bd49757710 legacy=0x55bd49759b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.113+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/58868217 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd495fdca0 con 0x55bd4975b220 2024-09-12T16:52:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8b7cbd640 1 --2- 172.21.15.151:0/58868217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4975d610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800a5c0 tx=0x7fd8a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f97467fead8b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8b74bc640 1 -- 172.21.15.151:0/58868217 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a80a6070 con 0x55bd4975b220 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8b74bc640 1 -- 172.21.15.151:0/58868217 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a80af070 con 0x55bd4975b220 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8b74bc640 1 -- 172.21.15.151:0/58868217 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a80aa5c0 con 0x55bd4975b220 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/58868217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 msgr2=0x55bd4975d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/58868217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4975d610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800a5c0 tx=0x7fd8a801b340 comp rx=0 tx=0).stop 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/58868217 shutdown_connections 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/58868217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4975d610 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/58868217 >> 172.21.15.151:0/58868217 conn(0x55bd496caaa0 msgr2=0x55bd496caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/58868217 shutdown_connections 2024-09-12T16:52:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.117+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/58868217 wait complete. 2024-09-12T16:52:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8ba9b89c0 1 Processor -- start 2024-09-12T16:52:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8ba9b89c0 1 -- start start 2024-09-12T16:52:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8ba9b89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49757710 0x55bd49842870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8ba9b89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bd4965d680 con 0x55bd49757710 2024-09-12T16:52:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8b84be640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49757710 0x55bd49842870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8b84be640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49757710 0x55bd49842870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60728/0 (socket says 172.21.15.151:60728) 2024-09-12T16:52:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8b84be640 1 -- 172.21.15.151:0/3210182299 learned_addr learned my addr 172.21.15.151:0/3210182299 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8b84be640 1 -- 172.21.15.151:0/3210182299 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd495d8da0 con 0x55bd49757710 2024-09-12T16:52:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd8b84be640 1 --2- 172.21.15.151:0/3210182299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49757710 0x55bd49842870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac001ec0 tx=0x7fd8ac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef520a402911577 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd7a660c640 1 -- 172.21.15.151:0/3210182299 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ac00e5d0 con 0x55bd49757710 2024-09-12T16:52:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd7a660c640 1 -- 172.21.15.151:0/3210182299 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00e770 con 0x55bd49757710 2024-09-12T16:52:43.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.133+0000 7fd7a660c640 1 -- 172.21.15.151:0/3210182299 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ac00ea70 con 0x55bd49757710 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/3210182299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49757710 msgr2=0x55bd49842870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/3210182299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49757710 0x55bd49842870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac001ec0 tx=0x7fd8ac00b6d0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/3210182299 shutdown_connections 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/3210182299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49757710 0x55bd49842870 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/3210182299 >> 172.21.15.151:0/3210182299 conn(0x55bd496caaa0 msgr2=0x55bd4983e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/3210182299 shutdown_connections 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/3210182299 wait complete. 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 Processor -- start 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- start start 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4984a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bd495ffa50 con 0x55bd4975b220 2024-09-12T16:52:43.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8b84be640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4984a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8b84be640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4984a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60744/0 (socket says 172.21.15.151:60744) 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8b84be640 1 -- 172.21.15.151:0/4213667277 learned_addr learned my addr 172.21.15.151:0/4213667277 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8b84be640 1 -- 172.21.15.151:0/4213667277 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd4984a7d0 con 0x55bd4975b220 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8b84be640 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4984a270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00b710 tx=0x7fd8ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd7a4e09640 1 -- 172.21.15.151:0/4213667277 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ac01a690 con 0x55bd4975b220 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd4984aa60 con 0x55bd4975b220 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd7a4e09640 1 -- 172.21.15.151:0/4213667277 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac01a830 con 0x55bd4975b220 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd7a4e09640 1 -- 172.21.15.151:0/4213667277 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8ac02c060 con 0x55bd4975b220 2024-09-12T16:52:43.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.137+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd4984b320 con 0x55bd4975b220 2024-09-12T16:52:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd7a4e09640 1 -- 172.21.15.151:0/4213667277 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd8ac017070 con 0x55bd4975b220 2024-09-12T16:52:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd7a4e09640 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd7a0039a70 0x7fd7a003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd7a4e09640 1 -- 172.21.15.151:0/4213667277 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd8ac015020 con 0x55bd4975b220 2024-09-12T16:52:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b7cbd640 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd7a0039a70 0x7fd7a003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd4984f2e0 0x55bd498516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49851c10 con 0x55bd4984f2e0 2024-09-12T16:52:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b8cbf640 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd4984f2e0 0x55bd498516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b7cbd640 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd7a0039a70 0x7fd7a003bf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80ae000 tx=0x7fd8a80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b8cbf640 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd4984f2e0 0x55bd498516d0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/4213667277 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8b000a4d0 con 0x55bd4984f2e0 2024-09-12T16:52:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49852030 con 0x55bd4984f2e0 2024-09-12T16:52:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/4213667277 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8b000a4d0 con 0x55bd4984f2e0 2024-09-12T16:52:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49853e40 0x55bd49856230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49856900 con 0x55bd49853e40 2024-09-12T16:52:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b84be640 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49853e40 0x55bd49856230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b84be640 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49853e40 0x55bd49856230 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8b84be640 1 -- 172.21.15.151:0/4213667277 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd49853e40 2024-09-12T16:52:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.141+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49852ce0 con 0x55bd4984f2e0 2024-09-12T16:52:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/4213667277 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8b000a4d0 con 0x55bd4984f2e0 2024-09-12T16:52:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49853160 con 0x55bd4984f2e0 2024-09-12T16:52:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/4213667277 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8b000a4d0 con 0x55bd4984f2e0 2024-09-12T16:52:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8ba9b89c0 1 Processor -- start 2024-09-12T16:52:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8ba9b89c0 1 -- start start 2024-09-12T16:52:43.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8ba9b89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49864f90 0x55bd498653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8ba9b89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bd4966a450 con 0x55bd49864f90 2024-09-12T16:52:43.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8b8cbf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49864f90 0x55bd498653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8b8cbf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49864f90 0x55bd498653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60760/0 (socket says 172.21.15.151:60760) 2024-09-12T16:52:43.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2466588509 learned_addr learned my addr 172.21.15.151:0/2466588509 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:43.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2466588509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd498659f0 con 0x55bd49864f90 2024-09-12T16:52:43.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8b8cbf640 1 --2- 172.21.15.151:0/2466588509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49864f90 0x55bd498653b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x55bd496c6940 tx=0x7fd8b0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd79dffb640 1 -- 172.21.15.151:0/2466588509 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b0014450 con 0x55bd49864f90 2024-09-12T16:52:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2466588509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd49866250 con 0x55bd49864f90 2024-09-12T16:52:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd79dffb640 1 -- 172.21.15.151:0/2466588509 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b00145f0 con 0x55bd49864f90 2024-09-12T16:52:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd79dffb640 1 -- 172.21.15.151:0/2466588509 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b0014910 con 0x55bd49864f90 2024-09-12T16:52:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.145+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2466588509 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd498667c0 con 0x55bd49864f90 2024-09-12T16:52:43.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd79dffb640 1 -- 172.21.15.151:0/2466588509 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd8b0011040 con 0x55bd49864f90 2024-09-12T16:52:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd79dffb640 1 --2- 172.21.15.151:0/2466588509 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd790039a70 0x7fd79003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd79dffb640 1 -- 172.21.15.151:0/2466588509 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd8b001e070 con 0x55bd49864f90 2024-09-12T16:52:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8b84be640 1 --2- 172.21.15.151:0/2466588509 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd790039a70 0x7fd79003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 Processor -- start 2024-09-12T16:52:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 -- start start 2024-09-12T16:52:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8b84be640 1 --2- 172.21.15.151:0/2466588509 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd790039a70 0x7fd79003bf30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55bd4984b5d0 tx=0x7fd8ac01ab10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49871c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bd498430c0 con 0x55bd498718b0 2024-09-12T16:52:43.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8b8cbf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49871c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8b8cbf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49871c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60776/0 (socket says 172.21.15.151:60776) 2024-09-12T16:52:43.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2191870078 learned_addr learned my addr 172.21.15.151:0/2191870078 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:43.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2191870078 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd49872260 con 0x55bd498718b0 2024-09-12T16:52:43.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8b8cbf640 1 --2- 172.21.15.151:0/2191870078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49871c90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0050640 tx=0x7fd8b002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc60a3abe7b428bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd7977fe640 1 -- 172.21.15.151:0/2191870078 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b0052110 con 0x55bd498718b0 2024-09-12T16:52:43.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd7977fe640 1 -- 172.21.15.151:0/2191870078 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b0016440 con 0x55bd498718b0 2024-09-12T16:52:43.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd7977fe640 1 -- 172.21.15.151:0/2191870078 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b0001b50 con 0x55bd498718b0 2024-09-12T16:52:43.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2191870078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 msgr2=0x55bd49871c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2191870078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49871c90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0050640 tx=0x7fd8b002b720 comp rx=0 tx=0).stop 2024-09-12T16:52:43.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2191870078 shutdown_connections 2024-09-12T16:52:43.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2191870078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49871c90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2191870078 >> 172.21.15.151:0/2191870078 conn(0x55bd4986dce0 msgr2=0x55bd4986bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2191870078 shutdown_connections 2024-09-12T16:52:43.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2191870078 wait complete. 2024-09-12T16:52:43.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 Processor -- start 2024-09-12T16:52:43.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.149+0000 7fd8ba9b89c0 1 -- start start 2024-09-12T16:52:43.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8ba9b89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49878db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8ba9b89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bd498728c0 con 0x55bd498718b0 2024-09-12T16:52:43.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8b8cbf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49878db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8b8cbf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49878db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:60784/0 (socket says 172.21.15.151:60784) 2024-09-12T16:52:43.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 learned_addr learned my addr 172.21.15.151:0/2545163405 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:52:43.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd49879310 con 0x55bd498718b0 2024-09-12T16:52:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8b8cbf640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49878db0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0041fd0 tx=0x7fd8b00505d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd795ffb640 1 -- 172.21.15.151:0/2545163405 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b0031030 con 0x55bd498718b0 2024-09-12T16:52:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd498795a0 con 0x55bd498718b0 2024-09-12T16:52:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd795ffb640 1 -- 172.21.15.151:0/2545163405 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b0014c40 con 0x55bd498718b0 2024-09-12T16:52:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd795ffb640 1 -- 172.21.15.151:0/2545163405 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b00114f0 con 0x55bd498718b0 2024-09-12T16:52:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd49879f50 con 0x55bd498718b0 2024-09-12T16:52:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd795ffb640 1 -- 172.21.15.151:0/2545163405 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd8b0034030 con 0x55bd498718b0 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd795ffb640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd788039a70 0x7fd78803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd795ffb640 1 -- 172.21.15.151:0/2545163405 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd8b0032070 con 0x55bd498718b0 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8b84be640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd788039a70 0x7fd78803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd498842a0 0x55bd49886730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49886e80 con 0x55bd498842a0 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.153+0000 7fd8b7cbd640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd498842a0 0x55bd49886730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b84be640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd788039a70 0x7fd78803bf30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac01b750 tx=0x7fd8ac027800 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b7cbd640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd498842a0 0x55bd49886730 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 realm 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd498872b0 con 0x55bd498842a0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49887b80 con 0x55bd498842a0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49887f20 con 0x55bd498842a0 2024-09-12T16:52:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49888c80 0x55bd4988b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd4988b680 con 0x55bd49888c80 2024-09-12T16:52:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b8cbf640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49888c80 0x55bd4988b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b8cbf640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49888c80 0x55bd4988b070 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:52:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 20 searching for the correct realm 2024-09-12T16:52:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bd4988d560 0x55bd4988f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b84be640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bd4988d560 0x55bd4988f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b84be640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bd4988d560 0x55bd4988f9d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b84be640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55bd49757710 0x7fd8ac0195a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.157+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49757710 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55bd49757710 0x7fd8ac0195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55bd49757710 0x7fd8ac0195a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd498842a0 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd498842a0 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49757710 2024-09-12T16:52:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.161+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd498842a0 2024-09-12T16:52:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd498842a0 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49757710 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd498842a0 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd498842a0 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.165+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49757710 2024-09-12T16:52:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd498842a0 2024-09-12T16:52:43.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49757710 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd4988d560 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.169+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49888c80 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd498842a0 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd498900a0 con 0x55bd49757710 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd4988bfd0 con 0x55bd498842a0 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd4988bbe0 con 0x55bd498842a0 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd4988c8c0 con 0x55bd498842a0 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 zone default found 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 4 Realm: () 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 zonegroup default 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd4988c8e0 con 0x55bd49888c80 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49892440 con 0x55bd4988d560 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd49892830 con 0x55bd4988d560 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 started sync module instance, tier type = 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.173+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498918d0 con 0x55bd49757710 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.177+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.177+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94271470902768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498918d0 con 0x55bd49757710 2024-09-12T16:52:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.177+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498932f0 con 0x55bd498842a0 2024-09-12T16:52:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.177+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94271470902768] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.177+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.177+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94271470906880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498918d0 con 0x55bd498842a0 2024-09-12T16:52:43.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.177+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49893d00 con 0x55bd4988d560 2024-09-12T16:52:43.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.181+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94271470906880] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.181+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.181+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94271470900256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49891840 con 0x55bd4988d560 2024-09-12T16:52:43.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.181+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49894a90 con 0x55bd49757710 2024-09-12T16:52:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.181+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.181+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94271470912928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49895330 con 0x55bd49757710 2024-09-12T16:52:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.181+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49895d30 con 0x55bd498842a0 2024-09-12T16:52:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.181+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94271470900256] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.185+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94271470912928] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.185+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.185+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94271470911728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49894e00 con 0x55bd498842a0 2024-09-12T16:52:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.185+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498965d0 con 0x55bd49888c80 2024-09-12T16:52:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.185+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94271470911728] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.185+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.185+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94271470919968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49894e00 con 0x55bd49888c80 2024-09-12T16:52:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.185+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49896e20 con 0x55bd49888c80 2024-09-12T16:52:43.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.189+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94271470919968] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.189+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.189+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94271470917696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49896e20 con 0x55bd49888c80 2024-09-12T16:52:43.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.189+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49897820 con 0x55bd49888c80 2024-09-12T16:52:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.189+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94271470917696] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94271470924592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49897a00 con 0x55bd49888c80 2024-09-12T16:52:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 20 add_watcher() i=0 2024-09-12T16:52:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 20 add_watcher() i=1 2024-09-12T16:52:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 20 add_watcher() i=2 2024-09-12T16:52:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 20 add_watcher() i=3 2024-09-12T16:52:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 20 add_watcher() i=4 2024-09-12T16:52:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 20 add_watcher() i=5 2024-09-12T16:52:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 20 add_watcher() i=6 2024-09-12T16:52:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94271470924592] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 20 add_watcher() i=7 2024-09-12T16:52:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:52:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd4989add0 con 0x55bd498842a0 2024-09-12T16:52:43.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94271470926064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498981f0 con 0x55bd498842a0 2024-09-12T16:52:43.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.193+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94271470926064] v34'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.197+0000 7fd76e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:43.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.197+0000 7fd8ba9b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:52:43.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.197+0000 7fd8ba9b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:52:43.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.197+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a3620 con 0x55bd498842a0 2024-09-12T16:52:43.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.197+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.197+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a3620 con 0x55bd49888c80 2024-09-12T16:52:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.201+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.201+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a3620 con 0x55bd4988d560 2024-09-12T16:52:43.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.201+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.201+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a40d0 con 0x55bd498842a0 2024-09-12T16:52:43.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.201+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'194 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.201+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4640 con 0x55bd49757710 2024-09-12T16:52:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.205+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.205+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4bb0 con 0x55bd4988d560 2024-09-12T16:52:43.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.205+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.205+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4bb0 con 0x55bd498842a0 2024-09-12T16:52:43.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.205+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.205+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4e60 con 0x55bd49888c80 2024-09-12T16:52:43.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.209+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.209+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4e30 con 0x55bd49757710 2024-09-12T16:52:43.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.209+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.209+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4e30 con 0x55bd4988d560 2024-09-12T16:52:43.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.213+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.213+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4ec0 con 0x55bd49757710 2024-09-12T16:52:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.213+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.213+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4ec0 con 0x55bd49888c80 2024-09-12T16:52:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.217+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.217+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4ec0 con 0x55bd49757710 2024-09-12T16:52:43.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.217+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.217+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4ec0 con 0x55bd49888c80 2024-09-12T16:52:43.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.221+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.221+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4f20 con 0x55bd498842a0 2024-09-12T16:52:43.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.221+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'195 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.221+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4f20 con 0x55bd4988d560 2024-09-12T16:52:43.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.221+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.221+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4fb0 con 0x55bd49757710 2024-09-12T16:52:43.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.225+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.225+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4fb0 con 0x55bd4988d560 2024-09-12T16:52:43.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.225+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.225+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4f50 con 0x55bd498842a0 2024-09-12T16:52:43.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.229+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.229+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4fb0 con 0x55bd498842a0 2024-09-12T16:52:43.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.229+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'196 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.229+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a4fb0 con 0x55bd4988d560 2024-09-12T16:52:43.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.233+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.233+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a5020 con 0x55bd49757710 2024-09-12T16:52:43.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.233+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.233+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a5020 con 0x55bd4988d560 2024-09-12T16:52:43.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.233+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.237+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a5090 con 0x55bd4988d560 2024-09-12T16:52:43.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.237+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.237+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a5090 con 0x55bd4988d560 2024-09-12T16:52:43.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.237+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.237+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a5090 con 0x55bd4988d560 2024-09-12T16:52:43.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.241+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.241+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a5090 con 0x55bd49888c80 2024-09-12T16:52:43.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.241+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.241+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a50f0 con 0x55bd4988d560 2024-09-12T16:52:43.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.245+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.245+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a50f0 con 0x55bd49888c80 2024-09-12T16:52:43.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.245+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.245+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a50f0 con 0x55bd4988d560 2024-09-12T16:52:43.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.249+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.249+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a5120 con 0x55bd49888c80 2024-09-12T16:52:43.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a5120 con 0x55bd49757710 2024-09-12T16:52:43.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd76d7e2640 20 reqs_thread_entry: start 2024-09-12T16:52:43.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd8ba9b89c0 20 init_complete bucket index max shards: 11 2024-09-12T16:52:43.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd8ba9b89c0 20 Filter name: none 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd6deffd640 20 reqs_thread_entry: start 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd8ba9b89c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.253+0000 7fd8ba9b89c0 20 rados->read ofs=0 len=0 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a2e90 con 0x55bd498842a0 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8ba9b89c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8ba9b89c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8ba9b89c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8ba9b89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:52:43.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd498c27d0 con 0x55bd49757710 2024-09-12T16:52:43.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.260 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T16:52:43.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd76e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:52:43.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.257+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94271470926064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498a2930 con 0x55bd498842a0 2024-09-12T16:52:43.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.261+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94271470926064] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.261+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94271470902768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498978f0 con 0x55bd49757710 2024-09-12T16:52:43.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.261+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94271470902768] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.261+0000 7fd8ba9b89c0 20 remove_watcher() i=0 2024-09-12T16:52:43.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.261+0000 7fd8ba9b89c0 2 removed watcher, disabling cache 2024-09-12T16:52:43.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.261+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94271470906880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498978f0 con 0x55bd498842a0 2024-09-12T16:52:43.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.265+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94271470906880] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.265+0000 7fd8ba9b89c0 20 remove_watcher() i=1 2024-09-12T16:52:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.265+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94271470900256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49892e00 con 0x55bd4988d560 2024-09-12T16:52:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.265+0000 7fd8b84be640 1 -- 172.21.15.151:0/2545163405 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94271470900256] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8ac02e070 con 0x55bd4988d560 2024-09-12T16:52:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.265+0000 7fd8ba9b89c0 20 remove_watcher() i=2 2024-09-12T16:52:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.265+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94271470912928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498978f0 con 0x55bd49757710 2024-09-12T16:52:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.269+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94271470912928] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd49757710 2024-09-12T16:52:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.269+0000 7fd8ba9b89c0 20 remove_watcher() i=3 2024-09-12T16:52:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.269+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94271470911728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49891420 con 0x55bd498842a0 2024-09-12T16:52:43.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.269+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94271470911728] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80aaa80 con 0x55bd498842a0 2024-09-12T16:52:43.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.269+0000 7fd8ba9b89c0 20 remove_watcher() i=4 2024-09-12T16:52:43.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.269+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94271470919968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49892e00 con 0x55bd49888c80 2024-09-12T16:52:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.273+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94271470919968] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.273+0000 7fd8ba9b89c0 20 remove_watcher() i=5 2024-09-12T16:52:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.273+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94271470917696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd498978f0 con 0x55bd49888c80 2024-09-12T16:52:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.273+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94271470917696] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.273+0000 7fd8ba9b89c0 20 remove_watcher() i=6 2024-09-12T16:52:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.273+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94271470924592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd49891420 con 0x55bd49888c80 2024-09-12T16:52:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8b8cbf640 1 -- 172.21.15.151:0/2545163405 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94271470924592] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b002a070 con 0x55bd49888c80 2024-09-12T16:52:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 20 remove_watcher() i=7 2024-09-12T16:52:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49888c80 msgr2=0x55bd4988b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49888c80 0x55bd4988b070 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd498842a0 msgr2=0x55bd49886730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd498842a0 0x55bd49886730 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55bd49757710 msgr2=0x7fd8ac0195a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x55bd49757710 0x7fd8ac0195a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bd4988d560 msgr2=0x55bd4988f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55bd4988d560 0x55bd4988f9d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd788039a70 msgr2=0x7fd78803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd788039a70 0x7fd78803bf30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac01b750 tx=0x7fd8ac027800 comp rx=0 tx=0).stop 2024-09-12T16:52:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 msgr2=0x55bd49878db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2545163405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd498718b0 0x55bd49878db0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0041fd0 tx=0x7fd8b00505d0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 reap_dead start 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8b7cbd640 1 -- 172.21.15.151:0/2545163405 reap_dead start 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 shutdown_connections 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 >> 172.21.15.151:0/2545163405 conn(0x55bd4986dce0 msgr2=0x55bd4986bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 shutdown_connections 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2545163405 wait complete. 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2466588509 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd790039a70 msgr2=0x7fd79003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2466588509 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd790039a70 0x7fd79003bf30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55bd4984b5d0 tx=0x7fd8ac01ab10 comp rx=0 tx=0).stop 2024-09-12T16:52:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2466588509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49864f90 msgr2=0x55bd498653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2466588509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49864f90 0x55bd498653b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x55bd496c6940 tx=0x7fd8b0018830 comp rx=0 tx=0).stop 2024-09-12T16:52:43.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2466588509 shutdown_connections 2024-09-12T16:52:43.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2466588509 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd790039a70 0x7fd79003bf30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/2466588509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd49864f90 0x55bd498653b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2466588509 >> 172.21.15.151:0/2466588509 conn(0x55bd4985a940 msgr2=0x55bd4985ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2466588509 shutdown_connections 2024-09-12T16:52:43.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/2466588509 wait complete. 2024-09-12T16:52:43.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49853e40 msgr2=0x55bd49856230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49853e40 0x55bd49856230 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd4984f2e0 msgr2=0x55bd498516d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd4984f2e0 0x55bd498516d0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd7a0039a70 msgr2=0x7fd7a003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd7a0039a70 0x7fd7a003bf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80ae000 tx=0x7fd8a80a6000 comp rx=0 tx=0).stop 2024-09-12T16:52:43.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 msgr2=0x55bd4984a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4984a270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00b710 tx=0x7fd8ac000bd0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 shutdown_connections 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55bd49853e40 0x55bd49856230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55bd4984f2e0 0x55bd498516d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd7a0039a70 0x7fd7a003bf30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 --2- 172.21.15.151:0/4213667277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bd4975b220 0x55bd4984a270 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 >> 172.21.15.151:0/4213667277 conn(0x55bd496caaa0 msgr2=0x55bd4983cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 shutdown_connections 2024-09-12T16:52:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:52:43.277+0000 7fd8ba9b89c0 1 -- 172.21.15.151:0/4213667277 wait complete. 2024-09-12T16:52:43.293 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T16:52:43.314 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:52:43.324 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-12T16:53:18.325 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-12T16:53:18.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-12T16:53:18.326 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-12T16:53:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:18.368 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701d4ef9c0 1 Processor -- start 2024-09-12T16:53:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701d4ef9c0 1 -- start start 2024-09-12T16:53:18.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701d4ef9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55adcd4a0200 0x55adcd4a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701d4ef9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55adcd3529c0 con 0x55adcd4a3340 2024-09-12T16:53:18.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701d4ef9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55adcd3a26d0 con 0x55adcd4a0200 2024-09-12T16:53:18.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701aff5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55adcd4a0200 0x55adcd4a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701aff5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55adcd4a0200 0x55adcd4a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40156/0 (socket says 172.21.15.151:40156) 2024-09-12T16:53:18.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701a7f4640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55adcd4a3340 0x55adcd4a5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:43178/0 (socket says 172.21.15.151:43178) 2024-09-12T16:53:18.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701aff5640 1 -- 172.21.15.151:0/3227323666 learned_addr learned my addr 172.21.15.151:0/3227323666 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701aff5640 1 -- 172.21.15.151:0/3227323666 >> v1:172.21.15.122:6789/0 conn(0x55adcd4a3340 legacy=0x55adcd4a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.364+0000 7f701aff5640 1 -- 172.21.15.151:0/3227323666 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcd346ca0 con 0x55adcd4a0200 2024-09-12T16:53:18.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f701aff5640 1 --2- 172.21.15.151:0/3227323666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd4a05e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f700c00a4e0 tx=0x7f700c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511b4595667ef782 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f7019ff3640 1 -- 172.21.15.151:0/3227323666 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700c0aa540 con 0x55adcd4a0200 2024-09-12T16:53:18.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f7019ff3640 1 -- 172.21.15.151:0/3227323666 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700c0aa6e0 con 0x55adcd4a0200 2024-09-12T16:53:18.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f7019ff3640 1 -- 172.21.15.151:0/3227323666 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700c0aaa40 con 0x55adcd4a0200 2024-09-12T16:53:18.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3227323666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 msgr2=0x55adcd4a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3227323666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd4a05e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f700c00a4e0 tx=0x7f700c01b090 comp rx=0 tx=0).stop 2024-09-12T16:53:18.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3227323666 shutdown_connections 2024-09-12T16:53:18.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3227323666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd4a05e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3227323666 >> 172.21.15.151:0/3227323666 conn(0x55adcd413b10 msgr2=0x55adcd413f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3227323666 shutdown_connections 2024-09-12T16:53:18.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.368+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3227323666 wait complete. 2024-09-12T16:53:18.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 Processor -- start 2024-09-12T16:53:18.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 -- start start 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd58b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55adcd3a6680 con 0x55adcd4a0200 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701aff5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd58b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701aff5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd58b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40168/0 (socket says 172.21.15.151:40168) 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701aff5640 1 -- 172.21.15.151:0/448329808 learned_addr learned my addr 172.21.15.151:0/448329808 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701aff5640 1 -- 172.21.15.151:0/448329808 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcd321da0 con 0x55adcd4a0200 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701aff5640 1 --2- 172.21.15.151:0/448329808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd58b8c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f700c019740 tx=0x7f700c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa794e8e7a7bc41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f6f08e09640 1 -- 172.21.15.151:0/448329808 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700c0b9070 con 0x55adcd4a0200 2024-09-12T16:53:18.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f6f08e09640 1 -- 172.21.15.151:0/448329808 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700c0aaa90 con 0x55adcd4a0200 2024-09-12T16:53:18.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f6f08e09640 1 -- 172.21.15.151:0/448329808 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700c0aad70 con 0x55adcd4a0200 2024-09-12T16:53:18.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/448329808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 msgr2=0x55adcd58b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/448329808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd58b8c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f700c019740 tx=0x7f700c0033b0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/448329808 shutdown_connections 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/448329808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd58b8c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/448329808 >> 172.21.15.151:0/448329808 conn(0x55adcd413b10 msgr2=0x55adcd587560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/448329808 shutdown_connections 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/448329808 wait complete. 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 Processor -- start 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.388+0000 7f701d4ef9c0 1 -- start start 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701d4ef9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd592db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701d4ef9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55adcd348a50 con 0x55adcd4a0200 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701aff5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd592db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701aff5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd592db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40178/0 (socket says 172.21.15.151:40178) 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701aff5640 1 -- 172.21.15.151:0/575250884 learned_addr learned my addr 172.21.15.151:0/575250884 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701aff5640 1 -- 172.21.15.151:0/575250884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcd593310 con 0x55adcd4a0200 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701aff5640 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd592db0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f700c018cc0 tx=0x7f700c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f6f07606640 1 -- 172.21.15.151:0/575250884 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700c0b9070 con 0x55adcd4a0200 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f6f07606640 1 -- 172.21.15.151:0/575250884 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700c0b5b10 con 0x55adcd4a0200 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f6f07606640 1 -- 172.21.15.151:0/575250884 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700c0b5df0 con 0x55adcd4a0200 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adcd5935a0 con 0x55adcd4a0200 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adcd593f50 con 0x55adcd4a0200 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f6f07606640 1 -- 172.21.15.151:0/575250884 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f700c0b3040 con 0x55adcd4a0200 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f6f07606640 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f00039ac0 0x7f6f0003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f6f07606640 1 -- 172.21.15.151:0/575250884 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f700c0c4070 con 0x55adcd4a0200 2024-09-12T16:53:18.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701a7f4640 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f00039ac0 0x7f6f0003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd4a3340 0x55adcd599f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd59a460 con 0x55adcd4a3340 2024-09-12T16:53:18.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701b7f6640 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd4a3340 0x55adcd599f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.392+0000 7f701a7f4640 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f00039ac0 0x7f6f0003bf80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7010001e40 tx=0x7f70100013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701b7f6640 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd4a3340 0x55adcd599f20 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701b7f6640 1 -- 172.21.15.151:0/575250884 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70140083f0 con 0x55adcd4a3340 2024-09-12T16:53:18.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd59a8b0 con 0x55adcd4a3340 2024-09-12T16:53:18.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701b7f6640 1 -- 172.21.15.151:0/575250884 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70140083f0 con 0x55adcd4a3340 2024-09-12T16:53:18.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd59c6c0 0x55adcd59eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd59f180 con 0x55adcd59c6c0 2024-09-12T16:53:18.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701aff5640 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd59c6c0 0x55adcd59eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701aff5640 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd59c6c0 0x55adcd59eab0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701aff5640 1 -- 172.21.15.151:0/575250884 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd59c6c0 2024-09-12T16:53:18.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd59b560 con 0x55adcd4a3340 2024-09-12T16:53:18.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701b7f6640 1 -- 172.21.15.151:0/575250884 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70140083f0 con 0x55adcd4a3340 2024-09-12T16:53:18.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd59ba00 con 0x55adcd4a3340 2024-09-12T16:53:18.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701b7f6640 1 -- 172.21.15.151:0/575250884 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f70140083f0 con 0x55adcd4a3340 2024-09-12T16:53:18.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.396+0000 7f701d4ef9c0 1 Processor -- start 2024-09-12T16:53:18.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701d4ef9c0 1 -- start start 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701d4ef9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5ad7f0 0x55adcd5adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701d4ef9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55adcd3b3450 con 0x55adcd5ad7f0 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701b7f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5ad7f0 0x55adcd5adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701b7f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5ad7f0 0x55adcd5adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40182/0 (socket says 172.21.15.151:40182) 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701b7f6640 1 -- 172.21.15.151:0/3752405095 learned_addr learned my addr 172.21.15.151:0/3752405095 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701b7f6640 1 -- 172.21.15.151:0/3752405095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcd5ae250 con 0x55adcd5ad7f0 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701b7f6640 1 --2- 172.21.15.151:0/3752405095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5ad7f0 0x55adcd5adc10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55adcd594eb0 tx=0x7f701400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f6f04e01640 1 -- 172.21.15.151:0/3752405095 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7014007e00 con 0x55adcd5ad7f0 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f6f04e01640 1 -- 172.21.15.151:0/3752405095 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701401e020 con 0x55adcd5ad7f0 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3752405095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adcd5aeab0 con 0x55adcd5ad7f0 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f6f04e01640 1 -- 172.21.15.151:0/3752405095 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7014019590 con 0x55adcd5ad7f0 2024-09-12T16:53:18.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3752405095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adcd5af020 con 0x55adcd5ad7f0 2024-09-12T16:53:18.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f6f04e01640 1 -- 172.21.15.151:0/3752405095 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7014016040 con 0x55adcd5ad7f0 2024-09-12T16:53:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f6f04e01640 1 --2- 172.21.15.151:0/3752405095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ef4039ac0 0x7f6ef403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.400+0000 7f6f04e01640 1 -- 172.21.15.151:0/3752405095 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f701401f030 con 0x55adcd5ad7f0 2024-09-12T16:53:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701aff5640 1 --2- 172.21.15.151:0/3752405095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ef4039ac0 0x7f6ef403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 Processor -- start 2024-09-12T16:53:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- start start 2024-09-12T16:53:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701aff5640 1 --2- 172.21.15.151:0/3752405095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ef4039ac0 0x7f6ef403bf80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55adcd594240 tx=0x7f700c0e95d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55adcd58c050 con 0x55adcd5bb100 2024-09-12T16:53:18.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701b7f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701b7f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5bb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40188/0 (socket says 172.21.15.151:40188) 2024-09-12T16:53:18.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701b7f6640 1 -- 172.21.15.151:0/1126402449 learned_addr learned my addr 172.21.15.151:0/1126402449 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701b7f6640 1 -- 172.21.15.151:0/1126402449 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcd5bbab0 con 0x55adcd5bb100 2024-09-12T16:53:18.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701b7f6640 1 --2- 172.21.15.151:0/1126402449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5bb4e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7014050900 tx=0x7f7014017760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c19138e146ee21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f6efe7fc640 1 -- 172.21.15.151:0/1126402449 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f701401d040 con 0x55adcd5bb100 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f6efe7fc640 1 -- 172.21.15.151:0/1126402449 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70140173b0 con 0x55adcd5bb100 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f6efe7fc640 1 -- 172.21.15.151:0/1126402449 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7014023600 con 0x55adcd5bb100 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/1126402449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 msgr2=0x55adcd5bb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/1126402449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5bb4e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7014050900 tx=0x7f7014017760 comp rx=0 tx=0).stop 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/1126402449 shutdown_connections 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/1126402449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5bb4e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/1126402449 >> 172.21.15.151:0/1126402449 conn(0x55adcd5b64c0 msgr2=0x55adcd5b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/1126402449 shutdown_connections 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/1126402449 wait complete. 2024-09-12T16:53:18.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 Processor -- start 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- start start 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701d4ef9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55adcd5b9ff0 con 0x55adcd5bb100 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701b7f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701b7f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5c1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40202/0 (socket says 172.21.15.151:40202) 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.404+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 learned_addr learned my addr 172.21.15.151:0/3955377686 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adcd5c1ad0 con 0x55adcd5bb100 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701b7f6640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5c1570 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7014019bd0 tx=0x7f7014050890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f6efcff9640 1 -- 172.21.15.151:0/3955377686 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f701401d070 con 0x55adcd5bb100 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adcd5c1d60 con 0x55adcd5bb100 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f6efcff9640 1 -- 172.21.15.151:0/3955377686 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7014031030 con 0x55adcd5bb100 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f6efcff9640 1 -- 172.21.15.151:0/3955377686 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7014048040 con 0x55adcd5bb100 2024-09-12T16:53:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adcd5c2710 con 0x55adcd5bb100 2024-09-12T16:53:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f6efcff9640 1 -- 172.21.15.151:0/3955377686 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f70140520d0 con 0x55adcd5bb100 2024-09-12T16:53:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f6efcff9640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ee4039a70 0x7f6ee403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f6efcff9640 1 -- 172.21.15.151:0/3955377686 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7014037d40 con 0x55adcd5bb100 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701aff5640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ee4039a70 0x7f6ee403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd5cc840 0x55adcd5cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5cf3e0 con 0x55adcd5cc840 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701a7f4640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd5cc840 0x55adcd5cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701aff5640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ee4039a70 0x7f6ee403bf30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f700c0b5690 tx=0x7f700c0e1000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701a7f4640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd5cc840 0x55adcd5cec90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f701000f620 con 0x55adcd5cc840 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 20 realm 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5cbc50 con 0x55adcd5cc840 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f701000f620 con 0x55adcd5cc840 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5cfee0 con 0x55adcd5cc840 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f701000f620 con 0x55adcd5cc840 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.408+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d07b0 con 0x55adcd5cc840 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f701000f620 con 0x55adcd5cc840 2024-09-12T16:53:18.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701d4ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd5d10b0 0x55adcd5d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d3be0 con 0x55adcd5d10b0 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701b7f6640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd5d10b0 0x55adcd5d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701b7f6640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd5d10b0 0x55adcd5d34a0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701d4ef9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701d4ef9c0 20 searching for the correct realm 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55adcd5d5b80 0x55adcd5d8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701aff5640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55adcd5d5b80 0x55adcd5d8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701aff5640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55adcd5d5b80 0x55adcd5d8040 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701aff5640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f700c0bd5e0 0x7f700c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x7f700c0bd5e0 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701a7f4640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f700c0bd5e0 0x7f700c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701a7f4640 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f700c0bd5e0 0x7f700c0b6030 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701000f620 con 0x7f700c0bd5e0 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.412+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5cc840 2024-09-12T16:53:18.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701000f620 con 0x55adcd5cc840 2024-09-12T16:53:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5cc840 2024-09-12T16:53:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x7f700c0bd5e0 2024-09-12T16:53:18.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5cc840 2024-09-12T16:53:18.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.416+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5cc840 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x7f700c0bd5e0 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5cc840 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5cc840 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x7f700c0bd5e0 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.420+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5cc840 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x7f700c0bd5e0 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d5b80 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5d10b0 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x55adcd5cc840 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.424+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8710 con 0x7f700c0bd5e0 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d45a0 con 0x55adcd5cc840 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d49f0 con 0x55adcd5cc840 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d4ed0 con 0x55adcd5cc840 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 zone default found 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 4 Realm: () 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:18.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 zonegroup default 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d8b90 con 0x55adcd5d10b0 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5daa80 con 0x55adcd5d5b80 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5daf60 con 0x55adcd5d5b80 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 started sync module instance, tier type = 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.428+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d9dc0 con 0x7f700c0bd5e0 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.432+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.432+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94204963168992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d9dc0 con 0x7f700c0bd5e0 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.432+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5dba80 con 0x55adcd5cc840 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.432+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94204963168992] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.432+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.432+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94204963173728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5d9dc0 con 0x55adcd5cc840 2024-09-12T16:53:18.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.432+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5dc490 con 0x55adcd5d5b80 2024-09-12T16:53:18.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94204963176416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5dcce0 con 0x55adcd5d5b80 2024-09-12T16:53:18.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5dd6e0 con 0x7f700c0bd5e0 2024-09-12T16:53:18.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94204963173728] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94204963166480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5ddad0 con 0x7f700c0bd5e0 2024-09-12T16:53:18.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5de490 con 0x55adcd5cc840 2024-09-12T16:53:18.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94204963176416] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.436+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94204963166480] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.440+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.440+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94204963181040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5ddfe0 con 0x55adcd5cc840 2024-09-12T16:53:18.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.440+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5de830 con 0x55adcd5d10b0 2024-09-12T16:53:18.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.440+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94204963181040] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.440+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.440+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94204963184608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5de400 con 0x55adcd5d10b0 2024-09-12T16:53:18.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.440+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5df530 con 0x55adcd5d10b0 2024-09-12T16:53:18.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94204963188864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5df950 con 0x55adcd5d10b0 2024-09-12T16:53:18.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5e0440 con 0x55adcd5d10b0 2024-09-12T16:53:18.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94204963184608] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94204963188864] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94204963192592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5df4a0 con 0x55adcd5d10b0 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 20 add_watcher() i=0 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 20 add_watcher() i=1 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 20 add_watcher() i=2 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 20 add_watcher() i=3 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 20 add_watcher() i=4 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 20 add_watcher() i=5 2024-09-12T16:53:18.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.444+0000 7f701d4ef9c0 20 add_watcher() i=6 2024-09-12T16:53:18.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94204963192592] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 20 add_watcher() i=7 2024-09-12T16:53:18.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:18.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5df4a0 con 0x55adcd5cc840 2024-09-12T16:53:18.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94204963187664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5df4a0 con 0x55adcd5cc840 2024-09-12T16:53:18.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94204963187664] v34'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f6ed17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:18.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:18.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:18.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 5 note: GC not initialized 2024-09-12T16:53:18.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f6e4bfff640 20 reqs_thread_entry: start 2024-09-12T16:53:18.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:18.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 20 Filter name: none 2024-09-12T16:53:18.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f6e49ffb640 20 reqs_thread_entry: start 2024-09-12T16:53:18.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd606c20 con 0x55adcd5cc840 2024-09-12T16:53:18.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd606c20 con 0x7f700c0bd5e0 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.448+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd606be0 con 0x55adcd5cc840 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd606be0 con 0x55adcd5d5b80 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607120 con 0x55adcd5d5b80 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6070e0 con 0x55adcd5d5b80 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6070e0 con 0x55adcd5cc840 2024-09-12T16:53:18.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607060 con 0x55adcd5cc840 2024-09-12T16:53:18.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5d5b80 2024-09-12T16:53:18.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5d5b80 2024-09-12T16:53:18.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5d10b0 2024-09-12T16:53:18.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.452+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd608710 con 0x55adcd5cc840 2024-09-12T16:53:18.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd608710 con 0x7f700c0bd5e0 2024-09-12T16:53:18.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd608710 con 0x55adcd5d5b80 2024-09-12T16:53:18.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd608710 con 0x55adcd5d10b0 2024-09-12T16:53:18.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd608710 con 0x55adcd5d10b0 2024-09-12T16:53:18.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6086c0 con 0x55adcd5d5b80 2024-09-12T16:53:18.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd608650 con 0x55adcd5d10b0 2024-09-12T16:53:18.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd608650 con 0x55adcd5cc840 2024-09-12T16:53:18.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd608620 con 0x55adcd5d5b80 2024-09-12T16:53:18.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.456+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5d10b0 2024-09-12T16:53:18.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x7f700c0bd5e0 2024-09-12T16:53:18.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5d10b0 2024-09-12T16:53:18.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5cc840 2024-09-12T16:53:18.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5cc840 2024-09-12T16:53:18.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5d5b80 2024-09-12T16:53:18.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5cc840 2024-09-12T16:53:18.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5cc840 2024-09-12T16:53:18.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5d5b80 2024-09-12T16:53:18.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5d5b80 2024-09-12T16:53:18.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5d5b80 2024-09-12T16:53:18.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.460+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adcd6085d0 con 0x55adcd5d10b0 2024-09-12T16:53:18.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.464+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.464+0000 7f6ed17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:18.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.464+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94204963187664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd5e0ce0 con 0x55adcd5cc840 2024-09-12T16:53:18.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.464+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94204963187664] v34'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.464+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94204963168992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.468+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94204963168992] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.468+0000 7f701d4ef9c0 20 remove_watcher() i=0 2024-09-12T16:53:18.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.468+0000 7f701d4ef9c0 2 removed watcher, disabling cache 2024-09-12T16:53:18.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.468+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94204963173728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5cc840 2024-09-12T16:53:18.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.468+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94204963173728] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.468+0000 7f701d4ef9c0 20 remove_watcher() i=1 2024-09-12T16:53:18.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.468+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94204963176416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5d5b80 2024-09-12T16:53:18.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.472+0000 7f701aff5640 1 -- 172.21.15.151:0/3955377686 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94204963176416] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f700c0c6d80 con 0x55adcd5d5b80 2024-09-12T16:53:18.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.472+0000 7f701d4ef9c0 20 remove_watcher() i=2 2024-09-12T16:53:18.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.472+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94204963166480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.472+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94204963166480] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x7f700c0bd5e0 2024-09-12T16:53:18.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.472+0000 7f701d4ef9c0 20 remove_watcher() i=3 2024-09-12T16:53:18.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.472+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94204963181040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5cc840 2024-09-12T16:53:18.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.476+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94204963181040] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701002b040 con 0x55adcd5cc840 2024-09-12T16:53:18.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.476+0000 7f701d4ef9c0 20 remove_watcher() i=4 2024-09-12T16:53:18.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.476+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94204963184608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5d10b0 2024-09-12T16:53:18.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.476+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94204963184608] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.476+0000 7f701d4ef9c0 20 remove_watcher() i=5 2024-09-12T16:53:18.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.476+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94204963188864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5d10b0 2024-09-12T16:53:18.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94204963188864] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 20 remove_watcher() i=6 2024-09-12T16:53:18.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94204963192592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55adcd607040 con 0x55adcd5d10b0 2024-09-12T16:53:18.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701b7f6640 1 -- 172.21.15.151:0/3955377686 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94204963192592] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f701403d070 con 0x55adcd5d10b0 2024-09-12T16:53:18.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 20 remove_watcher() i=7 2024-09-12T16:53:18.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd5d10b0 msgr2=0x55adcd5d34a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd5d10b0 0x55adcd5d34a0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd5cc840 msgr2=0x55adcd5cec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd5cc840 0x55adcd5cec90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f700c0bd5e0 msgr2=0x7f700c0b6030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f700c0bd5e0 0x7f700c0b6030 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55adcd5d5b80 msgr2=0x55adcd5d8040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55adcd5d5b80 0x55adcd5d8040 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ee4039a70 msgr2=0x7f6ee403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ee4039a70 0x7f6ee403bf30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f700c0b5690 tx=0x7f700c0e1000 comp rx=0 tx=0).stop 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 msgr2=0x55adcd5c1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701a7f4640 1 -- 172.21.15.151:0/3955377686 reap_dead start 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5c1570 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7014019bd0 tx=0x7f7014050890 comp rx=0 tx=0).stop 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 shutdown_connections 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3955377686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5bb100 0x55adcd5c1570 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 >> 172.21.15.151:0/3955377686 conn(0x55adcd5b64c0 msgr2=0x55adcd5ba770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 shutdown_connections 2024-09-12T16:53:18.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.480+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3955377686 wait complete. 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3752405095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ef4039ac0 msgr2=0x7f6ef403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3752405095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ef4039ac0 0x7f6ef403bf80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55adcd594240 tx=0x7f700c0e95d0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3752405095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5ad7f0 msgr2=0x55adcd5adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3752405095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5ad7f0 0x55adcd5adc10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55adcd594eb0 tx=0x7f701400af40 comp rx=0 tx=0).stop 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3752405095 shutdown_connections 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3752405095 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6ef4039ac0 0x7f6ef403bf80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/3752405095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd5ad7f0 0x55adcd5adc10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3752405095 >> 172.21.15.151:0/3752405095 conn(0x55adcd5a31a0 msgr2=0x55adcd5a3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3752405095 shutdown_connections 2024-09-12T16:53:18.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/3752405095 wait complete. 2024-09-12T16:53:18.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd59c6c0 msgr2=0x55adcd59eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd59c6c0 0x55adcd59eab0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd4a3340 msgr2=0x55adcd599f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd4a3340 0x55adcd599f20 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f00039ac0 msgr2=0x7f6f0003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f00039ac0 0x7f6f0003bf80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7010001e40 tx=0x7f70100013a0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 msgr2=0x55adcd592db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd592db0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f700c018cc0 tx=0x7f700c017e30 comp rx=0 tx=0).stop 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 shutdown_connections 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55adcd59c6c0 0x55adcd59eab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55adcd4a3340 0x55adcd599f20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f00039ac0 0x7f6f0003bf80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 --2- 172.21.15.151:0/575250884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55adcd4a0200 0x55adcd592db0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 >> 172.21.15.151:0/575250884 conn(0x55adcd413b10 msgr2=0x55adcd585ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 shutdown_connections 2024-09-12T16:53:18.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.484+0000 7f701d4ef9c0 1 -- 172.21.15.151:0/575250884 wait complete. 2024-09-12T16:53:18.497 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T16:53:18.498 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:53:18.498 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-12T16:53:18.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-12T16:53:18.498 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-12T16:53:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:18.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.572+0000 7fccbb4d89c0 1 Processor -- start 2024-09-12T16:53:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.572+0000 7fccbb4d89c0 1 -- start start 2024-09-12T16:53:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.572+0000 7fccbb4d89c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d998248dd0 0x55d9982491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.572+0000 7fccbb4d89c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d9980fe9c0 con 0x55d99824bfb0 2024-09-12T16:53:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.572+0000 7fccbb4d89c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55d99814e6d0 con 0x55d998248dd0 2024-09-12T16:53:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb8fde640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d998248dd0 0x55d9982491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb87dd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55d99824bfb0 0x55d99824e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:43194/0 (socket says 172.21.15.151:43194) 2024-09-12T16:53:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb8fde640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d998248dd0 0x55d9982491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40204/0 (socket says 172.21.15.151:40204) 2024-09-12T16:53:18.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb87dd640 1 -- 172.21.15.151:0/1117800050 learned_addr learned my addr 172.21.15.151:0/1117800050 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:53:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb8fde640 1 -- 172.21.15.151:0/1117800050 >> v1:172.21.15.122:6789/0 conn(0x55d99824bfb0 legacy=0x55d99824e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb8fde640 1 -- 172.21.15.151:0/1117800050 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9980f2ca0 con 0x55d998248dd0 2024-09-12T16:53:18.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb8fde640 1 --2- 172.21.15.151:0/1117800050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d9982491b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fccb000a420 tx=0x7fccb001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ddb74b94e560ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb7fdc640 1 -- 172.21.15.151:0/1117800050 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb00af070 con 0x55d998248dd0 2024-09-12T16:53:18.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb7fdc640 1 -- 172.21.15.151:0/1117800050 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb00aa530 con 0x55d998248dd0 2024-09-12T16:53:18.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.576+0000 7fccb7fdc640 1 -- 172.21.15.151:0/1117800050 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb00aa850 con 0x55d998248dd0 2024-09-12T16:53:18.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.580+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1117800050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 msgr2=0x55d9982491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.580+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1117800050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d9982491b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fccb000a420 tx=0x7fccb001afd0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.580+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1117800050 shutdown_connections 2024-09-12T16:53:18.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.580+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1117800050 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d9982491b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.580+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1117800050 >> 172.21.15.151:0/1117800050 conn(0x55d9982448f0 msgr2=0x55d998246d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.580+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1117800050 shutdown_connections 2024-09-12T16:53:18.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.580+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1117800050 wait complete. 2024-09-12T16:53:18.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 Processor -- start 2024-09-12T16:53:18.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- start start 2024-09-12T16:53:18.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d998337830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d998152680 con 0x55d998248dd0 2024-09-12T16:53:18.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccb8fde640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d998337830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccb8fde640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d998337830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40218/0 (socket says 172.21.15.151:40218) 2024-09-12T16:53:18.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccb8fde640 1 -- 172.21.15.151:0/4195857582 learned_addr learned my addr 172.21.15.151:0/4195857582 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccb8fde640 1 -- 172.21.15.151:0/4195857582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9980cdda0 con 0x55d998248dd0 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccb8fde640 1 --2- 172.21.15.151:0/4195857582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d998337830 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fccb0018c00 tx=0x7fccb00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe7e1e361a125d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fcba6e0d640 1 -- 172.21.15.151:0/4195857582 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb00af040 con 0x55d998248dd0 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fcba6e0d640 1 -- 172.21.15.151:0/4195857582 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb00aaa00 con 0x55d998248dd0 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fcba6e0d640 1 -- 172.21.15.151:0/4195857582 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb00aace0 con 0x55d998248dd0 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/4195857582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 msgr2=0x55d998337830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/4195857582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d998337830 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fccb0018c00 tx=0x7fccb00033b0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/4195857582 shutdown_connections 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/4195857582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d998337830 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/4195857582 >> 172.21.15.151:0/4195857582 conn(0x55d9982448f0 msgr2=0x55d99832f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/4195857582 shutdown_connections 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/4195857582 wait complete. 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 Processor -- start 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- start start 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d99833ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.596+0000 7fccbb4d89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d9980f4a50 con 0x55d998248dd0 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb8fde640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d99833ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb8fde640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d99833ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40234/0 (socket says 172.21.15.151:40234) 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb8fde640 1 -- 172.21.15.151:0/2456372200 learned_addr learned my addr 172.21.15.151:0/2456372200 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb8fde640 1 -- 172.21.15.151:0/2456372200 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99833f340 con 0x55d998248dd0 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb8fde640 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d99833ede0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fccb0018c00 tx=0x7fccb0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fcba560a640 1 -- 172.21.15.151:0/2456372200 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb00c5070 con 0x55d998248dd0 2024-09-12T16:53:18.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d99833f5d0 con 0x55d998248dd0 2024-09-12T16:53:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fcba560a640 1 -- 172.21.15.151:0/2456372200 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb00c1690 con 0x55d998248dd0 2024-09-12T16:53:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fcba560a640 1 -- 172.21.15.151:0/2456372200 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb00c19b0 con 0x55d998248dd0 2024-09-12T16:53:18.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99833ffb0 con 0x55d998248dd0 2024-09-12T16:53:18.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fcba560a640 1 -- 172.21.15.151:0/2456372200 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fccb00b5470 con 0x55d998248dd0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fcba560a640 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba0039a70 0x7fcba003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fcba560a640 1 -- 172.21.15.151:0/2456372200 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fccb00bb070 con 0x55d998248dd0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb87dd640 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba0039a70 0x7fcba003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d99824bfb0 0x55d998345f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998346440 con 0x55d99824bfb0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb97df640 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d99824bfb0 0x55d998345f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb87dd640 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba0039a70 0x7fcba003bf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fccac004180 tx=0x7fccac001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.600+0000 7fccb97df640 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d99824bfb0 0x55d998345f00 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccb97df640 1 -- 172.21.15.151:0/2456372200 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcca80083f0 con 0x55d99824bfb0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983468b0 con 0x55d99824bfb0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccb97df640 1 -- 172.21.15.151:0/2456372200 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcca80083f0 con 0x55d99824bfb0 2024-09-12T16:53:18.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d9983486c0 0x55d99834aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d99834b180 con 0x55d9983486c0 2024-09-12T16:53:18.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccb8fde640 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d9983486c0 0x55d99834aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccb8fde640 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d9983486c0 0x55d99834aab0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccb8fde640 1 -- 172.21.15.151:0/2456372200 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fccb00c7070 con 0x55d9983486c0 2024-09-12T16:53:18.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998347530 con 0x55d99824bfb0 2024-09-12T16:53:18.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccb97df640 1 -- 172.21.15.151:0/2456372200 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcca80083f0 con 0x55d99824bfb0 2024-09-12T16:53:18.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983479b0 con 0x55d99824bfb0 2024-09-12T16:53:18.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccb97df640 1 -- 172.21.15.151:0/2456372200 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcca80083f0 con 0x55d99824bfb0 2024-09-12T16:53:18.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 Processor -- start 2024-09-12T16:53:18.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 -- start start 2024-09-12T16:53:18.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9983597d0 0x55d998359bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.604+0000 7fccbb4d89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d99815f450 con 0x55d9983597d0 2024-09-12T16:53:18.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb97df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9983597d0 0x55d998359bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb97df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9983597d0 0x55d998359bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40240/0 (socket says 172.21.15.151:40240) 2024-09-12T16:53:18.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb97df640 1 -- 172.21.15.151:0/2744146454 learned_addr learned my addr 172.21.15.151:0/2744146454 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb97df640 1 -- 172.21.15.151:0/2744146454 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99835a230 con 0x55d9983597d0 2024-09-12T16:53:18.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb97df640 1 --2- 172.21.15.151:0/2744146454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9983597d0 0x55d998359bf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x55d998340ea0 tx=0x7fcca800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fcb9e7fc640 1 -- 172.21.15.151:0/2744146454 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcca8007da0 con 0x55d9983597d0 2024-09-12T16:53:18.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fcb9e7fc640 1 -- 172.21.15.151:0/2744146454 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca801e020 con 0x55d9983597d0 2024-09-12T16:53:18.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2744146454 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d99835aa90 con 0x55d9983597d0 2024-09-12T16:53:18.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fcb9e7fc640 1 -- 172.21.15.151:0/2744146454 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcca8019590 con 0x55d9983597d0 2024-09-12T16:53:18.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2744146454 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99835b000 con 0x55d9983597d0 2024-09-12T16:53:18.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fcb9e7fc640 1 -- 172.21.15.151:0/2744146454 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcca8016040 con 0x55d9983597d0 2024-09-12T16:53:18.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fcb9e7fc640 1 --2- 172.21.15.151:0/2744146454 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb90039a70 0x7fcb9003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fcb9e7fc640 1 -- 172.21.15.151:0/2744146454 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcca801f030 con 0x55d9983597d0 2024-09-12T16:53:18.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb8fde640 1 --2- 172.21.15.151:0/2744146454 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb90039a70 0x7fcb9003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccbb4d89c0 1 Processor -- start 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccbb4d89c0 1 -- start start 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb8fde640 1 --2- 172.21.15.151:0/2744146454 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb90039a70 0x7fcb9003bf30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fccb00c1ba0 tx=0x7fccb00b6850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccbb4d89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d998367540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccbb4d89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d998337fc0 con 0x55d998367140 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb97df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d998367540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb97df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d998367540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40244/0 (socket says 172.21.15.151:40244) 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.608+0000 7fccb97df640 1 -- 172.21.15.151:0/2032707993 learned_addr learned my addr 172.21.15.151:0/2032707993 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccb97df640 1 -- 172.21.15.151:0/2032707993 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d998367b30 con 0x55d998367140 2024-09-12T16:53:18.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccb97df640 1 --2- 172.21.15.151:0/2032707993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d998367540 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcca80508d0 tx=0x7fcca8023610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed86c88ba199209a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fcb8ffff640 1 -- 172.21.15.151:0/2032707993 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcca801d040 con 0x55d998367140 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fcb8ffff640 1 -- 172.21.15.151:0/2032707993 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca8052320 con 0x55d998367140 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fcb8ffff640 1 -- 172.21.15.151:0/2032707993 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcca804f340 con 0x55d998367140 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2032707993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 msgr2=0x55d998367540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2032707993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d998367540 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcca80508d0 tx=0x7fcca8023610 comp rx=0 tx=0).stop 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2032707993 shutdown_connections 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2032707993 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d998367540 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2032707993 >> 172.21.15.151:0/2032707993 conn(0x55d998362560 msgr2=0x55d9983607a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2032707993 shutdown_connections 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2032707993 wait complete. 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 Processor -- start 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- start start 2024-09-12T16:53:18.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d99836d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d998366090 con 0x55d998367140 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccb97df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d99836d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccb97df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d99836d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40252/0 (socket says 172.21.15.151:40252) 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 learned_addr learned my addr 172.21.15.151:0/1433500752 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99836db50 con 0x55d998367140 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccb97df640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d99836d5f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcca8017e10 tx=0x7fcca8050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fcb8e7fc640 1 -- 172.21.15.151:0/1433500752 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcca801d030 con 0x55d998367140 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d99836dde0 con 0x55d998367140 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fcb8e7fc640 1 -- 172.21.15.151:0/1433500752 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca8031030 con 0x55d998367140 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fcb8e7fc640 1 -- 172.21.15.151:0/1433500752 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcca803b060 con 0x55d998367140 2024-09-12T16:53:18.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.612+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99836e790 con 0x55d998367140 2024-09-12T16:53:18.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fcb8e7fc640 1 -- 172.21.15.151:0/1433500752 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcca8050a10 con 0x55d998367140 2024-09-12T16:53:18.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fcb8e7fc640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb84039a20 0x7fcb8403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fcb8e7fc640 1 -- 172.21.15.151:0/1433500752 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcca8024030 con 0x55d998367140 2024-09-12T16:53:18.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb8fde640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb84039a20 0x7fcb8403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d9983788d0 0x55d99837ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d99837b4b0 con 0x55d9983788d0 2024-09-12T16:53:18.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb87dd640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d9983788d0 0x55d99837ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb8fde640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb84039a20 0x7fcb8403bee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fccb00033f0 tx=0x7fccb00da000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb87dd640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d9983788d0 0x55d99837ad60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccac00e640 con 0x55d9983788d0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 realm 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998377c80 con 0x55d9983788d0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccac00e640 con 0x55d9983788d0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d99837bf90 con 0x55d9983788d0 2024-09-12T16:53:18.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccac00e640 con 0x55d9983788d0 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d99837c860 con 0x55d9983788d0 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccac00e640 con 0x55d9983788d0 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d99837d110 0x55d99837f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d99837fc60 con 0x55d99837d110 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.616+0000 7fccb97df640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d99837d110 0x55d99837f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb97df640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d99837d110 0x55d99837f500 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccbb4d89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccbb4d89c0 20 searching for the correct realm 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d998381c50 0x55d998384110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb8fde640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d998381c50 0x55d998384110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb8fde640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d998381c50 0x55d998384110 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb8fde640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fccb00dd040 0x7fccb00b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x7fccb00dd040 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb87dd640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fccb00dd040 0x7fccb00b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb87dd640 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fccb00dd040 0x7fccb00b37a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac00e640 con 0x7fccb00dd040 2024-09-12T16:53:18.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d9983788d0 2024-09-12T16:53:18.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac00e640 con 0x55d9983788d0 2024-09-12T16:53:18.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d9983788d0 2024-09-12T16:53:18.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.620+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x7fccb00dd040 2024-09-12T16:53:18.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x7fccb00dd040 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d9983788d0 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d9983788d0 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x7fccb00dd040 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fccac029040 con 0x7fccb00dd040 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.624+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d9983788d0 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d9983788d0 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x7fccb00dd040 2024-09-12T16:53:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x7fccb00dd040 2024-09-12T16:53:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d9983788d0 2024-09-12T16:53:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.628+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x7fccb00dd040 2024-09-12T16:53:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x7fccb00dd040 2024-09-12T16:53:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d998381c50 2024-09-12T16:53:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d99837d110 2024-09-12T16:53:18.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x55d9983788d0 2024-09-12T16:53:18.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9983847e0 con 0x7fccb00dd040 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccac029040 con 0x7fccb00dd040 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccbb4d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccbb4d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccbb4d89c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccbb4d89c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccbb4d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccbb4d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.632+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998380670 con 0x55d9983788d0 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998380af0 con 0x55d9983788d0 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccac029040 con 0x55d9983788d0 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998380f10 con 0x55d9983788d0 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 zone default found 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 4 Realm: () 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:18.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 zonegroup default 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998380f10 con 0x55d99837d110 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998386b00 con 0x55d998381c50 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d998386ea0 con 0x55d998381c50 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 started sync module instance, tier type = 2024-09-12T16:53:18.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:18.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998385f40 con 0x7fccb00dd040 2024-09-12T16:53:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94393050096704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998385f40 con 0x7fccb00dd040 2024-09-12T16:53:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.636+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998387860 con 0x55d9983788d0 2024-09-12T16:53:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.640+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94393050096704] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.640+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.640+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94393050100928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998385f40 con 0x55d9983788d0 2024-09-12T16:53:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.640+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998388270 con 0x55d998381c50 2024-09-12T16:53:18.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.640+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94393050100928] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94393050094224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998385eb0 con 0x55d998381c50 2024-09-12T16:53:18.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998388f70 con 0x7fccb00dd040 2024-09-12T16:53:18.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94393050106832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998389600 con 0x7fccb00dd040 2024-09-12T16:53:18.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838a120 con 0x55d9983788d0 2024-09-12T16:53:18.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94393050094224] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94393050106832] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94393050110960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838a0e0 con 0x55d9983788d0 2024-09-12T16:53:18.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.644+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838a510 con 0x55d99837d110 2024-09-12T16:53:18.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.648+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94393050110960] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.648+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.648+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94393050105360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838a900 con 0x55d99837d110 2024-09-12T16:53:18.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.648+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838b2c0 con 0x55d99837d110 2024-09-12T16:53:18.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94393050105360] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94393050107984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838b2c0 con 0x55d99837d110 2024-09-12T16:53:18.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838bc80 con 0x55d99837d110 2024-09-12T16:53:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94393050107984] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94393050115600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838be60 con 0x55d99837d110 2024-09-12T16:53:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 20 add_watcher() i=0 2024-09-12T16:53:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 20 add_watcher() i=1 2024-09-12T16:53:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 20 add_watcher() i=2 2024-09-12T16:53:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 20 add_watcher() i=3 2024-09-12T16:53:18.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 20 add_watcher() i=4 2024-09-12T16:53:18.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 20 add_watcher() i=5 2024-09-12T16:53:18.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.652+0000 7fccbb4d89c0 20 add_watcher() i=6 2024-09-12T16:53:18.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94393050115600] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 20 add_watcher() i=7 2024-09-12T16:53:18.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:18.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d99838f040 con 0x55d9983788d0 2024-09-12T16:53:18.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94393050130928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d99838be00 con 0x55d9983788d0 2024-09-12T16:53:18.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94393050130928] v34'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fcb6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:18.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:18.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:18.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 5 note: GC not initialized 2024-09-12T16:53:18.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fcb6dfe3640 20 reqs_thread_entry: start 2024-09-12T16:53:18.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:18.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 20 Filter name: none 2024-09-12T16:53:18.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fcadf7fe640 20 reqs_thread_entry: start 2024-09-12T16:53:18.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2990 con 0x55d9983788d0 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2990 con 0x7fccb00dd040 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.656+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d9983788d0 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d998381c50 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d998381c50 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d998381c50 2024-09-12T16:53:18.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d9983788d0 2024-09-12T16:53:18.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d9983788d0 2024-09-12T16:53:18.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d998381c50 2024-09-12T16:53:18.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d998381c50 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b2950 con 0x55d99837d110 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b40e0 con 0x55d9983788d0 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b23d0 con 0x7fccb00dd040 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.660+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b40e0 con 0x55d998381c50 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b40e0 con 0x55d99837d110 2024-09-12T16:53:18.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b40e0 con 0x55d99837d110 2024-09-12T16:53:18.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b4090 con 0x55d998381c50 2024-09-12T16:53:18.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fe0 con 0x55d99837d110 2024-09-12T16:53:18.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fe0 con 0x55d9983788d0 2024-09-12T16:53:18.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fe0 con 0x55d998381c50 2024-09-12T16:53:18.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.664+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d99837d110 2024-09-12T16:53:18.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x7fccb00dd040 2024-09-12T16:53:18.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d99837d110 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d9983788d0 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d9983788d0 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d998381c50 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d9983788d0 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d9983788d0 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d998381c50 2024-09-12T16:53:18.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d998381c50 2024-09-12T16:53:18.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d998381c50 2024-09-12T16:53:18.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3fc0 con 0x55d99837d110 2024-09-12T16:53:18.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.668+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.672+0000 7fcb6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:18.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.672+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94393050130928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998372a10 con 0x55d9983788d0 2024-09-12T16:53:18.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.672+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94393050130928] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.672+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94393050096704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9983b3cc0 con 0x7fccb00dd040 2024-09-12T16:53:18.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.672+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94393050096704] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.672+0000 7fccbb4d89c0 20 remove_watcher() i=0 2024-09-12T16:53:18.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.672+0000 7fccbb4d89c0 2 removed watcher, disabling cache 2024-09-12T16:53:18.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.672+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94393050100928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998386440 con 0x55d9983788d0 2024-09-12T16:53:18.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.676+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94393050100928] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.676+0000 7fccbb4d89c0 20 remove_watcher() i=1 2024-09-12T16:53:18.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.676+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94393050094224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998386440 con 0x55d998381c50 2024-09-12T16:53:18.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.676+0000 7fccb8fde640 1 -- 172.21.15.151:0/1433500752 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94393050094224] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb00f2040 con 0x55d998381c50 2024-09-12T16:53:18.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.676+0000 7fccbb4d89c0 20 remove_watcher() i=2 2024-09-12T16:53:18.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.676+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94393050106832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998386440 con 0x7fccb00dd040 2024-09-12T16:53:18.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.680+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94393050106832] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x7fccb00dd040 2024-09-12T16:53:18.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.680+0000 7fccbb4d89c0 20 remove_watcher() i=3 2024-09-12T16:53:18.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.680+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94393050110960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998388bd0 con 0x55d9983788d0 2024-09-12T16:53:18.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.680+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94393050110960] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccac0391c0 con 0x55d9983788d0 2024-09-12T16:53:18.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.680+0000 7fccbb4d89c0 20 remove_watcher() i=4 2024-09-12T16:53:18.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.680+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94393050105360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998386440 con 0x55d99837d110 2024-09-12T16:53:18.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.684+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94393050105360] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.684+0000 7fccbb4d89c0 20 remove_watcher() i=5 2024-09-12T16:53:18.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.684+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94393050107984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998388bd0 con 0x55d99837d110 2024-09-12T16:53:18.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94393050107984] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 20 remove_watcher() i=6 2024-09-12T16:53:18.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94393050115600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d998386440 con 0x55d99837d110 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccb97df640 1 -- 172.21.15.151:0/1433500752 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94393050115600] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcca802a070 con 0x55d99837d110 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 20 remove_watcher() i=7 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d99837d110 msgr2=0x55d99837f500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d99837d110 0x55d99837f500 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d9983788d0 msgr2=0x55d99837ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d9983788d0 0x55d99837ad60 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fccb00dd040 msgr2=0x7fccb00b37a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fccb00dd040 0x7fccb00b37a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d998381c50 msgr2=0x55d998384110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55d998381c50 0x55d998384110 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb84039a20 msgr2=0x7fcb8403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb84039a20 0x7fcb8403bee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fccb00033f0 tx=0x7fccb00da000 comp rx=0 tx=0).stop 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccb87dd640 1 -- 172.21.15.151:0/1433500752 reap_dead start 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 msgr2=0x55d99836d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.688+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d99836d5f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcca8017e10 tx=0x7fcca8050860 comp rx=0 tx=0).stop 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 shutdown_connections 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/1433500752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998367140 0x55d99836d5f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 >> 172.21.15.151:0/1433500752 conn(0x55d998362560 msgr2=0x55d998360770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 shutdown_connections 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/1433500752 wait complete. 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2744146454 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb90039a70 msgr2=0x7fcb9003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2744146454 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb90039a70 0x7fcb9003bf30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fccb00c1ba0 tx=0x7fccb00b6850 comp rx=0 tx=0).stop 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2744146454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9983597d0 msgr2=0x55d998359bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2744146454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9983597d0 0x55d998359bf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x55d998340ea0 tx=0x7fcca800af40 comp rx=0 tx=0).stop 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2744146454 shutdown_connections 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2744146454 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcb90039a70 0x7fcb9003bf30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2744146454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9983597d0 0x55d998359bf0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2744146454 >> 172.21.15.151:0/2744146454 conn(0x55d99834f180 msgr2=0x55d99834f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2744146454 shutdown_connections 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2744146454 wait complete. 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d9983486c0 msgr2=0x55d99834aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d9983486c0 0x55d99834aab0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d99824bfb0 msgr2=0x55d998345f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d99824bfb0 0x55d998345f00 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba0039a70 msgr2=0x7fcba003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba0039a70 0x7fcba003bf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fccac004180 tx=0x7fccac001340 comp rx=0 tx=0).stop 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 msgr2=0x55d99833ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d99833ede0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fccb0018c00 tx=0x7fccb0017d70 comp rx=0 tx=0).stop 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 shutdown_connections 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d9983486c0 0x55d99834aab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d99824bfb0 0x55d998345f00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcba0039a70 0x7fcba003bf30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 --2- 172.21.15.151:0/2456372200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d998248dd0 0x55d99833ede0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 >> 172.21.15.151:0/2456372200 conn(0x55d9982448f0 msgr2=0x55d99832daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 shutdown_connections 2024-09-12T16:53:18.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.692+0000 7fccbb4d89c0 1 -- 172.21.15.151:0/2456372200 wait complete. 2024-09-12T16:53:18.706 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T16:53:18.706 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:53:18.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-12T16:53:18.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-12T16:53:18.707 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-12T16:53:18.784 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:18.784 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:18.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f03568809c0 1 Processor -- start 2024-09-12T16:53:18.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f03568809c0 1 -- start start 2024-09-12T16:53:18.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f03568809c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56359430c0d0 0x56359430e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f03568809c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635941bc9c0 con 0x563594307f80 2024-09-12T16:53:18.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f03568809c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56359420c6d0 con 0x56359430c0d0 2024-09-12T16:53:18.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f0353b85640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56359430c0d0 0x56359430e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f0353b85640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56359430c0d0 0x56359430e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40260/0 (socket says 172.21.15.151:40260) 2024-09-12T16:53:18.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f0353b85640 1 -- 172.21.15.151:0/717837859 learned_addr learned my addr 172.21.15.151:0/717837859 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.780+0000 7f0354386640 1 --1- 172.21.15.151:0/717837859 >> v1:172.21.15.122:6789/0 conn(0x563594307f80 0x563594308360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:43198/0 (socket says 172.21.15.151:43198) 2024-09-12T16:53:18.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f0353b85640 1 -- 172.21.15.151:0/717837859 >> v1:172.21.15.122:6789/0 conn(0x563594307f80 legacy=0x563594308360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f0353b85640 1 -- 172.21.15.151:0/717837859 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635941b0ca0 con 0x56359430c0d0 2024-09-12T16:53:18.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f0353b85640 1 --2- 172.21.15.151:0/717837859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359430c0d0 0x56359430e4c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f033c00a5c0 tx=0x7f033c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60e7dbe6a8b8c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f0353384640 1 -- 172.21.15.151:0/717837859 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033c0a9590 con 0x56359430c0d0 2024-09-12T16:53:18.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f0353384640 1 -- 172.21.15.151:0/717837859 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0ae070 con 0x56359430c0d0 2024-09-12T16:53:18.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f0353384640 1 -- 172.21.15.151:0/717837859 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f033c0a9880 con 0x56359430c0d0 2024-09-12T16:53:18.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f03568809c0 1 -- 172.21.15.151:0/717837859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359430c0d0 msgr2=0x56359430e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f03568809c0 1 --2- 172.21.15.151:0/717837859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359430c0d0 0x56359430e4c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f033c00a5c0 tx=0x7f033c01b3d0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f03568809c0 1 -- 172.21.15.151:0/717837859 shutdown_connections 2024-09-12T16:53:18.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f03568809c0 1 --2- 172.21.15.151:0/717837859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359430c0d0 0x56359430e4c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f03568809c0 1 -- 172.21.15.151:0/717837859 >> 172.21.15.151:0/717837859 conn(0x563594303aa0 msgr2=0x563594305ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f03568809c0 1 -- 172.21.15.151:0/717837859 shutdown_connections 2024-09-12T16:53:18.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.784+0000 7f03568809c0 1 -- 172.21.15.151:0/717837859 wait complete. 2024-09-12T16:53:18.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.800+0000 7f03568809c0 1 Processor -- start 2024-09-12T16:53:18.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.800+0000 7f03568809c0 1 -- start start 2024-09-12T16:53:18.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.800+0000 7f03568809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943f3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.800+0000 7f03568809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563594210680 con 0x563594307f80 2024-09-12T16:53:18.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.800+0000 7f0354386640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.800+0000 7f0354386640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943f3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40272/0 (socket says 172.21.15.151:40272) 2024-09-12T16:53:18.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.800+0000 7f0354386640 1 -- 172.21.15.151:0/2099986701 learned_addr learned my addr 172.21.15.151:0/2099986701 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0354386640 1 -- 172.21.15.151:0/2099986701 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359418bda0 con 0x563594307f80 2024-09-12T16:53:18.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0354386640 1 --2- 172.21.15.151:0/2099986701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943f3720 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0344001680 tx=0x7f0344001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31b8aa73dec3dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f024260c640 1 -- 172.21.15.151:0/2099986701 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0344013420 con 0x563594307f80 2024-09-12T16:53:18.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f024260c640 1 -- 172.21.15.151:0/2099986701 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03440135c0 con 0x563594307f80 2024-09-12T16:53:18.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f024260c640 1 -- 172.21.15.151:0/2099986701 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03440138e0 con 0x563594307f80 2024-09-12T16:53:18.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- 172.21.15.151:0/2099986701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 msgr2=0x5635943f3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 --2- 172.21.15.151:0/2099986701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943f3720 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0344001680 tx=0x7f0344001b40 comp rx=0 tx=0).stop 2024-09-12T16:53:18.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- 172.21.15.151:0/2099986701 shutdown_connections 2024-09-12T16:53:18.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 --2- 172.21.15.151:0/2099986701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943f3720 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- 172.21.15.151:0/2099986701 >> 172.21.15.151:0/2099986701 conn(0x563594303aa0 msgr2=0x5635943ef360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- 172.21.15.151:0/2099986701 shutdown_connections 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- 172.21.15.151:0/2099986701 wait complete. 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 Processor -- start 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- start start 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635941b2a50 con 0x563594307f80 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0354386640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0354386640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943fadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40288/0 (socket says 172.21.15.151:40288) 2024-09-12T16:53:18.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0354386640 1 -- 172.21.15.151:0/651072520 learned_addr learned my addr 172.21.15.151:0/651072520 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0354386640 1 -- 172.21.15.151:0/651072520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635943fb320 con 0x563594307f80 2024-09-12T16:53:18.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0354386640 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943fadc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x5635943f46b0 tx=0x7f0344000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0240e09640 1 -- 172.21.15.151:0/651072520 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03440037a0 con 0x563594307f80 2024-09-12T16:53:18.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0240e09640 1 -- 172.21.15.151:0/651072520 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0344023070 con 0x563594307f80 2024-09-12T16:53:18.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635943fb5b0 con 0x563594307f80 2024-09-12T16:53:18.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f0240e09640 1 -- 172.21.15.151:0/651072520 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0344003ad0 con 0x563594307f80 2024-09-12T16:53:18.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.804+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635943fbf60 con 0x563594307f80 2024-09-12T16:53:18.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0240e09640 1 -- 172.21.15.151:0/651072520 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0344010070 con 0x563594307f80 2024-09-12T16:53:18.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0240e09640 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f023c039ac0 0x7f023c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0240e09640 1 -- 172.21.15.151:0/651072520 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f03440503b0 con 0x563594307f80 2024-09-12T16:53:18.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0353b85640 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f023c039ac0 0x7f023c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56359430c0d0 0x563594401f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594402470 con 0x56359430c0d0 2024-09-12T16:53:18.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0354b87640 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56359430c0d0 0x563594401f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0353b85640 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f023c039ac0 0x7f023c03bf80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f033c0ad000 tx=0x7f033c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0354b87640 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56359430c0d0 0x563594401f30 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0354b87640 1 -- 172.21.15.151:0/651072520 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f034c0083f0 con 0x56359430c0d0 2024-09-12T16:53:18.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635944028c0 con 0x56359430c0d0 2024-09-12T16:53:18.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0354b87640 1 -- 172.21.15.151:0/651072520 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f034c0083f0 con 0x56359430c0d0 2024-09-12T16:53:18.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635944046d0 0x563594406ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594407190 con 0x5635944046d0 2024-09-12T16:53:18.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0354386640 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635944046d0 0x563594406ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.808+0000 7f0354386640 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635944046d0 0x563594406ac0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0354386640 1 -- 172.21.15.151:0/651072520 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f034400f030 con 0x5635944046d0 2024-09-12T16:53:18.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594403540 con 0x56359430c0d0 2024-09-12T16:53:18.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0354b87640 1 -- 172.21.15.151:0/651072520 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f034c0083f0 con 0x56359430c0d0 2024-09-12T16:53:18.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635944039e0 con 0x56359430c0d0 2024-09-12T16:53:18.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0354b87640 1 -- 172.21.15.151:0/651072520 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f034c0083f0 con 0x56359430c0d0 2024-09-12T16:53:18.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f03568809c0 1 Processor -- start 2024-09-12T16:53:18.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f03568809c0 1 -- start start 2024-09-12T16:53:18.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f03568809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359427e470 0x56359427cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f03568809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56359421d450 con 0x56359427e470 2024-09-12T16:53:18.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0354b87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359427e470 0x56359427cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0354b87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359427e470 0x56359427cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40292/0 (socket says 172.21.15.151:40292) 2024-09-12T16:53:18.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0354b87640 1 -- 172.21.15.151:0/1812198612 learned_addr learned my addr 172.21.15.151:0/1812198612 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0354b87640 1 -- 172.21.15.151:0/1812198612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359427e990 con 0x56359427e470 2024-09-12T16:53:18.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0354b87640 1 --2- 172.21.15.151:0/1812198612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359427e470 0x56359427cd10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x5635943fcee0 tx=0x7f034c00af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0239ffb640 1 -- 172.21.15.151:0/1812198612 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034c007da0 con 0x56359427e470 2024-09-12T16:53:18.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0239ffb640 1 -- 172.21.15.151:0/1812198612 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034c01e020 con 0x56359427e470 2024-09-12T16:53:18.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f03568809c0 1 -- 172.21.15.151:0/1812198612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56359427d250 con 0x56359427e470 2024-09-12T16:53:18.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f0239ffb640 1 -- 172.21.15.151:0/1812198612 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034c019590 con 0x56359427e470 2024-09-12T16:53:18.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.812+0000 7f03568809c0 1 -- 172.21.15.151:0/1812198612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359427d7c0 con 0x56359427e470 2024-09-12T16:53:18.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0239ffb640 1 -- 172.21.15.151:0/1812198612 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f034c016040 con 0x56359427e470 2024-09-12T16:53:18.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0239ffb640 1 --2- 172.21.15.151:0/1812198612 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f022c039a70 0x7f022c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0239ffb640 1 -- 172.21.15.151:0/1812198612 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f034c01f030 con 0x56359427e470 2024-09-12T16:53:18.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0354386640 1 --2- 172.21.15.151:0/1812198612 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f022c039a70 0x7f022c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 Processor -- start 2024-09-12T16:53:18.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- start start 2024-09-12T16:53:18.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0354386640 1 --2- 172.21.15.151:0/1812198612 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f022c039a70 0x7f022c03bf30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f034401dfd0 tx=0x7f0344006340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x563594425750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635943f3f70 con 0x563594425370 2024-09-12T16:53:18.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0354b87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x563594425750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0354b87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x563594425750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40306/0 (socket says 172.21.15.151:40306) 2024-09-12T16:53:18.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0354b87640 1 -- 172.21.15.151:0/1648348695 learned_addr learned my addr 172.21.15.151:0/1648348695 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0354b87640 1 -- 172.21.15.151:0/1648348695 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563594425d40 con 0x563594425370 2024-09-12T16:53:18.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f0354b87640 1 --2- 172.21.15.151:0/1648348695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x563594425750 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f034c050990 tx=0x7f034c0234d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17186844aa69cc4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f02337fe640 1 -- 172.21.15.151:0/1648348695 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034c01d040 con 0x563594425370 2024-09-12T16:53:18.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f02337fe640 1 -- 172.21.15.151:0/1648348695 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034c0173b0 con 0x563594425370 2024-09-12T16:53:18.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f02337fe640 1 -- 172.21.15.151:0/1648348695 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034c015ce0 con 0x563594425370 2024-09-12T16:53:18.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- 172.21.15.151:0/1648348695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 msgr2=0x563594425750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 --2- 172.21.15.151:0/1648348695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x563594425750 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f034c050990 tx=0x7f034c0234d0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- 172.21.15.151:0/1648348695 shutdown_connections 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 --2- 172.21.15.151:0/1648348695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x563594425750 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- 172.21.15.151:0/1648348695 >> 172.21.15.151:0/1648348695 conn(0x563594420790 msgr2=0x56359441e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- 172.21.15.151:0/1648348695 shutdown_connections 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- 172.21.15.151:0/1648348695 wait complete. 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 Processor -- start 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- start start 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x56359442b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.816+0000 7f03568809c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635944242c0 con 0x563594425370 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0354b87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x56359442b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0354b87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x56359442b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40314/0 (socket says 172.21.15.151:40314) 2024-09-12T16:53:18.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 learned_addr learned my addr 172.21.15.151:0/566993476 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:18.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359442bdb0 con 0x563594425370 2024-09-12T16:53:18.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0354b87640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x56359442b850 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f034c04f860 tx=0x7f034c050920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0231ffb640 1 -- 172.21.15.151:0/566993476 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034c045070 con 0x563594425370 2024-09-12T16:53:18.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56359442c040 con 0x563594425370 2024-09-12T16:53:18.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0231ffb640 1 -- 172.21.15.151:0/566993476 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f034c0520d0 con 0x563594425370 2024-09-12T16:53:18.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0231ffb640 1 -- 172.21.15.151:0/566993476 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f034c01d050 con 0x563594425370 2024-09-12T16:53:18.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359442c040 con 0x563594425370 2024-09-12T16:53:18.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0231ffb640 1 -- 172.21.15.151:0/566993476 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f034c03e300 con 0x563594425370 2024-09-12T16:53:18.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0231ffb640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0224039a70 0x7f022403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0231ffb640 1 -- 172.21.15.151:0/566993476 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f034c038d40 con 0x563594425370 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0354386640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0224039a70 0x7f022403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563594436930 0x563594438dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594439510 con 0x563594436930 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0353b85640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563594436930 0x563594438dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0354386640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0224039a70 0x7f022403bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f034401da60 tx=0x7f0344050000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.820+0000 7f0353b85640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563594436930 0x563594438dc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 realm 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594439940 con 0x563594436930 2024-09-12T16:53:18.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56359443a210 con 0x563594436930 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56359443a5b0 con 0x563594436930 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56359443b310 0x56359443d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56359443dc40 con 0x56359443b310 2024-09-12T16:53:18.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0354b87640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56359443b310 0x56359443d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0354b87640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56359443b310 0x56359443d700 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f034c02a070 con 0x56359443b310 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 20 searching for the correct realm 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56359443fb70 0x563594442030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0354386640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56359443fb70 0x563594442030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0354386640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56359443fb70 0x563594442030 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0354386640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f03440417e0 0x7f034404e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x7f03440417e0 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0353b85640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f03440417e0 0x7f034404e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.824+0000 7f0353b85640 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f03440417e0 0x7f034404e780 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x563594436930 2024-09-12T16:53:18.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x563594436930 2024-09-12T16:53:18.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x7f03440417e0 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x563594436930 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.828+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x563594436930 2024-09-12T16:53:18.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x7f03440417e0 2024-09-12T16:53:18.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x563594436930 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x563594436930 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.832+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x7f03440417e0 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x563594436930 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x7f03440417e0 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443fb70 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.836+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x56359443b310 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x563594436930 2024-09-12T16:53:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563594442700 con 0x7f03440417e0 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56359443e590 con 0x563594436930 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56359443ea10 con 0x563594436930 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56359443ee30 con 0x563594436930 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 zone default found 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 4 Realm: () 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 zonegroup default 2024-09-12T16:53:18.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56359443ee30 con 0x56359443b310 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594444a20 con 0x56359443fb70 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594444dc0 con 0x56359443fb70 2024-09-12T16:53:18.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 started sync module instance, tier type = 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.840+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594443e60 con 0x7f03440417e0 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.844+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.844+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94788120757120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594443e60 con 0x7f03440417e0 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.844+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594445780 con 0x563594436930 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.844+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94788120757120] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.844+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.844+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94788120761312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594443e60 con 0x563594436930 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.844+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594446190 con 0x56359443fb70 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94788120761312] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94788120754608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594443dd0 con 0x56359443fb70 2024-09-12T16:53:18.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594446f20 con 0x7f03440417e0 2024-09-12T16:53:18.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94788120767024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944477c0 con 0x7f03440417e0 2024-09-12T16:53:18.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944481c0 con 0x563594436930 2024-09-12T16:53:18.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94788120754608] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.848+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94788120767024] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.852+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.852+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94788120765824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594447290 con 0x563594436930 2024-09-12T16:53:18.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.852+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594448a60 con 0x56359443b310 2024-09-12T16:53:18.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.852+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94788120765824] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.852+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.852+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94788120774064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594447290 con 0x56359443b310 2024-09-12T16:53:18.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.852+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944492b0 con 0x56359443b310 2024-09-12T16:53:18.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94788120774064] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94788120771792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944492b0 con 0x56359443b310 2024-09-12T16:53:18.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594449cd0 con 0x56359443b310 2024-09-12T16:53:18.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94788120778688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56359444a140 con 0x56359443b310 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 20 add_watcher() i=0 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 20 add_watcher() i=1 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 20 add_watcher() i=2 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 20 add_watcher() i=3 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 20 add_watcher() i=4 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 20 add_watcher() i=5 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94788120771792] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.856+0000 7f03568809c0 20 add_watcher() i=6 2024-09-12T16:53:18.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94788120778688] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 20 add_watcher() i=7 2024-09-12T16:53:18.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:18.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594448e00 con 0x563594436930 2024-09-12T16:53:18.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94788120776192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56359444a6c0 con 0x563594436930 2024-09-12T16:53:18.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94788120776192] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f020afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 5 note: GC not initialized 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f0209fe3640 20 reqs_thread_entry: start 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 20 Filter name: none 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f0202ffd640 20 reqs_thread_entry: start 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.860+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56359446fed0 con 0x563594436930 2024-09-12T16:53:18.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.864+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.864+0000 7f03568809c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:53:18.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.864+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563594471450 con 0x56359443b310 2024-09-12T16:53:18.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.864+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.864+0000 7f020afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:18.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.864+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94788120776192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56359446f7f0 con 0x563594436930 2024-09-12T16:53:18.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.864+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94788120776192] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.864+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94788120757120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594448e00 con 0x7f03440417e0 2024-09-12T16:53:18.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.868+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94788120757120] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.868+0000 7f03568809c0 20 remove_watcher() i=0 2024-09-12T16:53:18.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.868+0000 7f03568809c0 2 removed watcher, disabling cache 2024-09-12T16:53:18.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.868+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94788120761312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563594448e00 con 0x563594436930 2024-09-12T16:53:18.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.868+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94788120761312] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.868+0000 7f03568809c0 20 remove_watcher() i=1 2024-09-12T16:53:18.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.868+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94788120754608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944453e0 con 0x56359443fb70 2024-09-12T16:53:18.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.872+0000 7f0354386640 1 -- 172.21.15.151:0/566993476 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94788120754608] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034400f030 con 0x56359443fb70 2024-09-12T16:53:18.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.872+0000 7f03568809c0 20 remove_watcher() i=2 2024-09-12T16:53:18.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.872+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94788120767024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944439b0 con 0x7f03440417e0 2024-09-12T16:53:18.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.872+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94788120767024] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x7f03440417e0 2024-09-12T16:53:18.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.872+0000 7f03568809c0 20 remove_watcher() i=3 2024-09-12T16:53:18.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.872+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94788120765824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944439b0 con 0x563594436930 2024-09-12T16:53:18.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.876+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94788120765824] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f033c0a9990 con 0x563594436930 2024-09-12T16:53:18.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.876+0000 7f03568809c0 20 remove_watcher() i=4 2024-09-12T16:53:18.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.876+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94788120774064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944439b0 con 0x56359443b310 2024-09-12T16:53:18.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.876+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94788120774064] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.876+0000 7f03568809c0 20 remove_watcher() i=5 2024-09-12T16:53:18.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.876+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94788120771792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944439b0 con 0x56359443b310 2024-09-12T16:53:18.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94788120771792] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 20 remove_watcher() i=6 2024-09-12T16:53:18.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94788120778688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635944439b0 con 0x56359443b310 2024-09-12T16:53:18.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f0354b87640 1 -- 172.21.15.151:0/566993476 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94788120778688] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f034c05c040 con 0x56359443b310 2024-09-12T16:53:18.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 20 remove_watcher() i=7 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56359443b310 msgr2=0x56359443d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56359443b310 0x56359443d700 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563594436930 msgr2=0x563594438dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563594436930 0x563594438dc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f03440417e0 msgr2=0x7f034404e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f03440417e0 0x7f034404e780 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56359443fb70 msgr2=0x563594442030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56359443fb70 0x563594442030 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0224039a70 msgr2=0x7f022403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0224039a70 0x7f022403bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f034401da60 tx=0x7f0344050000 comp rx=0 tx=0).stop 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 msgr2=0x56359442b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f0353b85640 1 -- 172.21.15.151:0/566993476 reap_dead start 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x56359442b850 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f034c04f860 tx=0x7f034c050920 comp rx=0 tx=0).stop 2024-09-12T16:53:18.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 shutdown_connections 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/566993476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594425370 0x56359442b850 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 >> 172.21.15.151:0/566993476 conn(0x563594420790 msgr2=0x56359441e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 shutdown_connections 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/566993476 wait complete. 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/1812198612 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f022c039a70 msgr2=0x7f022c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/1812198612 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f022c039a70 0x7f022c03bf30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f034401dfd0 tx=0x7f0344006340 comp rx=0 tx=0).stop 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/1812198612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359427e470 msgr2=0x56359427cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/1812198612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359427e470 0x56359427cd10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x5635943fcee0 tx=0x7f034c00af20 comp rx=0 tx=0).stop 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/1812198612 shutdown_connections 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/1812198612 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f022c039a70 0x7f022c03bf30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 --2- 172.21.15.151:0/1812198612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56359427e470 0x56359427cd10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/1812198612 >> 172.21.15.151:0/1812198612 conn(0x56359440b190 msgr2=0x56359440b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/1812198612 shutdown_connections 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.880+0000 7f03568809c0 1 -- 172.21.15.151:0/1812198612 wait complete. 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635944046d0 msgr2=0x563594406ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635944046d0 0x563594406ac0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56359430c0d0 msgr2=0x563594401f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56359430c0d0 0x563594401f30 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f023c039ac0 msgr2=0x7f023c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f023c039ac0 0x7f023c03bf80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f033c0ad000 tx=0x7f033c0a6000 comp rx=0 tx=0).stop 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 msgr2=0x5635943fadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943fadc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x5635943f46b0 tx=0x7f0344000f50 comp rx=0 tx=0).stop 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 shutdown_connections 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635944046d0 0x563594406ac0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56359430c0d0 0x563594401f30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f023c039ac0 0x7f023c03bf80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 --2- 172.21.15.151:0/651072520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563594307f80 0x5635943fadc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 >> 172.21.15.151:0/651072520 conn(0x563594303aa0 msgr2=0x5635943eddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 shutdown_connections 2024-09-12T16:53:18.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.884+0000 7f03568809c0 1 -- 172.21.15.151:0/651072520 wait complete. 2024-09-12T16:53:18.897 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T16:53:18.897 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:53:18.898 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-12T16:53:18.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-12T16:53:18.898 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-12T16:53:18.980 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:18.981 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:18.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.976+0000 7f685ef859c0 1 Processor -- start 2024-09-12T16:53:18.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.976+0000 7f685ef859c0 1 -- start start 2024-09-12T16:53:18.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.976+0000 7f685ef859c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55b27abf8300 0x55b27abfa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:18.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.976+0000 7f685ef859c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b27aaa89c0 con 0x55b27ab68230 2024-09-12T16:53:18.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.976+0000 7f685ef859c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55b27aaf86d0 con 0x55b27abf8300 2024-09-12T16:53:18.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685c28a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55b27abf8300 0x55b27abfa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:18.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685ca8b640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55b27ab68230 0x55b27abf6be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:43200/0 (socket says 172.21.15.151:43200) 2024-09-12T16:53:18.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685ca8b640 1 -- 172.21.15.151:0/297537044 learned_addr learned my addr 172.21.15.151:0/297537044 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:53:18.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685c28a640 1 -- 172.21.15.151:0/297537044 >> v1:172.21.15.122:6789/0 conn(0x55b27ab68230 legacy=0x55b27abf6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685c28a640 1 -- 172.21.15.151:0/297537044 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b27aa9cca0 con 0x55b27abf8300 2024-09-12T16:53:18.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685c28a640 1 --2- 172.21.15.151:0/297537044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27abf8300 0x55b27abfa6f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f685000a480 tx=0x7f685001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3641bd3e52d86a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:18.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685ba89640 1 -- 172.21.15.151:0/297537044 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68500af070 con 0x55b27abf8300 2024-09-12T16:53:18.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685ba89640 1 -- 172.21.15.151:0/297537044 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68500aa530 con 0x55b27abf8300 2024-09-12T16:53:18.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685ba89640 1 -- 172.21.15.151:0/297537044 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68500aa830 con 0x55b27abf8300 2024-09-12T16:53:18.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.980+0000 7f685ef859c0 1 -- 172.21.15.151:0/297537044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27abf8300 msgr2=0x55b27abfa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:18.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.984+0000 7f685ef859c0 1 --2- 172.21.15.151:0/297537044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27abf8300 0x55b27abfa6f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f685000a480 tx=0x7f685001b280 comp rx=0 tx=0).stop 2024-09-12T16:53:18.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.984+0000 7f685ef859c0 1 -- 172.21.15.151:0/297537044 shutdown_connections 2024-09-12T16:53:18.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.984+0000 7f685ef859c0 1 --2- 172.21.15.151:0/297537044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27abf8300 0x55b27abfa6f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:18.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.984+0000 7f685ef859c0 1 -- 172.21.15.151:0/297537044 >> 172.21.15.151:0/297537044 conn(0x55b27abee910 msgr2=0x55b27abf0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:18.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.984+0000 7f685ef859c0 1 -- 172.21.15.151:0/297537044 shutdown_connections 2024-09-12T16:53:18.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.984+0000 7f685ef859c0 1 -- 172.21.15.151:0/297537044 wait complete. 2024-09-12T16:53:19.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.996+0000 7f685ef859c0 1 Processor -- start 2024-09-12T16:53:19.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:18.996+0000 7f685ef859c0 1 -- start start 2024-09-12T16:53:19.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27acdf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b27aafc680 con 0x55b27ab68230 2024-09-12T16:53:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27acdf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27acdf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40324/0 (socket says 172.21.15.151:40324) 2024-09-12T16:53:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 -- 172.21.15.151:0/994168641 learned_addr learned my addr 172.21.15.151:0/994168641 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 -- 172.21.15.151:0/994168641 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b27aa77da0 con 0x55b27ab68230 2024-09-12T16:53:19.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 --2- 172.21.15.151:0/994168641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27acdf9b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f684c001e00 tx=0x7f684c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62693ee9cd9f592f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f674ae0d640 1 -- 172.21.15.151:0/994168641 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f684c012020 con 0x55b27ab68230 2024-09-12T16:53:19.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f674ae0d640 1 -- 172.21.15.151:0/994168641 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684c00e690 con 0x55b27ab68230 2024-09-12T16:53:19.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f674ae0d640 1 -- 172.21.15.151:0/994168641 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f684c00ea10 con 0x55b27ab68230 2024-09-12T16:53:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 -- 172.21.15.151:0/994168641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 msgr2=0x55b27acdf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 --2- 172.21.15.151:0/994168641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27acdf9b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f684c001e00 tx=0x7f684c00b6d0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 -- 172.21.15.151:0/994168641 shutdown_connections 2024-09-12T16:53:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 --2- 172.21.15.151:0/994168641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27acdf9b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 -- 172.21.15.151:0/994168641 >> 172.21.15.151:0/994168641 conn(0x55b27abee910 msgr2=0x55b27acdb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 -- 172.21.15.151:0/994168641 shutdown_connections 2024-09-12T16:53:19.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 -- 172.21.15.151:0/994168641 wait complete. 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 Processor -- start 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 -- start start 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27abf42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ef859c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b27aa9ea50 con 0x55b27ab68230 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27abf42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27abf42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40332/0 (socket says 172.21.15.151:40332) 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 -- 172.21.15.151:0/3742956850 learned_addr learned my addr 172.21.15.151:0/3742956850 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.000+0000 7f685ca8b640 1 -- 172.21.15.151:0/3742956850 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b27abf4820 con 0x55b27ab68230 2024-09-12T16:53:19.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27abf42c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x55b27ace0940 tx=0x7f684c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f674960a640 1 -- 172.21.15.151:0/3742956850 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f684c012030 con 0x55b27ab68230 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f674960a640 1 -- 172.21.15.151:0/3742956850 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684c01a750 con 0x55b27ab68230 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b27abf2c00 con 0x55b27ab68230 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f674960a640 1 -- 172.21.15.151:0/3742956850 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f684c01aa50 con 0x55b27ab68230 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b27abf3190 con 0x55b27ab68230 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f674960a640 1 -- 172.21.15.151:0/3742956850 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f684c015020 con 0x55b27ab68230 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f674960a640 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039a70 0x7f674403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f674960a640 1 -- 172.21.15.151:0/3742956850 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f684c020030 con 0x55b27ab68230 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685c28a640 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039a70 0x7f674403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27acee450 0x55b27acf0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27acf0d80 con 0x55b27acee450 2024-09-12T16:53:19.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685d28c640 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27acee450 0x55b27acf0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685c28a640 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039a70 0x7f674403bf30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f68500ac000 tx=0x7f68500a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685d28c640 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27acee450 0x55b27acf0840 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685d28c640 1 -- 172.21.15.151:0/3742956850 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f685400a4d0 con 0x55b27acee450 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27acf1160 con 0x55b27acee450 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685d28c640 1 -- 172.21.15.151:0/3742956850 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f685400a4d0 con 0x55b27acee450 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27acf2f70 0x55b27acf5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.004+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27acf5a30 con 0x55b27acf2f70 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27acf2f70 0x55b27acf5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27acf2f70 0x55b27acf5360 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ca8b640 1 -- 172.21.15.151:0/3742956850 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f684c008030 con 0x55b27acf2f70 2024-09-12T16:53:19.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27acf1de0 con 0x55b27acee450 2024-09-12T16:53:19.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685d28c640 1 -- 172.21.15.151:0/3742956850 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f685400a4d0 con 0x55b27acee450 2024-09-12T16:53:19.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27acf2280 con 0x55b27acee450 2024-09-12T16:53:19.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685d28c640 1 -- 172.21.15.151:0/3742956850 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f685400a4d0 con 0x55b27acee450 2024-09-12T16:53:19.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ef859c0 1 Processor -- start 2024-09-12T16:53:19.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ef859c0 1 -- start start 2024-09-12T16:53:19.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ef859c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad04080 0x55b27ad044a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.008+0000 7f685ef859c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b27ab09450 con 0x55b27ad04080 2024-09-12T16:53:19.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f685d28c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad04080 0x55b27ad044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f685d28c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad04080 0x55b27ad044a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40348/0 (socket says 172.21.15.151:40348) 2024-09-12T16:53:19.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f685d28c640 1 -- 172.21.15.151:0/3257027244 learned_addr learned my addr 172.21.15.151:0/3257027244 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f685d28c640 1 -- 172.21.15.151:0/3257027244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b27ad04ae0 con 0x55b27ad04080 2024-09-12T16:53:19.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f685d28c640 1 --2- 172.21.15.151:0/3257027244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad04080 0x55b27ad044a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55b27abf3e90 tx=0x7f6854018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f67427fc640 1 -- 172.21.15.151:0/3257027244 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6854014450 con 0x55b27ad04080 2024-09-12T16:53:19.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f67427fc640 1 -- 172.21.15.151:0/3257027244 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68540145f0 con 0x55b27ad04080 2024-09-12T16:53:19.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f67427fc640 1 -- 172.21.15.151:0/3257027244 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68540148f0 con 0x55b27ad04080 2024-09-12T16:53:19.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f685ef859c0 1 -- 172.21.15.151:0/3257027244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b27ad05340 con 0x55b27ad04080 2024-09-12T16:53:19.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.012+0000 7f685ef859c0 1 -- 172.21.15.151:0/3257027244 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b27ad058b0 con 0x55b27ad04080 2024-09-12T16:53:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f67427fc640 1 -- 172.21.15.151:0/3257027244 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6854011040 con 0x55b27ad04080 2024-09-12T16:53:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f67427fc640 1 --2- 172.21.15.151:0/3257027244 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6734039ac0 0x7f673403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f67427fc640 1 -- 172.21.15.151:0/3257027244 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f685401e070 con 0x55b27ad04080 2024-09-12T16:53:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3257027244 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6734039ac0 0x7f673403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685ef859c0 1 Processor -- start 2024-09-12T16:53:19.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685ef859c0 1 -- start start 2024-09-12T16:53:19.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3257027244 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6734039ac0 0x7f673403bf80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f684c001560 tx=0x7f684c02c950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685ef859c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad11d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685ef859c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b27ace0200 con 0x55b27ad11950 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685d28c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad11d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685d28c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad11d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40362/0 (socket says 172.21.15.151:40362) 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685d28c640 1 -- 172.21.15.151:0/1790582896 learned_addr learned my addr 172.21.15.151:0/1790582896 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685d28c640 1 -- 172.21.15.151:0/1790582896 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b27ad12340 con 0x55b27ad11950 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f685d28c640 1 --2- 172.21.15.151:0/1790582896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad11d50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6854016fd0 tx=0x7f68540118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfed2150129b48f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f6733fff640 1 -- 172.21.15.151:0/1790582896 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f685404f2a0 con 0x55b27ad11950 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f6733fff640 1 -- 172.21.15.151:0/1790582896 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6854011c00 con 0x55b27ad11950 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.016+0000 7f6733fff640 1 -- 172.21.15.151:0/1790582896 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68540495a0 con 0x55b27ad11950 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- 172.21.15.151:0/1790582896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 msgr2=0x55b27ad11d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 --2- 172.21.15.151:0/1790582896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad11d50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6854016fd0 tx=0x7f68540118e0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- 172.21.15.151:0/1790582896 shutdown_connections 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 --2- 172.21.15.151:0/1790582896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad11d50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- 172.21.15.151:0/1790582896 >> 172.21.15.151:0/1790582896 conn(0x55b27ad0cd70 msgr2=0x55b27ad0afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- 172.21.15.151:0/1790582896 shutdown_connections 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- 172.21.15.151:0/1790582896 wait complete. 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 Processor -- start 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- start start 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad17e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b27ad108a0 con 0x55b27ad11950 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685d28c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad17e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685d28c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad17e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40364/0 (socket says 172.21.15.151:40364) 2024-09-12T16:53:19.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 learned_addr learned my addr 172.21.15.151:0/3302368204 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b27ad18380 con 0x55b27ad11950 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685d28c640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad17e20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f685404b010 tx=0x7f6854050660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f67327fc640 1 -- 172.21.15.151:0/3302368204 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6854050810 con 0x55b27ad11950 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f67327fc640 1 -- 172.21.15.151:0/3302368204 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68540509b0 con 0x55b27ad11950 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b27ad18610 con 0x55b27ad11950 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f67327fc640 1 -- 172.21.15.151:0/3302368204 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6854050c90 con 0x55b27ad11950 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b27ad18fc0 con 0x55b27ad11950 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f67327fc640 1 -- 172.21.15.151:0/3302368204 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f685403e3f0 con 0x55b27ad11950 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f67327fc640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6728039a70 0x7f672803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.020+0000 7f67327fc640 1 -- 172.21.15.151:0/3302368204 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6854048050 con 0x55b27ad11950 2024-09-12T16:53:19.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6728039a70 0x7f672803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27ad23130 0x55b27ad255c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad25d10 con 0x55b27ad23130 2024-09-12T16:53:19.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685c28a640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27ad23130 0x55b27ad255c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6728039a70 0x7f672803bf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55b27acf5e10 tx=0x7f684c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685c28a640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27ad23130 0x55b27ad255c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 realm 2024-09-12T16:53:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad26140 con 0x55b27ad23130 2024-09-12T16:53:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:19.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad26a10 con 0x55b27ad23130 2024-09-12T16:53:19.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad26db0 con 0x55b27ad23130 2024-09-12T16:53:19.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27ad27b10 0x55b27ad29f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2a440 con 0x55b27ad27b10 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685d28c640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27ad27b10 0x55b27ad29f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.024+0000 7f685d28c640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27ad27b10 0x55b27ad29f00 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ef859c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ef859c0 20 searching for the correct realm 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b27ad2c390 0x55b27ad2e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b27ad2c390 0x55b27ad2e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b27ad2c390 0x55b27ad2e850 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ca8b640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f684c017050 0x7f684c04d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x7f684c017050 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685c28a640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f684c017050 0x7f684c04d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685c28a640 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f684c017050 0x7f684c04d3b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad23130 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad23130 2024-09-12T16:53:19.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.028+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x7f684c017050 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad23130 2024-09-12T16:53:19.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad23130 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x7f684c017050 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.032+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad23130 2024-09-12T16:53:19.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad23130 2024-09-12T16:53:19.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x7f684c017050 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad23130 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.036+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x7f684c017050 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad2c390 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad27b10 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x55b27ad23130 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ef20 con 0x7f684c017050 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2ad90 con 0x55b27ad23130 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2b1e0 con 0x55b27ad23130 2024-09-12T16:53:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2b680 con 0x55b27ad23130 2024-09-12T16:53:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:19.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 zone default found 2024-09-12T16:53:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 4 Realm: () 2024-09-12T16:53:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 zonegroup default 2024-09-12T16:53:19.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.040+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad2f3a0 con 0x55b27ad27b10 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad312c0 con 0x55b27ad2c390 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad31760 con 0x55b27ad2c390 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 20 started sync module instance, tier type = 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad305d0 con 0x7f684c017050 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94225053190928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad305d0 con 0x7f684c017050 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad322e0 con 0x55b27ad23130 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.044+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94225053190928] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.048+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.048+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94225053195696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad305d0 con 0x55b27ad23130 2024-09-12T16:53:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.048+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad32cf0 con 0x55b27ad2c390 2024-09-12T16:53:19.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.048+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94225053195696] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.048+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.048+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94225053188384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad30540 con 0x55b27ad2c390 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.048+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad339f0 con 0x7f684c017050 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.052+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.052+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94225053202000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad340a0 con 0x7f684c017050 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.052+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad34ba0 con 0x55b27ad23130 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.052+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94225053188384] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.052+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94225053202000] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.052+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.052+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94225053206160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad34b60 con 0x55b27ad23130 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.052+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad34fc0 con 0x55b27ad27b10 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.056+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.056+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94225053203184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad35860 con 0x55b27ad27b10 2024-09-12T16:53:19.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.056+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad36220 con 0x55b27ad27b10 2024-09-12T16:53:19.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.056+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94225053206160] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.056+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94225053203184] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.056+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.056+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94225053209520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad357d0 con 0x55b27ad27b10 2024-09-12T16:53:19.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.056+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad366d0 con 0x55b27ad27b10 2024-09-12T16:53:19.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94225053213216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad36b30 con 0x55b27ad27b10 2024-09-12T16:53:19.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 20 add_watcher() i=0 2024-09-12T16:53:19.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 20 add_watcher() i=1 2024-09-12T16:53:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 20 add_watcher() i=2 2024-09-12T16:53:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 20 add_watcher() i=3 2024-09-12T16:53:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 20 add_watcher() i=4 2024-09-12T16:53:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 20 add_watcher() i=5 2024-09-12T16:53:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94225053209520] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 20 add_watcher() i=6 2024-09-12T16:53:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94225053213216] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 20 add_watcher() i=7 2024-09-12T16:53:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad35d70 con 0x55b27ad23130 2024-09-12T16:53:19.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.060+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94225053212016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad37050 con 0x55b27ad23130 2024-09-12T16:53:19.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94225053212016] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f6712fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 5 note: GC not initialized 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f6711fe3640 20 reqs_thread_entry: start 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 20 Filter name: none 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f66837fe640 20 reqs_thread_entry: start 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad5c8b0 con 0x55b27ad23130 2024-09-12T16:53:19.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:53:19.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad5de30 con 0x55b27ad27b10 2024-09-12T16:53:19.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f6712fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.064+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94225053212016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad5c1d0 con 0x55b27ad23130 2024-09-12T16:53:19.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.068+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94225053212016] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.068+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94225053190928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad35d70 con 0x7f684c017050 2024-09-12T16:53:19.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.068+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94225053190928] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.068+0000 7f685ef859c0 20 remove_watcher() i=0 2024-09-12T16:53:19.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.068+0000 7f685ef859c0 2 removed watcher, disabling cache 2024-09-12T16:53:19.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.068+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94225053195696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad35d70 con 0x55b27ad23130 2024-09-12T16:53:19.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.072+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94225053195696] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.072+0000 7f685ef859c0 20 remove_watcher() i=1 2024-09-12T16:53:19.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.072+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94225053188384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad31db0 con 0x55b27ad2c390 2024-09-12T16:53:19.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.072+0000 7f685ca8b640 1 -- 172.21.15.151:0/3302368204 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94225053188384] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f684c008030 con 0x55b27ad2c390 2024-09-12T16:53:19.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.072+0000 7f685ef859c0 20 remove_watcher() i=2 2024-09-12T16:53:19.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.072+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94225053202000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad30120 con 0x7f684c017050 2024-09-12T16:53:19.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.076+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94225053202000] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x7f684c017050 2024-09-12T16:53:19.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.076+0000 7f685ef859c0 20 remove_watcher() i=3 2024-09-12T16:53:19.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.076+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94225053206160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad30120 con 0x55b27ad23130 2024-09-12T16:53:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.076+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94225053206160] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68500a8070 con 0x55b27ad23130 2024-09-12T16:53:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.076+0000 7f685ef859c0 20 remove_watcher() i=4 2024-09-12T16:53:19.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.076+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94225053203184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad34690 con 0x55b27ad27b10 2024-09-12T16:53:19.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.080+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94225053203184] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.080+0000 7f685ef859c0 20 remove_watcher() i=5 2024-09-12T16:53:19.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.080+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94225053209520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad30120 con 0x55b27ad27b10 2024-09-12T16:53:19.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.080+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94225053209520] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.080+0000 7f685ef859c0 20 remove_watcher() i=6 2024-09-12T16:53:19.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.080+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94225053213216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b27ad34690 con 0x55b27ad27b10 2024-09-12T16:53:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685d28c640 1 -- 172.21.15.151:0/3302368204 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94225053213216] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a070 con 0x55b27ad27b10 2024-09-12T16:53:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 20 remove_watcher() i=7 2024-09-12T16:53:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27ad27b10 msgr2=0x55b27ad29f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27ad27b10 0x55b27ad29f00 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27ad23130 msgr2=0x55b27ad255c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27ad23130 0x55b27ad255c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f684c017050 msgr2=0x7f684c04d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f684c017050 0x7f684c04d3b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b27ad2c390 msgr2=0x55b27ad2e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55b27ad2c390 0x55b27ad2e850 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6728039a70 msgr2=0x7f672803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6728039a70 0x7f672803bf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55b27acf5e10 tx=0x7f684c02f000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 msgr2=0x55b27ad17e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685c28a640 1 -- 172.21.15.151:0/3302368204 reap_dead start 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad17e20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f685404b010 tx=0x7f6854050660 comp rx=0 tx=0).stop 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 shutdown_connections 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3302368204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad11950 0x55b27ad17e20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 >> 172.21.15.151:0/3302368204 conn(0x55b27ad0cd70 msgr2=0x55b27ad0af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 shutdown_connections 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3302368204 wait complete. 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3257027244 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6734039ac0 msgr2=0x7f673403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3257027244 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6734039ac0 0x7f673403bf80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f684c001560 tx=0x7f684c02c950 comp rx=0 tx=0).stop 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3257027244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad04080 msgr2=0x55b27ad044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3257027244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad04080 0x55b27ad044a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55b27abf3e90 tx=0x7f6854018830 comp rx=0 tx=0).stop 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3257027244 shutdown_connections 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3257027244 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6734039ac0 0x7f673403bf80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3257027244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ad04080 0x55b27ad044a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3257027244 >> 172.21.15.151:0/3257027244 conn(0x55b27acf9a30 msgr2=0x55b27acf9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3257027244 shutdown_connections 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3257027244 wait complete. 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27acf2f70 msgr2=0x55b27acf5360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27acf2f70 0x55b27acf5360 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27acee450 msgr2=0x55b27acf0840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27acee450 0x55b27acf0840 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039a70 msgr2=0x7f674403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039a70 0x7f674403bf30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f68500ac000 tx=0x7f68500a5000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 msgr2=0x55b27abf42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27abf42c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x55b27ace0940 tx=0x7f684c000bd0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 shutdown_connections 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55b27acf2f70 0x55b27acf5360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55b27acee450 0x55b27acf0840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039a70 0x7f674403bf30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 --2- 172.21.15.151:0/3742956850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b27ab68230 0x55b27abf42c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 >> 172.21.15.151:0/3742956850 conn(0x55b27abee910 msgr2=0x55b27acd9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 shutdown_connections 2024-09-12T16:53:19.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.084+0000 7f685ef859c0 1 -- 172.21.15.151:0/3742956850 wait complete. 2024-09-12T16:53:19.100 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T16:53:19.100 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:53:19.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-12T16:53:19.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-12T16:53:19.100 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-12T16:53:19.184 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:19.184 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:19.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.180+0000 7f08336ff9c0 1 Processor -- start 2024-09-12T16:53:19.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.180+0000 7f08336ff9c0 1 -- start start 2024-09-12T16:53:19.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.180+0000 7f08336ff9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563695b03340 0x563695b05730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.180+0000 7f08336ff9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5636959b39c0 con 0x563695a731f0 2024-09-12T16:53:19.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.180+0000 7f08336ff9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x563695a036d0 con 0x563695b03340 2024-09-12T16:53:19.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.180+0000 7f0830a04640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563695b03340 0x563695b05730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.180+0000 7f0830a04640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563695b03340 0x563695b05730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40368/0 (socket says 172.21.15.151:40368) 2024-09-12T16:53:19.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.180+0000 7f0830a04640 1 -- 172.21.15.151:0/1744316898 learned_addr learned my addr 172.21.15.151:0/1744316898 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f0830a04640 1 -- 172.21.15.151:0/1744316898 >> v1:172.21.15.122:6789/0 conn(0x563695a731f0 legacy=0x563695b01c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f0830a04640 1 -- 172.21.15.151:0/1744316898 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636959a7ca0 con 0x563695b03340 2024-09-12T16:53:19.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f0830a04640 1 --2- 172.21.15.151:0/1744316898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695b03340 0x563695b05730 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f082800a5c0 tx=0x7f082801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21c377aec8ebe71 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f0823fff640 1 -- 172.21.15.151:0/1744316898 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08280b1070 con 0x563695b03340 2024-09-12T16:53:19.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f0823fff640 1 -- 172.21.15.151:0/1744316898 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08280a8070 con 0x563695b03340 2024-09-12T16:53:19.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f0823fff640 1 -- 172.21.15.151:0/1744316898 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08280ac5b0 con 0x563695b03340 2024-09-12T16:53:19.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1744316898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695b03340 msgr2=0x563695b05730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1744316898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695b03340 0x563695b05730 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f082800a5c0 tx=0x7f082801b340 comp rx=0 tx=0).stop 2024-09-12T16:53:19.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1744316898 shutdown_connections 2024-09-12T16:53:19.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1744316898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695b03340 0x563695b05730 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1744316898 >> 172.21.15.151:0/1744316898 conn(0x563695af9910 msgr2=0x563695afbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1744316898 shutdown_connections 2024-09-12T16:53:19.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.184+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1744316898 wait complete. 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 Processor -- start 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 -- start start 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bea840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563695a07680 con 0x563695a731f0 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f0831205640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f0831205640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bea840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40382/0 (socket says 172.21.15.151:40382) 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f0831205640 1 -- 172.21.15.151:0/1934156324 learned_addr learned my addr 172.21.15.151:0/1934156324 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f0831205640 1 -- 172.21.15.151:0/1934156324 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563695982da0 con 0x563695a731f0 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f0831205640 1 --2- 172.21.15.151:0/1934156324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bea840 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f082400b2d0 tx=0x7f082400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900724e9c9f6c8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f071f606640 1 -- 172.21.15.151:0/1934156324 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082400a040 con 0x563695a731f0 2024-09-12T16:53:19.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f071f606640 1 -- 172.21.15.151:0/1934156324 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082400f750 con 0x563695a731f0 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f071f606640 1 -- 172.21.15.151:0/1934156324 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082400fa70 con 0x563695a731f0 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1934156324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 msgr2=0x563695bea840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1934156324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bea840 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f082400b2d0 tx=0x7f082400b790 comp rx=0 tx=0).stop 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1934156324 shutdown_connections 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1934156324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bea840 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1934156324 >> 172.21.15.151:0/1934156324 conn(0x563695af9910 msgr2=0x563695be6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1934156324 shutdown_connections 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1934156324 wait complete. 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 Processor -- start 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 -- start start 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.204+0000 7f08336ff9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bf1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f08336ff9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5636959a9a50 con 0x563695a731f0 2024-09-12T16:53:19.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f0831205640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bf1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f0831205640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bf1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40386/0 (socket says 172.21.15.151:40386) 2024-09-12T16:53:19.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f0831205640 1 -- 172.21.15.151:0/1799482087 learned_addr learned my addr 172.21.15.151:0/1799482087 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f0831205640 1 -- 172.21.15.151:0/1799482087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563695bf2470 con 0x563695a731f0 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f0831205640 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bf1f10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0824000c10 tx=0x7f0824000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f071de03640 1 -- 172.21.15.151:0/1799482087 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082401c9f0 con 0x563695a731f0 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563695bf2700 con 0x563695a731f0 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f071de03640 1 -- 172.21.15.151:0/1799482087 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082401cb90 con 0x563695a731f0 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f071de03640 1 -- 172.21.15.151:0/1799482087 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082401a480 con 0x563695a731f0 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563695bf30b0 con 0x563695a731f0 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f071de03640 1 -- 172.21.15.151:0/1799482087 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0824017050 con 0x563695a731f0 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f071de03640 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0718039a70 0x7f071803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f071de03640 1 -- 172.21.15.151:0/1799482087 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0824015020 con 0x563695a731f0 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f0830a04640 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0718039a70 0x7f071803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695b03340 0x563695bf9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695bf95c0 con 0x563695b03340 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f0831a06640 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695b03340 0x563695bf9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.208+0000 7f0830a04640 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0718039a70 0x7f071803bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f08280ae000 tx=0x7f08280a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f0831a06640 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695b03340 0x563695bf9080 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f0831a06640 1 -- 172.21.15.151:0/1799482087 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f082c00a4d0 con 0x563695b03340 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695bf3410 con 0x563695b03340 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f0831a06640 1 -- 172.21.15.151:0/1799482087 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f082c00a4d0 con 0x563695b03340 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695bfb8b0 0x563695bfdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695bfe3e0 con 0x563695bfb8b0 2024-09-12T16:53:19.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f0831205640 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695bfb8b0 0x563695bfdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f0831205640 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695bfb8b0 0x563695bfdca0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f0831205640 1 -- 172.21.15.151:0/1799482087 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f082402e070 con 0x563695bfb8b0 2024-09-12T16:53:19.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695bfa750 con 0x563695b03340 2024-09-12T16:53:19.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f0831a06640 1 -- 172.21.15.151:0/1799482087 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f082c00a4d0 con 0x563695b03340 2024-09-12T16:53:19.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695bfab40 con 0x563695b03340 2024-09-12T16:53:19.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f0831a06640 1 -- 172.21.15.151:0/1799482087 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f082c00a4d0 con 0x563695b03340 2024-09-12T16:53:19.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f08336ff9c0 1 Processor -- start 2024-09-12T16:53:19.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.212+0000 7f08336ff9c0 1 -- start start 2024-09-12T16:53:19.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f08336ff9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695aff380 0x563695afdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f08336ff9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563695a14450 con 0x563695aff380 2024-09-12T16:53:19.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0831a06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695aff380 0x563695afdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0831a06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695aff380 0x563695afdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40398/0 (socket says 172.21.15.151:40398) 2024-09-12T16:53:19.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0831a06640 1 -- 172.21.15.151:0/425503007 learned_addr learned my addr 172.21.15.151:0/425503007 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0831a06640 1 -- 172.21.15.151:0/425503007 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563695aff8a0 con 0x563695aff380 2024-09-12T16:53:19.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0831a06640 1 --2- 172.21.15.151:0/425503007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695aff380 0x563695afdc20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x563695bf32a0 tx=0x7f082c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0716ffd640 1 -- 172.21.15.151:0/425503007 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082c014450 con 0x563695aff380 2024-09-12T16:53:19.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0716ffd640 1 -- 172.21.15.151:0/425503007 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c0145f0 con 0x563695aff380 2024-09-12T16:53:19.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f08336ff9c0 1 -- 172.21.15.151:0/425503007 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563695afe160 con 0x563695aff380 2024-09-12T16:53:19.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0716ffd640 1 -- 172.21.15.151:0/425503007 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082c014910 con 0x563695aff380 2024-09-12T16:53:19.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f08336ff9c0 1 -- 172.21.15.151:0/425503007 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563695afe6d0 con 0x563695aff380 2024-09-12T16:53:19.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0716ffd640 1 -- 172.21.15.151:0/425503007 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f082c011040 con 0x563695aff380 2024-09-12T16:53:19.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0716ffd640 1 --2- 172.21.15.151:0/425503007 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0708039ac0 0x7f070803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0716ffd640 1 -- 172.21.15.151:0/425503007 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f082c01e070 con 0x563695aff380 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0831205640 1 --2- 172.21.15.151:0/425503007 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0708039ac0 0x7f070803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f08336ff9c0 1 Processor -- start 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f08336ff9c0 1 -- start start 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f0831205640 1 --2- 172.21.15.151:0/425503007 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0708039ac0 0x7f070803bf80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x563695bf9a20 tx=0x7f082404ed20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f08336ff9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c1c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.216+0000 7f08336ff9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563695beb090 con 0x563695c1c4d0 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c1c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c1c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40412/0 (socket says 172.21.15.151:40412) 2024-09-12T16:53:19.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 -- 172.21.15.151:0/307384924 learned_addr learned my addr 172.21.15.151:0/307384924 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 -- 172.21.15.151:0/307384924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563695c1cec0 con 0x563695c1c4d0 2024-09-12T16:53:19.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 --2- 172.21.15.151:0/307384924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c1c8d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f082c013010 tx=0x7f082c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f54139af45f054 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0714ff9640 1 -- 172.21.15.151:0/307384924 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082c028070 con 0x563695c1c4d0 2024-09-12T16:53:19.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0714ff9640 1 -- 172.21.15.151:0/307384924 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c022dc0 con 0x563695c1c4d0 2024-09-12T16:53:19.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0714ff9640 1 -- 172.21.15.151:0/307384924 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082c02b350 con 0x563695c1c4d0 2024-09-12T16:53:19.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 -- 172.21.15.151:0/307384924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 msgr2=0x563695c1c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/307384924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c1c8d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f082c013010 tx=0x7f082c011a80 comp rx=0 tx=0).stop 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 -- 172.21.15.151:0/307384924 shutdown_connections 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/307384924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c1c8d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 -- 172.21.15.151:0/307384924 >> 172.21.15.151:0/307384924 conn(0x563695c178f0 msgr2=0x563695c15b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 -- 172.21.15.151:0/307384924 shutdown_connections 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 -- 172.21.15.151:0/307384924 wait complete. 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 Processor -- start 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 -- start start 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c22990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f08336ff9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563695c1b420 con 0x563695c1c4d0 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c22990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c22990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40428/0 (socket says 172.21.15.151:40428) 2024-09-12T16:53:19.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 learned_addr learned my addr 172.21.15.151:0/2154535703 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563695c22ef0 con 0x563695c1c4d0 2024-09-12T16:53:19.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.220+0000 7f0831a06640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c22990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f082c011ac0 tx=0x7f082c050500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0706ffd640 1 -- 172.21.15.151:0/2154535703 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082c022dc0 con 0x563695c1c4d0 2024-09-12T16:53:19.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0706ffd640 1 -- 172.21.15.151:0/2154535703 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c02b350 con 0x563695c1c4d0 2024-09-12T16:53:19.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563695c23180 con 0x563695c1c4d0 2024-09-12T16:53:19.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0706ffd640 1 -- 172.21.15.151:0/2154535703 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082c016440 con 0x563695c1c4d0 2024-09-12T16:53:19.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563695c23b30 con 0x563695c1c4d0 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0706ffd640 1 -- 172.21.15.151:0/2154535703 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f082c035020 con 0x563695c1c4d0 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0706ffd640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f06fc039ac0 0x7f06fc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0706ffd640 1 -- 172.21.15.151:0/2154535703 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f082c033020 con 0x563695c1c4d0 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0831205640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f06fc039ac0 0x7f06fc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695c2dc60 0x563695c300b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c30800 con 0x563695c2dc60 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0830a04640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695c2dc60 0x563695c300b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0831205640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f06fc039ac0 0x7f06fc03bf80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f082402ffd0 tx=0x7f082403a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0830a04640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695c2dc60 0x563695c300b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 realm 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c30bd0 con 0x563695c2dc60 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c314a0 con 0x563695c2dc60 2024-09-12T16:53:19.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c31840 con 0x563695c2dc60 2024-09-12T16:53:19.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695c322f0 0x563695c346e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.224+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c34e40 con 0x563695c322f0 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0831a06640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695c322f0 0x563695c346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0831a06640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695c322f0 0x563695c346e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f08336ff9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f08336ff9c0 20 searching for the correct realm 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563695c36de0 0x563695c392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0831205640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563695c36de0 0x563695c392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0831205640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563695c36de0 0x563695c392a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082402e070 con 0x563695c36de0 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0831205640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f082404c070 0x7f0824040470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x7f082404c070 2024-09-12T16:53:19.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0830a04640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f082404c070 0x7f0824040470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0830a04640 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f082404c070 0x7f0824040470 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.228+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c2dc60 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c2dc60 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x7f082404c070 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082402e070 con 0x563695c36de0 2024-09-12T16:53:19.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c2dc60 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.232+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c2dc60 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x7f082404c070 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c2dc60 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c2dc60 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.236+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x7f082404c070 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c2dc60 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x7f082404c070 2024-09-12T16:53:19.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c36de0 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c322f0 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x563695c2dc60 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.240+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563695c39970 con 0x7f082404c070 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:19.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c35770 con 0x563695c2dc60 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c35bf0 con 0x563695c2dc60 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c36090 con 0x563695c2dc60 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 zone default found 2024-09-12T16:53:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 4 Realm: () 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 zonegroup default 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c39df0 con 0x563695c322f0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c3bcb0 con 0x563695c36de0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c3c170 con 0x563695c36de0 2024-09-12T16:53:19.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 started sync module instance, tier type = 2024-09-12T16:53:19.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:19.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3b020 con 0x7f082404c070 2024-09-12T16:53:19.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.244+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94792440853824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3b020 con 0x7f082404c070 2024-09-12T16:53:19.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.248+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3cc90 con 0x563695c2dc60 2024-09-12T16:53:19.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.248+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94792440853824] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.248+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.248+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94792440858480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3b020 con 0x563695c2dc60 2024-09-12T16:53:19.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.248+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3d6a0 con 0x563695c36de0 2024-09-12T16:53:19.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94792440858480] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94792440851312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3af90 con 0x563695c36de0 2024-09-12T16:53:19.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3e3a0 con 0x7f082404c070 2024-09-12T16:53:19.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94792440864768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3ea30 con 0x7f082404c070 2024-09-12T16:53:19.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3f530 con 0x563695c2dc60 2024-09-12T16:53:19.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94792440851312] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.252+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94792440864768] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.256+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.256+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94792440868896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3f4f0 con 0x563695c2dc60 2024-09-12T16:53:19.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.256+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3f950 con 0x563695c322f0 2024-09-12T16:53:19.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.256+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94792440868896] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.256+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.256+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94792440863296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3f950 con 0x563695c322f0 2024-09-12T16:53:19.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.256+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c40360 con 0x563695c322f0 2024-09-12T16:53:19.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94792440863296] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94792440865920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c40360 con 0x563695c322f0 2024-09-12T16:53:19.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c40d20 con 0x563695c322f0 2024-09-12T16:53:19.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94792440875120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c41140 con 0x563695c322f0 2024-09-12T16:53:19.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 20 add_watcher() i=0 2024-09-12T16:53:19.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 20 add_watcher() i=1 2024-09-12T16:53:19.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 20 add_watcher() i=2 2024-09-12T16:53:19.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 20 add_watcher() i=3 2024-09-12T16:53:19.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 20 add_watcher() i=4 2024-09-12T16:53:19.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 20 add_watcher() i=5 2024-09-12T16:53:19.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94792440865920] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.260+0000 7f08336ff9c0 20 add_watcher() i=6 2024-09-12T16:53:19.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94792440875120] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 20 add_watcher() i=7 2024-09-12T16:53:19.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:19.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c41140 con 0x563695c2dc60 2024-09-12T16:53:19.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94792440876176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c410b0 con 0x563695c2dc60 2024-09-12T16:53:19.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94792440876176] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f06e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:19.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:19.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 5 note: GC not initialized 2024-09-12T16:53:19.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f06e6fe5640 20 reqs_thread_entry: start 2024-09-12T16:53:19.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:19.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 20 Filter name: none 2024-09-12T16:53:19.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f06e4fe1640 20 reqs_thread_entry: start 2024-09-12T16:53:19.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.264+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c66f20 con 0x563695c2dc60 2024-09-12T16:53:19.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.268+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.268+0000 7f08336ff9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:53:19.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.268+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563695c684a0 con 0x563695c322f0 2024-09-12T16:53:19.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.268+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.268+0000 7f06e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.268+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94792440876176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c66840 con 0x563695c2dc60 2024-09-12T16:53:19.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.268+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94792440876176] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.268+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94792440853824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c40c90 con 0x7f082404c070 2024-09-12T16:53:19.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.272+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94792440853824] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.272+0000 7f08336ff9c0 20 remove_watcher() i=0 2024-09-12T16:53:19.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.272+0000 7f08336ff9c0 2 removed watcher, disabling cache 2024-09-12T16:53:19.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.272+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94792440858480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c40c90 con 0x563695c2dc60 2024-09-12T16:53:19.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.272+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94792440858480] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.272+0000 7f08336ff9c0 20 remove_watcher() i=1 2024-09-12T16:53:19.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.272+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94792440851312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c40c90 con 0x563695c36de0 2024-09-12T16:53:19.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.276+0000 7f0831205640 1 -- 172.21.15.151:0/2154535703 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94792440851312] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082405d040 con 0x563695c36de0 2024-09-12T16:53:19.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.276+0000 7f08336ff9c0 20 remove_watcher() i=2 2024-09-12T16:53:19.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.276+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94792440864768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3ab70 con 0x7f082404c070 2024-09-12T16:53:19.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.276+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94792440864768] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x7f082404c070 2024-09-12T16:53:19.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.276+0000 7f08336ff9c0 20 remove_watcher() i=3 2024-09-12T16:53:19.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.276+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94792440868896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3ab70 con 0x563695c2dc60 2024-09-12T16:53:19.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.280+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94792440868896] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08280b4040 con 0x563695c2dc60 2024-09-12T16:53:19.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.280+0000 7f08336ff9c0 20 remove_watcher() i=4 2024-09-12T16:53:19.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.280+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94792440863296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3f020 con 0x563695c322f0 2024-09-12T16:53:19.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.280+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94792440863296] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.280+0000 7f08336ff9c0 20 remove_watcher() i=5 2024-09-12T16:53:19.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.280+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94792440865920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3ab70 con 0x563695c322f0 2024-09-12T16:53:19.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.284+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94792440865920] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.284+0000 7f08336ff9c0 20 remove_watcher() i=6 2024-09-12T16:53:19.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.284+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94792440875120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563695c3da40 con 0x563695c322f0 2024-09-12T16:53:19.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f0831a06640 1 -- 172.21.15.151:0/2154535703 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94792440875120] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f082c02a070 con 0x563695c322f0 2024-09-12T16:53:19.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 20 remove_watcher() i=7 2024-09-12T16:53:19.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695c322f0 msgr2=0x563695c346e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695c322f0 0x563695c346e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695c2dc60 msgr2=0x563695c300b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695c2dc60 0x563695c300b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f082404c070 msgr2=0x7f0824040470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f082404c070 0x7f0824040470 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563695c36de0 msgr2=0x563695c392a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563695c36de0 0x563695c392a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f06fc039ac0 msgr2=0x7f06fc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f06fc039ac0 0x7f06fc03bf80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f082402ffd0 tx=0x7f082403a000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f0830a04640 1 -- 172.21.15.151:0/2154535703 reap_dead start 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 msgr2=0x563695c22990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c22990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f082c011ac0 tx=0x7f082c050500 comp rx=0 tx=0).stop 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 shutdown_connections 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/2154535703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695c1c4d0 0x563695c22990 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 >> 172.21.15.151:0/2154535703 conn(0x563695c178f0 msgr2=0x563695c15b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 shutdown_connections 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/2154535703 wait complete. 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/425503007 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0708039ac0 msgr2=0x7f070803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/425503007 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0708039ac0 0x7f070803bf80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x563695bf9a20 tx=0x7f082404ed20 comp rx=0 tx=0).stop 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/425503007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695aff380 msgr2=0x563695afdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/425503007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695aff380 0x563695afdc20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x563695bf32a0 tx=0x7f082c018830 comp rx=0 tx=0).stop 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/425503007 shutdown_connections 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/425503007 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0708039ac0 0x7f070803bf80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/425503007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695aff380 0x563695afdc20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/425503007 >> 172.21.15.151:0/425503007 conn(0x563695c023a0 msgr2=0x563695c02780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/425503007 shutdown_connections 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/425503007 wait complete. 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695bfb8b0 msgr2=0x563695bfdca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695bfb8b0 0x563695bfdca0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695b03340 msgr2=0x563695bf9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695b03340 0x563695bf9080 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0718039a70 msgr2=0x7f071803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0718039a70 0x7f071803bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f08280ae000 tx=0x7f08280a6000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 msgr2=0x563695bf1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bf1f10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0824000c10 tx=0x7f0824000ee0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 shutdown_connections 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563695bfb8b0 0x563695bfdca0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563695b03340 0x563695bf9080 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0718039a70 0x7f071803bf30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 --2- 172.21.15.151:0/1799482087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563695a731f0 0x563695bf1f10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 >> 172.21.15.151:0/1799482087 conn(0x563695af9910 msgr2=0x563695be4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 shutdown_connections 2024-09-12T16:53:19.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.288+0000 7f08336ff9c0 1 -- 172.21.15.151:0/1799482087 wait complete. 2024-09-12T16:53:19.303 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T16:53:19.303 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:53:19.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-12T16:53:19.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-12T16:53:19.304 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-12T16:53:19.386 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:19.386 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:19.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b50a39c0 1 Processor -- start 2024-09-12T16:53:19.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b50a39c0 1 -- start start 2024-09-12T16:53:19.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b50a39c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5631fa3661f0 0x5631fa3f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b50a39c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5631fa2a69c0 con 0x5631fa3f5160 2024-09-12T16:53:19.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b50a39c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5631fa2f66d0 con 0x5631fa3661f0 2024-09-12T16:53:19.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b2ba9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5631fa3661f0 0x5631fa3f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b2ba9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5631fa3661f0 0x5631fa3f4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40440/0 (socket says 172.21.15.151:40440) 2024-09-12T16:53:19.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/2621013260 learned_addr learned my addr 172.21.15.151:0/2621013260 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b23a8640 1 --1- 172.21.15.151:0/2621013260 >> v1:172.21.15.122:6789/0 conn(0x5631fa3f5160 0x5631fa3f7550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:43216/0 (socket says 172.21.15.151:43216) 2024-09-12T16:53:19.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/2621013260 >> v1:172.21.15.122:6789/0 conn(0x5631fa3f5160 legacy=0x5631fa3f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.384+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/2621013260 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa29aca0 con 0x5631fa3661f0 2024-09-12T16:53:19.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/2621013260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa3f4c20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00a4e0 tx=0x7fb9ac01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5e5048e05b4f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b1ba7640 1 -- 172.21.15.151:0/2621013260 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac0aa540 con 0x5631fa3661f0 2024-09-12T16:53:19.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b1ba7640 1 -- 172.21.15.151:0/2621013260 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0aa6e0 con 0x5631fa3661f0 2024-09-12T16:53:19.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b1ba7640 1 -- 172.21.15.151:0/2621013260 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac0aaa40 con 0x5631fa3661f0 2024-09-12T16:53:19.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2621013260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 msgr2=0x5631fa3f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/2621013260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa3f4c20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00a4e0 tx=0x7fb9ac01b090 comp rx=0 tx=0).stop 2024-09-12T16:53:19.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2621013260 shutdown_connections 2024-09-12T16:53:19.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/2621013260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa3f4c20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2621013260 >> 172.21.15.151:0/2621013260 conn(0x5631fa3ec910 msgr2=0x5631fa3eed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2621013260 shutdown_connections 2024-09-12T16:53:19.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.388+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2621013260 wait complete. 2024-09-12T16:53:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b50a39c0 1 Processor -- start 2024-09-12T16:53:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b50a39c0 1 -- start start 2024-09-12T16:53:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b50a39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b50a39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631fa2fa680 con 0x5631fa3661f0 2024-09-12T16:53:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b2ba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b2ba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4dd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40444/0 (socket says 172.21.15.151:40444) 2024-09-12T16:53:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/1144476572 learned_addr learned my addr 172.21.15.151:0/1144476572 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/1144476572 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa275da0 con 0x5631fa3661f0 2024-09-12T16:53:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/1144476572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4dd7f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac017ca0 tx=0x7fb9ac0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d43873283df1f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb8a0e09640 1 -- 172.21.15.151:0/1144476572 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac0b9030 con 0x5631fa3661f0 2024-09-12T16:53:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb8a0e09640 1 -- 172.21.15.151:0/1144476572 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0aaa80 con 0x5631fa3661f0 2024-09-12T16:53:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.404+0000 7fb8a0e09640 1 -- 172.21.15.151:0/1144476572 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac0aada0 con 0x5631fa3661f0 2024-09-12T16:53:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/1144476572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 msgr2=0x5631fa4dd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/1144476572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4dd7f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac017ca0 tx=0x7fb9ac0033b0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/1144476572 shutdown_connections 2024-09-12T16:53:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/1144476572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4dd7f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/1144476572 >> 172.21.15.151:0/1144476572 conn(0x5631fa3ec910 msgr2=0x5631fa4d9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/1144476572 shutdown_connections 2024-09-12T16:53:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/1144476572 wait complete. 2024-09-12T16:53:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 Processor -- start 2024-09-12T16:53:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- start start 2024-09-12T16:53:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631fa29ca50 con 0x5631fa3661f0 2024-09-12T16:53:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b2ba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b2ba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4e4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40460/0 (socket says 172.21.15.151:40460) 2024-09-12T16:53:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/231623203 learned_addr learned my addr 172.21.15.151:0/231623203 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/231623203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa4e5340 con 0x5631fa3661f0 2024-09-12T16:53:19.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4e4de0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac017ca0 tx=0x7fb9ac017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb89f606640 1 -- 172.21.15.151:0/231623203 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac0b9070 con 0x5631fa3661f0 2024-09-12T16:53:19.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb89f606640 1 -- 172.21.15.151:0/231623203 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0c3030 con 0x5631fa3661f0 2024-09-12T16:53:19.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631fa4e55d0 con 0x5631fa3661f0 2024-09-12T16:53:19.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb89f606640 1 -- 172.21.15.151:0/231623203 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac0b5ba0 con 0x5631fa3661f0 2024-09-12T16:53:19.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.408+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fa4e5f80 con 0x5631fa3661f0 2024-09-12T16:53:19.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb89f606640 1 -- 172.21.15.151:0/231623203 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb9ac0b3040 con 0x5631fa3661f0 2024-09-12T16:53:19.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb89f606640 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb898039ac0 0x7fb89803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb89f606640 1 -- 172.21.15.151:0/231623203 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb9ac0ba070 con 0x5631fa3661f0 2024-09-12T16:53:19.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b23a8640 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb898039ac0 0x7fb89803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa3f5160 0x5631fa4ebf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa4ec490 con 0x5631fa3f5160 2024-09-12T16:53:19.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b33aa640 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa3f5160 0x5631fa4ebf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b23a8640 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb898039ac0 0x7fb89803bf80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8001e90 tx=0x7fb9a80013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b33aa640 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa3f5160 0x5631fa4ebf50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b33aa640 1 -- 172.21.15.151:0/231623203 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9a40083f0 con 0x5631fa3f5160 2024-09-12T16:53:19.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa4ec850 con 0x5631fa3f5160 2024-09-12T16:53:19.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b33aa640 1 -- 172.21.15.151:0/231623203 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9a40083f0 con 0x5631fa3f5160 2024-09-12T16:53:19.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa4ee660 0x5631fa4f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa4f1120 con 0x5631fa4ee660 2024-09-12T16:53:19.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa4ee660 0x5631fa4f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.412+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa4ee660 0x5631fa4f0a50 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/231623203 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb9ac0cf070 con 0x5631fa4ee660 2024-09-12T16:53:19.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa4ed500 con 0x5631fa3f5160 2024-09-12T16:53:19.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b33aa640 1 -- 172.21.15.151:0/231623203 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9a40083f0 con 0x5631fa3f5160 2024-09-12T16:53:19.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa4ed9a0 con 0x5631fa3f5160 2024-09-12T16:53:19.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b33aa640 1 -- 172.21.15.151:0/231623203 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb9a40083f0 con 0x5631fa3f5160 2024-09-12T16:53:19.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b50a39c0 1 Processor -- start 2024-09-12T16:53:19.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b50a39c0 1 -- start start 2024-09-12T16:53:19.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b50a39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa4ff790 0x5631fa4ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b50a39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631fa307450 con 0x5631fa4ff790 2024-09-12T16:53:19.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b33aa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa4ff790 0x5631fa4ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b33aa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa4ff790 0x5631fa4ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40464/0 (socket says 172.21.15.151:40464) 2024-09-12T16:53:19.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b33aa640 1 -- 172.21.15.151:0/2427113274 learned_addr learned my addr 172.21.15.151:0/2427113274 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b33aa640 1 -- 172.21.15.151:0/2427113274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa5001f0 con 0x5631fa4ff790 2024-09-12T16:53:19.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b33aa640 1 --2- 172.21.15.151:0/2427113274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa4ff790 0x5631fa4ffbb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x5631fa4e6e50 tx=0x7fb9a400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb89ce01640 1 -- 172.21.15.151:0/2427113274 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a4007e00 con 0x5631fa4ff790 2024-09-12T16:53:19.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb89ce01640 1 -- 172.21.15.151:0/2427113274 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a401e020 con 0x5631fa4ff790 2024-09-12T16:53:19.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2427113274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631fa500a50 con 0x5631fa4ff790 2024-09-12T16:53:19.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb89ce01640 1 -- 172.21.15.151:0/2427113274 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a4019590 con 0x5631fa4ff790 2024-09-12T16:53:19.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.416+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2427113274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fa500fc0 con 0x5631fa4ff790 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb89ce01640 1 -- 172.21.15.151:0/2427113274 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb9a4016040 con 0x5631fa4ff790 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb89ce01640 1 --2- 172.21.15.151:0/2427113274 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb88c039a70 0x7fb88c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb89ce01640 1 -- 172.21.15.151:0/2427113274 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb9a401f030 con 0x5631fa4ff790 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/2427113274 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb88c039a70 0x7fb88c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 Processor -- start 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 -- start start 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/2427113274 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb88c039a70 0x7fb88c03bf30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5631fa4e6270 tx=0x7fb9ac0a4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa3f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631fa4ddf80 con 0x5631fa3f0be0 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b33aa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa3f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b33aa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa3f0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40470/0 (socket says 172.21.15.151:40470) 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b33aa640 1 -- 172.21.15.151:0/199615947 learned_addr learned my addr 172.21.15.151:0/199615947 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b33aa640 1 -- 172.21.15.151:0/199615947 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa3f15d0 con 0x5631fa3f0be0 2024-09-12T16:53:19.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b33aa640 1 --2- 172.21.15.151:0/199615947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa3f0fe0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4050970 tx=0x7fb9a4019b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c517ec3bb6d0165b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb8967fc640 1 -- 172.21.15.151:0/199615947 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a401d040 con 0x5631fa3f0be0 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb8967fc640 1 -- 172.21.15.151:0/199615947 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a40235e0 con 0x5631fa3f0be0 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb8967fc640 1 -- 172.21.15.151:0/199615947 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a4019d80 con 0x5631fa3f0be0 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/199615947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 msgr2=0x5631fa3f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/199615947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa3f0fe0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4050970 tx=0x7fb9a4019b00 comp rx=0 tx=0).stop 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/199615947 shutdown_connections 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/199615947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa3f0fe0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/199615947 >> 172.21.15.151:0/199615947 conn(0x5631fa508500 msgr2=0x5631fa506740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/199615947 shutdown_connections 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/199615947 wait complete. 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.420+0000 7fb9b50a39c0 1 Processor -- start 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b50a39c0 1 -- start start 2024-09-12T16:53:19.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b50a39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa5157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b50a39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5631fa3f1c70 con 0x5631fa3f0be0 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b33aa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa5157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b33aa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa5157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40486/0 (socket says 172.21.15.151:40486) 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 learned_addr learned my addr 172.21.15.151:0/413597534 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa515d50 con 0x5631fa3f0be0 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b33aa640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa5157f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4017e00 tx=0x7fb9a4050900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb894ff9640 1 -- 172.21.15.151:0/413597534 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a401d070 con 0x5631fa3f0be0 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb894ff9640 1 -- 172.21.15.151:0/413597534 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a4031030 con 0x5631fa3f0be0 2024-09-12T16:53:19.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631fa515fe0 con 0x5631fa3f0be0 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb894ff9640 1 -- 172.21.15.151:0/413597534 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a4048040 con 0x5631fa3f0be0 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fa516990 con 0x5631fa3f0be0 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb894ff9640 1 -- 172.21.15.151:0/413597534 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb9a4015af0 con 0x5631fa3f0be0 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb894ff9640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb87c039a70 0x7fb87c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb894ff9640 1 -- 172.21.15.151:0/413597534 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb9a4037d40 con 0x5631fa3f0be0 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb87c039a70 0x7fb87c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa520a40 0x5631fa522ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa523620 con 0x5631fa520a40 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b23a8640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa520a40 0x5631fa522ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb87c039a70 0x7fb87c03bf30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0bd780 tx=0x7fb9ac0d5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.424+0000 7fb9b23a8640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa520a40 0x5631fa522ed0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9a800f660 con 0x5631fa520a40 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 realm 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa51fe50 con 0x5631fa520a40 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9a800f660 con 0x5631fa520a40 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa524120 con 0x5631fa520a40 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9a800f660 con 0x5631fa520a40 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa5249f0 con 0x5631fa520a40 2024-09-12T16:53:19.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9a800f660 con 0x5631fa520a40 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa5252a0 0x5631fa527690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa527df0 con 0x5631fa5252a0 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b33aa640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa5252a0 0x5631fa527690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b33aa640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa5252a0 0x5631fa527690 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 20 searching for the correct realm 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631fa529de0 0x5631fa52c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631fa529de0 0x5631fa52c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631fa529de0 0x5631fa52c2a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.428+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b2ba9640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb9ac0b4720 0x7fb9ac0e25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x7fb9ac0b4720 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb9ac0b4720 0x7fb9ac0e25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb9ac0b4720 0x7fb9ac0e25d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a800f660 con 0x7fb9ac0b4720 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa520a40 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a800f660 con 0x5631fa520a40 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa520a40 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x7fb9ac0b4720 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.432+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa520a40 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa520a40 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x7fb9ac0b4720 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa520a40 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.436+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa520a40 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x7fb9ac0b4720 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa520a40 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.440+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x7fb9ac0b4720 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa529de0 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa5252a0 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x5631fa520a40 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52c970 con 0x7fb9ac0b4720 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:19.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa528800 con 0x5631fa520a40 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa528c80 con 0x5631fa520a40 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa529120 con 0x5631fa520a40 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 zone default found 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 4 Realm: () 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 zonegroup default 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52cdf0 con 0x5631fa5252a0 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.444+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52f030 con 0x5631fa529de0 2024-09-12T16:53:19.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52f3d0 con 0x5631fa529de0 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 20 started sync module instance, tier type = 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52e470 con 0x7fb9ac0b4720 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94772653123984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52e470 con 0x7fb9ac0b4720 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52fd90 con 0x5631fa520a40 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.448+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94772653123984] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94772653128176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52e470 con 0x5631fa520a40 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa5307a0 con 0x5631fa529de0 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94772653128176] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94772653121472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52e3e0 con 0x5631fa529de0 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa5314a0 con 0x7fb9ac0b4720 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94772653134080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa531b30 con 0x7fb9ac0b4720 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.452+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa532630 con 0x5631fa520a40 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94772653121472] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94772653134080] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94772653138208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa5325f0 con 0x5631fa520a40 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa532a50 con 0x5631fa5252a0 2024-09-12T16:53:19.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94772653138208] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94772653135232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa532df0 con 0x5631fa5252a0 2024-09-12T16:53:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.456+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa5337b0 con 0x5631fa5252a0 2024-09-12T16:53:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.460+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94772653135232] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.460+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.460+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94772653132608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa5337b0 con 0x5631fa5252a0 2024-09-12T16:53:19.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.460+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa534170 con 0x5631fa5252a0 2024-09-12T16:53:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94772653132608] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94772653142784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa534350 con 0x5631fa5252a0 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 20 add_watcher() i=0 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 20 add_watcher() i=1 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 20 add_watcher() i=2 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 20 add_watcher() i=3 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 20 add_watcher() i=4 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 20 add_watcher() i=5 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 20 add_watcher() i=6 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94772653142784] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 20 add_watcher() i=7 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa537530 con 0x5631fa520a40 2024-09-12T16:53:19.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.464+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94772653158112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa5342f0 con 0x5631fa520a40 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94772653158112] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb8697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 5 note: GC not initialized 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb7e3fff640 20 reqs_thread_entry: start 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 20 Filter name: none 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb7e1ffb640 20 reqs_thread_entry: start 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa55a3f0 con 0x5631fa520a40 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:53:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5631fa55b970 con 0x5631fa5252a0 2024-09-12T16:53:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb8697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.468+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94772653158112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa559d10 con 0x5631fa520a40 2024-09-12T16:53:19.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.472+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94772653158112] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.472+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94772653123984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa559d10 con 0x7fb9ac0b4720 2024-09-12T16:53:19.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.472+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94772653123984] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.472+0000 7fb9b50a39c0 20 remove_watcher() i=0 2024-09-12T16:53:19.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.472+0000 7fb9b50a39c0 2 removed watcher, disabling cache 2024-09-12T16:53:19.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.472+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94772653128176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52e990 con 0x5631fa520a40 2024-09-12T16:53:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94772653128176] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b50a39c0 20 remove_watcher() i=1 2024-09-12T16:53:19.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94772653121472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52e990 con 0x5631fa529de0 2024-09-12T16:53:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b2ba9640 1 -- 172.21.15.151:0/413597534 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94772653121472] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9ac0db070 con 0x5631fa529de0 2024-09-12T16:53:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b50a39c0 20 remove_watcher() i=2 2024-09-12T16:53:19.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94772653134080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52dfc0 con 0x7fb9ac0b4720 2024-09-12T16:53:19.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94772653134080] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x7fb9ac0b4720 2024-09-12T16:53:19.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b50a39c0 20 remove_watcher() i=3 2024-09-12T16:53:19.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.476+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94772653138208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52dfc0 con 0x5631fa520a40 2024-09-12T16:53:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.480+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94772653138208] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a802b040 con 0x5631fa520a40 2024-09-12T16:53:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.480+0000 7fb9b50a39c0 20 remove_watcher() i=4 2024-09-12T16:53:19.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.480+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94772653135232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa532120 con 0x5631fa5252a0 2024-09-12T16:53:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.480+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94772653135232] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.480+0000 7fb9b50a39c0 20 remove_watcher() i=5 2024-09-12T16:53:19.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.480+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94772653132608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa52dfc0 con 0x5631fa5252a0 2024-09-12T16:53:19.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.484+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94772653132608] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.484+0000 7fb9b50a39c0 20 remove_watcher() i=6 2024-09-12T16:53:19.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.484+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94772653142784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5631fa530b40 con 0x5631fa5252a0 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b33aa640 1 -- 172.21.15.151:0/413597534 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94772653142784] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a403d070 con 0x5631fa5252a0 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 20 remove_watcher() i=7 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa5252a0 msgr2=0x5631fa527690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa5252a0 0x5631fa527690 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa520a40 msgr2=0x5631fa522ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa520a40 0x5631fa522ed0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb9ac0b4720 msgr2=0x7fb9ac0e25d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb9ac0b4720 0x7fb9ac0e25d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631fa529de0 msgr2=0x5631fa52c2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5631fa529de0 0x5631fa52c2a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb87c039a70 msgr2=0x7fb87c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb87c039a70 0x7fb87c03bf30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0bd780 tx=0x7fb9ac0d5000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 msgr2=0x5631fa5157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b23a8640 1 -- 172.21.15.151:0/413597534 reap_dead start 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa5157f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4017e00 tx=0x7fb9a4050900 comp rx=0 tx=0).stop 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 shutdown_connections 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/413597534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3f0be0 0x5631fa5157f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 >> 172.21.15.151:0/413597534 conn(0x5631fa508500 msgr2=0x5631fa506710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 shutdown_connections 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/413597534 wait complete. 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2427113274 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb88c039a70 msgr2=0x7fb88c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/2427113274 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb88c039a70 0x7fb88c03bf30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5631fa4e6270 tx=0x7fb9ac0a4000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2427113274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa4ff790 msgr2=0x5631fa4ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/2427113274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa4ff790 0x5631fa4ffbb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x5631fa4e6e50 tx=0x7fb9a400af40 comp rx=0 tx=0).stop 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2427113274 shutdown_connections 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/2427113274 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb88c039a70 0x7fb88c03bf30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/2427113274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa4ff790 0x5631fa4ffbb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2427113274 >> 172.21.15.151:0/2427113274 conn(0x5631fa4f5140 msgr2=0x5631fa4f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2427113274 shutdown_connections 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/2427113274 wait complete. 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa4ee660 msgr2=0x5631fa4f0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa4ee660 0x5631fa4f0a50 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa3f5160 msgr2=0x5631fa4ebf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa3f5160 0x5631fa4ebf50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb898039ac0 msgr2=0x7fb89803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb898039ac0 0x7fb89803bf80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8001e90 tx=0x7fb9a80013f0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 msgr2=0x5631fa4e4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4e4de0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac017ca0 tx=0x7fb9ac017e30 comp rx=0 tx=0).stop 2024-09-12T16:53:19.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 shutdown_connections 2024-09-12T16:53:19.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5631fa4ee660 0x5631fa4f0a50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5631fa3f5160 0x5631fa4ebf50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb898039ac0 0x7fb89803bf80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 --2- 172.21.15.151:0/231623203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5631fa3661f0 0x5631fa4e4de0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 >> 172.21.15.151:0/231623203 conn(0x5631fa3ec910 msgr2=0x5631fa4d7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 shutdown_connections 2024-09-12T16:53:19.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.488+0000 7fb9b50a39c0 1 -- 172.21.15.151:0/231623203 wait complete. 2024-09-12T16:53:19.503 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T16:53:19.504 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:53:19.504 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-12T16:53:19.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-12T16:53:19.504 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-12T16:53:19.585 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:19.585 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:19.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8fd959c0 1 Processor -- start 2024-09-12T16:53:19.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8fd959c0 1 -- start start 2024-09-12T16:53:19.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8fd959c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563edd50dae0 0x563edd50dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8fd959c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563edd44b9c0 con 0x563edd50c4e0 2024-09-12T16:53:19.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8fd959c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x563edd49b6d0 con 0x563edd50dae0 2024-09-12T16:53:19.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8d89b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563edd50dae0 0x563edd50dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8d89b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x563edd50dae0 0x563edd50dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40498/0 (socket says 172.21.15.151:40498) 2024-09-12T16:53:19.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8d89b640 1 -- 172.21.15.151:0/306105422 learned_addr learned my addr 172.21.15.151:0/306105422 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8d89b640 1 -- 172.21.15.151:0/306105422 >> v1:172.21.15.122:6789/0 conn(0x563edd50c4e0 legacy=0x563edd50c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8d89b640 1 -- 172.21.15.151:0/306105422 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd43fca0 con 0x563edd50dae0 2024-09-12T16:53:19.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/306105422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd50dec0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800a4e0 tx=0x7f6c8801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0acbc6c965d52fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.584+0000 7f6c8c899640 1 -- 172.21.15.151:0/306105422 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c880aa540 con 0x563edd50dae0 2024-09-12T16:53:19.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8c899640 1 -- 172.21.15.151:0/306105422 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c880aa6e0 con 0x563edd50dae0 2024-09-12T16:53:19.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8c899640 1 -- 172.21.15.151:0/306105422 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c880aaa40 con 0x563edd50dae0 2024-09-12T16:53:19.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/306105422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 msgr2=0x563edd50dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/306105422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd50dec0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800a4e0 tx=0x7f6c8801b090 comp rx=0 tx=0).stop 2024-09-12T16:53:19.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/306105422 shutdown_connections 2024-09-12T16:53:19.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/306105422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd50dec0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/306105422 >> 172.21.15.151:0/306105422 conn(0x563edd592ac0 msgr2=0x563edd594ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/306105422 shutdown_connections 2024-09-12T16:53:19.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.588+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/306105422 wait complete. 2024-09-12T16:53:19.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.600+0000 7f6c8fd959c0 1 Processor -- start 2024-09-12T16:53:19.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- start start 2024-09-12T16:53:19.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50c4e0 0x563edd684bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563edd49f680 con 0x563edd50c4e0 2024-09-12T16:53:19.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8d89b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50c4e0 0x563edd684bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8d89b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50c4e0 0x563edd684bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40504/0 (socket says 172.21.15.151:40504) 2024-09-12T16:53:19.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8d89b640 1 -- 172.21.15.151:0/559100139 learned_addr learned my addr 172.21.15.151:0/559100139 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8d89b640 1 -- 172.21.15.151:0/559100139 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd41ada0 con 0x563edd50c4e0 2024-09-12T16:53:19.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/559100139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50c4e0 0x563edd684bb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6c880ac040 tx=0x7f6c88003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335748cc817c6893 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6b7be07640 1 -- 172.21.15.151:0/559100139 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c880aaa80 con 0x563edd50c4e0 2024-09-12T16:53:19.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6b7be07640 1 -- 172.21.15.151:0/559100139 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c880aac20 con 0x563edd50c4e0 2024-09-12T16:53:19.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6b7be07640 1 -- 172.21.15.151:0/559100139 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c880b4460 con 0x563edd50c4e0 2024-09-12T16:53:19.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/559100139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50c4e0 msgr2=0x563edd684bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/559100139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50c4e0 0x563edd684bb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6c880ac040 tx=0x7f6c88003340 comp rx=0 tx=0).stop 2024-09-12T16:53:19.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/559100139 shutdown_connections 2024-09-12T16:53:19.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/559100139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50c4e0 0x563edd684bb0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/559100139 >> 172.21.15.151:0/559100139 conn(0x563edd592ac0 msgr2=0x563edd680850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/559100139 shutdown_connections 2024-09-12T16:53:19.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/559100139 wait complete. 2024-09-12T16:53:19.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 Processor -- start 2024-09-12T16:53:19.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- start start 2024-09-12T16:53:19.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd68c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.604+0000 7f6c8fd959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563edd441a50 con 0x563edd50dae0 2024-09-12T16:53:19.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8d89b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd68c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8d89b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd68c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40516/0 (socket says 172.21.15.151:40516) 2024-09-12T16:53:19.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8d89b640 1 -- 172.21.15.151:0/4206968950 learned_addr learned my addr 172.21.15.151:0/4206968950 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8d89b640 1 -- 172.21.15.151:0/4206968950 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd68c9c0 con 0x563edd50dae0 2024-09-12T16:53:19.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd68c460 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6c880aa6b0 tx=0x563edd50d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6b7a604640 1 -- 172.21.15.151:0/4206968950 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c880b47a0 con 0x563edd50dae0 2024-09-12T16:53:19.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6b7a604640 1 -- 172.21.15.151:0/4206968950 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c880c1070 con 0x563edd50dae0 2024-09-12T16:53:19.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563edd68cc50 con 0x563edd50dae0 2024-09-12T16:53:19.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6b7a604640 1 -- 172.21.15.151:0/4206968950 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c880b4a90 con 0x563edd50dae0 2024-09-12T16:53:19.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edd68d560 con 0x563edd50dae0 2024-09-12T16:53:19.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6b7a604640 1 -- 172.21.15.151:0/4206968950 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6c880b4c30 con 0x563edd50dae0 2024-09-12T16:53:19.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6b7a604640 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b74039ac0 0x7f6b7403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6b7a604640 1 -- 172.21.15.151:0/4206968950 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6c880eb700 con 0x563edd50dae0 2024-09-12T16:53:19.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8d09a640 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b74039ac0 0x7f6b7403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd691520 0x563edd693910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.608+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd693e50 con 0x563edd691520 2024-09-12T16:53:19.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8e09c640 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd691520 0x563edd693910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8d09a640 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b74039ac0 0x7f6b7403bf80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c84001ec0 tx=0x7f6c84001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8e09c640 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd691520 0x563edd693910 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8e09c640 1 -- 172.21.15.151:0/4206968950 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c800083f0 con 0x563edd691520 2024-09-12T16:53:19.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd694210 con 0x563edd691520 2024-09-12T16:53:19.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8e09c640 1 -- 172.21.15.151:0/4206968950 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c800083f0 con 0x563edd691520 2024-09-12T16:53:19.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd696020 0x563edd698410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd698b00 con 0x563edd696020 2024-09-12T16:53:19.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd696020 0x563edd698410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd696020 0x563edd698410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8d89b640 1 -- 172.21.15.151:0/4206968950 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd696020 2024-09-12T16:53:19.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd694ec0 con 0x563edd691520 2024-09-12T16:53:19.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8e09c640 1 -- 172.21.15.151:0/4206968950 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c800083f0 con 0x563edd691520 2024-09-12T16:53:19.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd695360 con 0x563edd691520 2024-09-12T16:53:19.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8e09c640 1 -- 172.21.15.151:0/4206968950 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c800083f0 con 0x563edd691520 2024-09-12T16:53:19.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8fd959c0 1 Processor -- start 2024-09-12T16:53:19.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.612+0000 7f6c8fd959c0 1 -- start start 2024-09-12T16:53:19.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8fd959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6a7190 0x563edd6a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8fd959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563edd4ac450 con 0x563edd6a7190 2024-09-12T16:53:19.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8e09c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6a7190 0x563edd6a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8e09c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6a7190 0x563edd6a75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40526/0 (socket says 172.21.15.151:40526) 2024-09-12T16:53:19.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1899251842 learned_addr learned my addr 172.21.15.151:0/1899251842 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1899251842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd6a7bf0 con 0x563edd6a7190 2024-09-12T16:53:19.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8e09c640 1 --2- 172.21.15.151:0/1899251842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6a7190 0x563edd6a75b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x563edd68d750 tx=0x7f6c8000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6b737fe640 1 -- 172.21.15.151:0/1899251842 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80007dd0 con 0x563edd6a7190 2024-09-12T16:53:19.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6b737fe640 1 -- 172.21.15.151:0/1899251842 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8001e020 con 0x563edd6a7190 2024-09-12T16:53:19.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1899251842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563edd6a8450 con 0x563edd6a7190 2024-09-12T16:53:19.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6b737fe640 1 -- 172.21.15.151:0/1899251842 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80019590 con 0x563edd6a7190 2024-09-12T16:53:19.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1899251842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edd6a89c0 con 0x563edd6a7190 2024-09-12T16:53:19.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6b737fe640 1 -- 172.21.15.151:0/1899251842 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6c80016040 con 0x563edd6a7190 2024-09-12T16:53:19.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6b737fe640 1 --2- 172.21.15.151:0/1899251842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b68039a70 0x7f6b6803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6b737fe640 1 -- 172.21.15.151:0/1899251842 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6c8001f030 con 0x563edd6a7190 2024-09-12T16:53:19.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/1899251842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b68039a70 0x7f6b6803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8fd959c0 1 Processor -- start 2024-09-12T16:53:19.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8fd959c0 1 -- start start 2024-09-12T16:53:19.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/1899251842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b68039a70 0x7f6b6803bf30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x563edd68d850 tx=0x7f6c880e99e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8fd959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.616+0000 7f6c8fd959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563edd685380 con 0x563edd6b4b20 2024-09-12T16:53:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40528/0 (socket says 172.21.15.151:40528) 2024-09-12T16:53:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 -- 172.21.15.151:0/961787326 learned_addr learned my addr 172.21.15.151:0/961787326 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 -- 172.21.15.151:0/961787326 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd6b5510 con 0x563edd6b4b20 2024-09-12T16:53:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 --2- 172.21.15.151:0/961787326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6b4f20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6c80017b60 tx=0x7f6c80018e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7e324d6e3b0484 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6b717fa640 1 -- 172.21.15.151:0/961787326 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8001d040 con 0x563edd6b4b20 2024-09-12T16:53:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6b717fa640 1 -- 172.21.15.151:0/961787326 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c800173b0 con 0x563edd6b4b20 2024-09-12T16:53:19.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6b717fa640 1 -- 172.21.15.151:0/961787326 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80023590 con 0x563edd6b4b20 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/961787326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 msgr2=0x563edd6b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/961787326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6b4f20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6c80017b60 tx=0x7f6c80018e30 comp rx=0 tx=0).stop 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/961787326 shutdown_connections 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/961787326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6b4f20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/961787326 >> 172.21.15.151:0/961787326 conn(0x563edd6aff40 msgr2=0x563edd6ae180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/961787326 shutdown_connections 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/961787326 wait complete. 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 Processor -- start 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- start start 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563edd6b3a70 con 0x563edd6b4b20 2024-09-12T16:53:19.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6bafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40542/0 (socket says 172.21.15.151:40542) 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 learned_addr learned my addr 172.21.15.151:0/1646808465 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563edd6bb510 con 0x563edd6b4b20 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8e09c640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6bafb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6c8004b010 tx=0x7f6c80050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6b5f7fe640 1 -- 172.21.15.151:0/1646808465 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8001d030 con 0x563edd6b4b20 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563edd6bb7a0 con 0x563edd6b4b20 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6b5f7fe640 1 -- 172.21.15.151:0/1646808465 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c80031030 con 0x563edd6b4b20 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6b5f7fe640 1 -- 172.21.15.151:0/1646808465 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80048040 con 0x563edd6b4b20 2024-09-12T16:53:19.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.620+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563edd6bc150 con 0x563edd6b4b20 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6b5f7fe640 1 -- 172.21.15.151:0/1646808465 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6c800520d0 con 0x563edd6b4b20 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6b5f7fe640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b58039a70 0x7f6b5803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6b5f7fe640 1 -- 172.21.15.151:0/1646808465 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6c80037d40 con 0x563edd6b4b20 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b58039a70 0x7f6b5803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd6c6260 0x563edd6c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6c8e40 con 0x563edd6c6260 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8d09a640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd6c6260 0x563edd6c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b58039a70 0x7f6b5803bf30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6c8801aec0 tx=0x7f6c880d3000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8d09a640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd6c6260 0x563edd6c86f0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8400d040 con 0x563edd6c6260 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 realm 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6c5670 con 0x563edd6c6260 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8400d040 con 0x563edd6c6260 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6c9940 con 0x563edd6c6260 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8400d040 con 0x563edd6c6260 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6ca210 con 0x563edd6c6260 2024-09-12T16:53:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c8400d040 con 0x563edd6c6260 2024-09-12T16:53:19.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd6cab10 0x563edd6ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6cd660 con 0x563edd6cab10 2024-09-12T16:53:19.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.624+0000 7f6c8e09c640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd6cab10 0x563edd6ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8e09c640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd6cab10 0x563edd6ccf00 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8fd959c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:19.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8fd959c0 20 searching for the correct realm 2024-09-12T16:53:19.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563edd6cf600 0x563edd6d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563edd6cf600 0x563edd6d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563edd6cf600 0x563edd6d1ac0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d89b640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6c880f8040 0x7f6c880a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x7f6c880f8040 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d09a640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6c880f8040 0x7f6c880a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d09a640 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6c880f8040 0x7f6c880a93c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8400d040 con 0x7f6c880f8040 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.628+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6c6260 2024-09-12T16:53:19.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8400d040 con 0x563edd6c6260 2024-09-12T16:53:19.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6c6260 2024-09-12T16:53:19.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x7f6c880f8040 2024-09-12T16:53:19.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6c6260 2024-09-12T16:53:19.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.632+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6c6260 2024-09-12T16:53:19.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x7f6c880f8040 2024-09-12T16:53:19.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6c6260 2024-09-12T16:53:19.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6c6260 2024-09-12T16:53:19.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.636+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x7f6c880f8040 2024-09-12T16:53:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6c6260 2024-09-12T16:53:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x7f6c880f8040 2024-09-12T16:53:19.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cf600 2024-09-12T16:53:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.640+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6cab10 2024-09-12T16:53:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x563edd6c6260 2024-09-12T16:53:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d2190 con 0x7f6c880f8040 2024-09-12T16:53:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6ce020 con 0x563edd6c6260 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6ce470 con 0x563edd6c6260 2024-09-12T16:53:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6ce890 con 0x563edd6c6260 2024-09-12T16:53:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:19.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 zone default found 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 4 Realm: () 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 zonegroup default 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6ce890 con 0x563edd6cab10 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d4150 con 0x563edd6cf600 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d4630 con 0x563edd6cf600 2024-09-12T16:53:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 started sync module instance, tier type = 2024-09-12T16:53:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:19.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.644+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d34a0 con 0x7f6c880f8040 2024-09-12T16:53:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.648+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.648+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94828002884080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d34a0 con 0x7f6c880f8040 2024-09-12T16:53:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.648+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d5110 con 0x563edd6c6260 2024-09-12T16:53:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.648+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94828002884080] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.648+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.648+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94828002888704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d34a0 con 0x563edd6c6260 2024-09-12T16:53:19.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.648+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d5b50 con 0x563edd6cf600 2024-09-12T16:53:19.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.652+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.652+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94828002891424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d63a0 con 0x563edd6cf600 2024-09-12T16:53:19.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.652+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d6d60 con 0x7f6c880f8040 2024-09-12T16:53:19.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.652+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94828002888704] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.652+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.652+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94828002896048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d6cd0 con 0x7f6c880f8040 2024-09-12T16:53:19.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.652+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d7af0 con 0x563edd6c6260 2024-09-12T16:53:19.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.652+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94828002891424] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.656+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.656+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94828002893552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d7ab0 con 0x563edd6c6260 2024-09-12T16:53:19.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.656+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d8500 con 0x563edd6cab10 2024-09-12T16:53:19.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.656+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94828002896048] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.656+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94828002893552] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.656+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.656+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94828002898256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d7a20 con 0x563edd6cab10 2024-09-12T16:53:19.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.656+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d8d50 con 0x563edd6cab10 2024-09-12T16:53:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.660+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94828002898256] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.660+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.660+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94828002899584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d8d50 con 0x563edd6cab10 2024-09-12T16:53:19.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.660+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d9600 con 0x563edd6cab10 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94828002905424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d9cb0 con 0x563edd6cab10 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 20 add_watcher() i=0 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 20 add_watcher() i=1 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 20 add_watcher() i=2 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 20 add_watcher() i=3 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 20 add_watcher() i=4 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 20 add_watcher() i=5 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94828002899584] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 20 add_watcher() i=6 2024-09-12T16:53:19.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94828002905424] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 20 add_watcher() i=7 2024-09-12T16:53:19.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:19.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6dcbb0 con 0x563edd6c6260 2024-09-12T16:53:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.664+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94828002907856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d9fd0 con 0x563edd6c6260 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94828002907856] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6b3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 5 note: GC not initialized 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6b3e7fc640 20 reqs_thread_entry: start 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 20 Filter name: none 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6aaffff640 20 reqs_thread_entry: start 2024-09-12T16:53:19.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd6ff8b0 con 0x563edd6c6260 2024-09-12T16:53:19.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:53:19.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563edd700e30 con 0x563edd6cab10 2024-09-12T16:53:19.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6b3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.668+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94828002907856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6ff1d0 con 0x563edd6c6260 2024-09-12T16:53:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.672+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94828002907856] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.672+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94828002884080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6ff1d0 con 0x7f6c880f8040 2024-09-12T16:53:19.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.672+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94828002884080] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.672+0000 7f6c8fd959c0 20 remove_watcher() i=0 2024-09-12T16:53:19.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.672+0000 7f6c8fd959c0 2 removed watcher, disabling cache 2024-09-12T16:53:19.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.672+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94828002888704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d39f0 con 0x563edd6c6260 2024-09-12T16:53:19.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.676+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94828002888704] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.676+0000 7f6c8fd959c0 20 remove_watcher() i=1 2024-09-12T16:53:19.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.676+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94828002891424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d4c00 con 0x563edd6cf600 2024-09-12T16:53:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.676+0000 7f6c8d89b640 1 -- 172.21.15.151:0/1646808465 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94828002891424] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c880ced70 con 0x563edd6cf600 2024-09-12T16:53:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.676+0000 7f6c8fd959c0 20 remove_watcher() i=2 2024-09-12T16:53:19.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.676+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94828002896048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d56a0 con 0x7f6c880f8040 2024-09-12T16:53:19.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.680+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94828002896048] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x7f6c880f8040 2024-09-12T16:53:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.680+0000 7f6c8fd959c0 20 remove_watcher() i=3 2024-09-12T16:53:19.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.680+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94828002893552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d68b0 con 0x563edd6c6260 2024-09-12T16:53:19.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.680+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94828002893552] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8402a040 con 0x563edd6c6260 2024-09-12T16:53:19.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.680+0000 7f6c8fd959c0 20 remove_watcher() i=4 2024-09-12T16:53:19.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.680+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94828002898256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d68b0 con 0x563edd6cab10 2024-09-12T16:53:19.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.684+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94828002898256] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.684+0000 7f6c8fd959c0 20 remove_watcher() i=5 2024-09-12T16:53:19.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.684+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94828002899584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d68b0 con 0x563edd6cab10 2024-09-12T16:53:19.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.684+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94828002899584] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.684+0000 7f6c8fd959c0 20 remove_watcher() i=6 2024-09-12T16:53:19.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.684+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94828002905424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563edd6d68b0 con 0x563edd6cab10 2024-09-12T16:53:19.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8e09c640 1 -- 172.21.15.151:0/1646808465 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94828002905424] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8003d070 con 0x563edd6cab10 2024-09-12T16:53:19.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 20 remove_watcher() i=7 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd6cab10 msgr2=0x563edd6ccf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd6cab10 0x563edd6ccf00 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd6c6260 msgr2=0x563edd6c86f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd6c6260 0x563edd6c86f0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6c880f8040 msgr2=0x7f6c880a93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f6c880f8040 0x7f6c880a93c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563edd6cf600 msgr2=0x563edd6d1ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x563edd6cf600 0x563edd6d1ac0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b58039a70 msgr2=0x7f6b5803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b58039a70 0x7f6b5803bf30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6c8801aec0 tx=0x7f6c880d3000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 msgr2=0x563edd6bafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8d09a640 1 -- 172.21.15.151:0/1646808465 reap_dead start 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6bafb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6c8004b010 tx=0x7f6c80050860 comp rx=0 tx=0).stop 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 shutdown_connections 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1646808465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6b4b20 0x563edd6bafb0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 >> 172.21.15.151:0/1646808465 conn(0x563edd6aff40 msgr2=0x563edd6ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 shutdown_connections 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1646808465 wait complete. 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1899251842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b68039a70 msgr2=0x7f6b6803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1899251842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b68039a70 0x7f6b6803bf30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x563edd68d850 tx=0x7f6c880e99e0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1899251842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6a7190 msgr2=0x563edd6a75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1899251842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6a7190 0x563edd6a75b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x563edd68d750 tx=0x7f6c8000af40 comp rx=0 tx=0).stop 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1899251842 shutdown_connections 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1899251842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b68039a70 0x7f6b6803bf30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/1899251842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd6a7190 0x563edd6a75b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1899251842 >> 172.21.15.151:0/1899251842 conn(0x563edd69cb40 msgr2=0x563edd69cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1899251842 shutdown_connections 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/1899251842 wait complete. 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd696020 msgr2=0x563edd698410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd696020 0x563edd698410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd691520 msgr2=0x563edd693910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd691520 0x563edd693910 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b74039ac0 msgr2=0x7f6b7403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b74039ac0 0x7f6b7403bf80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6c84001ec0 tx=0x7f6c84001440 comp rx=0 tx=0).stop 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 msgr2=0x563edd68c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd68c460 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6c880aa6b0 tx=0x563edd50d420 comp rx=0 tx=0).stop 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 shutdown_connections 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x563edd696020 0x563edd698410 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x563edd691520 0x563edd693910 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6b74039ac0 0x7f6b7403bf80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 --2- 172.21.15.151:0/4206968950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563edd50dae0 0x563edd68c460 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 >> 172.21.15.151:0/4206968950 conn(0x563edd592ac0 msgr2=0x563edd67f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 shutdown_connections 2024-09-12T16:53:19.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.688+0000 7f6c8fd959c0 1 -- 172.21.15.151:0/4206968950 wait complete. 2024-09-12T16:53:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T16:00:00.000000Z","epoch":1726156800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T16:53:19.705 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:53:19.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-12T16:53:19.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-12T16:53:19.706 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-12T16:53:19.789 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:19.790 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:19.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0304ce9c0 1 Processor -- start 2024-09-12T16:53:19.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0304ce9c0 1 -- start start 2024-09-12T16:53:19.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0304ce9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55978f8d5600 0x55978f969780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0304ce9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55978f8159c0 con 0x55978f8d5220 2024-09-12T16:53:19.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0304ce9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55978f8656d0 con 0x55978f8d5600 2024-09-12T16:53:19.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0257d3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55978f8d5600 0x55978f969780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0257d3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55978f8d5600 0x55978f969780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40556/0 (socket says 172.21.15.151:40556) 2024-09-12T16:53:19.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0257d3640 1 -- 172.21.15.151:0/2817798135 learned_addr learned my addr 172.21.15.151:0/2817798135 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0257d3640 1 -- 172.21.15.151:0/2817798135 >> v1:172.21.15.122:6789/0 conn(0x55978f8d5220 legacy=0x55978f966050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0257d3640 1 -- 172.21.15.151:0/2817798135 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978f809ca0 con 0x55978f8d5600 2024-09-12T16:53:19.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff0257d3640 1 --2- 172.21.15.151:0/2817798135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5600 0x55978f969780 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff01800a5c0 tx=0x7ff01801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ca5fb3e57c9550 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.788+0000 7ff02d7d3640 1 -- 172.21.15.151:0/2817798135 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0180a6070 con 0x55978f8d5600 2024-09-12T16:53:19.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff02d7d3640 1 -- 172.21.15.151:0/2817798135 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0180af070 con 0x55978f8d5600 2024-09-12T16:53:19.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff02d7d3640 1 -- 172.21.15.151:0/2817798135 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0180aa5c0 con 0x55978f8d5600 2024-09-12T16:53:19.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2817798135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5600 msgr2=0x55978f969780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2817798135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5600 0x55978f969780 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff01800a5c0 tx=0x7ff01801b340 comp rx=0 tx=0).stop 2024-09-12T16:53:19.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2817798135 shutdown_connections 2024-09-12T16:53:19.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2817798135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5600 0x55978f969780 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2817798135 >> 172.21.15.151:0/2817798135 conn(0x55978f95b940 msgr2=0x55978f95dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2817798135 shutdown_connections 2024-09-12T16:53:19.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.792+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2817798135 wait complete. 2024-09-12T16:53:19.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 Processor -- start 2024-09-12T16:53:19.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- start start 2024-09-12T16:53:19.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa4e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55978f869680 con 0x55978f8d5220 2024-09-12T16:53:19.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff02dfd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa4e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff02dfd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa4e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40562/0 (socket says 172.21.15.151:40562) 2024-09-12T16:53:19.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff02dfd4640 1 -- 172.21.15.151:0/785077494 learned_addr learned my addr 172.21.15.151:0/785077494 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff02dfd4640 1 -- 172.21.15.151:0/785077494 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978f7e4da0 con 0x55978f8d5220 2024-09-12T16:53:19.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/785077494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa4e9e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff02000b220 tx=0x7ff02000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0343798e7b5bde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7fef1be07640 1 -- 172.21.15.151:0/785077494 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff02000a040 con 0x55978f8d5220 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7fef1be07640 1 -- 172.21.15.151:0/785077494 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02000f750 con 0x55978f8d5220 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7fef1be07640 1 -- 172.21.15.151:0/785077494 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff02000fa70 con 0x55978f8d5220 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/785077494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 msgr2=0x55978fa4e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/785077494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa4e9e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff02000b220 tx=0x7ff02000b6e0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/785077494 shutdown_connections 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/785077494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa4e9e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/785077494 >> 172.21.15.151:0/785077494 conn(0x55978f95b940 msgr2=0x55978fa4a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/785077494 shutdown_connections 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/785077494 wait complete. 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 Processor -- start 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- start start 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa56080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff0304ce9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55978f80ba50 con 0x55978f8d5220 2024-09-12T16:53:19.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff02dfd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa56080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff02dfd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa56080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40568/0 (socket says 172.21.15.151:40568) 2024-09-12T16:53:19.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.808+0000 7ff02dfd4640 1 -- 172.21.15.151:0/3152204129 learned_addr learned my addr 172.21.15.151:0/3152204129 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff02dfd4640 1 -- 172.21.15.151:0/3152204129 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978fa565e0 con 0x55978f8d5220 2024-09-12T16:53:19.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa56080 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x55978fa4f970 tx=0x7ff020000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7fef1a604640 1 -- 172.21.15.151:0/3152204129 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff02001a880 con 0x55978f8d5220 2024-09-12T16:53:19.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7fef1a604640 1 -- 172.21.15.151:0/3152204129 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02001aa20 con 0x55978f8d5220 2024-09-12T16:53:19.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978fa56870 con 0x55978f8d5220 2024-09-12T16:53:19.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7fef1a604640 1 -- 172.21.15.151:0/3152204129 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff02001ad00 con 0x55978f8d5220 2024-09-12T16:53:19.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978fa57220 con 0x55978f8d5220 2024-09-12T16:53:19.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7fef1a604640 1 -- 172.21.15.151:0/3152204129 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff020017050 con 0x55978f8d5220 2024-09-12T16:53:19.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7fef1a604640 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef14039a70 0x7fef1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7fef1a604640 1 -- 172.21.15.151:0/3152204129 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff020015020 con 0x55978f8d5220 2024-09-12T16:53:19.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff0257d3640 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef14039a70 0x7fef1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978f8d5600 0x55978fa5d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa5d730 con 0x55978f8d5600 2024-09-12T16:53:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff02e7d5640 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978f8d5600 0x55978fa5d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff0257d3640 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef14039a70 0x7fef1403bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff0180ae000 tx=0x7ff0180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff02e7d5640 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978f8d5600 0x55978fa5d1f0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff02e7d5640 1 -- 172.21.15.151:0/3152204129 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff02800a4d0 con 0x55978f8d5600 2024-09-12T16:53:19.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.812+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa5db50 con 0x55978f8d5600 2024-09-12T16:53:19.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02e7d5640 1 -- 172.21.15.151:0/3152204129 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff02800a4d0 con 0x55978f8d5600 2024-09-12T16:53:19.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa5f960 0x55978fa61d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa62440 con 0x55978fa5f960 2024-09-12T16:53:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa5f960 0x55978fa61d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa5f960 0x55978fa61d50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02dfd4640 1 -- 172.21.15.151:0/3152204129 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff02002e070 con 0x55978fa5f960 2024-09-12T16:53:19.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa5e800 con 0x55978f8d5600 2024-09-12T16:53:19.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02e7d5640 1 -- 172.21.15.151:0/3152204129 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff02800a4d0 con 0x55978f8d5600 2024-09-12T16:53:19.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa5eca0 con 0x55978f8d5600 2024-09-12T16:53:19.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02e7d5640 1 -- 172.21.15.151:0/3152204129 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff02800a4d0 con 0x55978f8d5600 2024-09-12T16:53:19.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff0304ce9c0 1 Processor -- start 2024-09-12T16:53:19.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff0304ce9c0 1 -- start start 2024-09-12T16:53:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff0304ce9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa70ad0 0x55978fa70ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff0304ce9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55978f876450 con 0x55978fa70ad0 2024-09-12T16:53:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02e7d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa70ad0 0x55978fa70ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02e7d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa70ad0 0x55978fa70ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40572/0 (socket says 172.21.15.151:40572) 2024-09-12T16:53:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02e7d5640 1 -- 172.21.15.151:0/1075950777 learned_addr learned my addr 172.21.15.151:0/1075950777 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.816+0000 7ff02e7d5640 1 -- 172.21.15.151:0/1075950777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978fa71530 con 0x55978fa70ad0 2024-09-12T16:53:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff02e7d5640 1 --2- 172.21.15.151:0/1075950777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa70ad0 0x55978fa70ef0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55978fa57440 tx=0x7ff028018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7fef137fe640 1 -- 172.21.15.151:0/1075950777 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff028014450 con 0x55978fa70ad0 2024-09-12T16:53:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7fef137fe640 1 -- 172.21.15.151:0/1075950777 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028014610 con 0x55978fa70ad0 2024-09-12T16:53:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/1075950777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978fa71d90 con 0x55978fa70ad0 2024-09-12T16:53:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7fef137fe640 1 -- 172.21.15.151:0/1075950777 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff028014930 con 0x55978fa70ad0 2024-09-12T16:53:19.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/1075950777 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978fa72300 con 0x55978fa70ad0 2024-09-12T16:53:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7fef137fe640 1 -- 172.21.15.151:0/1075950777 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff028011040 con 0x55978fa70ad0 2024-09-12T16:53:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7fef137fe640 1 --2- 172.21.15.151:0/1075950777 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef08039a70 0x7fef0803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7fef137fe640 1 -- 172.21.15.151:0/1075950777 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff02801e070 con 0x55978fa70ad0 2024-09-12T16:53:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/1075950777 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef08039a70 0x7fef0803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff0304ce9c0 1 Processor -- start 2024-09-12T16:53:19.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff0304ce9c0 1 -- start start 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/1075950777 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef08039a70 0x7fef0803bf30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55978fa57540 tx=0x7ff02004ebf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff0304ce9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa7e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff0304ce9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55978fa4f230 con 0x55978fa7e480 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff02e7d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa7e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff02e7d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa7e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40574/0 (socket says 172.21.15.151:40574) 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff02e7d5640 1 -- 172.21.15.151:0/401582706 learned_addr learned my addr 172.21.15.151:0/401582706 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff02e7d5640 1 -- 172.21.15.151:0/401582706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978fa7ee50 con 0x55978fa7e480 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.820+0000 7ff02e7d5640 1 --2- 172.21.15.151:0/401582706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa7e860 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff028011e90 tx=0x7ff028041f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99802ae87503c9b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7fef117fa640 1 -- 172.21.15.151:0/401582706 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff02804f2a0 con 0x55978fa7e480 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7fef117fa640 1 -- 172.21.15.151:0/401582706 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028016960 con 0x55978fa7e480 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7fef117fa640 1 -- 172.21.15.151:0/401582706 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff028016440 con 0x55978fa7e480 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/401582706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 msgr2=0x55978fa7e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/401582706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa7e860 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff028011e90 tx=0x7ff028041f80 comp rx=0 tx=0).stop 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/401582706 shutdown_connections 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/401582706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa7e860 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/401582706 >> 172.21.15.151:0/401582706 conn(0x55978fa79840 msgr2=0x55978fa77a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/401582706 shutdown_connections 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/401582706 wait complete. 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 Processor -- start 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- start start 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa84870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55978fa7d370 con 0x55978fa7e480 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff02e7d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa84870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff02e7d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa84870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40582/0 (socket says 172.21.15.151:40582) 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 learned_addr learned my addr 172.21.15.151:0/2956244877 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978fa84dd0 con 0x55978fa7e480 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff02e7d5640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa84870 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff02804f4c0 tx=0x7ff0280505d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7feeff7fe640 1 -- 172.21.15.151:0/2956244877 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff028031070 con 0x55978fa7e480 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7feeff7fe640 1 -- 172.21.15.151:0/2956244877 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02804f2a0 con 0x55978fa7e480 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978fa85060 con 0x55978fa7e480 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7feeff7fe640 1 -- 172.21.15.151:0/2956244877 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff02803e7f0 con 0x55978fa7e480 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.824+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978fa85060 con 0x55978fa7e480 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7feeff7fe640 1 -- 172.21.15.151:0/2956244877 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff028034070 con 0x55978fa7e480 2024-09-12T16:53:19.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7feeff7fe640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feef8039a20 0x7feef803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7feeff7fe640 1 -- 172.21.15.151:0/2956244877 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff028048070 con 0x55978fa7e480 2024-09-12T16:53:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feef8039a20 0x7feef803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978fa8f970 0x55978fa91e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa92580 con 0x55978fa8f970 2024-09-12T16:53:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0257d3640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978fa8f970 0x55978fa91e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feef8039a20 0x7feef803bee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff020018ce0 tx=0x7ff020034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0257d3640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978fa8f970 0x55978fa91e30 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 realm 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa929b0 con 0x55978fa8f970 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa93280 con 0x55978fa8f970 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa93620 con 0x55978fa8f970 2024-09-12T16:53:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa94380 0x55978fa96770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa96d80 con 0x55978fa94380 2024-09-12T16:53:19.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff02e7d5640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa94380 0x55978fa96770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.828+0000 7ff02e7d5640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa94380 0x55978fa96770 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0304ce9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0304ce9c0 20 searching for the correct realm 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55978fa98cd0 0x55978fa9b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55978fa98cd0 0x55978fa9b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55978fa98cd0 0x55978fa9b0e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02dfd4640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ff020051b00 0x7ff020050070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x7ff020051b00 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0257d3640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ff020051b00 0x7ff020050070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0257d3640 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ff020051b00 0x7ff020050070 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa8f970 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa8f970 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.832+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x7ff020051b00 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa8f970 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa8f970 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x7ff020051b00 2024-09-12T16:53:19.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.836+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa8f970 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa8f970 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x7ff020051b00 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa8f970 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.840+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x7ff020051b00 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa98cd0 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa94380 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x55978fa8f970 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9b760 con 0x7ff020051b00 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:19.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa97740 con 0x55978fa8f970 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa97350 con 0x55978fa8f970 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa98030 con 0x55978fa8f970 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 zone default found 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 4 Realm: () 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 zonegroup default 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.844+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa98030 con 0x55978fa94380 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9db00 con 0x55978fa98cd0 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9def0 con 0x55978fa98cd0 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 20 started sync module instance, tier type = 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9cf90 con 0x7ff020051b00 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94109438694544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9cf90 con 0x7ff020051b00 2024-09-12T16:53:19.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.848+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9e9d0 con 0x55978fa8f970 2024-09-12T16:53:19.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.852+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94109438694544] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.852+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.852+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94109438698688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9cf90 con 0x55978fa8f970 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.852+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9f3e0 con 0x55978fa98cd0 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.852+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.852+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94109438701360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9fc30 con 0x55978fa98cd0 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.852+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa05f0 con 0x7ff020051b00 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.852+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94109438698688] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.856+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.856+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94109438705984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa0560 con 0x7ff020051b00 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.856+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa1370 con 0x55978fa8f970 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.856+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94109438701360] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.856+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94109438705984] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.856+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.856+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94109438703488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa0e30 con 0x55978fa8f970 2024-09-12T16:53:19.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.856+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa16c0 con 0x55978fa94380 2024-09-12T16:53:19.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.860+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94109438703488] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.860+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.860+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94109438708368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa1ab0 con 0x55978fa94380 2024-09-12T16:53:19.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.860+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa2470 con 0x55978fa94380 2024-09-12T16:53:19.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.860+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.860+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94109438713792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa2890 con 0x55978fa94380 2024-09-12T16:53:19.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.860+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa3360 con 0x55978fa94380 2024-09-12T16:53:19.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.860+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94109438708368] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94109438713792] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94109438717520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa2420 con 0x55978fa94380 2024-09-12T16:53:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 20 add_watcher() i=0 2024-09-12T16:53:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 20 add_watcher() i=1 2024-09-12T16:53:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 20 add_watcher() i=2 2024-09-12T16:53:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 20 add_watcher() i=3 2024-09-12T16:53:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 20 add_watcher() i=4 2024-09-12T16:53:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 20 add_watcher() i=5 2024-09-12T16:53:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 20 add_watcher() i=6 2024-09-12T16:53:19.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94109438717520] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 20 add_watcher() i=7 2024-09-12T16:53:19.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:19.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978faa6460 con 0x55978fa8f970 2024-09-12T16:53:19.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.864+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94109438709488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa38e0 con 0x55978fa8f970 2024-09-12T16:53:19.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94109438709488] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7feedf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:19.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:19.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 5 note: GC not initialized 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7feede7fc640 20 reqs_thread_entry: start 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 20 Filter name: none 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7fee4ffff640 20 reqs_thread_entry: start 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fac94b0 con 0x55978fa94380 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fac7b50 con 0x55978fa8f970 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T16:53:19.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.868+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fac8420 con 0x55978fa94380 2024-09-12T16:53:19.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff0304ce9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-12T16:53:19.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff0304ce9c0 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T16:53:19.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff0304ce9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-12T16:53:19.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94109438869360 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978faccaa0 con 0x55978fa94380 2024-09-12T16:53:19.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== watch-notify(notify (1) cookie 94109438717520 notify 146028888078 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55978fac8e00 con 0x55978fa94380 2024-09-12T16:53:19.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7fef117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94109438717520 notifier 4726 bl.length()=556 2024-09-12T16:53:19.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7fef117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-12T16:53:19.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7fef117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T16:53:19.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(65 notify.7 [notify cookie 94109438869360 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7fef117fa640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7feef0003eb0 con 0x55978fa94380 2024-09-12T16:53:19.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== watch-notify(notify_complete (2) cookie 94109438869360 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff028046070 con 0x55978fa94380 2024-09-12T16:53:19.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.872+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fac8420 con 0x55978fa8f970 2024-09-12T16:53:19.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff0304ce9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T16:53:19.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff0304ce9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T16:53:19.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff0304ce9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T16:53:19.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94109438869360 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55978fac8390 con 0x55978fa94380 2024-09-12T16:53:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== watch-notify(notify (1) cookie 94109438708368 notify 146028888079 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7ff028046070 con 0x55978fa94380 2024-09-12T16:53:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7fef117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94109438708368 notifier 4726 bl.length()=177 2024-09-12T16:53:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7fef117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T16:53:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7fef117fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T16:53:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7fef117fa640 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7feef0003eb0 con 0x55978fa94380 2024-09-12T16:53:19.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(68 notify.5 [notify cookie 94109438869360 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== watch-notify(notify_complete (2) cookie 94109438869360 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55978fa7ee50 con 0x55978fa94380 2024-09-12T16:53:19.881 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-12T16:53:19.873078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:53:19.873063Z","tags":[],"group_ids":[]} 2024-09-12T16:53:19.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7feedf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:19.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.876+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94109438709488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fac7200 con 0x55978fa8f970 2024-09-12T16:53:19.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.880+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94109438709488] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.880+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94109438694544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fac7200 con 0x7ff020051b00 2024-09-12T16:53:19.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.880+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94109438694544] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.880+0000 7ff0304ce9c0 20 remove_watcher() i=0 2024-09-12T16:53:19.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.880+0000 7ff0304ce9c0 2 removed watcher, disabling cache 2024-09-12T16:53:19.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.880+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94109438698688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fac7200 con 0x55978fa8f970 2024-09-12T16:53:19.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94109438698688] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff0304ce9c0 20 remove_watcher() i=1 2024-09-12T16:53:19.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94109438701360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9e4c0 con 0x55978fa98cd0 2024-09-12T16:53:19.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff02dfd4640 1 -- 172.21.15.151:0/2956244877 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94109438701360] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff02003a040 con 0x55978fa98cd0 2024-09-12T16:53:19.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff0304ce9c0 20 remove_watcher() i=2 2024-09-12T16:53:19.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94109438705984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9ef30 con 0x7ff020051b00 2024-09-12T16:53:19.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94109438705984] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x7ff020051b00 2024-09-12T16:53:19.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff0304ce9c0 20 remove_watcher() i=3 2024-09-12T16:53:19.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.884+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94109438703488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa0140 con 0x55978fa8f970 2024-09-12T16:53:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.888+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94109438703488] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0180aaa00 con 0x55978fa8f970 2024-09-12T16:53:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.888+0000 7ff0304ce9c0 20 remove_watcher() i=4 2024-09-12T16:53:19.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.888+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94109438708368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9ef30 con 0x55978fa94380 2024-09-12T16:53:19.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.892+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94109438708368] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.892+0000 7ff0304ce9c0 20 remove_watcher() i=5 2024-09-12T16:53:19.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.892+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94109438713792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978faa0140 con 0x55978fa94380 2024-09-12T16:53:19.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.892+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94109438713792] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.892+0000 7ff0304ce9c0 20 remove_watcher() i=6 2024-09-12T16:53:19.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.892+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94109438717520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55978fa9ef30 con 0x55978fa94380 2024-09-12T16:53:19.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff02e7d5640 1 -- 172.21.15.151:0/2956244877 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94109438717520] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff028033030 con 0x55978fa94380 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 20 remove_watcher() i=7 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa94380 msgr2=0x55978fa96770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa94380 0x55978fa96770 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978fa8f970 msgr2=0x55978fa91e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978fa8f970 0x55978fa91e30 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ff020051b00 msgr2=0x7ff020050070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ff020051b00 0x7ff020050070 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55978fa98cd0 msgr2=0x55978fa9b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55978fa98cd0 0x55978fa9b0e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feef8039a20 msgr2=0x7feef803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7feef8039a20 0x7feef803bee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff020018ce0 tx=0x7ff020034000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0257d3640 1 -- 172.21.15.151:0/2956244877 reap_dead start 2024-09-12T16:53:19.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 msgr2=0x55978fa84870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa84870 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff02804f4c0 tx=0x7ff0280505d0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 shutdown_connections 2024-09-12T16:53:19.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/2956244877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa7e480 0x55978fa84870 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 >> 172.21.15.151:0/2956244877 conn(0x55978fa79840 msgr2=0x55978fa77a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 shutdown_connections 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/2956244877 wait complete. 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/1075950777 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef08039a70 msgr2=0x7fef0803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/1075950777 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef08039a70 0x7fef0803bf30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55978fa57540 tx=0x7ff02004ebf0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/1075950777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa70ad0 msgr2=0x55978fa70ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/1075950777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa70ad0 0x55978fa70ef0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55978fa57440 tx=0x7ff028018830 comp rx=0 tx=0).stop 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/1075950777 shutdown_connections 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/1075950777 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef08039a70 0x7fef0803bf30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/1075950777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978fa70ad0 0x55978fa70ef0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/1075950777 >> 172.21.15.151:0/1075950777 conn(0x55978fa66480 msgr2=0x55978fa66860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/1075950777 shutdown_connections 2024-09-12T16:53:19.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/1075950777 wait complete. 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa5f960 msgr2=0x55978fa61d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa5f960 0x55978fa61d50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978f8d5600 msgr2=0x55978fa5d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978f8d5600 0x55978fa5d1f0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef14039a70 msgr2=0x7fef1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef14039a70 0x7fef1403bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff0180ae000 tx=0x7ff0180a6000 comp rx=0 tx=0).stop 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 msgr2=0x55978fa56080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa56080 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x55978fa4f970 tx=0x7ff020000bd0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 shutdown_connections 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55978fa5f960 0x55978fa61d50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55978f8d5600 0x55978fa5d1f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fef14039a70 0x7fef1403bf30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 --2- 172.21.15.151:0/3152204129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55978f8d5220 0x55978fa56080 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 >> 172.21.15.151:0/3152204129 conn(0x55978f95b940 msgr2=0x55978fa490b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 shutdown_connections 2024-09-12T16:53:19.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.896+0000 7ff0304ce9c0 1 -- 172.21.15.151:0/3152204129 wait complete. 2024-09-12T16:53:19.911 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-12T16:53:19.873078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:53:19.873063Z', 'tags': [], 'group_ids': []} 2024-09-12T16:53:19.929 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:53:19.936 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-12T16:53:19.936 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-12T16:53:19.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-12T16:53:19.937 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-12T16:53:19.985 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:19.986 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:19.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e18b589c0 1 Processor -- start 2024-09-12T16:53:19.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e18b589c0 1 -- start start 2024-09-12T16:53:19.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e18b589c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x556031ef9fe0 0x556031efc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:19.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e18b589c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556031dab9c0 con 0x556031ef5df0 2024-09-12T16:53:19.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e18b589c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x556031dfb6d0 con 0x556031ef9fe0 2024-09-12T16:53:19.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e15e5d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x556031ef9fe0 0x556031efc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:19.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e15e5d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x556031ef9fe0 0x556031efc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40598/0 (socket says 172.21.15.151:40598) 2024-09-12T16:53:19.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e1665e640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x556031ef5df0 0x556031ef61d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:43258/0 (socket says 172.21.15.151:43258) 2024-09-12T16:53:19.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e15e5d640 1 -- 172.21.15.151:0/91669155 learned_addr learned my addr 172.21.15.151:0/91669155 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:19.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e15e5d640 1 -- 172.21.15.151:0/91669155 >> v1:172.21.15.122:6789/0 conn(0x556031ef5df0 legacy=0x556031ef61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.984+0000 7f7e15e5d640 1 -- 172.21.15.151:0/91669155 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556031d9fca0 con 0x556031ef9fe0 2024-09-12T16:53:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e15e5d640 1 --2- 172.21.15.151:0/91669155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef9fe0 0x556031efc3d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00a5c0 tx=0x7f7e0c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829239fa91f24363 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e1565c640 1 -- 172.21.15.151:0/91669155 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e0c0a9590 con 0x556031ef9fe0 2024-09-12T16:53:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e1565c640 1 -- 172.21.15.151:0/91669155 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0ae070 con 0x556031ef9fe0 2024-09-12T16:53:19.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e1565c640 1 -- 172.21.15.151:0/91669155 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e0c0a9880 con 0x556031ef9fe0 2024-09-12T16:53:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e18b589c0 1 -- 172.21.15.151:0/91669155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef9fe0 msgr2=0x556031efc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/91669155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef9fe0 0x556031efc3d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00a5c0 tx=0x7f7e0c01b3d0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e18b589c0 1 -- 172.21.15.151:0/91669155 shutdown_connections 2024-09-12T16:53:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/91669155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef9fe0 0x556031efc3d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e18b589c0 1 -- 172.21.15.151:0/91669155 >> 172.21.15.151:0/91669155 conn(0x556031ef1910 msgr2=0x556031ef3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e18b589c0 1 -- 172.21.15.151:0/91669155 shutdown_connections 2024-09-12T16:53:19.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:19.988+0000 7f7e18b589c0 1 -- 172.21.15.151:0/91669155 wait complete. 2024-09-12T16:53:20.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.000+0000 7f7e18b589c0 1 Processor -- start 2024-09-12T16:53:20.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.000+0000 7f7e18b589c0 1 -- start start 2024-09-12T16:53:20.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.000+0000 7f7e18b589c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.000+0000 7f7e18b589c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556031dff680 con 0x556031ef5df0 2024-09-12T16:53:20.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.000+0000 7f7e1665e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.000+0000 7f7e1665e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40602/0 (socket says 172.21.15.151:40602) 2024-09-12T16:53:20.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.000+0000 7f7e1665e640 1 -- 172.21.15.151:0/1381940348 learned_addr learned my addr 172.21.15.151:0/1381940348 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:20.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.000+0000 7f7e1665e640 1 -- 172.21.15.151:0/1381940348 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556031d7ada0 con 0x556031ef5df0 2024-09-12T16:53:20.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e1665e640 1 --2- 172.21.15.151:0/1381940348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe04d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7e080016f0 tx=0x7f7e08001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b2802f8b32a531 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7d04608640 1 -- 172.21.15.151:0/1381940348 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08003460 con 0x556031ef5df0 2024-09-12T16:53:20.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7d04608640 1 -- 172.21.15.151:0/1381940348 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08003620 con 0x556031ef5df0 2024-09-12T16:53:20.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7d04608640 1 -- 172.21.15.151:0/1381940348 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08003940 con 0x556031ef5df0 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- 172.21.15.151:0/1381940348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 msgr2=0x556031fe04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/1381940348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe04d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7e080016f0 tx=0x7f7e08001bb0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- 172.21.15.151:0/1381940348 shutdown_connections 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/1381940348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe04d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- 172.21.15.151:0/1381940348 >> 172.21.15.151:0/1381940348 conn(0x556031ef1910 msgr2=0x556031fdc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- 172.21.15.151:0/1381940348 shutdown_connections 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- 172.21.15.151:0/1381940348 wait complete. 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 Processor -- start 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- start start 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556031da1a50 con 0x556031ef5df0 2024-09-12T16:53:20.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e1665e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e1665e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40614/0 (socket says 172.21.15.151:40614) 2024-09-12T16:53:20.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e1665e640 1 -- 172.21.15.151:0/797198353 learned_addr learned my addr 172.21.15.151:0/797198353 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:20.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e1665e640 1 -- 172.21.15.151:0/797198353 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556031fe8070 con 0x556031ef5df0 2024-09-12T16:53:20.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e1665e640 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe7b10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x556031fe1460 tx=0x7f7e08001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7d02e05640 1 -- 172.21.15.151:0/797198353 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e08022020 con 0x556031ef5df0 2024-09-12T16:53:20.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556031fe8300 con 0x556031ef5df0 2024-09-12T16:53:20.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7d02e05640 1 -- 172.21.15.151:0/797198353 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0801e480 con 0x556031ef5df0 2024-09-12T16:53:20.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7d02e05640 1 -- 172.21.15.151:0/797198353 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e0801e760 con 0x556031ef5df0 2024-09-12T16:53:20.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.004+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556031fe8d30 con 0x556031ef5df0 2024-09-12T16:53:20.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7d02e05640 1 -- 172.21.15.151:0/797198353 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7e08025020 con 0x556031ef5df0 2024-09-12T16:53:20.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7d02e05640 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cfc039ac0 0x7f7cfc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7d02e05640 1 -- 172.21.15.151:0/797198353 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7e08050280 con 0x556031ef5df0 2024-09-12T16:53:20.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e15e5d640 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cfc039ac0 0x7f7cfc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556031ef9fe0 0x556031feec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556031fef1c0 con 0x556031ef9fe0 2024-09-12T16:53:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e16e5f640 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556031ef9fe0 0x556031feec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e15e5d640 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cfc039ac0 0x7f7cfc03bf80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0ad000 tx=0x7f7e0c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e16e5f640 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556031ef9fe0 0x556031feec80 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e16e5f640 1 -- 172.21.15.151:0/797198353 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e100083f0 con 0x556031ef9fe0 2024-09-12T16:53:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556031fe8fe0 con 0x556031ef9fe0 2024-09-12T16:53:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e16e5f640 1 -- 172.21.15.151:0/797198353 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e100083f0 con 0x556031ef9fe0 2024-09-12T16:53:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556031ff1460 0x556031ff3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556031ff3f90 con 0x556031ff1460 2024-09-12T16:53:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.008+0000 7f7e1665e640 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556031ff1460 0x556031ff3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e1665e640 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556031ff1460 0x556031ff3850 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e1665e640 1 -- 172.21.15.151:0/797198353 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e0801b040 con 0x556031ff1460 2024-09-12T16:53:20.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556031ff02a0 con 0x556031ef9fe0 2024-09-12T16:53:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e16e5f640 1 -- 172.21.15.151:0/797198353 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e100083f0 con 0x556031ef9fe0 2024-09-12T16:53:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556031ff06d0 con 0x556031ef9fe0 2024-09-12T16:53:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e16e5f640 1 -- 172.21.15.151:0/797198353 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e100083f0 con 0x556031ef9fe0 2024-09-12T16:53:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e18b589c0 1 Processor -- start 2024-09-12T16:53:20.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e18b589c0 1 -- start start 2024-09-12T16:53:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e18b589c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560320069d0 0x556032006df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e18b589c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556031e0c450 con 0x5560320069d0 2024-09-12T16:53:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e16e5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560320069d0 0x556032006df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e16e5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560320069d0 0x556032006df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40628/0 (socket says 172.21.15.151:40628) 2024-09-12T16:53:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3947682475 learned_addr learned my addr 172.21.15.151:0/3947682475 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:20.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3947682475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556032007430 con 0x5560320069d0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.012+0000 7f7e16e5f640 1 --2- 172.21.15.151:0/3947682475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560320069d0 0x556032006df0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x556031fe8b40 tx=0x7f7e1000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7cfbfff640 1 -- 172.21.15.151:0/3947682475 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e10007d70 con 0x5560320069d0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7cfbfff640 1 -- 172.21.15.151:0/3947682475 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1001e020 con 0x5560320069d0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3947682475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556032007c90 con 0x5560320069d0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7cfbfff640 1 -- 172.21.15.151:0/3947682475 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e10019590 con 0x5560320069d0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3947682475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556032008200 con 0x5560320069d0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7cfbfff640 1 -- 172.21.15.151:0/3947682475 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7e10016040 con 0x5560320069d0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7cfbfff640 1 --2- 172.21.15.151:0/3947682475 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cf0039a70 0x7f7cf003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7cfbfff640 1 -- 172.21.15.151:0/3947682475 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7e1001f030 con 0x5560320069d0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e1665e640 1 --2- 172.21.15.151:0/3947682475 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cf0039a70 0x7f7cf003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e18b589c0 1 Processor -- start 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e18b589c0 1 -- start start 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e1665e640 1 --2- 172.21.15.151:0/3947682475 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cf0039a70 0x7f7cf003bf30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e0804e5d0 tx=0x7f7e08010c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e18b589c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x556032014720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e18b589c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556031fe0cc0 con 0x556032014340 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e16e5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x556032014720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e16e5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x556032014720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40638/0 (socket says 172.21.15.151:40638) 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3009094094 learned_addr learned my addr 172.21.15.151:0/3009094094 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.016+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3009094094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556032014d10 con 0x556032014340 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e16e5f640 1 --2- 172.21.15.151:0/3009094094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x556032014720 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7e100508a0 tx=0x7f7e10023410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b645cd85685b813f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7cf9ffb640 1 -- 172.21.15.151:0/3009094094 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e1001d040 con 0x556032014340 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7cf9ffb640 1 -- 172.21.15.151:0/3009094094 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1004f210 con 0x556032014340 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7cf9ffb640 1 -- 172.21.15.151:0/3009094094 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e1004f3e0 con 0x556032014340 2024-09-12T16:53:20.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3009094094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 msgr2=0x556032014720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3009094094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x556032014720 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7e100508a0 tx=0x7f7e10023410 comp rx=0 tx=0).stop 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3009094094 shutdown_connections 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3009094094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x556032014720 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3009094094 >> 172.21.15.151:0/3009094094 conn(0x55603200f760 msgr2=0x55603200d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3009094094 shutdown_connections 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3009094094 wait complete. 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 Processor -- start 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- start start 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x55603201a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556032013290 con 0x556032014340 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e16e5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x55603201a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e16e5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x55603201a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:40652/0 (socket says 172.21.15.151:40652) 2024-09-12T16:53:20.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 learned_addr learned my addr 172.21.15.151:0/3985704706 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55603201ad70 con 0x556032014340 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e16e5f640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x55603201a810 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7e10023720 tx=0x7f7e10050830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7ce7fff640 1 -- 172.21.15.151:0/3985704706 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e1001d030 con 0x556032014340 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7ce7fff640 1 -- 172.21.15.151:0/3985704706 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e10049040 con 0x556032014340 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55603201b000 con 0x556032014340 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7ce7fff640 1 -- 172.21.15.151:0/3985704706 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e100188e0 con 0x556032014340 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.020+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603201b9b0 con 0x556032014340 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7ce7fff640 1 -- 172.21.15.151:0/3985704706 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7e10018b90 con 0x556032014340 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7ce7fff640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7ce0039a70 0x7f7ce003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7ce7fff640 1 -- 172.21.15.151:0/3985704706 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7e10038d50 con 0x556032014340 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e1665e640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7ce0039a70 0x7f7ce003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556032025b30 0x556032027ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032028740 con 0x556032025b30 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e15e5d640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556032025b30 0x556032027ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e1665e640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7ce0039a70 0x7f7ce003bf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7e08010da0 tx=0x7f7e08047f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e15e5d640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556032025b30 0x556032027ff0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 realm 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032028b70 con 0x556032025b30 2024-09-12T16:53:20.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032029440 con 0x556032025b30 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560320297e0 con 0x556032025b30 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55603202a540 0x55603202c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603202cf40 con 0x55603202a540 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e16e5f640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55603202a540 0x55603202c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e16e5f640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55603202a540 0x55603202c930 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 20 searching for the correct realm 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55603202ee90 0x5560320312a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.024+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e1665e640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55603202ee90 0x5560320312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e1665e640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55603202ee90 0x5560320312a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e1665e640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7e08027020 0x7f7e080267e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:20.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x7f7e08027020 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e15e5d640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7e08027020 0x7f7e080267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e15e5d640 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7e08027020 0x7f7e080267e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x556032025b30 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x556032025b30 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.028+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x7f7e08027020 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x556032025b30 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x556032025b30 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x7f7e08027020 2024-09-12T16:53:20.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x556032025b30 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.032+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x556032025b30 2024-09-12T16:53:20.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x7f7e08027020 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x556032025b30 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x7f7e08027020 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202ee90 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.036+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x55603202a540 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x556032025b30 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556032031920 con 0x7f7e08027020 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:20.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603202d900 con 0x556032025b30 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603202d540 con 0x556032025b30 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:20.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603202e220 con 0x556032025b30 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 zone default found 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 4 Realm: () 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 zonegroup default 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603202e240 con 0x55603202a540 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:20.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032033cc0 con 0x55603202ee90 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032034060 con 0x55603202ee90 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 started sync module instance, tier type = 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.040+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032033150 con 0x7f7e08027020 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.044+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.044+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93871644292688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032033150 con 0x7f7e08027020 2024-09-12T16:53:20.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.044+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032034b70 con 0x556032025b30 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.044+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93871644292688] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.044+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.044+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93871644296800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032033150 con 0x556032025b30 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.044+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032035580 con 0x55603202ee90 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93871644299472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032035e20 con 0x55603202ee90 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560320367e0 con 0x7f7e08027020 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93871644296800] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93871644304176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032036750 con 0x7f7e08027020 2024-09-12T16:53:20.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032037530 con 0x556032025b30 2024-09-12T16:53:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93871644299472] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93871644304176] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93871644301680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032037030 con 0x556032025b30 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.048+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032037dd0 con 0x55603202a540 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.052+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93871644301680] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.052+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.052+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93871644309792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032037030 con 0x55603202a540 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.052+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032038620 con 0x55603202a540 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.052+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93871644309792] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.052+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.052+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93871644306304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032038800 con 0x55603202a540 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.052+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032039050 con 0x55603202a540 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93871644306304] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93871644312880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032038f20 con 0x55603202a540 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e18b589c0 20 add_watcher() i=0 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e18b589c0 20 add_watcher() i=1 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e18b589c0 20 add_watcher() i=2 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e18b589c0 20 add_watcher() i=3 2024-09-12T16:53:20.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e18b589c0 20 add_watcher() i=4 2024-09-12T16:53:20.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e18b589c0 20 add_watcher() i=5 2024-09-12T16:53:20.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e18b589c0 20 add_watcher() i=6 2024-09-12T16:53:20.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.056+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93871644312880] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 20 add_watcher() i=7 2024-09-12T16:53:20.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:20.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603203c490 con 0x556032025b30 2024-09-12T16:53:20.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93871644314064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560320399e0 con 0x556032025b30 2024-09-12T16:53:20.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93871644314064] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7cccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:20.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:20.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:20.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 5 note: GC not initialized 2024-09-12T16:53:20.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7c477fe640 20 reqs_thread_entry: start 2024-09-12T16:53:20.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:20.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 20 Filter name: none 2024-09-12T16:53:20.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7c457fa640 20 reqs_thread_entry: start 2024-09-12T16:53:20.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T16:53:20.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603205f680 con 0x55603202a540 2024-09-12T16:53:20.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T16:53:20.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-12T16:53:20.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T16:53:20.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:53:20.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.060+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032063970 con 0x7f7e08027020 2024-09-12T16:53:20.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T16:53:20.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T16:53:20.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T16:53:20.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 93871644484480 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560320645e0 con 0x55603202a540 2024-09-12T16:53:20.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== watch-notify(notify (1) cookie 93871644309792 notify 146028888080 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55603201b000 con 0x55603202a540 2024-09-12T16:53:20.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7cf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 93871644309792 notifier 4733 bl.length()=382 2024-09-12T16:53:20.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7cf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T16:53:20.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7cf9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T16:53:20.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7cf9ffb640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7cdc003eb0 con 0x55603202a540 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(64 notify.5 [notify cookie 93871644484480 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== watch-notify(notify_complete (2) cookie 93871644484480 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55603201ad70 con 0x55603202a540 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032062380 con 0x556032025b30 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 : miss 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 8.0 8:00386c13:root::.bucket.meta.myfoo6%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032061fa0 con 0x55603202ee90 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 info.flags=0x17 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 to cache LRU end 2024-09-12T16:53:20.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.064+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 8.0 8:00386c13:root::.bucket.meta.myfoo6%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55603206ba80 con 0x55603202ee90 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 info.flags=0x17 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 to cache LRU end 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9, ofs0, ns] 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [notify cookie 93871644477904 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032067ba0 con 0x556032025b30 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== watch-notify(notify (1) cookie 93871644301680 notify 146028888104 ret 0) ==== 798+0+0 (crc 0 0 0) 0x556031d9fca0 con 0x556032025b30 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7cf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 93871644301680 notifier 4733 bl.length()=756 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7cf97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 info.flags=0x17 2024-09-12T16:53:20.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7cf97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 to cache LRU end 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7cf97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7cf97fa640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7c4c003540 con 0x556032025b30 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(69 notify.4 [notify cookie 93871644477904 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 93871644477904 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7e0c0d84d0 con 0x556032025b30 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(70 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 20 handle_bi_update(): bucket=:myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]): orig_sources= new_sources= 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 20 handle_bi_update(): bucket=:myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]): potential sources added=[] removed=[] 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 20 handle_bi_update(): bucket=:myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]): orig_dests= new_dests= 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 20 handle_bi_update(): bucket=:myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]): potential dests added=[] removed=[] 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560320666c0 con 0x556032025b30 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(71 bud.buckets [call] v34'5 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060af0 con 0x556032025b30 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(72 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.068+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060af0 con 0x556032025b30 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 93871644501696 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032067fa0 con 0x7f7e08027020 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== watch-notify(notify (1) cookie 93871644304176 notify 146028888081 ret 0) ==== 358+0+0 (crc 0 0 0) 0x556032061520 con 0x7f7e08027020 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 93871644304176 notifier 4733 bl.length()=316 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf9ffb640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7cdc003eb0 con 0x7f7e08027020 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(74 notify.3 [notify cookie 93871644501696 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== watch-notify(notify_complete (2) cookie 93871644501696 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7e0c0d84d0 con 0x7f7e08027020 2024-09-12T16:53:20.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 : hit (requested=0x17, cached=0x17) 2024-09-12T16:53:20.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 2024-09-12T16:53:20.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:76 8.0 8:00386c13:root::.bucket.meta.myfoo6%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032065f60 con 0x55603202ee90 2024-09-12T16:53:20.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(76 .bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 info.flags=0x17 2024-09-12T16:53:20.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 to cache LRU end 2024-09-12T16:53:20.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T16:53:20.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9, ofs0, ns] 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 93871644497264 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065e40 con 0x556032025b30 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== watch-notify(notify (1) cookie 93871644301680 notify 146028888105 ret 0) ==== 798+0+0 (crc 0 0 0) 0x7f7e0c0d84d0 con 0x556032025b30 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 93871644301680 notifier 4733 bl.length()=756 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 info.flags=0x17 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 to cache LRU end 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7cf97fa640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7c4c003520 con 0x556032025b30 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(77 notify.4 [notify cookie 93871644497264 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== watch-notify(notify_complete (2) cookie 93871644497264 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7e0c0d8d30 con 0x556032025b30 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 20 handle_bi_update(): bucket=:myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]): orig_sources= new_sources= 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 20 handle_bi_update(): bucket=:myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]): potential sources added=[] removed=[] 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 20 handle_bi_update(): bucket=:myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]): orig_dests= new_dests= 2024-09-12T16:53:20.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 20 handle_bi_update(): bucket=:myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]): potential dests added=[] removed=[] 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.072+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 4.19 4:9ae444df:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065a20 con 0x55603202ee90 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(79 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 4.f 4:f2e22db6:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065570 con 0x556032025b30 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(80 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:81 4.1e 4:7b16bb2b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065570 con 0x55603202a540 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(81 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:82 4.13 4:c9522374:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065530 con 0x7f7e08027020 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(82 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:83 4.2d 4:b6ab0f1e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065530 con 0x55603202a540 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(83 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 4.d 4:b3186d07:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065530 con 0x55603202ee90 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(84 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:85 4.17 4:ea69d204:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065530 con 0x55603202a540 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(85 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.076+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:86 4.21 4:852d3841:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065530 con 0x55603202a540 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(86 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 4.25 4:a6370575:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065530 con 0x55603202ee90 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(87 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:88 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065530 con 0x55603202ee90 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(88 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [call out=382b] v0'0 uv6 ondisk = 0) ==== 194+0+382 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 10 cls_bucket_list_unordered: got thirteen 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 4.10 4:0a54344d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065570 con 0x55603202ee90 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(89 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 get_obj_state: octx=0x7f7e0c0a9960 obj=myfoo6:thirteen state=0x5560320668a8 s->prefetch_data=0 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:90 3.32s0 3:4fbe83a9:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556032065570 con 0x55603202ee90 2024-09-12T16:53:20.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(90 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 10 manifest: total_size = 8 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 get_obj_state: setting s->obj_tag to 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.15341916355773242441 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 Read xattr rgw_rados: user.rgw.acl 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 Read xattr rgw_rados: user.rgw.etag 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 get_obj_state: octx=0x7f7e0c0a9960 obj=myfoo6:thirteen state=0x5560320668a8 s->prefetch_data=0 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 : hit (requested=0x17, cached=0x17) 2024-09-12T16:53:20.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560320650b0 con 0x55603202ee90 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(91 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.080+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:92 3.32s0 3:4fbe83a9:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55603206d390 con 0x55603202ee90 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(92 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:93 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55603206d390 con 0x55603202ee90 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:1 objects processed in :myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9]). Next marker thirteen 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55603206d390 con 0x7f7e08027020 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(93 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7cf9ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e18b589c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e18b589c0 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T16:53:20.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e18b589c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T16:53:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 93871644493088 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603206d390 con 0x55603202a540 2024-09-12T16:53:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== watch-notify(notify (1) cookie 93871644309792 notify 146028888081 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55603201ad70 con 0x55603202a540 2024-09-12T16:53:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7cf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 93871644309792 notifier 4733 bl.length()=556 2024-09-12T16:53:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7cf97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T16:53:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7cf97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T16:53:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.084+0000 7f7cf97fa640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7c4c003580 con 0x55603202a540 2024-09-12T16:53:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(95 notify.5 [notify cookie 93871644493088 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== watch-notify(notify_complete (2) cookie 93871644493088 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556032014d10 con 0x55603202a540 2024-09-12T16:53:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x556032025b30 2024-09-12T16:53:20.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e18b589c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e18b589c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e18b589c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 93871644493088 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603206d390 con 0x55603202a540 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== watch-notify(notify (1) cookie 93871644309792 notify 146028888082 ret 0) ==== 219+0+0 (crc 0 0 0) 0x556032014d10 con 0x55603202a540 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7cf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 93871644309792 notifier 4733 bl.length()=177 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7cf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7cf9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7cf9ffb640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7cdc003eb0 con 0x55603202a540 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(98 notify.5 [notify cookie 93871644493088 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== watch-notify(notify_complete (2) cookie 93871644493088 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556032008200 con 0x55603202a540 2024-09-12T16:53:20.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e18b589c0 10 removing user index: bar 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.088+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x55603202a540 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(100 bar [delete] v34'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e18b589c0 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e18b589c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 93871644493088 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55603206d390 con 0x55603202a540 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== watch-notify(notify (1) cookie 93871644312880 notify 146028888083 ret 0) ==== 194+0+0 (crc 0 0 0) 0x556032008200 con 0x55603202a540 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7cf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 93871644312880 notifier 4733 bl.length()=152 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== osd_op_reply(101 notify.7 [notify cookie 93871644493088 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7cf97fa640 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7c4c003580 con 0x55603202a540 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== watch-notify(notify_complete (2) cookie 93871644493088 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556032007c90 con 0x55603202a540 2024-09-12T16:53:20.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.101 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-12T16:53:19.873078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:53:19.873063Z","tags":[],"group_ids":[]} 2024-09-12T16:53:20.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7cccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:20.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.092+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93871644314064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x556032025b30 2024-09-12T16:53:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.096+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93871644314064] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.096+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93871644292688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x7f7e08027020 2024-09-12T16:53:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.096+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93871644292688] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.096+0000 7f7e18b589c0 20 remove_watcher() i=0 2024-09-12T16:53:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.096+0000 7f7e18b589c0 2 removed watcher, disabling cache 2024-09-12T16:53:20.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.096+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93871644296800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x556032025b30 2024-09-12T16:53:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93871644296800] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e18b589c0 20 remove_watcher() i=1 2024-09-12T16:53:20.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93871644299472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x55603202ee90 2024-09-12T16:53:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e1665e640 1 -- 172.21.15.151:0/3985704706 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93871644299472] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0803a040 con 0x55603202ee90 2024-09-12T16:53:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e18b589c0 20 remove_watcher() i=2 2024-09-12T16:53:20.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93871644304176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x7f7e08027020 2024-09-12T16:53:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93871644304176] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x7f7e08027020 2024-09-12T16:53:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e18b589c0 20 remove_watcher() i=3 2024-09-12T16:53:20.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.100+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93871644301680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x556032025b30 2024-09-12T16:53:20.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.104+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93871644301680] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e0c0a99e0 con 0x556032025b30 2024-09-12T16:53:20.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.104+0000 7f7e18b589c0 20 remove_watcher() i=4 2024-09-12T16:53:20.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.104+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93871644309792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x55603202a540 2024-09-12T16:53:20.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.104+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93871644309792] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.104+0000 7f7e18b589c0 20 remove_watcher() i=5 2024-09-12T16:53:20.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.104+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93871644306304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x55603202a540 2024-09-12T16:53:20.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93871644306304] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 20 remove_watcher() i=6 2024-09-12T16:53:20.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93871644312880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556032060360 con 0x55603202a540 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e16e5f640 1 -- 172.21.15.151:0/3985704706 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93871644312880] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e1003e070 con 0x55603202a540 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 20 remove_watcher() i=7 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55603202a540 msgr2=0x55603202c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55603202a540 0x55603202c930 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556032025b30 msgr2=0x556032027ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556032025b30 0x556032027ff0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7e08027020 msgr2=0x7f7e080267e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f7e08027020 0x7f7e080267e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55603202ee90 msgr2=0x5560320312a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55603202ee90 0x5560320312a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7ce0039a70 msgr2=0x7f7ce003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7ce0039a70 0x7f7ce003bf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7e08010da0 tx=0x7f7e08047f90 comp rx=0 tx=0).stop 2024-09-12T16:53:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 msgr2=0x55603201a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3985704706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556032014340 0x55603201a810 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7e10023720 tx=0x7f7e10050830 comp rx=0 tx=0).stop 2024-09-12T16:53:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 reap_dead start 2024-09-12T16:53:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e15e5d640 1 -- 172.21.15.151:0/3985704706 reap_dead start 2024-09-12T16:53:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 shutdown_connections 2024-09-12T16:53:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 >> 172.21.15.151:0/3985704706 conn(0x55603200f760 msgr2=0x55603200d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 shutdown_connections 2024-09-12T16:53:20.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3985704706 wait complete. 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3947682475 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cf0039a70 msgr2=0x7f7cf003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3947682475 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cf0039a70 0x7f7cf003bf30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7e0804e5d0 tx=0x7f7e08010c70 comp rx=0 tx=0).stop 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3947682475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560320069d0 msgr2=0x556032006df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3947682475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560320069d0 0x556032006df0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x556031fe8b40 tx=0x7f7e1000af40 comp rx=0 tx=0).stop 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3947682475 shutdown_connections 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3947682475 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cf0039a70 0x7f7cf003bf30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/3947682475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560320069d0 0x556032006df0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.108+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3947682475 >> 172.21.15.151:0/3947682475 conn(0x556031ff7f70 msgr2=0x556031ff8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3947682475 shutdown_connections 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/3947682475 wait complete. 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556031ff1460 msgr2=0x556031ff3850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556031ff1460 0x556031ff3850 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556031ef9fe0 msgr2=0x556031feec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556031ef9fe0 0x556031feec80 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cfc039ac0 msgr2=0x7f7cfc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cfc039ac0 0x7f7cfc03bf80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0ad000 tx=0x7f7e0c0a6000 comp rx=0 tx=0).stop 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 msgr2=0x556031fe7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe7b10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x556031fe1460 tx=0x7f7e08001260 comp rx=0 tx=0).stop 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 shutdown_connections 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556031ff1460 0x556031ff3850 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556031ef9fe0 0x556031feec80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7cfc039ac0 0x7f7cfc03bf80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 --2- 172.21.15.151:0/797198353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556031ef5df0 0x556031fe7b10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 >> 172.21.15.151:0/797198353 conn(0x556031ef1910 msgr2=0x556031fdaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:20.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 shutdown_connections 2024-09-12T16:53:20.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:20.112+0000 7f7e18b589c0 1 -- 172.21.15.151:0/797198353 wait complete. 2024-09-12T16:53:20.124 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-12T16:53:19.873078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:53:19.873063Z', 'tags': [], 'group_ids': []} 2024-09-12T16:53:25.136 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:53:25.136 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-12T16:53:25.136 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-12T16:53:25.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-12T16:53:25.137 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-12T16:53:25.185 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:25.185 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:25.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.180+0000 7fc854c759c0 1 Processor -- start 2024-09-12T16:53:25.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc854c759c0 1 -- start start 2024-09-12T16:53:25.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc854c759c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x556f0d139600 0x556f0d1cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc854c759c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f0d0799c0 con 0x556f0d139220 2024-09-12T16:53:25.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc854c759c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x556f0d0c96d0 con 0x556f0d139600 2024-09-12T16:53:25.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc851f7a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x556f0d139600 0x556f0d1cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc851f7a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x556f0d139600 0x556f0d1cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57342/0 (socket says 172.21.15.151:57342) 2024-09-12T16:53:25.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc851f7a640 1 -- 172.21.15.151:0/3315884987 learned_addr learned my addr 172.21.15.151:0/3315884987 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc851f7a640 1 -- 172.21.15.151:0/3315884987 >> v1:172.21.15.122:6789/0 conn(0x556f0d139220 legacy=0x556f0d1ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc851779640 1 -- 172.21.15.151:0/3315884987 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627485895 0 0) 0x556f0d0799c0 con 0x556f0d139220 2024-09-12T16:53:25.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc851f7a640 1 -- 172.21.15.151:0/3315884987 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0d06dca0 con 0x556f0d139600 2024-09-12T16:53:25.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.184+0000 7fc851f7a640 1 --2- 172.21.15.151:0/3315884987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139600 0x556f0d1cd780 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc84800a5c0 tx=0x7fc84801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcc9930e389c407 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc851779640 1 -- 172.21.15.151:0/3315884987 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8480a6070 con 0x556f0d139600 2024-09-12T16:53:25.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc851779640 1 -- 172.21.15.151:0/3315884987 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8480af070 con 0x556f0d139600 2024-09-12T16:53:25.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc851779640 1 -- 172.21.15.151:0/3315884987 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8480aa5c0 con 0x556f0d139600 2024-09-12T16:53:25.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc854c759c0 1 -- 172.21.15.151:0/3315884987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139600 msgr2=0x556f0d1cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3315884987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139600 0x556f0d1cd780 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc84800a5c0 tx=0x7fc84801b340 comp rx=0 tx=0).stop 2024-09-12T16:53:25.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc854c759c0 1 -- 172.21.15.151:0/3315884987 shutdown_connections 2024-09-12T16:53:25.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3315884987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139600 0x556f0d1cd780 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc854c759c0 1 -- 172.21.15.151:0/3315884987 >> 172.21.15.151:0/3315884987 conn(0x556f0d1bf940 msgr2=0x556f0d1c1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc854c759c0 1 -- 172.21.15.151:0/3315884987 shutdown_connections 2024-09-12T16:53:25.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.188+0000 7fc854c759c0 1 -- 172.21.15.151:0/3315884987 wait complete. 2024-09-12T16:53:25.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 Processor -- start 2024-09-12T16:53:25.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- start start 2024-09-12T16:53:25.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556f0d0cd680 con 0x556f0d139220 2024-09-12T16:53:25.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc85277b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc85277b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57346/0 (socket says 172.21.15.151:57346) 2024-09-12T16:53:25.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc85277b640 1 -- 172.21.15.151:0/2974982240 learned_addr learned my addr 172.21.15.151:0/2974982240 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc85277b640 1 -- 172.21.15.151:0/2974982240 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0d048da0 con 0x556f0d139220 2024-09-12T16:53:25.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc85277b640 1 --2- 172.21.15.151:0/2974982240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b2810 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc84c006f80 tx=0x7fc84c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9e8a4ce69ac6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc740608640 1 -- 172.21.15.151:0/2974982240 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84c017070 con 0x556f0d139220 2024-09-12T16:53:25.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc740608640 1 -- 172.21.15.151:0/2974982240 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c0025d0 con 0x556f0d139220 2024-09-12T16:53:25.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc740608640 1 -- 172.21.15.151:0/2974982240 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84c002910 con 0x556f0d139220 2024-09-12T16:53:25.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- 172.21.15.151:0/2974982240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 msgr2=0x556f0d2b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 --2- 172.21.15.151:0/2974982240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b2810 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc84c006f80 tx=0x7fc84c001b10 comp rx=0 tx=0).stop 2024-09-12T16:53:25.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- 172.21.15.151:0/2974982240 shutdown_connections 2024-09-12T16:53:25.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 --2- 172.21.15.151:0/2974982240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b2810 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- 172.21.15.151:0/2974982240 >> 172.21.15.151:0/2974982240 conn(0x556f0d1bf940 msgr2=0x556f0d2ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- 172.21.15.151:0/2974982240 shutdown_connections 2024-09-12T16:53:25.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- 172.21.15.151:0/2974982240 wait complete. 2024-09-12T16:53:25.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 Processor -- start 2024-09-12T16:53:25.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- start start 2024-09-12T16:53:25.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc854c759c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556f0d06fa50 con 0x556f0d139220 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc85277b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc85277b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57360/0 (socket says 172.21.15.151:57360) 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.204+0000 7fc85277b640 1 -- 172.21.15.151:0/3533945985 learned_addr learned my addr 172.21.15.151:0/3533945985 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc85277b640 1 -- 172.21.15.151:0/3533945985 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0d2ba490 con 0x556f0d139220 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc85277b640 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b9f30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0012f0 tx=0x7fc84c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc73ee05640 1 -- 172.21.15.151:0/3533945985 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84c023070 con 0x556f0d139220 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f0d2ba720 con 0x556f0d139220 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc73ee05640 1 -- 172.21.15.151:0/3533945985 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c01e430 con 0x556f0d139220 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc73ee05640 1 -- 172.21.15.151:0/3533945985 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84c017070 con 0x556f0d139220 2024-09-12T16:53:25.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0d2bb0d0 con 0x556f0d139220 2024-09-12T16:53:25.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc73ee05640 1 -- 172.21.15.151:0/3533945985 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc84c026070 con 0x556f0d139220 2024-09-12T16:53:25.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc73ee05640 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc738039a70 0x7fc73803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc73ee05640 1 -- 172.21.15.151:0/3533945985 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc84c04f460 con 0x556f0d139220 2024-09-12T16:53:25.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc851f7a640 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc738039a70 0x7fc73803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d139600 0x556f0d2c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2c15e0 con 0x556f0d139600 2024-09-12T16:53:25.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc852f7c640 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d139600 0x556f0d2c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc851f7a640 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc738039a70 0x7fc73803bf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc8480ae000 tx=0x7fc8480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc852f7c640 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d139600 0x556f0d2c10a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc852f7c640 1 -- 172.21.15.151:0/3533945985 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8440083f0 con 0x556f0d139600 2024-09-12T16:53:25.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2bb430 con 0x556f0d139600 2024-09-12T16:53:25.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc852f7c640 1 -- 172.21.15.151:0/3533945985 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8440083f0 con 0x556f0d139600 2024-09-12T16:53:25.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2c38d0 0x556f0d2c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.208+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2c6400 con 0x556f0d2c38d0 2024-09-12T16:53:25.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc85277b640 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2c38d0 0x556f0d2c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc85277b640 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2c38d0 0x556f0d2c5cc0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc85277b640 1 -- 172.21.15.151:0/3533945985 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2c38d0 2024-09-12T16:53:25.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2c2740 con 0x556f0d139600 2024-09-12T16:53:25.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc852f7c640 1 -- 172.21.15.151:0/3533945985 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8440083f0 con 0x556f0d139600 2024-09-12T16:53:25.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2c2b30 con 0x556f0d139600 2024-09-12T16:53:25.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc852f7c640 1 -- 172.21.15.151:0/3533945985 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8440083f0 con 0x556f0d139600 2024-09-12T16:53:25.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc854c759c0 1 Processor -- start 2024-09-12T16:53:25.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc854c759c0 1 -- start start 2024-09-12T16:53:25.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc854c759c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2d49d0 0x556f0d2d4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc854c759c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556f0d0da450 con 0x556f0d2d49d0 2024-09-12T16:53:25.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc852f7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2d49d0 0x556f0d2d4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc852f7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2d49d0 0x556f0d2d4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57376/0 (socket says 172.21.15.151:57376) 2024-09-12T16:53:25.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc852f7c640 1 -- 172.21.15.151:0/1853077706 learned_addr learned my addr 172.21.15.151:0/1853077706 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.212+0000 7fc852f7c640 1 -- 172.21.15.151:0/1853077706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0d2d5430 con 0x556f0d2d49d0 2024-09-12T16:53:25.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc852f7c640 1 --2- 172.21.15.151:0/1853077706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2d49d0 0x556f0d2d4df0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x556f0d2bacb0 tx=0x7fc84400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc737fff640 1 -- 172.21.15.151:0/1853077706 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc844010db0 con 0x556f0d2d49d0 2024-09-12T16:53:25.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc737fff640 1 -- 172.21.15.151:0/1853077706 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84401f020 con 0x556f0d2d49d0 2024-09-12T16:53:25.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc854c759c0 1 -- 172.21.15.151:0/1853077706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f0d2d5c90 con 0x556f0d2d49d0 2024-09-12T16:53:25.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc737fff640 1 -- 172.21.15.151:0/1853077706 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84401a5a0 con 0x556f0d2d49d0 2024-09-12T16:53:25.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc854c759c0 1 -- 172.21.15.151:0/1853077706 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0d2d6200 con 0x556f0d2d49d0 2024-09-12T16:53:25.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc737fff640 1 -- 172.21.15.151:0/1853077706 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc844013030 con 0x556f0d2d49d0 2024-09-12T16:53:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc737fff640 1 --2- 172.21.15.151:0/1853077706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc72c039ac0 0x7fc72c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc737fff640 1 -- 172.21.15.151:0/1853077706 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc844020030 con 0x556f0d2d49d0 2024-09-12T16:53:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc85277b640 1 --2- 172.21.15.151:0/1853077706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc72c039ac0 0x7fc72c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc854c759c0 1 Processor -- start 2024-09-12T16:53:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc854c759c0 1 -- start start 2024-09-12T16:53:25.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc85277b640 1 --2- 172.21.15.151:0/1853077706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc72c039ac0 0x7fc72c03bf80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc84c011fd0 tx=0x7fc84c011400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc854c759c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc854c759c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556f0d2b3060 con 0x556f0d2e2320 2024-09-12T16:53:25.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc852f7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc852f7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57386/0 (socket says 172.21.15.151:57386) 2024-09-12T16:53:25.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc852f7c640 1 -- 172.21.15.151:0/1681274641 learned_addr learned my addr 172.21.15.151:0/1681274641 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc852f7c640 1 -- 172.21.15.151:0/1681274641 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0d2e2d10 con 0x556f0d2e2320 2024-09-12T16:53:25.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc852f7c640 1 --2- 172.21.15.151:0/1681274641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e2720 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc8440507e0 tx=0x7fc844019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60217d00ece1031 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc735ffb640 1 -- 172.21.15.151:0/1681274641 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84404f2d0 con 0x556f0d2e2320 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.216+0000 7fc735ffb640 1 -- 172.21.15.151:0/1681274641 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8440520d0 con 0x556f0d2e2320 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc735ffb640 1 -- 172.21.15.151:0/1681274641 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc844050b80 con 0x556f0d2e2320 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- 172.21.15.151:0/1681274641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 msgr2=0x556f0d2e2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 --2- 172.21.15.151:0/1681274641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e2720 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc8440507e0 tx=0x7fc844019690 comp rx=0 tx=0).stop 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- 172.21.15.151:0/1681274641 shutdown_connections 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 --2- 172.21.15.151:0/1681274641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e2720 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- 172.21.15.151:0/1681274641 >> 172.21.15.151:0/1681274641 conn(0x556f0d2dd740 msgr2=0x556f0d2db980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- 172.21.15.151:0/1681274641 shutdown_connections 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- 172.21.15.151:0/1681274641 wait complete. 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 Processor -- start 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- start start 2024-09-12T16:53:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556f0d2e1270 con 0x556f0d2e2320 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc852f7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc852f7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57394/0 (socket says 172.21.15.151:57394) 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 learned_addr learned my addr 172.21.15.151:0/644101598 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0d2e8da0 con 0x556f0d2e2320 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc852f7c640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e8840 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc844015fd0 tx=0x7fc844050740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc723fff640 1 -- 172.21.15.151:0/644101598 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc844018ad0 con 0x556f0d2e2320 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f0d2e9030 con 0x556f0d2e2320 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc723fff640 1 -- 172.21.15.151:0/644101598 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844018c70 con 0x556f0d2e2320 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc723fff640 1 -- 172.21.15.151:0/644101598 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc84403e960 con 0x556f0d2e2320 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.220+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0d2e99e0 con 0x556f0d2e2320 2024-09-12T16:53:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc723fff640 1 -- 172.21.15.151:0/644101598 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc844040d10 con 0x556f0d2e2320 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc723fff640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc71c039a70 0x7fc71c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc723fff640 1 -- 172.21.15.151:0/644101598 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc844038d40 con 0x556f0d2e2320 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc85277b640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc71c039a70 0x7fc71c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d2f3b50 0x556f0d2f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2f6730 con 0x556f0d2f3b50 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc851f7a640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d2f3b50 0x556f0d2f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc85277b640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc71c039a70 0x7fc71c03bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0064c0 tx=0x7fc84c044000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc851f7a640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d2f3b50 0x556f0d2f5fe0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 realm 2024-09-12T16:53:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2f6b60 con 0x556f0d2f3b50 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2f7430 con 0x556f0d2f3b50 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2f77d0 con 0x556f0d2f3b50 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2f8530 0x556f0d2fa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2faf30 con 0x556f0d2f8530 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc852f7c640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2f8530 0x556f0d2fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.224+0000 7fc852f7c640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2f8530 0x556f0d2fa920 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8440083f0 con 0x556f0d2f8530 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc854c759c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc854c759c0 20 searching for the correct realm 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556f0d2fce10 0x556f0d2ff280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc85277b640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556f0d2fce10 0x556f0d2ff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc85277b640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556f0d2fce10 0x556f0d2ff280 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc85277b640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc84c032030 0x7fc84c040950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x7fc84c032030 2024-09-12T16:53:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc851f7a640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc84c032030 0x7fc84c040950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc851f7a640 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc84c032030 0x7fc84c040950 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f3b50 2024-09-12T16:53:25.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f3b50 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.228+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x7fc84c032030 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f3b50 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f3b50 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x7fc84c032030 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.232+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f3b50 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f3b50 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x7fc84c032030 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f3b50 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.236+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x7fc84c032030 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2fce10 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f8530 2024-09-12T16:53:25.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x556f0d2f3b50 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2ff950 con 0x7fc84c032030 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2fb880 con 0x556f0d2f3b50 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2fc120 con 0x556f0d2f3b50 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2fb4c0 con 0x556f0d2f3b50 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 zone default found 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 4 Realm: () 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:25.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 zonegroup default 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d2fc120 con 0x556f0d2f8530 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.240+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d301cf0 con 0x556f0d2fce10 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d3020c0 con 0x556f0d2fce10 2024-09-12T16:53:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 20 started sync module instance, tier type = 2024-09-12T16:53:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d301180 con 0x7fc84c032030 2024-09-12T16:53:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93935450986112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d301180 con 0x7fc84c032030 2024-09-12T16:53:25.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d302b60 con 0x556f0d2f3b50 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.244+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93935450986112] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.248+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.248+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93935450990192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d301180 con 0x556f0d2f3b50 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.248+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d303570 con 0x556f0d2fce10 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.248+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.248+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93935450992832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d303e10 con 0x556f0d2fce10 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.248+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d3047d0 con 0x7fc84c032030 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.248+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93935450990192] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93935450997536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d304740 con 0x7fc84c032030 2024-09-12T16:53:25.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d305520 con 0x556f0d2f3b50 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93935450992832] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93935450997536] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93935450995040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d305020 con 0x556f0d2f3b50 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d305dc0 con 0x556f0d2f8530 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.252+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93935451003152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d305020 con 0x556f0d2f8530 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.256+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d306c30 con 0x556f0d2f8530 2024-09-12T16:53:25.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.256+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93935450995040] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.256+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93935451003152] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.256+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.256+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93935450999664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d304f90 con 0x556f0d2f8530 2024-09-12T16:53:25.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.256+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d3070e0 con 0x556f0d2f8530 2024-09-12T16:53:25.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93935450999664] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93935451006848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d307050 con 0x556f0d2f8530 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 20 add_watcher() i=0 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 20 add_watcher() i=1 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 20 add_watcher() i=2 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 20 add_watcher() i=3 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 20 add_watcher() i=4 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 20 add_watcher() i=5 2024-09-12T16:53:25.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 20 add_watcher() i=6 2024-09-12T16:53:25.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93935451006848] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 20 add_watcher() i=7 2024-09-12T16:53:25.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:25.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.260+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d30a480 con 0x556f0d2f3b50 2024-09-12T16:53:25.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93935451008368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d3079a0 con 0x556f0d2f3b50 2024-09-12T16:53:25.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93935451008368] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc708fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:25.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:25.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:25.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 5 note: GC not initialized 2024-09-12T16:53:25.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc6837fe640 20 reqs_thread_entry: start 2024-09-12T16:53:25.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:25.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 20 Filter name: none 2024-09-12T16:53:25.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc6817fa640 20 reqs_thread_entry: start 2024-09-12T16:53:25.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:53:25.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32d6f0 con 0x556f0d2f8530 2024-09-12T16:53:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T16:53:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:53:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T16:53:25.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.264+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32bd90 con 0x556f0d2f8530 2024-09-12T16:53:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T16:53:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:53:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T16:53:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T16:53:25.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32c660 con 0x556f0d2f8530 2024-09-12T16:53:25.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T16:53:25.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:53:25.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T16:53:25.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93935451161008 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d330ce0 con 0x556f0d2f8530 2024-09-12T16:53:25.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== watch-notify(notify (1) cookie 93935451003152 notify 146028888084 ret 0) ==== 598+0+0 (crc 0 0 0) 0x556f0d32d040 con 0x556f0d2f8530 2024-09-12T16:53:25.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc735ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 93935451003152 notifier 4740 bl.length()=556 2024-09-12T16:53:25.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc735ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T16:53:25.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc735ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:53:25.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc735ffb640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc718003eb0 con 0x556f0d2f8530 2024-09-12T16:53:25.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.268+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(65 notify.5 [notify cookie 93935451161008 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== watch-notify(notify_complete (2) cookie 93935451161008 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f0d2e8da0 con 0x556f0d2f8530 2024-09-12T16:53:25.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32c610 con 0x556f0d2f8530 2024-09-12T16:53:25.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc854c759c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T16:53:25.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc854c759c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:53:25.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc854c759c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T16:53:25.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93935451160928 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f0d330e40 con 0x556f0d2fce10 2024-09-12T16:53:25.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== watch-notify(notify (1) cookie 93935450992832 notify 146028888070 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fc84c056040 con 0x556f0d2fce10 2024-09-12T16:53:25.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc7357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 93935450992832 notifier 4740 bl.length()=177 2024-09-12T16:53:25.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc7357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T16:53:25.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc7357fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T16:53:25.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc7357fa640 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc688003410 con 0x556f0d2fce10 2024-09-12T16:53:25.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 notify.2 [notify cookie 93935451160928 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.272+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== watch-notify(notify_complete (2) cookie 93935451160928 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f0d2bb0d0 con 0x556f0d2fce10 2024-09-12T16:53:25.281 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T16:53:25.270775Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:53:25.270761Z","tags":[],"group_ids":[]} 2024-09-12T16:53:25.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc708fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93935451008368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x556f0d2f3b50 2024-09-12T16:53:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93935451008368] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93935450986112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x7fc84c032030 2024-09-12T16:53:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93935450986112] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc854c759c0 20 remove_watcher() i=0 2024-09-12T16:53:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc854c759c0 2 removed watcher, disabling cache 2024-09-12T16:53:25.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.276+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93935450990192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x556f0d2f3b50 2024-09-12T16:53:25.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.280+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93935450990192] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.280+0000 7fc854c759c0 20 remove_watcher() i=1 2024-09-12T16:53:25.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.280+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93935450992832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x556f0d2fce10 2024-09-12T16:53:25.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc85277b640 1 -- 172.21.15.151:0/644101598 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93935450992832] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84c025030 con 0x556f0d2fce10 2024-09-12T16:53:25.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc854c759c0 20 remove_watcher() i=2 2024-09-12T16:53:25.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93935450997536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x7fc84c032030 2024-09-12T16:53:25.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93935450997536] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x7fc84c032030 2024-09-12T16:53:25.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc854c759c0 20 remove_watcher() i=3 2024-09-12T16:53:25.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93935450995040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x556f0d2f3b50 2024-09-12T16:53:25.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93935450995040] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8480aa900 con 0x556f0d2f3b50 2024-09-12T16:53:25.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc854c759c0 20 remove_watcher() i=4 2024-09-12T16:53:25.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.284+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93935451003152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x556f0d2f8530 2024-09-12T16:53:25.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.288+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93935451003152] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.288+0000 7fc854c759c0 20 remove_watcher() i=5 2024-09-12T16:53:25.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.288+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93935450999664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x556f0d2f8530 2024-09-12T16:53:25.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.288+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93935450999664] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.288+0000 7fc854c759c0 20 remove_watcher() i=6 2024-09-12T16:53:25.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.288+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93935451006848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f0d32b4c0 con 0x556f0d2f8530 2024-09-12T16:53:25.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc852f7c640 1 -- 172.21.15.151:0/644101598 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93935451006848] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc84405c040 con 0x556f0d2f8530 2024-09-12T16:53:25.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 20 remove_watcher() i=7 2024-09-12T16:53:25.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2f8530 msgr2=0x556f0d2fa920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2f8530 0x556f0d2fa920 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d2f3b50 msgr2=0x556f0d2f5fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d2f3b50 0x556f0d2f5fe0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc84c032030 msgr2=0x7fc84c040950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fc84c032030 0x7fc84c040950 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556f0d2fce10 msgr2=0x556f0d2ff280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556f0d2fce10 0x556f0d2ff280 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc71c039a70 msgr2=0x7fc71c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc71c039a70 0x7fc71c03bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0064c0 tx=0x7fc84c044000 comp rx=0 tx=0).stop 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 msgr2=0x556f0d2e8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/644101598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2e2320 0x556f0d2e8840 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc844015fd0 tx=0x7fc844050740 comp rx=0 tx=0).stop 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc851f7a640 1 -- 172.21.15.151:0/644101598 reap_dead start 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 shutdown_connections 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 >> 172.21.15.151:0/644101598 conn(0x556f0d2dd740 msgr2=0x556f0d2db950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 shutdown_connections 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/644101598 wait complete. 2024-09-12T16:53:25.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/1853077706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc72c039ac0 msgr2=0x7fc72c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/1853077706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc72c039ac0 0x7fc72c03bf80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc84c011fd0 tx=0x7fc84c011400 comp rx=0 tx=0).stop 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/1853077706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2d49d0 msgr2=0x556f0d2d4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/1853077706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2d49d0 0x556f0d2d4df0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x556f0d2bacb0 tx=0x7fc84400af40 comp rx=0 tx=0).stop 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/1853077706 shutdown_connections 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/1853077706 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc72c039ac0 0x7fc72c03bf80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/1853077706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d2d49d0 0x556f0d2d4df0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/1853077706 >> 172.21.15.151:0/1853077706 conn(0x556f0d2ca380 msgr2=0x556f0d2ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/1853077706 shutdown_connections 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/1853077706 wait complete. 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2c38d0 msgr2=0x556f0d2c5cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2c38d0 0x556f0d2c5cc0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d139600 msgr2=0x556f0d2c10a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d139600 0x556f0d2c10a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc738039a70 msgr2=0x7fc73803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc738039a70 0x7fc73803bf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc8480ae000 tx=0x7fc8480a6000 comp rx=0 tx=0).stop 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 msgr2=0x556f0d2b9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b9f30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0012f0 tx=0x7fc84c001260 comp rx=0 tx=0).stop 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 shutdown_connections 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556f0d2c38d0 0x556f0d2c5cc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x556f0d139600 0x556f0d2c10a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fc738039a70 0x7fc73803bf30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 --2- 172.21.15.151:0/3533945985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f0d139220 0x556f0d2b9f30 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.292+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 >> 172.21.15.151:0/3533945985 conn(0x556f0d1bf940 msgr2=0x556f0d2acee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.296+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 shutdown_connections 2024-09-12T16:53:25.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.296+0000 7fc854c759c0 1 -- 172.21.15.151:0/3533945985 wait complete. 2024-09-12T16:53:25.309 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T16:53:25.270775Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:53:25.270761Z', 'tags': [], 'group_ids': []} 2024-09-12T16:53:25.329 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:53:25.338 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-12T16:53:25.338 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-12T16:53:25.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-12T16:53:25.339 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-12T16:53:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f36659f69c0 1 Processor -- start 2024-09-12T16:53:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f36659f69c0 1 -- start start 2024-09-12T16:53:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f36659f69c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5615e7f50fe0 0x5615e7f533d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f36659f69c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5615e7e029c0 con 0x5615e7f4cdf0 2024-09-12T16:53:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f36659f69c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5615e7e526d0 con 0x5615e7f50fe0 2024-09-12T16:53:25.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f3662cfb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5615e7f50fe0 0x5615e7f533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f3662cfb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5615e7f50fe0 0x5615e7f533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57408/0 (socket says 172.21.15.151:57408) 2024-09-12T16:53:25.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f3662cfb640 1 -- 172.21.15.151:0/2764880308 learned_addr learned my addr 172.21.15.151:0/2764880308 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.368+0000 7f36634fc640 1 --1- 172.21.15.151:0/2764880308 >> v1:172.21.15.122:6789/0 conn(0x5615e7f4cdf0 0x5615e7f4d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:33954/0 (socket says 172.21.15.151:33954) 2024-09-12T16:53:25.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f3662cfb640 1 -- 172.21.15.151:0/2764880308 >> v1:172.21.15.122:6789/0 conn(0x5615e7f4cdf0 legacy=0x5615e7f4d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36624fa640 1 -- 172.21.15.151:0/2764880308 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1140743130 0 0) 0x5615e7e029c0 con 0x5615e7f4cdf0 2024-09-12T16:53:25.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f3662cfb640 1 -- 172.21.15.151:0/2764880308 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e7df6ca0 con 0x5615e7f50fe0 2024-09-12T16:53:25.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f3662cfb640 1 --2- 172.21.15.151:0/2764880308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f50fe0 0x5615e7f533d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f364c00a750 tx=0x7f364c01d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18471d7be8a55466 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36624fa640 1 -- 172.21.15.151:0/2764880308 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364c00a200 con 0x5615e7f50fe0 2024-09-12T16:53:25.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36624fa640 1 -- 172.21.15.151:0/2764880308 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c00a3a0 con 0x5615e7f50fe0 2024-09-12T16:53:25.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36624fa640 1 -- 172.21.15.151:0/2764880308 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364c0086f0 con 0x5615e7f50fe0 2024-09-12T16:53:25.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36659f69c0 1 -- 172.21.15.151:0/2764880308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f50fe0 msgr2=0x5615e7f533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36659f69c0 1 --2- 172.21.15.151:0/2764880308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f50fe0 0x5615e7f533d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f364c00a750 tx=0x7f364c01d290 comp rx=0 tx=0).stop 2024-09-12T16:53:25.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36659f69c0 1 -- 172.21.15.151:0/2764880308 shutdown_connections 2024-09-12T16:53:25.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36659f69c0 1 --2- 172.21.15.151:0/2764880308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f50fe0 0x5615e7f533d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36659f69c0 1 -- 172.21.15.151:0/2764880308 >> 172.21.15.151:0/2764880308 conn(0x5615e7f48910 msgr2=0x5615e7f4ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36659f69c0 1 -- 172.21.15.151:0/2764880308 shutdown_connections 2024-09-12T16:53:25.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.372+0000 7f36659f69c0 1 -- 172.21.15.151:0/2764880308 wait complete. 2024-09-12T16:53:25.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.388+0000 7f36659f69c0 1 Processor -- start 2024-09-12T16:53:25.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.388+0000 7f36659f69c0 1 -- start start 2024-09-12T16:53:25.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.388+0000 7f36659f69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e80372b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.388+0000 7f36659f69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615e7e56680 con 0x5615e7f4cdf0 2024-09-12T16:53:25.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.388+0000 7f36634fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e80372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.388+0000 7f36634fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e80372b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57420/0 (socket says 172.21.15.151:57420) 2024-09-12T16:53:25.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.388+0000 7f36634fc640 1 -- 172.21.15.151:0/3485286231 learned_addr learned my addr 172.21.15.151:0/3485286231 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.388+0000 7f36634fc640 1 -- 172.21.15.151:0/3485286231 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e7dd1da0 con 0x5615e7f4cdf0 2024-09-12T16:53:25.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36634fc640 1 --2- 172.21.15.151:0/3485286231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e80372b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f365c001eb0 tx=0x7f365c00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d4529e29aa7b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f355160a640 1 -- 172.21.15.151:0/3485286231 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365c00d640 con 0x5615e7f4cdf0 2024-09-12T16:53:25.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f355160a640 1 -- 172.21.15.151:0/3485286231 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c008070 con 0x5615e7f4cdf0 2024-09-12T16:53:25.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f355160a640 1 -- 172.21.15.151:0/3485286231 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365c00d970 con 0x5615e7f4cdf0 2024-09-12T16:53:25.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 -- 172.21.15.151:0/3485286231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 msgr2=0x5615e80372b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3485286231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e80372b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f365c001eb0 tx=0x7f365c00b6b0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 -- 172.21.15.151:0/3485286231 shutdown_connections 2024-09-12T16:53:25.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3485286231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e80372b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 -- 172.21.15.151:0/3485286231 >> 172.21.15.151:0/3485286231 conn(0x5615e7f48910 msgr2=0x5615e8032ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 -- 172.21.15.151:0/3485286231 shutdown_connections 2024-09-12T16:53:25.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 -- 172.21.15.151:0/3485286231 wait complete. 2024-09-12T16:53:25.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 Processor -- start 2024-09-12T16:53:25.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 -- start start 2024-09-12T16:53:25.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e803ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36659f69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615e7df8a50 con 0x5615e7f4cdf0 2024-09-12T16:53:25.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36634fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e803ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36634fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e803ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57432/0 (socket says 172.21.15.151:57432) 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36634fc640 1 -- 172.21.15.151:0/536553170 learned_addr learned my addr 172.21.15.151:0/536553170 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36634fc640 1 -- 172.21.15.151:0/536553170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e803ef60 con 0x5615e7f4cdf0 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f36634fc640 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e803ea00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f365c000c10 tx=0x7f365c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.392+0000 7f354fe07640 1 -- 172.21.15.151:0/536553170 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365c01a7c0 con 0x5615e7f4cdf0 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f354fe07640 1 -- 172.21.15.151:0/536553170 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c01a960 con 0x5615e7f4cdf0 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615e803f1f0 con 0x5615e7f4cdf0 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f354fe07640 1 -- 172.21.15.151:0/536553170 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365c01ac80 con 0x5615e7f4cdf0 2024-09-12T16:53:25.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e803fba0 con 0x5615e7f4cdf0 2024-09-12T16:53:25.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f354fe07640 1 -- 172.21.15.151:0/536553170 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f365c017070 con 0x5615e7f4cdf0 2024-09-12T16:53:25.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f354fe07640 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3548039ac0 0x7f354803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f354fe07640 1 -- 172.21.15.151:0/536553170 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f365c015020 con 0x5615e7f4cdf0 2024-09-12T16:53:25.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f3662cfb640 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3548039ac0 0x7f354803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e7f50fe0 0x5615e8045b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e80460b0 con 0x5615e7f50fe0 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f3663cfd640 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e7f50fe0 0x5615e8045b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f3662cfb640 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3548039ac0 0x7f354803bf80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f364c0ad000 tx=0x7f364c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f3663cfd640 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e7f50fe0 0x5615e8045b70 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f3663cfd640 1 -- 172.21.15.151:0/536553170 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f365400a4d0 con 0x5615e7f50fe0 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e80464e0 con 0x5615e7f50fe0 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f3663cfd640 1 -- 172.21.15.151:0/536553170 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f365400a4d0 con 0x5615e7f50fe0 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e80482f0 0x5615e804a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e804add0 con 0x5615e80482f0 2024-09-12T16:53:25.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.396+0000 7f36634fc640 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e80482f0 0x5615e804a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36634fc640 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e80482f0 0x5615e804a6e0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36634fc640 1 -- 172.21.15.151:0/536553170 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f365c02e070 con 0x5615e80482f0 2024-09-12T16:53:25.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e8047190 con 0x5615e7f50fe0 2024-09-12T16:53:25.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f3663cfd640 1 -- 172.21.15.151:0/536553170 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f365400a4d0 con 0x5615e7f50fe0 2024-09-12T16:53:25.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e8047630 con 0x5615e7f50fe0 2024-09-12T16:53:25.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f3663cfd640 1 -- 172.21.15.151:0/536553170 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f365400a4d0 con 0x5615e7f50fe0 2024-09-12T16:53:25.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36659f69c0 1 Processor -- start 2024-09-12T16:53:25.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36659f69c0 1 -- start start 2024-09-12T16:53:25.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36659f69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e8059460 0x5615e8059880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36659f69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615e7e63450 con 0x5615e8059460 2024-09-12T16:53:25.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f3663cfd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e8059460 0x5615e8059880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f3663cfd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e8059460 0x5615e8059880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57442/0 (socket says 172.21.15.151:57442) 2024-09-12T16:53:25.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f3663cfd640 1 -- 172.21.15.151:0/1295746931 learned_addr learned my addr 172.21.15.151:0/1295746931 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f3663cfd640 1 -- 172.21.15.151:0/1295746931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e8059ec0 con 0x5615e8059460 2024-09-12T16:53:25.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f3663cfd640 1 --2- 172.21.15.151:0/1295746931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e8059460 0x5615e8059880 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x5615e803f8c0 tx=0x7f3654018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f354d602640 1 -- 172.21.15.151:0/1295746931 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3654014450 con 0x5615e8059460 2024-09-12T16:53:25.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36659f69c0 1 -- 172.21.15.151:0/1295746931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615e805a720 con 0x5615e8059460 2024-09-12T16:53:25.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f354d602640 1 -- 172.21.15.151:0/1295746931 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654014610 con 0x5615e8059460 2024-09-12T16:53:25.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f354d602640 1 -- 172.21.15.151:0/1295746931 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3654014930 con 0x5615e8059460 2024-09-12T16:53:25.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.400+0000 7f36659f69c0 1 -- 172.21.15.151:0/1295746931 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e805ac90 con 0x5615e8059460 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f354d602640 1 -- 172.21.15.151:0/1295746931 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3654011040 con 0x5615e8059460 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f354d602640 1 --2- 172.21.15.151:0/1295746931 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f353c039a70 0x7f353c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f354d602640 1 -- 172.21.15.151:0/1295746931 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f365401e070 con 0x5615e8059460 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36634fc640 1 --2- 172.21.15.151:0/1295746931 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f353c039a70 0x7f353c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36659f69c0 1 Processor -- start 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36659f69c0 1 -- start start 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36634fc640 1 --2- 172.21.15.151:0/1295746931 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f353c039a70 0x7f353c03bf30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5615e803fe90 tx=0x7f365c00ef50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36659f69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e806b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36659f69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615e8037b00 con 0x5615e806b260 2024-09-12T16:53:25.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f3663cfd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e806b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f3663cfd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e806b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57456/0 (socket says 172.21.15.151:57456) 2024-09-12T16:53:25.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f3663cfd640 1 -- 172.21.15.151:0/182098007 learned_addr learned my addr 172.21.15.151:0/182098007 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f3663cfd640 1 -- 172.21.15.151:0/182098007 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e806bc50 con 0x5615e806b260 2024-09-12T16:53:25.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f3663cfd640 1 --2- 172.21.15.151:0/182098007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e806b660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3654011e90 tx=0x7f3654041f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c337c2fc76e8eb39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f3546ffd640 1 -- 172.21.15.151:0/182098007 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3654052110 con 0x5615e806b260 2024-09-12T16:53:25.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f3546ffd640 1 -- 172.21.15.151:0/182098007 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654016440 con 0x5615e806b260 2024-09-12T16:53:25.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f3546ffd640 1 -- 172.21.15.151:0/182098007 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36540430d0 con 0x5615e806b260 2024-09-12T16:53:25.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36659f69c0 1 -- 172.21.15.151:0/182098007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 msgr2=0x5615e806b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36659f69c0 1 --2- 172.21.15.151:0/182098007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e806b660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3654011e90 tx=0x7f3654041f80 comp rx=0 tx=0).stop 2024-09-12T16:53:25.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36659f69c0 1 -- 172.21.15.151:0/182098007 shutdown_connections 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.404+0000 7f36659f69c0 1 --2- 172.21.15.151:0/182098007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e806b660 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 -- 172.21.15.151:0/182098007 >> 172.21.15.151:0/182098007 conn(0x5615e80621d0 msgr2=0x5615e8060410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 -- 172.21.15.151:0/182098007 shutdown_connections 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 -- 172.21.15.151:0/182098007 wait complete. 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 Processor -- start 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 -- start start 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e8071720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615e806a1c0 con 0x5615e806b260 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f3663cfd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e8071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f3663cfd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e8071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57470/0 (socket says 172.21.15.151:57470) 2024-09-12T16:53:25.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 learned_addr learned my addr 172.21.15.151:0/3638385337 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e8071c80 con 0x5615e806b260 2024-09-12T16:53:25.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f3663cfd640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e8071720 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f365402b500 tx=0x7f36540505d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f35457fa640 1 -- 172.21.15.151:0/3638385337 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365404f2a0 con 0x5615e806b260 2024-09-12T16:53:25.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f35457fa640 1 -- 172.21.15.151:0/3638385337 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654052110 con 0x5615e806b260 2024-09-12T16:53:25.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615e8071f10 con 0x5615e806b260 2024-09-12T16:53:25.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f35457fa640 1 -- 172.21.15.151:0/3638385337 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3654050ac0 con 0x5615e806b260 2024-09-12T16:53:25.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e80728c0 con 0x5615e806b260 2024-09-12T16:53:25.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f35457fa640 1 -- 172.21.15.151:0/3638385337 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3654050c60 con 0x5615e806b260 2024-09-12T16:53:25.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f35457fa640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f352c039c10 0x7f352c03c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f35457fa640 1 -- 172.21.15.151:0/3638385337 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f365400e040 con 0x5615e806b260 2024-09-12T16:53:25.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36634fc640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f352c039c10 0x7f352c03c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e807ca00 0x5615e807eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.408+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e807f610 con 0x5615e807ca00 2024-09-12T16:53:25.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3662cfb640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e807ca00 0x5615e807eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36634fc640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f352c039c10 0x7f352c03c0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f365c01cfd0 tx=0x7f365c031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3662cfb640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e807ca00 0x5615e807eec0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 realm 2024-09-12T16:53:25.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e807fa40 con 0x5615e807ca00 2024-09-12T16:53:25.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:25.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e8080310 con 0x5615e807ca00 2024-09-12T16:53:25.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e80806b0 con 0x5615e807ca00 2024-09-12T16:53:25.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:25.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e8081410 0x5615e8083800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e8083e10 con 0x5615e8081410 2024-09-12T16:53:25.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3663cfd640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e8081410 0x5615e8083800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3663cfd640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e8081410 0x5615e8083800 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:25.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 20 searching for the correct realm 2024-09-12T16:53:25.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5615e8085d60 0x5615e8088170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.412+0000 7f36634fc640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5615e8085d60 0x5615e8088170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f36634fc640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5615e8085d60 0x5615e8088170 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f36634fc640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f365c03d050 0x7f365c0193e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x7f365c03d050 2024-09-12T16:53:25.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3662cfb640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f365c03d050 0x7f365c0193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3662cfb640 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f365c03d050 0x7f365c0193e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e807ca00 2024-09-12T16:53:25.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e807ca00 2024-09-12T16:53:25.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.416+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x7f365c03d050 2024-09-12T16:53:25.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e807ca00 2024-09-12T16:53:25.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e807ca00 2024-09-12T16:53:25.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x7f365c03d050 2024-09-12T16:53:25.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.420+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e807ca00 2024-09-12T16:53:25.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e807ca00 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x7f365c03d050 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e807ca00 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.424+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x7f365c03d050 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8085d60 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e8081410 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x5615e807ca00 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5615e80887f0 con 0x7f365c03d050 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:25.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e80847d0 con 0x5615e807ca00 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e8084410 con 0x5615e807ca00 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e80851f0 con 0x5615e807ca00 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:25.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 zone default found 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 4 Realm: () 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 zonegroup default 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.428+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e8088c70 con 0x5615e8081410 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e808af30 con 0x5615e8085d60 2024-09-12T16:53:25.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e808b2d0 con 0x5615e8085d60 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 20 started sync module instance, tier type = 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808a3c0 con 0x7f365c03d050 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94652087183552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808a3c0 con 0x7f365c03d050 2024-09-12T16:53:25.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808bdc0 con 0x5615e807ca00 2024-09-12T16:53:25.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.432+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94652087183552] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.436+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.436+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94652087187632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808a3c0 con 0x5615e807ca00 2024-09-12T16:53:25.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.436+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808c800 con 0x5615e8085d60 2024-09-12T16:53:25.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.436+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94652087187632] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.436+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.436+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94652087181072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808a330 con 0x5615e8085d60 2024-09-12T16:53:25.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.436+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808d590 con 0x7f365c03d050 2024-09-12T16:53:25.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.440+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.440+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94652087193760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808de30 con 0x7f365c03d050 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.440+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808e830 con 0x5615e807ca00 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.440+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94652087181072] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.440+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94652087193760] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.440+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.440+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94652087192560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808d900 con 0x5615e807ca00 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.440+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808f0d0 con 0x5615e8081410 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.444+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94652087192560] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.444+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.444+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94652087200800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808d900 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.444+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808f920 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.444+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94652087200800] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.444+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.444+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94652087198528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e808f920 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.444+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e8090320 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94652087198528] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94652087205424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e8090500 con 0x5615e8081410 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 20 add_watcher() i=0 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 20 add_watcher() i=1 2024-09-12T16:53:25.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 20 add_watcher() i=2 2024-09-12T16:53:25.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 20 add_watcher() i=3 2024-09-12T16:53:25.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 20 add_watcher() i=4 2024-09-12T16:53:25.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 20 add_watcher() i=5 2024-09-12T16:53:25.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 20 add_watcher() i=6 2024-09-12T16:53:25.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94652087205424] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 20 add_watcher() i=7 2024-09-12T16:53:25.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.448+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e80938d0 con 0x5615e807ca00 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94652087206896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e8090cc0 con 0x5615e807ca00 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94652087206896] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f3519fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 5 note: GC not initialized 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f3518fe1640 20 reqs_thread_entry: start 2024-09-12T16:53:25.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:25.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 20 Filter name: none 2024-09-12T16:53:25.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f34927fc640 20 reqs_thread_entry: start 2024-09-12T16:53:25.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T16:53:25.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b69c0 con 0x7f365c03d050 2024-09-12T16:53:25.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T16:53:25.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-12T16:53:25.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T16:53:25.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:53:25.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.452+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80bacb0 con 0x5615e8081410 2024-09-12T16:53:25.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.456+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.462 INFO:teuthology.orchestra.run.smithi151.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-12T16:53:25.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.456+0000 7f3519fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:25.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.456+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94652087206896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x5615e807ca00 2024-09-12T16:53:25.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.456+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94652087206896] v34'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.456+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94652087183552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x7f365c03d050 2024-09-12T16:53:25.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.460+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94652087183552] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.460+0000 7f36659f69c0 20 remove_watcher() i=0 2024-09-12T16:53:25.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.460+0000 7f36659f69c0 2 removed watcher, disabling cache 2024-09-12T16:53:25.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.460+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94652087187632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x5615e807ca00 2024-09-12T16:53:25.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.460+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94652087187632] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.460+0000 7f36659f69c0 20 remove_watcher() i=1 2024-09-12T16:53:25.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.460+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94652087181072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x5615e8085d60 2024-09-12T16:53:25.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.464+0000 7f36634fc640 1 -- 172.21.15.151:0/3638385337 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94652087181072] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365c02e070 con 0x5615e8085d60 2024-09-12T16:53:25.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.464+0000 7f36659f69c0 20 remove_watcher() i=2 2024-09-12T16:53:25.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.464+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94652087193760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x7f365c03d050 2024-09-12T16:53:25.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.464+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94652087193760] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x7f365c03d050 2024-09-12T16:53:25.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.464+0000 7f36659f69c0 20 remove_watcher() i=3 2024-09-12T16:53:25.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.464+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94652087192560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x5615e807ca00 2024-09-12T16:53:25.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.468+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94652087192560] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0aa070 con 0x5615e807ca00 2024-09-12T16:53:25.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.468+0000 7f36659f69c0 20 remove_watcher() i=4 2024-09-12T16:53:25.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.468+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94652087200800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x5615e8081410 2024-09-12T16:53:25.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.468+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94652087200800] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.468+0000 7f36659f69c0 20 remove_watcher() i=5 2024-09-12T16:53:25.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.468+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94652087198528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x5615e8081410 2024-09-12T16:53:25.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94652087198528] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 20 remove_watcher() i=6 2024-09-12T16:53:25.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94652087205424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5615e80b47d0 con 0x5615e8081410 2024-09-12T16:53:25.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f3663cfd640 1 -- 172.21.15.151:0/3638385337 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94652087205424] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365402a070 con 0x5615e8081410 2024-09-12T16:53:25.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 20 remove_watcher() i=7 2024-09-12T16:53:25.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e8081410 msgr2=0x5615e8083800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e8081410 0x5615e8083800 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e807ca00 msgr2=0x5615e807eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e807ca00 0x5615e807eec0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f365c03d050 msgr2=0x7f365c0193e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f365c03d050 0x7f365c0193e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5615e8085d60 msgr2=0x5615e8088170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5615e8085d60 0x5615e8088170 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f352c039c10 msgr2=0x7f352c03c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f352c039c10 0x7f352c03c0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f365c01cfd0 tx=0x7f365c031000 comp rx=0 tx=0).stop 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 msgr2=0x5615e8071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f3662cfb640 1 -- 172.21.15.151:0/3638385337 reap_dead start 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e8071720 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f365402b500 tx=0x7f36540505d0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 shutdown_connections 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/3638385337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e806b260 0x5615e8071720 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 >> 172.21.15.151:0/3638385337 conn(0x5615e80621d0 msgr2=0x5615e80603e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 shutdown_connections 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/3638385337 wait complete. 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/1295746931 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f353c039a70 msgr2=0x7f353c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/1295746931 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f353c039a70 0x7f353c03bf30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5615e803fe90 tx=0x7f365c00ef50 comp rx=0 tx=0).stop 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/1295746931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e8059460 msgr2=0x5615e8059880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/1295746931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e8059460 0x5615e8059880 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x5615e803f8c0 tx=0x7f3654018830 comp rx=0 tx=0).stop 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/1295746931 shutdown_connections 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/1295746931 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f353c039a70 0x7f353c03bf30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 --2- 172.21.15.151:0/1295746931 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e8059460 0x5615e8059880 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.472+0000 7f36659f69c0 1 -- 172.21.15.151:0/1295746931 >> 172.21.15.151:0/1295746931 conn(0x5615e804ee10 msgr2=0x5615e804f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/1295746931 shutdown_connections 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/1295746931 wait complete. 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e80482f0 msgr2=0x5615e804a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e80482f0 0x5615e804a6e0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e7f50fe0 msgr2=0x5615e8045b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e7f50fe0 0x5615e8045b70 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3548039ac0 msgr2=0x7f354803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3548039ac0 0x7f354803bf80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f364c0ad000 tx=0x7f364c0a7000 comp rx=0 tx=0).stop 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 msgr2=0x5615e803ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e803ea00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f365c000c10 tx=0x7f365c000ee0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 shutdown_connections 2024-09-12T16:53:25.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5615e80482f0 0x5615e804a6e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5615e7f50fe0 0x5615e8045b70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3548039ac0 0x7f354803bf80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 --2- 172.21.15.151:0/536553170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615e7f4cdf0 0x5615e803ea00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 >> 172.21.15.151:0/536553170 conn(0x5615e7f48910 msgr2=0x5615e8031980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 shutdown_connections 2024-09-12T16:53:25.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.476+0000 7f36659f69c0 1 -- 172.21.15.151:0/536553170 wait complete. 2024-09-12T16:53:25.490 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T16:53:25.537 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:53:25.537 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-12T16:53:25.545 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-12T16:53:25.546 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-12T16:53:25.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-12T16:53:25.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-12T16:53:25.547 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-12T16:53:25.589 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:25.589 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:25.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.584+0000 7fdb7ff139c0 1 Processor -- start 2024-09-12T16:53:25.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.584+0000 7fdb7ff139c0 1 -- start start 2024-09-12T16:53:25.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.584+0000 7fdb7ff139c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56089c682340 0x56089c684730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.584+0000 7fdb7ff139c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56089c5309c0 con 0x56089c67e1f0 2024-09-12T16:53:25.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.584+0000 7fdb7ff139c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56089c5806d0 con 0x56089c682340 2024-09-12T16:53:25.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.584+0000 7fdb7da19640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x56089c67e1f0 0x56089c67e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:33958/0 (socket says 172.21.15.151:33958) 2024-09-12T16:53:25.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.584+0000 7fdb7da19640 1 -- 172.21.15.151:0/1720834228 learned_addr learned my addr 172.21.15.151:0/1720834228 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:53:25.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892057885 0 0) 0x56089c5309c0 con 0x56089c67e1f0 2024-09-12T16:53:25.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb68001e20 con 0x56089c67e1f0 2024-09-12T16:53:25.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1648800663 0 0) 0x7fdb68001e20 con 0x56089c67e1f0 2024-09-12T16:53:25.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 >> v2:172.21.15.122:3300/0 conn(0x56089c682340 msgr2=0x56089c684730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T16:53:25.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 --2- 172.21.15.151:0/1720834228 >> v2:172.21.15.122:3300/0 conn(0x56089c682340 0x56089c684730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089c524ca0 con 0x56089c67e1f0 2024-09-12T16:53:25.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 <== mon.0 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3718109123 0 0) 0x7fdb70001630 con 0x56089c67e1f0 2024-09-12T16:53:25.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 >> v1:172.21.15.122:6789/0 conn(0x56089c67e1f0 legacy=0x56089c67e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 --2- 172.21.15.151:0/1720834228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68002350 0x7fdb68002750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56089c5806d0 con 0x7fdb68002350 2024-09-12T16:53:25.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7da19640 1 --2- 172.21.15.151:0/1720834228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68002350 0x7fdb68002750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.588+0000 7fdb7da19640 1 -- 172.21.15.151:0/1720834228 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb68001e20 con 0x7fdb68002350 2024-09-12T16:53:25.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7da19640 1 --2- 172.21.15.151:0/1720834228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68002350 0x7fdb68002750 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdb700099f0 tx=0x7fdb7001bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c5da0289c334c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700096c0 con 0x7fdb68002350 2024-09-12T16:53:25.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700a8070 con 0x7fdb68002350 2024-09-12T16:53:25.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ca17640 1 -- 172.21.15.151:0/1720834228 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700a4d60 con 0x7fdb68002350 2024-09-12T16:53:25.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/1720834228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68002350 msgr2=0x7fdb68002750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/1720834228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68002350 0x7fdb68002750 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdb700099f0 tx=0x7fdb7001bca0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/1720834228 shutdown_connections 2024-09-12T16:53:25.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/1720834228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68002350 0x7fdb68002750 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/1720834228 >> v2:172.21.15.122:3300/0 conn(0x56089c682340 0x56089c684730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/1720834228 >> 172.21.15.151:0/1720834228 conn(0x56089c5f1b00 msgr2=0x56089c5f1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/1720834228 shutdown_connections 2024-09-12T16:53:25.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.592+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/1720834228 wait complete. 2024-09-12T16:53:25.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7ff139c0 1 Processor -- start 2024-09-12T16:53:25.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7ff139c0 1 -- start start 2024-09-12T16:53:25.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7ff139c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c67e1f0 0x56089c769490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7ff139c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56089c584680 con 0x56089c67e1f0 2024-09-12T16:53:25.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7da19640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c67e1f0 0x56089c769490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7da19640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c67e1f0 0x56089c769490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57498/0 (socket says 172.21.15.151:57498) 2024-09-12T16:53:25.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7da19640 1 -- 172.21.15.151:0/3728306597 learned_addr learned my addr 172.21.15.151:0/3728306597 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7da19640 1 -- 172.21.15.151:0/3728306597 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089c4ffda0 con 0x56089c67e1f0 2024-09-12T16:53:25.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fdb7da19640 1 --2- 172.21.15.151:0/3728306597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c67e1f0 0x56089c769490 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdb7001c540 tx=0x7fdb70001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f3198592556dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fda6be07640 1 -- 172.21.15.151:0/3728306597 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700014c0 con 0x56089c67e1f0 2024-09-12T16:53:25.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fda6be07640 1 -- 172.21.15.151:0/3728306597 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700a4ac0 con 0x56089c67e1f0 2024-09-12T16:53:25.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.608+0000 7fda6be07640 1 -- 172.21.15.151:0/3728306597 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700a4de0 con 0x56089c67e1f0 2024-09-12T16:53:25.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/3728306597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c67e1f0 msgr2=0x56089c769490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/3728306597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c67e1f0 0x56089c769490 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdb7001c540 tx=0x7fdb70001970 comp rx=0 tx=0).stop 2024-09-12T16:53:25.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/3728306597 shutdown_connections 2024-09-12T16:53:25.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/3728306597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c67e1f0 0x56089c769490 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/3728306597 >> 172.21.15.151:0/3728306597 conn(0x56089c5f1b00 msgr2=0x56089c7651d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/3728306597 shutdown_connections 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/3728306597 wait complete. 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 Processor -- start 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- start start 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c682340 0x56089c770e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56089c526a50 con 0x56089c682340 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7da19640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c682340 0x56089c770e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7da19640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c682340 0x56089c770e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57506/0 (socket says 172.21.15.151:57506) 2024-09-12T16:53:25.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7da19640 1 -- 172.21.15.151:0/2531487338 learned_addr learned my addr 172.21.15.151:0/2531487338 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7da19640 1 -- 172.21.15.151:0/2531487338 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089c7713a0 con 0x56089c682340 2024-09-12T16:53:25.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7da19640 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c682340 0x56089c770e40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdb70000c10 tx=0x7fdb68004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fda6a604640 1 -- 172.21.15.151:0/2531487338 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700c7070 con 0x56089c682340 2024-09-12T16:53:25.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56089c771630 con 0x56089c682340 2024-09-12T16:53:25.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fda6a604640 1 -- 172.21.15.151:0/2531487338 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700c3690 con 0x56089c682340 2024-09-12T16:53:25.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fda6a604640 1 -- 172.21.15.151:0/2531487338 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700c3970 con 0x56089c682340 2024-09-12T16:53:25.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.612+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089c771fc0 con 0x56089c682340 2024-09-12T16:53:25.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fda6a604640 1 -- 172.21.15.151:0/2531487338 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb700ca070 con 0x56089c682340 2024-09-12T16:53:25.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fda6a604640 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda64039a70 0x7fda6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fda6a604640 1 -- 172.21.15.151:0/2531487338 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdb700bd070 con 0x56089c682340 2024-09-12T16:53:25.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7d218640 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda64039a70 0x7fda6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7fdb68002350 0x56089c777f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c778450 con 0x7fdb68002350 2024-09-12T16:53:25.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7e21a640 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7fdb68002350 0x56089c777f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7d218640 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda64039a70 0x7fda6403bf30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdb740084f0 tx=0x7fdb74005610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7e21a640 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7fdb68002350 0x56089c777f10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7e21a640 1 -- 172.21.15.151:0/2531487338 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x7fdb68002350 2024-09-12T16:53:25.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7787f0 con 0x7fdb68002350 2024-09-12T16:53:25.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7e21a640 1 -- 172.21.15.151:0/2531487338 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb7800a4d0 con 0x7fdb68002350 2024-09-12T16:53:25.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c77a600 0x56089c77c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c77d130 con 0x56089c77a600 2024-09-12T16:53:25.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7da19640 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c77a600 0x56089c77c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7da19640 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c77a600 0x56089c77c9f0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7da19640 1 -- 172.21.15.151:0/2531487338 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c77a600 2024-09-12T16:53:25.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.616+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7794a0 con 0x7fdb68002350 2024-09-12T16:53:25.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7e21a640 1 -- 172.21.15.151:0/2531487338 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb7800a4d0 con 0x7fdb68002350 2024-09-12T16:53:25.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c779940 con 0x7fdb68002350 2024-09-12T16:53:25.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7e21a640 1 -- 172.21.15.151:0/2531487338 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb7800a4d0 con 0x7fdb68002350 2024-09-12T16:53:25.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7ff139c0 1 Processor -- start 2024-09-12T16:53:25.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7ff139c0 1 -- start start 2024-09-12T16:53:25.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7ff139c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c78b7c0 0x56089c78bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7ff139c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56089c591450 con 0x56089c78b7c0 2024-09-12T16:53:25.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7e21a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c78b7c0 0x56089c78bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7e21a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c78b7c0 0x56089c78bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57508/0 (socket says 172.21.15.151:57508) 2024-09-12T16:53:25.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7e21a640 1 -- 172.21.15.151:0/704497367 learned_addr learned my addr 172.21.15.151:0/704497367 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7e21a640 1 -- 172.21.15.151:0/704497367 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089c78c220 con 0x56089c78b7c0 2024-09-12T16:53:25.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7e21a640 1 --2- 172.21.15.151:0/704497367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c78b7c0 0x56089c78bbe0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x56089c67f040 tx=0x7fdb78018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fda637fe640 1 -- 172.21.15.151:0/704497367 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb78014450 con 0x56089c78b7c0 2024-09-12T16:53:25.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/704497367 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56089c78ca80 con 0x56089c78b7c0 2024-09-12T16:53:25.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/704497367 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089c78cff0 con 0x56089c78b7c0 2024-09-12T16:53:25.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fda637fe640 1 -- 172.21.15.151:0/704497367 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb78014610 con 0x56089c78b7c0 2024-09-12T16:53:25.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.620+0000 7fda637fe640 1 -- 172.21.15.151:0/704497367 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb78014930 con 0x56089c78b7c0 2024-09-12T16:53:25.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fda637fe640 1 -- 172.21.15.151:0/704497367 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb78011040 con 0x56089c78b7c0 2024-09-12T16:53:25.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fda637fe640 1 --2- 172.21.15.151:0/704497367 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda58039ac0 0x7fda5803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fda637fe640 1 -- 172.21.15.151:0/704497367 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdb7801e070 con 0x56089c78b7c0 2024-09-12T16:53:25.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7da19640 1 --2- 172.21.15.151:0/704497367 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda58039ac0 0x7fda5803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 Processor -- start 2024-09-12T16:53:25.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- start start 2024-09-12T16:53:25.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7da19640 1 --2- 172.21.15.151:0/704497367 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda58039ac0 0x7fda5803bf80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56089c7722a0 tx=0x7fdb700e9b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c799480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56089c769c80 con 0x56089c799080 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7e21a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c799480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7e21a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c799480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57522/0 (socket says 172.21.15.151:57522) 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7e21a640 1 -- 172.21.15.151:0/953387478 learned_addr learned my addr 172.21.15.151:0/953387478 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7e21a640 1 -- 172.21.15.151:0/953387478 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089c799a70 con 0x56089c799080 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7e21a640 1 --2- 172.21.15.151:0/953387478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c799480 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdb78016cc0 tx=0x7fdb7802cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948f363aba2841fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fda617fa640 1 -- 172.21.15.151:0/953387478 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb78028070 con 0x56089c799080 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fda617fa640 1 -- 172.21.15.151:0/953387478 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7804d020 con 0x56089c799080 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fda617fa640 1 -- 172.21.15.151:0/953387478 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb780167c0 con 0x56089c799080 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/953387478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 msgr2=0x56089c799480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/953387478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c799480 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdb78016cc0 tx=0x7fdb7802cca0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/953387478 shutdown_connections 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/953387478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c799480 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/953387478 >> 172.21.15.151:0/953387478 conn(0x56089c794480 msgr2=0x56089c7926c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/953387478 shutdown_connections 2024-09-12T16:53:25.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/953387478 wait complete. 2024-09-12T16:53:25.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 Processor -- start 2024-09-12T16:53:25.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- start start 2024-09-12T16:53:25.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c79f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.624+0000 7fdb7ff139c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56089c797fb0 con 0x56089c799080 2024-09-12T16:53:25.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7e21a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c79f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7e21a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c79f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57536/0 (socket says 172.21.15.151:57536) 2024-09-12T16:53:25.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 learned_addr learned my addr 172.21.15.151:0/4155052150 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56089c79fa70 con 0x56089c799080 2024-09-12T16:53:25.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7e21a640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c79f510 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdb78016cc0 tx=0x7fdb780505c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fda4f7fe640 1 -- 172.21.15.151:0/4155052150 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb780167c0 con 0x56089c799080 2024-09-12T16:53:25.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fda4f7fe640 1 -- 172.21.15.151:0/4155052150 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb78045070 con 0x56089c799080 2024-09-12T16:53:25.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56089c79fd00 con 0x56089c799080 2024-09-12T16:53:25.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fda4f7fe640 1 -- 172.21.15.151:0/4155052150 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb78014ad0 con 0x56089c799080 2024-09-12T16:53:25.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089c7a06b0 con 0x56089c799080 2024-09-12T16:53:25.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fda4f7fe640 1 -- 172.21.15.151:0/4155052150 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdb7803e3f0 con 0x56089c799080 2024-09-12T16:53:25.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fda4f7fe640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda48039a70 0x7fda4803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fda4f7fe640 1 -- 172.21.15.151:0/4155052150 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdb7804e070 con 0x56089c799080 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7da19640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda48039a70 0x7fda4803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56089c7aa9a0 0x56089c7ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7ad5b0 con 0x56089c7aa9a0 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7d218640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56089c7aa9a0 0x56089c7ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7da19640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda48039a70 0x7fda4803bf30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdb70000fe0 tx=0x7fdb700e4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.628+0000 7fdb7d218640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56089c7aa9a0 0x56089c7ace60 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 realm 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7a9cf0 con 0x56089c7aa9a0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7ae0b0 con 0x56089c7aa9a0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7ae980 con 0x56089c7aa9a0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:25.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c7af3a0 0x56089c7b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b1f20 con 0x56089c7af3a0 2024-09-12T16:53:25.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7e21a640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c7af3a0 0x56089c7b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7e21a640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c7af3a0 0x56089c7b1790 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 20 searching for the correct realm 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56089c7b3e70 0x56089c7b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7da19640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56089c7b3e70 0x56089c7b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7da19640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56089c7b3e70 0x56089c7b62a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7da19640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fdb700cc070 0x7fdb700ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x7fdb700cc070 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7d218640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fdb700cc070 0x7fdb700ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.632+0000 7fdb7d218640 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fdb700cc070 0x7fdb700ab5e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7aa9a0 2024-09-12T16:53:25.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7aa9a0 2024-09-12T16:53:25.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x7fdb700cc070 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7aa9a0 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.636+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7aa9a0 2024-09-12T16:53:25.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x7fdb700cc070 2024-09-12T16:53:25.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7aa9a0 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7aa9a0 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.640+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x7fdb700cc070 2024-09-12T16:53:25.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7aa9a0 2024-09-12T16:53:25.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x7fdb700cc070 2024-09-12T16:53:25.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7b3e70 2024-09-12T16:53:25.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.644+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7af3a0 2024-09-12T16:53:25.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x56089c7aa9a0 2024-09-12T16:53:25.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6920 con 0x7fdb700cc070 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b28e0 con 0x56089c7aa9a0 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b2520 con 0x56089c7aa9a0 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b3300 con 0x56089c7aa9a0 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 zone default found 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 4 Realm: () 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 zonegroup default 2024-09-12T16:53:25.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b6da0 con 0x56089c7af3a0 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b8fe0 con 0x56089c7b3e70 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b93b0 con 0x56089c7b3e70 2024-09-12T16:53:25.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 started sync module instance, tier type = 2024-09-12T16:53:25.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:25.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.648+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b8470 con 0x7fdb700cc070 2024-09-12T16:53:25.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.652+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.652+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594985068912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b8470 con 0x7fdb700cc070 2024-09-12T16:53:25.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.652+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b9ef0 con 0x56089c7aa9a0 2024-09-12T16:53:25.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.652+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594985068912] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.652+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.652+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594985073120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b8470 con 0x56089c7aa9a0 2024-09-12T16:53:25.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.652+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7ba900 con 0x56089c7b3e70 2024-09-12T16:53:25.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.656+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594985073120] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.656+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.656+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594985066432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7b83e0 con 0x56089c7b3e70 2024-09-12T16:53:25.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.656+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bb600 con 0x7fdb700cc070 2024-09-12T16:53:25.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.656+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.656+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594985079424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bbea0 con 0x7fdb700cc070 2024-09-12T16:53:25.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.656+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bc8a0 con 0x56089c7aa9a0 2024-09-12T16:53:25.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.656+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594985066432] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.660+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594985079424] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.660+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.660+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594985077920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bb980 con 0x56089c7aa9a0 2024-09-12T16:53:25.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.660+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bd140 con 0x56089c7af3a0 2024-09-12T16:53:25.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.660+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594985077920] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.660+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.660+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594985083824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bb980 con 0x56089c7af3a0 2024-09-12T16:53:25.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.660+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bd5f0 con 0x56089c7af3a0 2024-09-12T16:53:25.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.664+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594985083824] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.664+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.664+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594985086096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bd560 con 0x56089c7af3a0 2024-09-12T16:53:25.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.664+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7be050 con 0x56089c7af3a0 2024-09-12T16:53:25.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.664+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594985086096] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594985089824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7be230 con 0x56089c7af3a0 2024-09-12T16:53:25.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 20 add_watcher() i=0 2024-09-12T16:53:25.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 20 add_watcher() i=1 2024-09-12T16:53:25.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 20 add_watcher() i=2 2024-09-12T16:53:25.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 20 add_watcher() i=3 2024-09-12T16:53:25.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 20 add_watcher() i=4 2024-09-12T16:53:25.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 20 add_watcher() i=5 2024-09-12T16:53:25.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 20 add_watcher() i=6 2024-09-12T16:53:25.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594985089824] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 20 add_watcher() i=7 2024-09-12T16:53:25.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:25.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c1600 con 0x56089c7aa9a0 2024-09-12T16:53:25.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594985091360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7be9f0 con 0x56089c7aa9a0 2024-09-12T16:53:25.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.668+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594985091360] v34'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.672+0000 7fda2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:25.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.672+0000 7fdb7ff139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:25.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.672+0000 7fdb7ff139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:25.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.672+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c9e40 con 0x56089c7aa9a0 2024-09-12T16:53:25.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.672+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.672+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c9e40 con 0x56089c7af3a0 2024-09-12T16:53:25.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.676+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.676+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c9e40 con 0x56089c7b3e70 2024-09-12T16:53:25.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.676+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.676+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c94b0 con 0x56089c7aa9a0 2024-09-12T16:53:25.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.676+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'221 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.676+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c94b0 con 0x7fdb700cc070 2024-09-12T16:53:25.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.680+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.680+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c9680 con 0x56089c7b3e70 2024-09-12T16:53:25.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.680+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.680+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb3c0 con 0x56089c7aa9a0 2024-09-12T16:53:25.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.680+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.680+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb3c0 con 0x56089c7af3a0 2024-09-12T16:53:25.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.684+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.684+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb3c0 con 0x7fdb700cc070 2024-09-12T16:53:25.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.688+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.688+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb3c0 con 0x56089c7b3e70 2024-09-12T16:53:25.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.688+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.688+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x7fdb700cc070 2024-09-12T16:53:25.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.688+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.688+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7af3a0 2024-09-12T16:53:25.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.692+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.692+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x7fdb700cc070 2024-09-12T16:53:25.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.692+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.692+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7af3a0 2024-09-12T16:53:25.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.696+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.696+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7aa9a0 2024-09-12T16:53:25.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.696+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'222 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.696+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.700+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.700+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x7fdb700cc070 2024-09-12T16:53:25.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.700+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.700+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.704+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.704+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7aa9a0 2024-09-12T16:53:25.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.704+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.704+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7aa9a0 2024-09-12T16:53:25.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.708+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'223 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.708+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.708+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.708+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x7fdb700cc070 2024-09-12T16:53:25.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.712+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.712+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.712+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.712+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.712+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.712+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.716+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.716+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.716+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.716+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7af3a0 2024-09-12T16:53:25.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.720+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.720+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.720+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.720+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7af3a0 2024-09-12T16:53:25.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.724+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.724+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7b3e70 2024-09-12T16:53:25.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.724+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.724+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb870 con 0x56089c7af3a0 2024-09-12T16:53:25.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.728+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.728+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7cb8b0 con 0x7fdb700cc070 2024-09-12T16:53:25.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.728+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.728+0000 7fda2e7fc640 20 reqs_thread_entry: start 2024-09-12T16:53:25.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.728+0000 7fdb7ff139c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:25.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.728+0000 7fdb7ff139c0 20 Filter name: none 2024-09-12T16:53:25.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.728+0000 7fd99ffff640 20 reqs_thread_entry: start 2024-09-12T16:53:25.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T16:53:25.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c86d0 con 0x7fdb700cc070 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7c8790 con 0x56089c7aa9a0 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 : miss 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:96 8.0 8:00386c13:root::.bucket.meta.myfoo6%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7e8f20 con 0x56089c7b3e70 2024-09-12T16:53:25.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(96 .bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-12T16:53:25.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 info.flags=0x17 2024-09-12T16:53:25.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 to cache LRU end 2024-09-12T16:53:25.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:53:25.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T16:53:25.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 2024-09-12T16:53:25.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 4.19 4:9ae444df:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c8664e0 con 0x56089c7b3e70 2024-09-12T16:53:25.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(97 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:98 4.f 4:f2e22db6:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7aa9a0 2024-09-12T16:53:25.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(98 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:99 4.1e 4:7b16bb2b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7af3a0 2024-09-12T16:53:25.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(99 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.732+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:100 4.13 4:c9522374:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x7fdb700cc070 2024-09-12T16:53:25.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(100 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:101 4.2d 4:b6ab0f1e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7af3a0 2024-09-12T16:53:25.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(101 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:102 4.d 4:b3186d07:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7b3e70 2024-09-12T16:53:25.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(102 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:103 4.17 4:ea69d204:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7af3a0 2024-09-12T16:53:25.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(103 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:104 4.21 4:852d3841:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7af3a0 2024-09-12T16:53:25.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(104 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:105 4.25 4:a6370575:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7b3e70 2024-09-12T16:53:25.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(105 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.736+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:106 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7b3e70 2024-09-12T16:53:25.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(106 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [call out=349b] v0'0 uv8 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 10 cls_bucket_list_unordered: got thirteen 2024-09-12T16:53:25.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:107 4.10 4:0a54344d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c866520 con 0x56089c7b3e70 2024-09-12T16:53:25.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== osd_op_reply(107 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 20 get_obj_state: octx=0x7fdb74014b60 obj=myfoo6:thirteen state=0x56089c864568 s->prefetch_data=0 2024-09-12T16:53:25.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:108 3.32s0 3:4fbe83a9:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c865390 con 0x56089c7b3e70 2024-09-12T16:53:25.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(108 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 10 manifest: total_size = 8 2024-09-12T16:53:25.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 20 get_obj_state: setting s->obj_tag to _7jd_5S88f-rv07_tq-JULC_fEX7bZda 2024-09-12T16:53:25.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 20 get_obj_state: octx=0x7fdb74014b60 obj=myfoo6:thirteen state=0x56089c864568 s->prefetch_data=0 2024-09-12T16:53:25.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 20 prepare_atomic_modification: state is not atomic. state=0x56089c864568 2024-09-12T16:53:25.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 2024-09-12T16:53:25.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:109 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865ba0 con 0x56089c7b3e70 2024-09-12T16:53:25.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(109 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.740+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:110 3.32s0 3:4fbe83a9:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865ba0 con 0x56089c7b3e70 2024-09-12T16:53:25.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== osd_op_reply(110 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9_thirteen [call] v34'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:111 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7ed620 con 0x56089c7b3e70 2024-09-12T16:53:25.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 20 list_objects_ordered: starting attempt 1 2024-09-12T16:53:25.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T16:53:25.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:112 4.19 4:9ae444df:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7ef490 con 0x56089c7b3e70 2024-09-12T16:53:25.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:113 4.f 4:f2e22db6:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7f1d90 con 0x56089c7aa9a0 2024-09-12T16:53:25.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:114 4.1e 4:7b16bb2b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7f4740 con 0x56089c7af3a0 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:115 4.13 4:c9522374:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7ef490 con 0x7fdb700cc070 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:116 4.2d 4:b6ab0f1e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7f1d90 con 0x56089c7af3a0 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:117 4.d 4:b3186d07:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fbda0 con 0x56089c7b3e70 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:118 4.17 4:ea69d204:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7f1d90 con 0x56089c7af3a0 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:119 4.21 4:852d3841:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c801170 con 0x56089c7af3a0 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:120 4.25 4:a6370575:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7f1d90 con 0x56089c7b3e70 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:121 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7f1d90 con 0x56089c7b3e70 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:122 4.10 4:0a54344d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c808810 con 0x56089c7b3e70 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(115 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(113 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(116 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(114 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(119 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(118 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 35 ==== osd_op_reply(112 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 36 ==== osd_op_reply(117 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 37 ==== osd_op_reply(122 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 38 ==== osd_op_reply(120 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 39 ==== osd_op_reply(111 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.744+0000 7fda617fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 40 ==== osd_op_reply(121 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [call out=128b] v0'0 uv10 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9])"; uploads.size()=0; is_truncated=0 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:123 4.19 4:9ae444df:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fbe20 con 0x56089c7b3e70 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:124 4.f 4:f2e22db6:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c800c20 con 0x56089c7aa9a0 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:125 4.1e 4:7b16bb2b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fa8e0 con 0x56089c7af3a0 2024-09-12T16:53:25.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:126 4.13 4:c9522374:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fbe20 con 0x7fdb700cc070 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:127 4.2d 4:b6ab0f1e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fa8e0 con 0x56089c7af3a0 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:128 4.d 4:b3186d07:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c802650 con 0x56089c7b3e70 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:129 4.17 4:ea69d204:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fbe20 con 0x56089c7af3a0 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:130 4.21 4:852d3841:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fa8e0 con 0x56089c7af3a0 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:131 4.25 4:a6370575:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c802650 con 0x56089c7b3e70 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:132 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fbe20 con 0x56089c7b3e70 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:133 4.10 4:0a54344d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7fa8e0 con 0x56089c7b3e70 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(124 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 41 ==== osd_op_reply(123 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 42 ==== osd_op_reply(128 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 43 ==== osd_op_reply(131 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(126 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 44 ==== osd_op_reply(133 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== osd_op_reply(125 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== osd_op_reply(129 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 45 ==== osd_op_reply(132 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [call out=128b] v0'0 uv10 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(127 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(130 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c800b10 con 0x56089c7aa9a0 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(134 bud.buckets [call] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c800b10 con 0x56089c7aa9a0 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 20 rados_obj.operate() r=0 bl.length=166 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.748+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c800b10 con 0x56089c7aa9a0 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7ff139c0 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7ff139c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-12T16:53:25.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94594985776400 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c800b10 con 0x7fdb700cc070 2024-09-12T16:53:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== watch-notify(notify (1) cookie 94594985079424 notify 146028888083 ret 0) ==== 192+0+0 (crc 0 0 0) 0x56089c7c9b40 con 0x7fdb700cc070 2024-09-12T16:53:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fda617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94594985079424 notifier 4753 bl.length()=150 2024-09-12T16:53:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fda617fa640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fda40003d70 con 0x7fdb700cc070 2024-09-12T16:53:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(137 notify.3 [notify cookie 94594985776400 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 24 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 25 ==== watch-notify(notify_complete (2) cookie 94594985776400 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56089c7c8e30 con 0x7fdb700cc070 2024-09-12T16:53:25.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:139 8.0 8:00386c13:root::.bucket.meta.myfoo6%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c800b10 con 0x56089c7b3e70 2024-09-12T16:53:25.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 46 ==== osd_op_reply(139 .bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7ff139c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 from cache 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7ff139c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9, ofs0, ns] 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94594985266832 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c800b10 con 0x56089c7aa9a0 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== watch-notify(notify (1) cookie 94594985077920 notify 146028888106 ret 0) ==== 249+0+0 (crc 0 0 0) 0x56089c7c8e30 con 0x56089c7aa9a0 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fda60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94594985077920 notifier 4753 bl.length()=207 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(140 notify.4 [notify cookie 94594985266832 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fda60ff9640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd9a80032d0 con 0x56089c7aa9a0 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== watch-notify(notify_complete (2) cookie 94594985266832 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56089c7ca1e0 con 0x56089c7aa9a0 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.752+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:142 4.19 4:9ae444df:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7b3e70 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:143 4.f 4:f2e22db6:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c803d00 con 0x56089c7aa9a0 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:144 4.1e 4:7b16bb2b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c804550 con 0x56089c7af3a0 2024-09-12T16:53:25.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:145 4.13 4:c9522374:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c804970 con 0x7fdb700cc070 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:146 4.2d 4:b6ab0f1e:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7af3a0 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:147 4.d 4:b3186d07:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c803d00 con 0x56089c7b3e70 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:148 4.17 4:ea69d204:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c804550 con 0x56089c7af3a0 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:149 4.21 4:852d3841:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7af3a0 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:150 4.25 4:a6370575:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c804970 con 0x56089c7b3e70 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:151 4.1d 4:b87463e1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c803d00 con 0x56089c7b3e70 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:152 4.10 4:0a54344d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7b3e70 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 39 ==== osd_op_reply(143 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.1 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 47 ==== osd_op_reply(147 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 48 ==== osd_op_reply(152 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.10 [delete] v34'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 49 ==== osd_op_reply(151 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.9 [delete] v34'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== osd_op_reply(144 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.2 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(148 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.6 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 50 ==== osd_op_reply(142 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.0 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 26 ==== osd_op_reply(145 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.3 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(146 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.4 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(149 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.7 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 51 ==== osd_op_reply(150 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9.8 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 : miss 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.756+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:153 6.13 6:cbbae56c:::pubsub..bucket.myfoo6%2f1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c804550 con 0x56089c7af3a0 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(153 pubsub..bucket.myfoo6/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7ff139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7ff139c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 info.flags=0x0 2024-09-12T16:53:25.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7ff139c0 10 adding default.rgw.log++pubsub..bucket.myfoo6/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 to cache LRU end 2024-09-12T16:53:25.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:154 6.13 6:cbbae56c:::pubsub..bucket.myfoo6%2f1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7af3a0 2024-09-12T16:53:25.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== osd_op_reply(154 pubsub..bucket.myfoo6/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.9 [delete] v34'31 uv29 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7aa9a0 2024-09-12T16:53:25.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 40 ==== osd_op_reply(155 bud.buckets [call] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7ff139c0 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-12T16:53:25.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.760+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7aa9a0 2024-09-12T16:53:25.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 41 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7ff139c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T16:53:25.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94594985262816 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7af3a0 2024-09-12T16:53:25.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 43 ==== watch-notify(notify (1) cookie 94594985083824 notify 146028888086 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56089c7c9000 con 0x56089c7af3a0 2024-09-12T16:53:25.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fda60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94594985083824 notifier 4753 bl.length()=170 2024-09-12T16:53:25.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fda60ff9640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd9a80032b0 con 0x56089c7af3a0 2024-09-12T16:53:25.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 44 ==== osd_op_reply(157 notify.5 [notify cookie 94594985262816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 45 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 46 ==== watch-notify(notify_complete (2) cookie 94594985262816 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56089c79fd00 con 0x56089c7af3a0 2024-09-12T16:53:25.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7ff139c0 10 removing email index: 2024-09-12T16:53:25.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7ff139c0 10 removing user buckets index 2024-09-12T16:53:25.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.764+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7e8e90 con 0x56089c7aa9a0 2024-09-12T16:53:25.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 42 ==== osd_op_reply(159 bud.buckets [delete] v34'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7ff139c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-12T16:53:25.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94594985262816 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7e8e90 con 0x56089c7af3a0 2024-09-12T16:53:25.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 47 ==== watch-notify(notify (1) cookie 94594985086096 notify 146028888087 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56089c79fd00 con 0x56089c7af3a0 2024-09-12T16:53:25.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fda617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94594985086096 notifier 4753 bl.length()=160 2024-09-12T16:53:25.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fda617fa640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fda40003d70 con 0x56089c7af3a0 2024-09-12T16:53:25.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 48 ==== osd_op_reply(160 notify.6 [notify cookie 94594985262816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 49 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 50 ==== watch-notify(notify_complete (2) cookie 94594985262816 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56089c79fa70 con 0x56089c7af3a0 2024-09-12T16:53:25.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7ff139c0 10 removing user index: bud 2024-09-12T16:53:25.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7e7ee0 con 0x7fdb700cc070 2024-09-12T16:53:25.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 27 ==== osd_op_reply(162 bud [call,call,delete] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7ff139c0 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-12T16:53:25.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7ff139c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T16:53:25.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94594985776400 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56089c7e7ee0 con 0x56089c7af3a0 2024-09-12T16:53:25.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 51 ==== watch-notify(notify (1) cookie 94594985083824 notify 146028888088 ret 0) ==== 194+0+0 (crc 0 0 0) 0x56089c79fa70 con 0x56089c7af3a0 2024-09-12T16:53:25.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fda60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94594985083824 notifier 4753 bl.length()=152 2024-09-12T16:53:25.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.768+0000 7fda60ff9640 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd9a80032b0 con 0x56089c7af3a0 2024-09-12T16:53:25.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.772+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 52 ==== osd_op_reply(163 notify.5 [notify cookie 94594985776400 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.772+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 53 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.772+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 54 ==== watch-notify(notify_complete (2) cookie 94594985776400 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56089c799a70 con 0x56089c7af3a0 2024-09-12T16:53:25.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.772+0000 7fda2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:25.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.772+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594985091360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c865510 con 0x56089c7aa9a0 2024-09-12T16:53:25.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.772+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 43 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94594985091360] v34'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.772+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594985068912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7be120 con 0x7fdb700cc070 2024-09-12T16:53:25.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.776+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 28 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94594985068912] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.776+0000 7fdb7ff139c0 20 remove_watcher() i=0 2024-09-12T16:53:25.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.776+0000 7fdb7ff139c0 2 removed watcher, disabling cache 2024-09-12T16:53:25.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.776+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594985073120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7be120 con 0x56089c7aa9a0 2024-09-12T16:53:25.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.776+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 44 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94594985073120] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.776+0000 7fdb7ff139c0 20 remove_watcher() i=1 2024-09-12T16:53:25.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.776+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594985066432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7be120 con 0x56089c7b3e70 2024-09-12T16:53:25.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.780+0000 7fdb7da19640 1 -- 172.21.15.151:0/4155052150 <== osd.3 v2:172.21.15.151:6808/987175333 52 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94594985066432] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb700d3070 con 0x56089c7b3e70 2024-09-12T16:53:25.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.780+0000 7fdb7ff139c0 20 remove_watcher() i=2 2024-09-12T16:53:25.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.780+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594985079424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7be120 con 0x7fdb700cc070 2024-09-12T16:53:25.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.780+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.2 v2:172.21.15.151:6800/1197700885 29 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94594985079424] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x7fdb700cc070 2024-09-12T16:53:25.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.780+0000 7fdb7ff139c0 20 remove_watcher() i=3 2024-09-12T16:53:25.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.780+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594985077920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bb280 con 0x56089c7aa9a0 2024-09-12T16:53:25.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.784+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 <== osd.1 v2:172.21.15.151:6816/883447514 45 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94594985077920] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74014570 con 0x56089c7aa9a0 2024-09-12T16:53:25.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.784+0000 7fdb7ff139c0 20 remove_watcher() i=4 2024-09-12T16:53:25.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.784+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594985083824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7be120 con 0x56089c7af3a0 2024-09-12T16:53:25.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.784+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 55 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94594985083824] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.784+0000 7fdb7ff139c0 20 remove_watcher() i=5 2024-09-12T16:53:25.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.784+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594985086096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7baca0 con 0x56089c7af3a0 2024-09-12T16:53:25.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.788+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 56 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94594985086096] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.788+0000 7fdb7ff139c0 20 remove_watcher() i=6 2024-09-12T16:53:25.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.788+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594985089824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56089c7bb280 con 0x56089c7af3a0 2024-09-12T16:53:25.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.788+0000 7fdb7e21a640 1 -- 172.21.15.151:0/4155052150 <== osd.0 v2:172.21.15.122:6800/3868153603 57 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94594985089824] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7800a4d0 con 0x56089c7af3a0 2024-09-12T16:53:25.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 20 remove_watcher() i=7 2024-09-12T16:53:25.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c7af3a0 msgr2=0x56089c7b1790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c7af3a0 0x56089c7b1790 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56089c7aa9a0 msgr2=0x56089c7ace60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56089c7aa9a0 0x56089c7ace60 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fdb700cc070 msgr2=0x7fdb700ab5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fdb700cc070 0x7fdb700ab5e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56089c7b3e70 msgr2=0x56089c7b62a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56089c7b3e70 0x56089c7b62a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda48039a70 msgr2=0x7fda4803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda48039a70 0x7fda4803bf30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdb70000fe0 tx=0x7fdb700e4000 comp rx=0 tx=0).stop 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 msgr2=0x56089c79f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7d218640 1 -- 172.21.15.151:0/4155052150 reap_dead start 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c79f510 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdb78016cc0 tx=0x7fdb780505c0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 shutdown_connections 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/4155052150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c799080 0x56089c79f510 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 >> 172.21.15.151:0/4155052150 conn(0x56089c794480 msgr2=0x56089c792690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 shutdown_connections 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/4155052150 wait complete. 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/704497367 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda58039ac0 msgr2=0x7fda5803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/704497367 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda58039ac0 0x7fda5803bf80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56089c7722a0 tx=0x7fdb700e9b10 comp rx=0 tx=0).stop 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/704497367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c78b7c0 msgr2=0x56089c78bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/704497367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c78b7c0 0x56089c78bbe0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x56089c67f040 tx=0x7fdb78018830 comp rx=0 tx=0).stop 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/704497367 shutdown_connections 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/704497367 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda58039ac0 0x7fda5803bf80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/704497367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c78b7c0 0x56089c78bbe0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/704497367 >> 172.21.15.151:0/704497367 conn(0x56089c781170 msgr2=0x56089c781550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/704497367 shutdown_connections 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/704497367 wait complete. 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c77a600 msgr2=0x56089c77c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c77a600 0x56089c77c9f0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7fdb68002350 msgr2=0x56089c777f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7fdb68002350 0x56089c777f10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda64039a70 msgr2=0x7fda6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda64039a70 0x7fda6403bf30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdb740084f0 tx=0x7fdb74005610 comp rx=0 tx=0).stop 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c682340 msgr2=0x56089c770e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c682340 0x56089c770e40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdb70000c10 tx=0x7fdb68004130 comp rx=0 tx=0).stop 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 shutdown_connections 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56089c77a600 0x56089c77c9f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7fdb68002350 0x56089c777f10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fda64039a70 0x7fda6403bf30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 --2- 172.21.15.151:0/2531487338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56089c682340 0x56089c770e40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 >> 172.21.15.151:0/2531487338 conn(0x56089c5f1b00 msgr2=0x56089c763c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 shutdown_connections 2024-09-12T16:53:25.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.792+0000 7fdb7ff139c0 1 -- 172.21.15.151:0/2531487338 wait complete. 2024-09-12T16:53:25.808 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-12T16:53:25.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-12T16:53:25.808 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-12T16:53:25.890 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:53:25.890 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:53:25.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.884+0000 7fce532869c0 1 Processor -- start 2024-09-12T16:53:25.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.884+0000 7fce532869c0 1 -- start start 2024-09-12T16:53:25.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.884+0000 7fce532869c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56513fa731f0 0x56513fa735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.884+0000 7fce532869c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56513f9259c0 con 0x56513fa76330 2024-09-12T16:53:25.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.884+0000 7fce532869c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56513f9756d0 con 0x56513fa731f0 2024-09-12T16:53:25.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.888+0000 7fce50d8c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56513fa731f0 0x56513fa735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.888+0000 7fce5058b640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x56513fa76330 0x56513fa78720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:33962/0 (socket says 172.21.15.151:33962) 2024-09-12T16:53:25.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.888+0000 7fce5058b640 1 -- 172.21.15.151:0/3060891026 learned_addr learned my addr 172.21.15.151:0/3060891026 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:53:25.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.888+0000 7fce4fd8a640 1 -- 172.21.15.151:0/3060891026 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865394544 0 0) 0x56513f9259c0 con 0x56513fa76330 2024-09-12T16:53:25.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.888+0000 7fce4fd8a640 1 -- 172.21.15.151:0/3060891026 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce3c001e20 con 0x56513fa76330 2024-09-12T16:53:25.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.888+0000 7fce50d8c640 1 -- 172.21.15.151:0/3060891026 >> v1:172.21.15.122:6789/0 conn(0x56513fa76330 legacy=0x56513fa78720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.888+0000 7fce50d8c640 1 -- 172.21.15.151:0/3060891026 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513f919ca0 con 0x56513fa731f0 2024-09-12T16:53:25.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce50d8c640 1 --2- 172.21.15.151:0/3060891026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa731f0 0x56513fa735d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fce4800a420 tx=0x7fce4801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6494b834ad41cc17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce4fd8a640 1 -- 172.21.15.151:0/3060891026 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce480af070 con 0x56513fa731f0 2024-09-12T16:53:25.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce4fd8a640 1 -- 172.21.15.151:0/3060891026 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce480aa530 con 0x56513fa731f0 2024-09-12T16:53:25.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce4fd8a640 1 -- 172.21.15.151:0/3060891026 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce480aa810 con 0x56513fa731f0 2024-09-12T16:53:25.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce532869c0 1 -- 172.21.15.151:0/3060891026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa731f0 msgr2=0x56513fa735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce532869c0 1 --2- 172.21.15.151:0/3060891026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa731f0 0x56513fa735d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fce4800a420 tx=0x7fce4801afd0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce532869c0 1 -- 172.21.15.151:0/3060891026 shutdown_connections 2024-09-12T16:53:25.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce532869c0 1 --2- 172.21.15.151:0/3060891026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa731f0 0x56513fa735d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce532869c0 1 -- 172.21.15.151:0/3060891026 >> 172.21.15.151:0/3060891026 conn(0x56513f9e6b00 msgr2=0x56513f9e6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce532869c0 1 -- 172.21.15.151:0/3060891026 shutdown_connections 2024-09-12T16:53:25.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.892+0000 7fce532869c0 1 -- 172.21.15.151:0/3060891026 wait complete. 2024-09-12T16:53:25.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce532869c0 1 Processor -- start 2024-09-12T16:53:25.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce532869c0 1 -- start start 2024-09-12T16:53:25.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce532869c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb5e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce532869c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56513f979680 con 0x56513fa76330 2024-09-12T16:53:25.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce50d8c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb5e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce50d8c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb5e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57552/0 (socket says 172.21.15.151:57552) 2024-09-12T16:53:25.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce50d8c640 1 -- 172.21.15.151:0/748532503 learned_addr learned my addr 172.21.15.151:0/748532503 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce50d8c640 1 -- 172.21.15.151:0/748532503 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513f8f4da0 con 0x56513fa76330 2024-09-12T16:53:25.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fce50d8c640 1 --2- 172.21.15.151:0/748532503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb5e7e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fce480ad040 tx=0x7fce480033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d839b42c07e383c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fcd3ee0d640 1 -- 172.21.15.151:0/748532503 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce480af040 con 0x56513fa76330 2024-09-12T16:53:25.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fcd3ee0d640 1 -- 172.21.15.151:0/748532503 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce480bb070 con 0x56513fa76330 2024-09-12T16:53:25.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.908+0000 7fcd3ee0d640 1 -- 172.21.15.151:0/748532503 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce480aa9e0 con 0x56513fa76330 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- 172.21.15.151:0/748532503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 msgr2=0x56513fb5e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 --2- 172.21.15.151:0/748532503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb5e7e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fce480ad040 tx=0x7fce480033b0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- 172.21.15.151:0/748532503 shutdown_connections 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 --2- 172.21.15.151:0/748532503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb5e7e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- 172.21.15.151:0/748532503 >> 172.21.15.151:0/748532503 conn(0x56513f9e6b00 msgr2=0x56513fb5a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- 172.21.15.151:0/748532503 shutdown_connections 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- 172.21.15.151:0/748532503 wait complete. 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 Processor -- start 2024-09-12T16:53:25.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- start start 2024-09-12T16:53:25.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb65d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56513f91ba50 con 0x56513fa76330 2024-09-12T16:53:25.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce50d8c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb65d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce50d8c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb65d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57568/0 (socket says 172.21.15.151:57568) 2024-09-12T16:53:25.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce50d8c640 1 -- 172.21.15.151:0/649231075 learned_addr learned my addr 172.21.15.151:0/649231075 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce50d8c640 1 -- 172.21.15.151:0/649231075 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513fb662a0 con 0x56513fa76330 2024-09-12T16:53:25.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce50d8c640 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb65d40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fce48000f90 tx=0x7fce48017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fcd3d60a640 1 -- 172.21.15.151:0/649231075 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce480af040 con 0x56513fa76330 2024-09-12T16:53:25.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56513fb66530 con 0x56513fa76330 2024-09-12T16:53:25.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fcd3d60a640 1 -- 172.21.15.151:0/649231075 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce480bb040 con 0x56513fa76330 2024-09-12T16:53:25.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fcd3d60a640 1 -- 172.21.15.151:0/649231075 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce480b5730 con 0x56513fa76330 2024-09-12T16:53:25.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513fb66e90 con 0x56513fa76330 2024-09-12T16:53:25.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.912+0000 7fcd3d60a640 1 -- 172.21.15.151:0/649231075 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce480ce060 con 0x56513fa76330 2024-09-12T16:53:25.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fcd3d60a640 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd38039a70 0x7fcd3803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fcd3d60a640 1 -- 172.21.15.151:0/649231075 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fce480eafc0 con 0x56513fa76330 2024-09-12T16:53:25.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce5058b640 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd38039a70 0x7fcd3803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb6ae50 0x56513fb6d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fb6d780 con 0x56513fb6ae50 2024-09-12T16:53:25.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce5158d640 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb6ae50 0x56513fb6d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce5058b640 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd38039a70 0x7fcd3803bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fce38001dc0 tx=0x7fce38001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce5158d640 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb6ae50 0x56513fb6d240 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce5158d640 1 -- 172.21.15.151:0/649231075 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce400083f0 con 0x56513fb6ae50 2024-09-12T16:53:25.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fb6dbd0 con 0x56513fb6ae50 2024-09-12T16:53:25.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce5158d640 1 -- 172.21.15.151:0/649231075 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce400083f0 con 0x56513fb6ae50 2024-09-12T16:53:25.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fb6f9e0 0x56513fb71dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fb724a0 con 0x56513fb6f9e0 2024-09-12T16:53:25.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce50d8c640 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fb6f9e0 0x56513fb71dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce50d8c640 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fb6f9e0 0x56513fb71dd0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce50d8c640 1 -- 172.21.15.151:0/649231075 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce480b2040 con 0x56513fb6f9e0 2024-09-12T16:53:25.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fb6e880 con 0x56513fb6ae50 2024-09-12T16:53:25.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce5158d640 1 -- 172.21.15.151:0/649231075 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce400083f0 con 0x56513fb6ae50 2024-09-12T16:53:25.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.916+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fb6ed20 con 0x56513fb6ae50 2024-09-12T16:53:25.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce5158d640 1 -- 172.21.15.151:0/649231075 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce400083f0 con 0x56513fb6ae50 2024-09-12T16:53:25.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce532869c0 1 Processor -- start 2024-09-12T16:53:25.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce532869c0 1 -- start start 2024-09-12T16:53:25.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce532869c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb80b10 0x56513fb80f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce532869c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56513f986450 con 0x56513fb80b10 2024-09-12T16:53:25.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce5158d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb80b10 0x56513fb80f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce5158d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb80b10 0x56513fb80f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57578/0 (socket says 172.21.15.151:57578) 2024-09-12T16:53:25.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce5158d640 1 -- 172.21.15.151:0/1774629324 learned_addr learned my addr 172.21.15.151:0/1774629324 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce5158d640 1 -- 172.21.15.151:0/1774629324 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513fb81570 con 0x56513fb80b10 2024-09-12T16:53:25.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce5158d640 1 --2- 172.21.15.151:0/1774629324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb80b10 0x56513fb80f30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x56513fb67e10 tx=0x7fce4000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fcd367fc640 1 -- 172.21.15.151:0/1774629324 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce40007e00 con 0x56513fb80b10 2024-09-12T16:53:25.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fcd367fc640 1 -- 172.21.15.151:0/1774629324 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4001e020 con 0x56513fb80b10 2024-09-12T16:53:25.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce532869c0 1 -- 172.21.15.151:0/1774629324 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56513fb81dd0 con 0x56513fb80b10 2024-09-12T16:53:25.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fcd367fc640 1 -- 172.21.15.151:0/1774629324 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce40019590 con 0x56513fb80b10 2024-09-12T16:53:25.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fce532869c0 1 -- 172.21.15.151:0/1774629324 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513fb82340 con 0x56513fb80b10 2024-09-12T16:53:25.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fcd367fc640 1 -- 172.21.15.151:0/1774629324 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce40016040 con 0x56513fb80b10 2024-09-12T16:53:25.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.920+0000 7fcd367fc640 1 --2- 172.21.15.151:0/1774629324 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd28039ac0 0x7fcd2803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fcd367fc640 1 -- 172.21.15.151:0/1774629324 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fce4001f030 con 0x56513fb80b10 2024-09-12T16:53:25.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce50d8c640 1 --2- 172.21.15.151:0/1774629324 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd28039ac0 0x7fcd2803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 Processor -- start 2024-09-12T16:53:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- start start 2024-09-12T16:53:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce50d8c640 1 --2- 172.21.15.151:0/1774629324 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd28039ac0 0x7fcd2803bf80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x56513fb671e0 tx=0x7fce480a95d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb8e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56513fb5ef70 con 0x56513fb8e3e0 2024-09-12T16:53:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce5158d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb8e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce5158d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb8e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57580/0 (socket says 172.21.15.151:57580) 2024-09-12T16:53:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce5158d640 1 -- 172.21.15.151:0/3259162416 learned_addr learned my addr 172.21.15.151:0/3259162416 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce5158d640 1 -- 172.21.15.151:0/3259162416 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513fb8edb0 con 0x56513fb8e3e0 2024-09-12T16:53:25.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce5158d640 1 --2- 172.21.15.151:0/3259162416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb8e7c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fce40050920 tx=0x7fce40019b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487ed5fbdc2ade28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fcd27fff640 1 -- 172.21.15.151:0/3259162416 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4001d070 con 0x56513fb8e3e0 2024-09-12T16:53:25.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fcd27fff640 1 -- 172.21.15.151:0/3259162416 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce40023460 con 0x56513fb8e3e0 2024-09-12T16:53:25.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fcd27fff640 1 -- 172.21.15.151:0/3259162416 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce40019c50 con 0x56513fb8e3e0 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- 172.21.15.151:0/3259162416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 msgr2=0x56513fb8e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 --2- 172.21.15.151:0/3259162416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb8e7c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fce40050920 tx=0x7fce40019b00 comp rx=0 tx=0).stop 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- 172.21.15.151:0/3259162416 shutdown_connections 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 --2- 172.21.15.151:0/3259162416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb8e7c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- 172.21.15.151:0/3259162416 >> 172.21.15.151:0/3259162416 conn(0x56513fb897a0 msgr2=0x56513fb879e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- 172.21.15.151:0/3259162416 shutdown_connections 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- 172.21.15.151:0/3259162416 wait complete. 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 Processor -- start 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- start start 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce532869c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56513fb8d2d0 con 0x56513fb8e3e0 2024-09-12T16:53:25.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce5158d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce5158d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb948e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:57584/0 (socket says 172.21.15.151:57584) 2024-09-12T16:53:25.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.924+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 learned_addr learned my addr 172.21.15.151:0/2396515246 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:53:25.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513fb94e40 con 0x56513fb8e3e0 2024-09-12T16:53:25.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce5158d640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb948e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fce40017e00 tx=0x7fce400508b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fcd267fc640 1 -- 172.21.15.151:0/2396515246 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4003ece0 con 0x56513fb8e3e0 2024-09-12T16:53:25.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fcd267fc640 1 -- 172.21.15.151:0/2396515246 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce40032020 con 0x56513fb8e3e0 2024-09-12T16:53:25.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56513fb950d0 con 0x56513fb8e3e0 2024-09-12T16:53:25.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fcd267fc640 1 -- 172.21.15.151:0/2396515246 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce40015af0 con 0x56513fb8e3e0 2024-09-12T16:53:25.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513fb950d0 con 0x56513fb8e3e0 2024-09-12T16:53:25.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fcd267fc640 1 -- 172.21.15.151:0/2396515246 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce40015cb0 con 0x56513fb8e3e0 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fcd267fc640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd1c039a70 0x7fcd1c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fcd267fc640 1 -- 172.21.15.151:0/2396515246 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fce40033030 con 0x56513fb8e3e0 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce50d8c640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd1c039a70 0x7fcd1c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb9f990 0x56513fba1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fba25a0 con 0x56513fb9f990 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce5058b640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb9f990 0x56513fba1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce50d8c640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd1c039a70 0x7fcd1c03bf30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce480e9570 tx=0x7fce480d7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce5058b640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb9f990 0x56513fba1e50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3800e550 con 0x56513fb9f990 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 20 realm 2024-09-12T16:53:25.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.928+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fb9ece0 con 0x56513fb9f990 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3800e550 con 0x56513fb9f990 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fba30a0 con 0x56513fb9f990 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3800e550 con 0x56513fb9f990 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fba3970 con 0x56513fb9f990 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce3800e550 con 0x56513fb9f990 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:25.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fba4390 0x56513fba6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fba6ec0 con 0x56513fba4390 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce5158d640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fba4390 0x56513fba6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce5158d640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fba4390 0x56513fba6780 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce4002a070 con 0x56513fba4390 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 20 searching for the correct realm 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56513fba8e10 0x56513fbab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fba8e10 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce50d8c640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56513fba8e10 0x56513fbab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce50d8c640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56513fba8e10 0x56513fbab240 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce50d8c640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fce480ed040 0x7fce480e9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:53:25.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x7fce480ed040 2024-09-12T16:53:25.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.932+0000 7fce5058b640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fce480ed040 0x7fce480e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:53:25.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fce480ed040 0x7fce480e9630 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:53:25.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800e550 con 0x7fce480ed040 2024-09-12T16:53:25.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fba4390 2024-09-12T16:53:25.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fb9f990 2024-09-12T16:53:25.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800e550 con 0x56513fb9f990 2024-09-12T16:53:25.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fb9f990 2024-09-12T16:53:25.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fba4390 2024-09-12T16:53:25.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fba4390 2024-09-12T16:53:25.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x7fce480ed040 2024-09-12T16:53:25.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x7fce480ed040 2024-09-12T16:53:25.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fba8e10 2024-09-12T16:53:25.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.936+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fb9f990 2024-09-12T16:53:25.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fba4390 2024-09-12T16:53:25.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fb9f990 2024-09-12T16:53:25.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x7fce480ed040 2024-09-12T16:53:25.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce38029040 con 0x7fce480ed040 2024-09-12T16:53:25.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56513fbab8c0 con 0x56513fba8e10 2024-09-12T16:53:25.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba8e10 2024-09-12T16:53:25.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba4390 2024-09-12T16:53:25.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba8e10 2024-09-12T16:53:25.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba8e10 2024-09-12T16:53:25.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fb9f990 2024-09-12T16:53:25.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.940+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fb9f990 2024-09-12T16:53:25.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba4390 2024-09-12T16:53:25.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba8e10 2024-09-12T16:53:25.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x7fce480ed040 2024-09-12T16:53:25.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x7fce480ed040 2024-09-12T16:53:25.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fb9f990 2024-09-12T16:53:25.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba4390 2024-09-12T16:53:25.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba8e10 2024-09-12T16:53:25.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba4390 2024-09-12T16:53:25.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x7fce480ed040 2024-09-12T16:53:25.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x7fce480ed040 2024-09-12T16:53:25.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.944+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba8e10 2024-09-12T16:53:25.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fba4390 2024-09-12T16:53:25.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x56513fb9f990 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fce480fa040 con 0x7fce480ed040 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce38029040 con 0x7fce480ed040 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fba7880 con 0x56513fb9f990 2024-09-12T16:53:25.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fba8120 con 0x56513fb9f990 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce38029040 con 0x56513fb9f990 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fba74c0 con 0x56513fb9f990 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 zone default found 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 4 Realm: () 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:53:25.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:53:25.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:53:25.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 zonegroup default 2024-09-12T16:53:25.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fba8120 con 0x56513fba4390 2024-09-12T16:53:25.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbadc30 con 0x56513fba8e10 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbadfd0 con 0x56513fba8e10 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 started sync module instance, tier type = 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.948+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbad0c0 con 0x7fce480ed040 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.952+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:25.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.952+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94906961548736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbad0c0 con 0x7fce480ed040 2024-09-12T16:53:25.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.952+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbaeac0 con 0x56513fb9f990 2024-09-12T16:53:25.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.952+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94906961548736] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:25.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.952+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:25.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.952+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94906961552800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbad0c0 con 0x56513fb9f990 2024-09-12T16:53:25.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.952+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbaf4d0 con 0x56513fba8e10 2024-09-12T16:53:25.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.956+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94906961552800] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:25.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.956+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.956+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94906961546256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbad030 con 0x56513fba8e10 2024-09-12T16:53:25.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.956+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb0220 con 0x7fce480ed040 2024-09-12T16:53:25.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.956+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:25.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.956+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94906961559168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb08b0 con 0x7fce480ed040 2024-09-12T16:53:25.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.956+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb13d0 con 0x56513fb9f990 2024-09-12T16:53:25.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.960+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94906961546256] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:25.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.960+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94906961559168] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:25.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.960+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:25.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.960+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94906961563296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb1390 con 0x56513fb9f990 2024-09-12T16:53:25.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.960+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb17c0 con 0x56513fba4390 2024-09-12T16:53:25.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.964+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94906961563296] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:25.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.964+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.964+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94906961560320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb17c0 con 0x56513fba4390 2024-09-12T16:53:25.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.964+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb2070 con 0x56513fba4390 2024-09-12T16:53:25.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.964+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94906961560320] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.964+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.964+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94906961557696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb2250 con 0x56513fba4390 2024-09-12T16:53:25.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.964+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb2ae0 con 0x56513fba4390 2024-09-12T16:53:25.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94906961568336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb3190 con 0x56513fba4390 2024-09-12T16:53:25.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce532869c0 20 add_watcher() i=0 2024-09-12T16:53:25.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce532869c0 20 add_watcher() i=1 2024-09-12T16:53:25.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce532869c0 20 add_watcher() i=2 2024-09-12T16:53:25.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce532869c0 20 add_watcher() i=3 2024-09-12T16:53:25.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce532869c0 20 add_watcher() i=4 2024-09-12T16:53:25.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce532869c0 20 add_watcher() i=5 2024-09-12T16:53:25.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94906961557696] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.968+0000 7fce532869c0 20 add_watcher() i=6 2024-09-12T16:53:25.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.992+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94906961568336] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:25.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.992+0000 7fce532869c0 20 add_watcher() i=7 2024-09-12T16:53:25.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.992+0000 7fce532869c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:53:25.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.992+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb6090 con 0x56513fb9f990 2024-09-12T16:53:25.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.992+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:25.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.992+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94906961570736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbb3480 con 0x56513fb9f990 2024-09-12T16:53:26.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.996+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94906961570736] v34'225 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.996+0000 7fcd077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:26.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.996+0000 7fce532869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:53:26.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.996+0000 7fce532869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:53:26.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:25.996+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbe8d0 con 0x56513fb9f990 2024-09-12T16:53:26.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.000+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.000+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbe8d0 con 0x56513fba4390 2024-09-12T16:53:26.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.004+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.004+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbe8d0 con 0x56513fba8e10 2024-09-12T16:53:26.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.004+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.004+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbf2f0 con 0x56513fb9f990 2024-09-12T16:53:26.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.004+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'226 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.004+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdf40 con 0x7fce480ed040 2024-09-12T16:53:26.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.008+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.008+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdf40 con 0x56513fba8e10 2024-09-12T16:53:26.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.008+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.008+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdf40 con 0x56513fb9f990 2024-09-12T16:53:26.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.012+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.012+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbe110 con 0x56513fba4390 2024-09-12T16:53:26.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.016+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.016+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbe110 con 0x7fce480ed040 2024-09-12T16:53:26.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.016+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.016+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbe110 con 0x56513fba8e10 2024-09-12T16:53:26.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.020+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.020+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbe1d0 con 0x7fce480ed040 2024-09-12T16:53:26.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.020+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'72 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.020+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbe1d0 con 0x56513fba4390 2024-09-12T16:53:26.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.024+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.024+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0000 con 0x7fce480ed040 2024-09-12T16:53:26.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.028+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.028+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0000 con 0x56513fba4390 2024-09-12T16:53:26.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.028+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.028+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0000 con 0x56513fb9f990 2024-09-12T16:53:26.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.032+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'227 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.032+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0000 con 0x56513fba8e10 2024-09-12T16:53:26.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.036+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.036+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0090 con 0x7fce480ed040 2024-09-12T16:53:26.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.036+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.036+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0090 con 0x56513fba8e10 2024-09-12T16:53:26.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.040+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.040+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0090 con 0x56513fb9f990 2024-09-12T16:53:26.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.044+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.044+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0090 con 0x56513fb9f990 2024-09-12T16:53:26.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.044+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'228 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.044+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0090 con 0x56513fba8e10 2024-09-12T16:53:26.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.048+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.048+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0100 con 0x7fce480ed040 2024-09-12T16:53:26.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.048+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.048+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0100 con 0x56513fba8e10 2024-09-12T16:53:26.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.052+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.052+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0140 con 0x56513fba8e10 2024-09-12T16:53:26.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.056+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.056+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0180 con 0x56513fba8e10 2024-09-12T16:53:26.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.056+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.056+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbc0180 con 0x56513fba8e10 2024-09-12T16:53:26.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.060+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.060+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdad0 con 0x56513fba4390 2024-09-12T16:53:26.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.060+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.060+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdbb0 con 0x56513fba8e10 2024-09-12T16:53:26.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.064+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.064+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdbb0 con 0x56513fba4390 2024-09-12T16:53:26.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.068+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.068+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdbb0 con 0x56513fba8e10 2024-09-12T16:53:26.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.068+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.068+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdbb0 con 0x56513fba4390 2024-09-12T16:53:26.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.072+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.072+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbdbb0 con 0x7fce480ed040 2024-09-12T16:53:26.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fcd067e4640 20 reqs_thread_entry: start 2024-09-12T16:53:26.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 20 init_complete bucket index max shards: 11 2024-09-12T16:53:26.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 20 Filter name: none 2024-09-12T16:53:26.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fccff7fe640 20 reqs_thread_entry: start 2024-09-12T16:53:26.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T16:53:26.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:26.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbbd1a0 con 0x56513fba4390 2024-09-12T16:53:26.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T16:53:26.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T16:53:26.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T16:53:26.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:53:26.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbddbb0 con 0x56513fba4390 2024-09-12T16:53:26.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 : miss 2024-09-12T16:53:26.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:26.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.076+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:96 8.15 8:afd7debf:root::.bucket.meta.myfoo7%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbdd980 con 0x56513fba8e10 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 20 rados_obj.operate() r=0 bl.length=390 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 info.flags=0x17 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 to cache LRU end 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 4.3d 4:bd2d22a0:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5aef0 con 0x56513fba8e10 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(97 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.0 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:98 4.30 4:0ef4fc7a:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5af70 con 0x56513fba8e10 2024-09-12T16:53:26.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(98 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:99 4.3a 4:5cea7aa9:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5af70 con 0x56513fba8e10 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(99 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.2 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:100 4.0 4:039c74c1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a980 con 0x7fce480ed040 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(100 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:101 4.10 4:0b4599ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a980 con 0x56513fba8e10 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(101 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.080+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:102 4.39 4:9c343faf:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a980 con 0x56513fba8e10 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== osd_op_reply(102 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5 [call out=382b] v0'0 uv3 ondisk = 0) ==== 195+0+382 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 10 cls_bucket_list_unordered: got fourteen 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:103 4.35 4:ad8614b4:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a9c0 con 0x56513fb9f990 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(103 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:104 4.f 4:f3267995:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a9c0 con 0x56513fb9f990 2024-09-12T16:53:26.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(104 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:105 4.1b 4:d8224600:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a9c0 con 0x7fce480ed040 2024-09-12T16:53:26.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(105 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:106 4.15 4:aa5f799d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a9c0 con 0x56513fba8e10 2024-09-12T16:53:26.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(106 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:107 4.2b 4:d76670d3:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a9c0 con 0x56513fb9f990 2024-09-12T16:53:26.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(107 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 20 get_obj_state: octx=0x7fce3800e4d0 obj=myfoo7:fourteen state=0x56513fc58f78 s->prefetch_data=0 2024-09-12T16:53:26.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:108 3.38s0 3:1e3445ba:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fc598f0 con 0x56513fba4390 2024-09-12T16:53:26.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(108 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 10 manifest: total_size = 8 2024-09-12T16:53:26.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 20 get_obj_state: setting s->obj_tag to 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.15007364299686370861 2024-09-12T16:53:26.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 20 get_obj_state: octx=0x7fce3800e4d0 obj=myfoo7:fourteen state=0x56513fc58f78 s->prefetch_data=0 2024-09-12T16:53:26.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 20 prepare_atomic_modification: state is not atomic. state=0x56513fc58f78 2024-09-12T16:53:26.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5 2024-09-12T16:53:26.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.084+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:109 4.39 4:9c343faf:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a1f0 con 0x56513fba8e10 2024-09-12T16:53:26.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.088+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(109 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.088+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:110 3.38s0 3:1e3445ba:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fc5a1f0 con 0x56513fba4390 2024-09-12T16:53:26.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(110 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:111 4.39 4:9c343faf:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbe2530 con 0x56513fba8e10 2024-09-12T16:53:26.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 20 list_objects_ordered: starting attempt 1 2024-09-12T16:53:26.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T16:53:26.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:112 4.3d 4:bd2d22a0:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbe4300 con 0x56513fba8e10 2024-09-12T16:53:26.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:113 4.30 4:0ef4fc7a:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbe2530 con 0x56513fba8e10 2024-09-12T16:53:26.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:114 4.3a 4:5cea7aa9:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbe9080 con 0x56513fba8e10 2024-09-12T16:53:26.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:115 4.0 4:039c74c1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbebb90 con 0x7fce480ed040 2024-09-12T16:53:26.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:116 4.10 4:0b4599ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbee4e0 con 0x56513fba8e10 2024-09-12T16:53:26.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:117 4.39 4:9c343faf:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf0e10 con 0x56513fba8e10 2024-09-12T16:53:26.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:118 4.35 4:ad8614b4:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf3c60 con 0x56513fb9f990 2024-09-12T16:53:26.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:119 4.f 4:f3267995:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf6a90 con 0x56513fb9f990 2024-09-12T16:53:26.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:120 4.1b 4:d8224600:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x7fce480ed040 2024-09-12T16:53:26.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:121 4.15 4:aa5f799d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbfc740 con 0x56513fba8e10 2024-09-12T16:53:26.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:122 4.2b 4:d76670d3:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff5c0 con 0x56513fb9f990 2024-09-12T16:53:26.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(115 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== osd_op_reply(112 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.0 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 35 ==== osd_op_reply(114 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.2 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 36 ==== osd_op_reply(113 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(118 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(119 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(122 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 37 ==== osd_op_reply(121 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(120 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 38 ==== osd_op_reply(116 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 39 ==== osd_op_reply(111 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fcd27fff640 20 handle_completion(): completion ok for obj=fourteen 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 40 ==== osd_op_reply(117 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10])"; uploads.size()=0; is_truncated=0 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:123 4.3d 4:bd2d22a0:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf0e10 con 0x56513fba8e10 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:124 4.30 4:0ef4fc7a:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x56513fba8e10 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:125 4.3a 4:5cea7aa9:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbfef70 con 0x56513fba8e10 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:126 4.0 4:039c74c1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x7fce480ed040 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:127 4.10 4:0b4599ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf0e10 con 0x56513fba8e10 2024-09-12T16:53:26.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:128 4.39 4:9c343faf:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbfef70 con 0x56513fba8e10 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:129 4.35 4:ad8614b4:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x56513fb9f990 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 41 ==== osd_op_reply(123 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.0 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:130 4.f 4:f3267995:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf0e10 con 0x56513fb9f990 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 42 ==== osd_op_reply(124 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 43 ==== osd_op_reply(125 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.2 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.092+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(126 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:131 4.1b 4:d8224600:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x7fce480ed040 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:132 4.15 4:aa5f799d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf0e10 con 0x56513fba8e10 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:133 4.2b 4:d76670d3:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff520 con 0x56513fb9f990 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(129 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(130 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 44 ==== osd_op_reply(128 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(131 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 45 ==== osd_op_reply(127 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(133 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 46 ==== osd_op_reply(132 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x56513fba4390 2024-09-12T16:53:26.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(134 fud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-12T16:53:26.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:26.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x7fce480ed040 2024-09-12T16:53:26.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 24 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 20 rados_obj.operate() r=0 bl.length=168 2024-09-12T16:53:26.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.096+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x7fce480ed040 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 25 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce532869c0 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce532869c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94906961884256 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf9910 con 0x7fce480ed040 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 26 ==== watch-notify(notify (1) cookie 94906961559168 notify 146028888084 ret 0) ==== 192+0+0 (crc 0 0 0) 0x56513fb94e40 con 0x7fce480ed040 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fcd277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94906961559168 notifier 4760 bl.length()=150 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 27 ==== osd_op_reply(137 notify.3 [notify cookie 94906961884256 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fcd277fe640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcc780032d0 con 0x7fce480ed040 2024-09-12T16:53:26.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 28 ==== watch-notify(notify_complete (2) cookie 94906961884256 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56513fbbd8c0 con 0x7fce480ed040 2024-09-12T16:53:26.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 29 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.100+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:139 8.15 8:afd7debf:root::.bucket.meta.myfoo7%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba8e10 2024-09-12T16:53:26.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 47 ==== osd_op_reply(139 .bucket.meta.myfoo7:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 from cache 2024-09-12T16:53:26.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10, ofs0, ns] 2024-09-12T16:53:26.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94906961858880 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== watch-notify(notify (1) cookie 94906961560320 notify 146028888089 ret 0) ==== 250+0+0 (crc 0 0 0) 0x56513fbbe1a0 con 0x56513fba4390 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fcd27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94906961560320 notifier 4760 bl.length()=208 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(140 notify.5 [notify cookie 94906961858880 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fcd27fff640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcd14003d70 con 0x56513fba4390 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== watch-notify(notify_complete (2) cookie 94906961858880 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56513fb8edb0 con 0x56513fba4390 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:142 4.3d 4:bd2d22a0:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba8e10 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:143 4.30 4:0ef4fc7a:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbdd8f0 con 0x56513fba8e10 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:144 4.3a 4:5cea7aa9:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf3430 con 0x56513fba8e10 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:145 4.0 4:039c74c1:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x7fce480ed040 2024-09-12T16:53:26.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:146 4.10 4:0b4599ca:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf3430 con 0x56513fba8e10 2024-09-12T16:53:26.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:147 4.39 4:9c343faf:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf3d00 con 0x56513fba8e10 2024-09-12T16:53:26.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:148 4.35 4:ad8614b4:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf3430 con 0x56513fb9f990 2024-09-12T16:53:26.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:149 4.f 4:f3267995:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf3d00 con 0x56513fb9f990 2024-09-12T16:53:26.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:150 4.1b 4:d8224600:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x7fce480ed040 2024-09-12T16:53:26.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:151 4.15 4:aa5f799d:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf3430 con 0x56513fba8e10 2024-09-12T16:53:26.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.104+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:152 4.2b 4:d76670d3:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbf3430 con 0x56513fb9f990 2024-09-12T16:53:26.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.108+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 48 ==== osd_op_reply(144 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.2 [delete] v34'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.108+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 30 ==== osd_op_reply(145 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.3 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.108+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 49 ==== osd_op_reply(147 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.5 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.108+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 50 ==== osd_op_reply(151 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.9 [delete] v34'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.108+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(149 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.7 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.108+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 31 ==== osd_op_reply(150 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.8 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.108+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(148 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.6 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 39 ==== osd_op_reply(152 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.10 [delete] v34'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 51 ==== osd_op_reply(146 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.4 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 52 ==== osd_op_reply(143 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.1 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 53 ==== osd_op_reply(142 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10.0 [delete] v34'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce532869c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 : miss 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce532869c0 20 rados->read ofs=0 len=0 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:153 6.e 6:7384fad2:::pubsub..bucket.myfoo7%2f1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fb9f990 2024-09-12T16:53:26.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 40 ==== osd_op_reply(153 pubsub..bucket.myfoo7/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce532869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:53:26.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce532869c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 info.flags=0x0 2024-09-12T16:53:26.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce532869c0 10 adding default.rgw.log++pubsub..bucket.myfoo7/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 to cache LRU end 2024-09-12T16:53:26.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:154 6.e 6:7384fad2:::pubsub..bucket.myfoo7%2f1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fb9f990 2024-09-12T16:53:26.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 41 ==== osd_op_reply(154 pubsub..bucket.myfoo7/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10 [delete] v34'31 uv24 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.112+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== osd_op_reply(155 fud.buckets [call] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fce532869c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T16:53:26.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fce532869c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T16:53:26.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94906961772112 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba8e10 2024-09-12T16:53:26.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 54 ==== watch-notify(notify (1) cookie 94906961546256 notify 146028888071 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56513fbdcec0 con 0x56513fba8e10 2024-09-12T16:53:26.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fcd277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94906961546256 notifier 4760 bl.length()=170 2024-09-12T16:53:26.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fcd277fe640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcc780032d0 con 0x56513fba8e10 2024-09-12T16:53:26.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.116+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 55 ==== osd_op_reply(157 notify.2 [notify cookie 94906961772112 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 56 ==== watch-notify(notify_complete (2) cookie 94906961772112 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fce480f4040 con 0x56513fba8e10 2024-09-12T16:53:26.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce532869c0 10 removing email index: 2024-09-12T16:53:26.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce532869c0 10 removing user buckets index 2024-09-12T16:53:26.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 57 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(159 fud.buckets [delete] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce532869c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-12T16:53:26.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94906961772112 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== watch-notify(notify (1) cookie 94906961557696 notify 146028888090 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56513fb8edb0 con 0x56513fba4390 2024-09-12T16:53:26.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fcd27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94906961557696 notifier 4760 bl.length()=160 2024-09-12T16:53:26.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fcd27fff640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcd14003d70 con 0x56513fba4390 2024-09-12T16:53:26.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.120+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(160 notify.6 [notify cookie 94906961772112 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.124+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.124+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== watch-notify(notify_complete (2) cookie 94906961772112 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fce4004f070 con 0x56513fba4390 2024-09-12T16:53:26.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.124+0000 7fce532869c0 10 removing user index: fud 2024-09-12T16:53:26.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.124+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.124+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(162 fud [call,call,delete] v34'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.124+0000 7fce532869c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-12T16:53:26.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.124+0000 7fce532869c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T16:53:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.124+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94906961882592 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.128+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== watch-notify(notify (1) cookie 94906961560320 notify 146028888091 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7fce4004f070 con 0x56513fba4390 2024-09-12T16:53:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.128+0000 7fcd277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94906961560320 notifier 4760 bl.length()=152 2024-09-12T16:53:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.128+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 43 ==== osd_op_reply(163 notify.5 [notify cookie 94906961882592 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.128+0000 7fcd277fe640 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcc780032d0 con 0x56513fba4390 2024-09-12T16:53:26.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.128+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.128+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 45 ==== watch-notify(notify_complete (2) cookie 94906961882592 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56513fb82340 con 0x56513fba4390 2024-09-12T16:53:26.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.128+0000 7fcd077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:53:26.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.128+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94906961570736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fb9f990 2024-09-12T16:53:26.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.132+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 42 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94906961570736] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.132+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94906961548736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x7fce480ed040 2024-09-12T16:53:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.132+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 32 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94906961548736] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.132+0000 7fce532869c0 20 remove_watcher() i=0 2024-09-12T16:53:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.132+0000 7fce532869c0 2 removed watcher, disabling cache 2024-09-12T16:53:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.132+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94906961552800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fb9f990 2024-09-12T16:53:26.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.136+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 43 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94906961552800] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.136+0000 7fce532869c0 20 remove_watcher() i=1 2024-09-12T16:53:26.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.136+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94906961546256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba8e10 2024-09-12T16:53:26.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.136+0000 7fce50d8c640 1 -- 172.21.15.151:0/2396515246 <== osd.3 v2:172.21.15.151:6808/987175333 58 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94906961546256] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce480b2040 con 0x56513fba8e10 2024-09-12T16:53:26.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.136+0000 7fce532869c0 20 remove_watcher() i=2 2024-09-12T16:53:26.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.136+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94906961559168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x7fce480ed040 2024-09-12T16:53:26.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.140+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.2 v2:172.21.15.151:6800/1197700885 33 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94906961559168] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x7fce480ed040 2024-09-12T16:53:26.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.140+0000 7fce532869c0 20 remove_watcher() i=3 2024-09-12T16:53:26.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.140+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94906961563296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fb9f990 2024-09-12T16:53:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.140+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 <== osd.1 v2:172.21.15.151:6816/883447514 44 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94906961563296] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce380391c0 con 0x56513fb9f990 2024-09-12T16:53:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.140+0000 7fce532869c0 20 remove_watcher() i=4 2024-09-12T16:53:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.140+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94906961560320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.144+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 46 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94906961560320] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.144+0000 7fce532869c0 20 remove_watcher() i=5 2024-09-12T16:53:26.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.144+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94906961557696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.144+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 47 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94906961557696] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.144+0000 7fce532869c0 20 remove_watcher() i=6 2024-09-12T16:53:26.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.144+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94906961568336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56513fbff460 con 0x56513fba4390 2024-09-12T16:53:26.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce5158d640 1 -- 172.21.15.151:0/2396515246 <== osd.0 v2:172.21.15.122:6800/3868153603 48 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94906961568336] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4005c040 con 0x56513fba4390 2024-09-12T16:53:26.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 20 remove_watcher() i=7 2024-09-12T16:53:26.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fba4390 msgr2=0x56513fba6780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fba4390 0x56513fba6780 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb9f990 msgr2=0x56513fba1e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb9f990 0x56513fba1e50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fce480ed040 msgr2=0x7fce480e9630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fce480ed040 0x7fce480e9630 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56513fba8e10 msgr2=0x56513fbab240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56513fba8e10 0x56513fbab240 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd1c039a70 msgr2=0x7fcd1c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd1c039a70 0x7fcd1c03bf30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce480e9570 tx=0x7fce480d7000 comp rx=0 tx=0).stop 2024-09-12T16:53:26.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 msgr2=0x56513fb948e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/2396515246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb8e3e0 0x56513fb948e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fce40017e00 tx=0x7fce400508b0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 reap_dead start 2024-09-12T16:53:26.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 shutdown_connections 2024-09-12T16:53:26.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 >> 172.21.15.151:0/2396515246 conn(0x56513fb897a0 msgr2=0x56513fb879b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:26.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce5058b640 1 -- 172.21.15.151:0/2396515246 reap_dead start 2024-09-12T16:53:26.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 shutdown_connections 2024-09-12T16:53:26.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/2396515246 wait complete. 2024-09-12T16:53:26.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/1774629324 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd28039ac0 msgr2=0x7fcd2803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/1774629324 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd28039ac0 0x7fcd2803bf80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x56513fb671e0 tx=0x7fce480a95d0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/1774629324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb80b10 msgr2=0x56513fb80f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/1774629324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb80b10 0x56513fb80f30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x56513fb67e10 tx=0x7fce4000af40 comp rx=0 tx=0).stop 2024-09-12T16:53:26.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/1774629324 shutdown_connections 2024-09-12T16:53:26.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/1774629324 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd28039ac0 0x7fcd2803bf80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 --2- 172.21.15.151:0/1774629324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fb80b10 0x56513fb80f30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/1774629324 >> 172.21.15.151:0/1774629324 conn(0x56513fb764c0 msgr2=0x56513fb768a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:26.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/1774629324 shutdown_connections 2024-09-12T16:53:26.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.148+0000 7fce532869c0 1 -- 172.21.15.151:0/1774629324 wait complete. 2024-09-12T16:53:26.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fb6f9e0 msgr2=0x56513fb71dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fb6f9e0 0x56513fb71dd0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb6ae50 msgr2=0x56513fb6d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb6ae50 0x56513fb6d240 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd38039a70 msgr2=0x7fcd3803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd38039a70 0x7fcd3803bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fce38001dc0 tx=0x7fce38001320 comp rx=0 tx=0).stop 2024-09-12T16:53:26.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 msgr2=0x56513fb65d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:53:26.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb65d40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fce48000f90 tx=0x7fce48017d70 comp rx=0 tx=0).stop 2024-09-12T16:53:26.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 shutdown_connections 2024-09-12T16:53:26.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56513fb6f9e0 0x56513fb71dd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56513fb6ae50 0x56513fb6d240 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fcd38039a70 0x7fcd3803bf30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 --2- 172.21.15.151:0/649231075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56513fa76330 0x56513fb65d40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:53:26.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 >> 172.21.15.151:0/649231075 conn(0x56513f9e6b00 msgr2=0x56513fb58e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:53:26.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 shutdown_connections 2024-09-12T16:53:26.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:53:26.152+0000 7fce532869c0 1 -- 172.21.15.151:0/649231075 wait complete. 2024-09-12T16:54:06.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-12T16:54:06.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-12T16:54:06.171 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-12T16:54:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb8aee89c0 1 Processor -- start 2024-09-12T16:54:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb8aee89c0 1 -- start start 2024-09-12T16:54:06.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb8aee89c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5563e1b35200 0x5563e1b355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb8aee89c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563e19e79c0 con 0x5563e1b38340 2024-09-12T16:54:06.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb8aee89c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5563e1a376d0 con 0x5563e1b35200 2024-09-12T16:54:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb889ee640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5563e1b35200 0x5563e1b355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb889ee640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5563e1b35200 0x5563e1b355e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51774/0 (socket says 172.21.15.151:51774) 2024-09-12T16:54:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb889ee640 1 -- 172.21.15.151:0/935414919 learned_addr learned my addr 172.21.15.151:0/935414919 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb881ed640 1 --1- 172.21.15.151:0/935414919 >> v1:172.21.15.122:6789/0 conn(0x5563e1b38340 0x5563e1b3a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49136/0 (socket says 172.21.15.151:49136) 2024-09-12T16:54:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb889ee640 1 -- 172.21.15.151:0/935414919 >> v1:172.21.15.122:6789/0 conn(0x5563e1b38340 legacy=0x5563e1b3a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.207+0000 7ffb889ee640 1 -- 172.21.15.151:0/935414919 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e19dbca0 con 0x5563e1b35200 2024-09-12T16:54:06.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb889ee640 1 --2- 172.21.15.151:0/935414919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1b355e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800a4e0 tx=0x7ffb7801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df41cc37349b192 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb879ec640 1 -- 172.21.15.151:0/935414919 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb780aa540 con 0x5563e1b35200 2024-09-12T16:54:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb879ec640 1 -- 172.21.15.151:0/935414919 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb780aa6e0 con 0x5563e1b35200 2024-09-12T16:54:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb879ec640 1 -- 172.21.15.151:0/935414919 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb780aaa40 con 0x5563e1b35200 2024-09-12T16:54:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/935414919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 msgr2=0x5563e1b355e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/935414919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1b355e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800a4e0 tx=0x7ffb7801b090 comp rx=0 tx=0).stop 2024-09-12T16:54:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/935414919 shutdown_connections 2024-09-12T16:54:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/935414919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1b355e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/935414919 >> 172.21.15.151:0/935414919 conn(0x5563e1aa8b10 msgr2=0x5563e1aa8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/935414919 shutdown_connections 2024-09-12T16:54:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.211+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/935414919 wait complete. 2024-09-12T16:54:06.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.227+0000 7ffb8aee89c0 1 Processor -- start 2024-09-12T16:54:06.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.227+0000 7ffb8aee89c0 1 -- start start 2024-09-12T16:54:06.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.227+0000 7ffb8aee89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c20870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.227+0000 7ffb8aee89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5563e1a3b680 con 0x5563e1b35200 2024-09-12T16:54:06.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb889ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c20870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb889ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c20870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51786/0 (socket says 172.21.15.151:51786) 2024-09-12T16:54:06.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb889ee640 1 -- 172.21.15.151:0/3749131213 learned_addr learned my addr 172.21.15.151:0/3749131213 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb889ee640 1 -- 172.21.15.151:0/3749131213 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e19b6da0 con 0x5563e1b35200 2024-09-12T16:54:06.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb889ee640 1 --2- 172.21.15.151:0/3749131213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c20870 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffb78019740 tx=0x7ffb780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ce7d95cbf6d917 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffa76e0d640 1 -- 172.21.15.151:0/3749131213 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb780b9070 con 0x5563e1b35200 2024-09-12T16:54:06.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffa76e0d640 1 -- 172.21.15.151:0/3749131213 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb780aaa90 con 0x5563e1b35200 2024-09-12T16:54:06.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffa76e0d640 1 -- 172.21.15.151:0/3749131213 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb780aad70 con 0x5563e1b35200 2024-09-12T16:54:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3749131213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 msgr2=0x5563e1c20870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3749131213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c20870 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffb78019740 tx=0x7ffb780033b0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3749131213 shutdown_connections 2024-09-12T16:54:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3749131213 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c20870 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3749131213 >> 172.21.15.151:0/3749131213 conn(0x5563e1aa8b10 msgr2=0x5563e1c1c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3749131213 shutdown_connections 2024-09-12T16:54:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3749131213 wait complete. 2024-09-12T16:54:06.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 Processor -- start 2024-09-12T16:54:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 -- start start 2024-09-12T16:54:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c27d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb8aee89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5563e19dda50 con 0x5563e1b35200 2024-09-12T16:54:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb889ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c27d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb889ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c27d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51790/0 (socket says 172.21.15.151:51790) 2024-09-12T16:54:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.231+0000 7ffb889ee640 1 -- 172.21.15.151:0/3601284796 learned_addr learned my addr 172.21.15.151:0/3601284796 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb889ee640 1 -- 172.21.15.151:0/3601284796 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e1c282c0 con 0x5563e1b35200 2024-09-12T16:54:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb889ee640 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c27d60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ffb78018cc0 tx=0x7ffb78017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffa7560a640 1 -- 172.21.15.151:0/3601284796 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb780b9070 con 0x5563e1b35200 2024-09-12T16:54:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffa7560a640 1 -- 172.21.15.151:0/3601284796 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb780b5b10 con 0x5563e1b35200 2024-09-12T16:54:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563e1c28550 con 0x5563e1b35200 2024-09-12T16:54:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffa7560a640 1 -- 172.21.15.151:0/3601284796 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb780b5df0 con 0x5563e1b35200 2024-09-12T16:54:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e1c28f00 con 0x5563e1b35200 2024-09-12T16:54:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffa7560a640 1 -- 172.21.15.151:0/3601284796 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffb780b3040 con 0x5563e1b35200 2024-09-12T16:54:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffa7560a640 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa70039ac0 0x7ffa7003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffa7560a640 1 -- 172.21.15.151:0/3601284796 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffb780c4070 con 0x5563e1b35200 2024-09-12T16:54:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb881ed640 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa70039ac0 0x7ffa7003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1b38340 0x5563e1c2eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c2f410 con 0x5563e1b38340 2024-09-12T16:54:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb891ef640 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1b38340 0x5563e1c2eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb881ed640 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa70039ac0 0x7ffa7003bf80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c001e40 tx=0x7ffb7c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb891ef640 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1b38340 0x5563e1c2eed0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb891ef640 1 -- 172.21.15.151:0/3601284796 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb800083f0 con 0x5563e1b38340 2024-09-12T16:54:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.235+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c2f830 con 0x5563e1b38340 2024-09-12T16:54:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb891ef640 1 -- 172.21.15.151:0/3601284796 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb800083f0 con 0x5563e1b38340 2024-09-12T16:54:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c31640 0x5563e1c33a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c34120 con 0x5563e1c31640 2024-09-12T16:54:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb889ee640 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c31640 0x5563e1c33a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb889ee640 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c31640 0x5563e1c33a30 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb889ee640 1 -- 172.21.15.151:0/3601284796 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c31640 2024-09-12T16:54:06.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c304b0 con 0x5563e1b38340 2024-09-12T16:54:06.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb891ef640 1 -- 172.21.15.151:0/3601284796 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb800083f0 con 0x5563e1b38340 2024-09-12T16:54:06.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c30950 con 0x5563e1b38340 2024-09-12T16:54:06.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb891ef640 1 -- 172.21.15.151:0/3601284796 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb800083f0 con 0x5563e1b38340 2024-09-12T16:54:06.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb8aee89c0 1 Processor -- start 2024-09-12T16:54:06.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb8aee89c0 1 -- start start 2024-09-12T16:54:06.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb8aee89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c42780 0x5563e1c42ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb8aee89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5563e1a48450 con 0x5563e1c42780 2024-09-12T16:54:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb891ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c42780 0x5563e1c42ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb891ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c42780 0x5563e1c42ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51792/0 (socket says 172.21.15.151:51792) 2024-09-12T16:54:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.239+0000 7ffb891ef640 1 -- 172.21.15.151:0/566022317 learned_addr learned my addr 172.21.15.151:0/566022317 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb891ef640 1 -- 172.21.15.151:0/566022317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e1c431e0 con 0x5563e1c42780 2024-09-12T16:54:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb891ef640 1 --2- 172.21.15.151:0/566022317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c42780 0x5563e1c42ba0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5563e1c28c70 tx=0x7ffb8000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffa6e7fc640 1 -- 172.21.15.151:0/566022317 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb80007dd0 con 0x5563e1c42780 2024-09-12T16:54:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffa6e7fc640 1 -- 172.21.15.151:0/566022317 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb8001e020 con 0x5563e1c42780 2024-09-12T16:54:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/566022317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563e1c43a40 con 0x5563e1c42780 2024-09-12T16:54:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffa6e7fc640 1 -- 172.21.15.151:0/566022317 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb80019590 con 0x5563e1c42780 2024-09-12T16:54:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/566022317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e1c43fb0 con 0x5563e1c42780 2024-09-12T16:54:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffa6e7fc640 1 -- 172.21.15.151:0/566022317 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffb80016040 con 0x5563e1c42780 2024-09-12T16:54:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffa6e7fc640 1 --2- 172.21.15.151:0/566022317 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa60039a70 0x7ffa6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffa6e7fc640 1 -- 172.21.15.151:0/566022317 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffb8001f030 con 0x5563e1c42780 2024-09-12T16:54:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb889ee640 1 --2- 172.21.15.151:0/566022317 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa60039a70 0x7ffa6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb8aee89c0 1 Processor -- start 2024-09-12T16:54:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb8aee89c0 1 -- start start 2024-09-12T16:54:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb889ee640 1 --2- 172.21.15.151:0/566022317 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa60039a70 0x7ffa6003bf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffb7801b0d0 tx=0x7ffb780e9570 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb8aee89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb8aee89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5563e1c21000 con 0x5563e1c500f0 2024-09-12T16:54:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb891ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb891ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51800/0 (socket says 172.21.15.151:51800) 2024-09-12T16:54:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.243+0000 7ffb891ef640 1 -- 172.21.15.151:0/823549350 learned_addr learned my addr 172.21.15.151:0/823549350 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb891ef640 1 -- 172.21.15.151:0/823549350 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e1c50ae0 con 0x5563e1c500f0 2024-09-12T16:54:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb891ef640 1 --2- 172.21.15.151:0/823549350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c504f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffb800508f0 tx=0x7ffb80017780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86eba0739370b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffa5ffff640 1 -- 172.21.15.151:0/823549350 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb80041e60 con 0x5563e1c500f0 2024-09-12T16:54:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffa5ffff640 1 -- 172.21.15.151:0/823549350 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb80022ca0 con 0x5563e1c500f0 2024-09-12T16:54:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffa5ffff640 1 -- 172.21.15.151:0/823549350 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb8001d040 con 0x5563e1c500f0 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/823549350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 msgr2=0x5563e1c504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/823549350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c504f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffb800508f0 tx=0x7ffb80017780 comp rx=0 tx=0).stop 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/823549350 shutdown_connections 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/823549350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c504f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/823549350 >> 172.21.15.151:0/823549350 conn(0x5563e1c4b510 msgr2=0x5563e1c49750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/823549350 shutdown_connections 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/823549350 wait complete. 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 Processor -- start 2024-09-12T16:54:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- start start 2024-09-12T16:54:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5563e1c4f040 con 0x5563e1c500f0 2024-09-12T16:54:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb891ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb891ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51814/0 (socket says 172.21.15.151:51814) 2024-09-12T16:54:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 learned_addr learned my addr 172.21.15.151:0/273570094 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e1c56b40 con 0x5563e1c500f0 2024-09-12T16:54:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb891ef640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c565e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffb8004f7c0 tx=0x7ffb80050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffa5e7fc640 1 -- 172.21.15.151:0/273570094 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb8001d030 con 0x5563e1c500f0 2024-09-12T16:54:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563e1c56dd0 con 0x5563e1c500f0 2024-09-12T16:54:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffa5e7fc640 1 -- 172.21.15.151:0/273570094 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb80031030 con 0x5563e1c500f0 2024-09-12T16:54:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffa5e7fc640 1 -- 172.21.15.151:0/273570094 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb80048040 con 0x5563e1c500f0 2024-09-12T16:54:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.247+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e1c57780 con 0x5563e1c500f0 2024-09-12T16:54:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffa5e7fc640 1 -- 172.21.15.151:0/273570094 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ffb8003eaa0 con 0x5563e1c500f0 2024-09-12T16:54:06.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffa5e7fc640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa54039a70 0x7ffa5403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffa5e7fc640 1 -- 172.21.15.151:0/273570094 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffb80037d40 con 0x5563e1c500f0 2024-09-12T16:54:06.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb889ee640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa54039a70 0x7ffa5403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1c618d0 0x5563e1c63d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c644e0 con 0x5563e1c618d0 2024-09-12T16:54:06.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb881ed640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1c618d0 0x5563e1c63d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb889ee640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa54039a70 0x7ffa5403bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffb780c6a90 tx=0x7ffb780db000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb881ed640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1c618d0 0x5563e1c63d90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb7c00f620 con 0x5563e1c618d0 2024-09-12T16:54:06.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 realm 2024-09-12T16:54:06.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c60c60 con 0x5563e1c618d0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb7c00f620 con 0x5563e1c618d0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c64fe0 con 0x5563e1c618d0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb7c00f620 con 0x5563e1c618d0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c658b0 con 0x5563e1c618d0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb7c00f620 con 0x5563e1c618d0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c662d0 0x5563e1c686c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c68e00 con 0x5563e1c662d0 2024-09-12T16:54:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.251+0000 7ffb891ef640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c662d0 0x5563e1c686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb891ef640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c662d0 0x5563e1c686c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb8aee89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb8aee89c0 20 searching for the correct realm 2024-09-12T16:54:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5563e1c6ad50 0x5563e1c6d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb889ee640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5563e1c6ad50 0x5563e1c6d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb889ee640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5563e1c6ad50 0x5563e1c6d160 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb889ee640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ffb780f8040 0x7ffb780b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x7ffb780f8040 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb881ed640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ffb780f8040 0x7ffb780b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb881ed640 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ffb780f8040 0x7ffb780b39a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c00f620 con 0x7ffb780f8040 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c618d0 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c00f620 con 0x5563e1c618d0 2024-09-12T16:54:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c618d0 2024-09-12T16:54:06.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.255+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x7ffb780f8040 2024-09-12T16:54:06.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c618d0 2024-09-12T16:54:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c618d0 2024-09-12T16:54:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x7ffb780f8040 2024-09-12T16:54:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.259+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c618d0 2024-09-12T16:54:06.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c618d0 2024-09-12T16:54:06.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x7ffb780f8040 2024-09-12T16:54:06.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c618d0 2024-09-12T16:54:06.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.263+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x7ffb780f8040 2024-09-12T16:54:06.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c6ad50 2024-09-12T16:54:06.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c662d0 2024-09-12T16:54:06.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x5563e1c618d0 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6d830 con 0x7ffb780f8040 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c697c0 con 0x5563e1c618d0 2024-09-12T16:54:06.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c69400 con 0x5563e1c618d0 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.267+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6a1a0 con 0x5563e1c618d0 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 zone default found 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 4 Realm: () 2024-09-12T16:54:06.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:06.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:06.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:06.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 zonegroup default 2024-09-12T16:54:06.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6dcd0 con 0x5563e1c662d0 2024-09-12T16:54:06.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6ffb0 con 0x5563e1c6ad50 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c70350 con 0x5563e1c6ad50 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 started sync module instance, tier type = 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6f440 con 0x7ffb780f8040 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93887478036832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6f440 con 0x7ffb780f8040 2024-09-12T16:54:06.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.271+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c70de0 con 0x5563e1c618d0 2024-09-12T16:54:06.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.275+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93887478036832] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.275+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.275+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93887478034320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c70da0 con 0x5563e1c618d0 2024-09-12T16:54:06.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.275+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c71760 con 0x5563e1c6ad50 2024-09-12T16:54:06.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.275+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93887478034320] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.275+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.275+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93887478040816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c70d10 con 0x5563e1c6ad50 2024-09-12T16:54:06.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.275+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c724f0 con 0x7ffb780f8040 2024-09-12T16:54:06.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.279+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.279+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93887478046720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c72d90 con 0x7ffb780f8040 2024-09-12T16:54:06.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.279+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c73790 con 0x5563e1c618d0 2024-09-12T16:54:06.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.279+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93887478040816] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.279+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93887478046720] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.279+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.279+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93887478045520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c72890 con 0x5563e1c618d0 2024-09-12T16:54:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.279+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c74030 con 0x5563e1c662d0 2024-09-12T16:54:06.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.283+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93887478045520] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.283+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.283+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93887478053760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c72890 con 0x5563e1c662d0 2024-09-12T16:54:06.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.283+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c74880 con 0x5563e1c662d0 2024-09-12T16:54:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.283+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93887478053760] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93887478051488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c74880 con 0x5563e1c662d0 2024-09-12T16:54:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c752c0 con 0x5563e1c662d0 2024-09-12T16:54:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93887478051488] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93887478058384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c754a0 con 0x5563e1c662d0 2024-09-12T16:54:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 20 add_watcher() i=0 2024-09-12T16:54:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 20 add_watcher() i=1 2024-09-12T16:54:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 20 add_watcher() i=2 2024-09-12T16:54:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 20 add_watcher() i=3 2024-09-12T16:54:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 20 add_watcher() i=4 2024-09-12T16:54:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 20 add_watcher() i=5 2024-09-12T16:54:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.287+0000 7ffb8aee89c0 20 add_watcher() i=6 2024-09-12T16:54:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93887478058384] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 20 add_watcher() i=7 2024-09-12T16:54:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c78870 con 0x5563e1c618d0 2024-09-12T16:54:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93887478059920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c75c60 con 0x5563e1c618d0 2024-09-12T16:54:06.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93887478059920] v34'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffa3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 5 note: GC not initialized 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffa3dfe3640 20 reqs_thread_entry: start 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 20 Filter name: none 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ff9af7fe640 20 reqs_thread_entry: start 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c9b9e0 con 0x5563e1c618d0 2024-09-12T16:54:06.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:54:06.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:54:06.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:54:06.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:06.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.291+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c9b400 con 0x5563e1c662d0 2024-09-12T16:54:06.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.295+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 usage.10 [call] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.295+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c9b400 con 0x5563e1c662d0 2024-09-12T16:54:06.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(64 usage.10 [call] v34'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffa3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:06.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93887478059920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c9b400 con 0x5563e1c618d0 2024-09-12T16:54:06.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93887478059920] v34'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93887478036832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c9b400 con 0x7ffb780f8040 2024-09-12T16:54:06.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93887478036832] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffb8aee89c0 20 remove_watcher() i=0 2024-09-12T16:54:06.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffb8aee89c0 2 removed watcher, disabling cache 2024-09-12T16:54:06.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.299+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93887478034320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c9b400 con 0x5563e1c618d0 2024-09-12T16:54:06.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.303+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93887478034320] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.303+0000 7ffb8aee89c0 20 remove_watcher() i=1 2024-09-12T16:54:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.303+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93887478040816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c9b400 con 0x5563e1c6ad50 2024-09-12T16:54:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb889ee640 1 -- 172.21.15.151:0/273570094 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93887478040816] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb780c6d80 con 0x5563e1c6ad50 2024-09-12T16:54:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb8aee89c0 20 remove_watcher() i=2 2024-09-12T16:54:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93887478046720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6ef90 con 0x7ffb780f8040 2024-09-12T16:54:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93887478046720] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x7ffb780f8040 2024-09-12T16:54:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb8aee89c0 20 remove_watcher() i=3 2024-09-12T16:54:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93887478045520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c708f0 con 0x5563e1c618d0 2024-09-12T16:54:06.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93887478045520] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb7c02b040 con 0x5563e1c618d0 2024-09-12T16:54:06.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb8aee89c0 20 remove_watcher() i=4 2024-09-12T16:54:06.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.307+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93887478053760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c6ef90 con 0x5563e1c662d0 2024-09-12T16:54:06.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.311+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93887478053760] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.311+0000 7ffb8aee89c0 20 remove_watcher() i=5 2024-09-12T16:54:06.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.311+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93887478051488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c71b50 con 0x5563e1c662d0 2024-09-12T16:54:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93887478051488] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 20 remove_watcher() i=6 2024-09-12T16:54:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93887478058384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563e1c708f0 con 0x5563e1c662d0 2024-09-12T16:54:06.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb891ef640 1 -- 172.21.15.151:0/273570094 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93887478058384] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb8003d070 con 0x5563e1c662d0 2024-09-12T16:54:06.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 20 remove_watcher() i=7 2024-09-12T16:54:06.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c662d0 msgr2=0x5563e1c686c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c662d0 0x5563e1c686c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1c618d0 msgr2=0x5563e1c63d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1c618d0 0x5563e1c63d90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ffb780f8040 msgr2=0x7ffb780b39a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7ffb780f8040 0x7ffb780b39a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5563e1c6ad50 msgr2=0x5563e1c6d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5563e1c6ad50 0x5563e1c6d160 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa54039a70 msgr2=0x7ffa5403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa54039a70 0x7ffa5403bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffb780c6a90 tx=0x7ffb780db000 comp rx=0 tx=0).stop 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 msgr2=0x5563e1c565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb881ed640 1 -- 172.21.15.151:0/273570094 reap_dead start 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c565e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffb8004f7c0 tx=0x7ffb80050880 comp rx=0 tx=0).stop 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 shutdown_connections 2024-09-12T16:54:06.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/273570094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c500f0 0x5563e1c565e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 >> 172.21.15.151:0/273570094 conn(0x5563e1c4b510 msgr2=0x5563e1c49720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 shutdown_connections 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/273570094 wait complete. 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/566022317 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa60039a70 msgr2=0x7ffa6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/566022317 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa60039a70 0x7ffa6003bf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffb7801b0d0 tx=0x7ffb780e9570 comp rx=0 tx=0).stop 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/566022317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c42780 msgr2=0x5563e1c42ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/566022317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c42780 0x5563e1c42ba0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5563e1c28c70 tx=0x7ffb8000af40 comp rx=0 tx=0).stop 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/566022317 shutdown_connections 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/566022317 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa60039a70 0x7ffa6003bf30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/566022317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1c42780 0x5563e1c42ba0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/566022317 >> 172.21.15.151:0/566022317 conn(0x5563e1c38130 msgr2=0x5563e1c38510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/566022317 shutdown_connections 2024-09-12T16:54:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.315+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/566022317 wait complete. 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c31640 msgr2=0x5563e1c33a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c31640 0x5563e1c33a30 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1b38340 msgr2=0x5563e1c2eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1b38340 0x5563e1c2eed0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa70039ac0 msgr2=0x7ffa7003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa70039ac0 0x7ffa7003bf80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c001e40 tx=0x7ffb7c0013a0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 msgr2=0x5563e1c27d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c27d60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ffb78018cc0 tx=0x7ffb78017e30 comp rx=0 tx=0).stop 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 shutdown_connections 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5563e1c31640 0x5563e1c33a30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5563e1b38340 0x5563e1c2eed0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ffa70039ac0 0x7ffa7003bf80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 --2- 172.21.15.151:0/3601284796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5563e1b35200 0x5563e1c27d60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 >> 172.21.15.151:0/3601284796 conn(0x5563e1aa8b10 msgr2=0x5563e1c1afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 shutdown_connections 2024-09-12T16:54:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.319+0000 7ffb8aee89c0 1 -- 172.21.15.151:0/3601284796 wait complete. 2024-09-12T16:54:06.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-12T16:54:06.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-12T16:54:06.334 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-12T16:54:06.413 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:06.413 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:06.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.407+0000 7f364297f9c0 1 Processor -- start 2024-09-12T16:54:06.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.407+0000 7f364297f9c0 1 -- start start 2024-09-12T16:54:06.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.407+0000 7f364297f9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c40ae60200 0x55c40ae605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.407+0000 7f364297f9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c40ad129c0 con 0x55c40ae63340 2024-09-12T16:54:06.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.407+0000 7f364297f9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55c40ad626d0 con 0x55c40ae60200 2024-09-12T16:54:06.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.411+0000 7f3640485640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c40ae60200 0x55c40ae605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.411+0000 7f363fc84640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55c40ae63340 0x55c40ae65730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49148/0 (socket says 172.21.15.151:49148) 2024-09-12T16:54:06.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.411+0000 7f363fc84640 1 -- 172.21.15.151:0/2946561882 learned_addr learned my addr 172.21.15.151:0/2946561882 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:06.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.411+0000 7f3640485640 1 -- 172.21.15.151:0/2946561882 >> v1:172.21.15.122:6789/0 conn(0x55c40ae63340 legacy=0x55c40ae65730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.411+0000 7f3640485640 1 -- 172.21.15.151:0/2946561882 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c40ad06ca0 con 0x55c40ae60200 2024-09-12T16:54:06.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.411+0000 7f3640485640 1 --2- 172.21.15.151:0/2946561882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40ae605e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f363000a480 tx=0x7f363001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976cc46cedf6f560 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f363f483640 1 -- 172.21.15.151:0/2946561882 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36300b0070 con 0x55c40ae60200 2024-09-12T16:54:06.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f363f483640 1 -- 172.21.15.151:0/2946561882 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36300ab540 con 0x55c40ae60200 2024-09-12T16:54:06.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f363f483640 1 -- 172.21.15.151:0/2946561882 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36300ab840 con 0x55c40ae60200 2024-09-12T16:54:06.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f364297f9c0 1 -- 172.21.15.151:0/2946561882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 msgr2=0x55c40ae605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f364297f9c0 1 --2- 172.21.15.151:0/2946561882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40ae605e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f363000a480 tx=0x7f363001b280 comp rx=0 tx=0).stop 2024-09-12T16:54:06.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f364297f9c0 1 -- 172.21.15.151:0/2946561882 shutdown_connections 2024-09-12T16:54:06.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f364297f9c0 1 --2- 172.21.15.151:0/2946561882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40ae605e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f364297f9c0 1 -- 172.21.15.151:0/2946561882 >> 172.21.15.151:0/2946561882 conn(0x55c40add3b10 msgr2=0x55c40add3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f364297f9c0 1 -- 172.21.15.151:0/2946561882 shutdown_connections 2024-09-12T16:54:06.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.415+0000 7f364297f9c0 1 -- 172.21.15.151:0/2946561882 wait complete. 2024-09-12T16:54:06.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f364297f9c0 1 Processor -- start 2024-09-12T16:54:06.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f364297f9c0 1 -- start start 2024-09-12T16:54:06.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f364297f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af4b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f364297f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c40ad66680 con 0x55c40ae60200 2024-09-12T16:54:06.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f3640485640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af4b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f3640485640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af4b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51830/0 (socket says 172.21.15.151:51830) 2024-09-12T16:54:06.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f3640485640 1 -- 172.21.15.151:0/1369534012 learned_addr learned my addr 172.21.15.151:0/1369534012 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f3640485640 1 -- 172.21.15.151:0/1369534012 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c40ace1da0 con 0x55c40ae60200 2024-09-12T16:54:06.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f3640485640 1 --2- 172.21.15.151:0/1369534012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af4b870 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f36300ae040 tx=0x7f3630003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60c2bc059ebf5aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f352e60c640 1 -- 172.21.15.151:0/1369534012 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36300b0070 con 0x55c40ae60200 2024-09-12T16:54:06.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f352e60c640 1 -- 172.21.15.151:0/1369534012 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36300b1040 con 0x55c40ae60200 2024-09-12T16:54:06.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.431+0000 7f352e60c640 1 -- 172.21.15.151:0/1369534012 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36300ab6f0 con 0x55c40ae60200 2024-09-12T16:54:06.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- 172.21.15.151:0/1369534012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 msgr2=0x55c40af4b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1369534012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af4b870 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f36300ae040 tx=0x7f3630003030 comp rx=0 tx=0).stop 2024-09-12T16:54:06.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- 172.21.15.151:0/1369534012 shutdown_connections 2024-09-12T16:54:06.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1369534012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af4b870 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- 172.21.15.151:0/1369534012 >> 172.21.15.151:0/1369534012 conn(0x55c40add3b10 msgr2=0x55c40af47510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- 172.21.15.151:0/1369534012 shutdown_connections 2024-09-12T16:54:06.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- 172.21.15.151:0/1369534012 wait complete. 2024-09-12T16:54:06.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 Processor -- start 2024-09-12T16:54:06.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- start start 2024-09-12T16:54:06.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af52dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c40ad08a50 con 0x55c40ae60200 2024-09-12T16:54:06.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f3640485640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af52dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f3640485640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af52dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51834/0 (socket says 172.21.15.151:51834) 2024-09-12T16:54:06.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f3640485640 1 -- 172.21.15.151:0/177506622 learned_addr learned my addr 172.21.15.151:0/177506622 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f3640485640 1 -- 172.21.15.151:0/177506622 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c40af53330 con 0x55c40ae60200 2024-09-12T16:54:06.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f3640485640 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af52dd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f36300ab510 tx=0x7f3630018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f352ce09640 1 -- 172.21.15.151:0/177506622 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36300b75b0 con 0x55c40ae60200 2024-09-12T16:54:06.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f352ce09640 1 -- 172.21.15.151:0/177506622 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36300b7750 con 0x55c40ae60200 2024-09-12T16:54:06.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c40af535c0 con 0x55c40ae60200 2024-09-12T16:54:06.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f352ce09640 1 -- 172.21.15.151:0/177506622 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36300b7a30 con 0x55c40ae60200 2024-09-12T16:54:06.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c40af53f70 con 0x55c40ae60200 2024-09-12T16:54:06.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.435+0000 7f352ce09640 1 -- 172.21.15.151:0/177506622 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f36300b7bd0 con 0x55c40ae60200 2024-09-12T16:54:06.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f352ce09640 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3528039a70 0x7f352803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f352ce09640 1 -- 172.21.15.151:0/177506622 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f36300bc070 con 0x55c40ae60200 2024-09-12T16:54:06.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f363fc84640 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3528039a70 0x7f352803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40ae63340 0x55c40af59f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af5a480 con 0x55c40ae63340 2024-09-12T16:54:06.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f3640c86640 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40ae63340 0x55c40af59f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f363fc84640 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3528039a70 0x7f352803bf30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3634001d80 tx=0x7f36340012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f3640c86640 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40ae63340 0x55c40af59f40 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f3640c86640 1 -- 172.21.15.151:0/177506622 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363800a4d0 con 0x55c40ae63340 2024-09-12T16:54:06.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af5a880 con 0x55c40ae63340 2024-09-12T16:54:06.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f3640c86640 1 -- 172.21.15.151:0/177506622 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f363800a4d0 con 0x55c40ae63340 2024-09-12T16:54:06.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af5c690 0x55c40af5ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af5f170 con 0x55c40af5c690 2024-09-12T16:54:06.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f3640485640 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af5c690 0x55c40af5ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f3640485640 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af5c690 0x55c40af5ea80 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f3640485640 1 -- 172.21.15.151:0/177506622 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f36300eb0b0 con 0x55c40af5c690 2024-09-12T16:54:06.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af5b530 con 0x55c40ae63340 2024-09-12T16:54:06.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f3640c86640 1 -- 172.21.15.151:0/177506622 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f363800a4d0 con 0x55c40ae63340 2024-09-12T16:54:06.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.439+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af5b9d0 con 0x55c40ae63340 2024-09-12T16:54:06.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3640c86640 1 -- 172.21.15.151:0/177506622 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f363800a4d0 con 0x55c40ae63340 2024-09-12T16:54:06.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f364297f9c0 1 Processor -- start 2024-09-12T16:54:06.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f364297f9c0 1 -- start start 2024-09-12T16:54:06.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f364297f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af6d800 0x55c40af6dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f364297f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c40ad73450 con 0x55c40af6d800 2024-09-12T16:54:06.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3640c86640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af6d800 0x55c40af6dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3640c86640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af6d800 0x55c40af6dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51850/0 (socket says 172.21.15.151:51850) 2024-09-12T16:54:06.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3640c86640 1 -- 172.21.15.151:0/1090092924 learned_addr learned my addr 172.21.15.151:0/1090092924 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3640c86640 1 -- 172.21.15.151:0/1090092924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c40af6e260 con 0x55c40af6d800 2024-09-12T16:54:06.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3640c86640 1 --2- 172.21.15.151:0/1090092924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af6d800 0x55c40af6dc20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55c40af53e00 tx=0x7f3638018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3525ffb640 1 -- 172.21.15.151:0/1090092924 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638014450 con 0x55c40af6d800 2024-09-12T16:54:06.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3525ffb640 1 -- 172.21.15.151:0/1090092924 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638014610 con 0x55c40af6d800 2024-09-12T16:54:06.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f364297f9c0 1 -- 172.21.15.151:0/1090092924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c40af6eac0 con 0x55c40af6d800 2024-09-12T16:54:06.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3525ffb640 1 -- 172.21.15.151:0/1090092924 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638014930 con 0x55c40af6d800 2024-09-12T16:54:06.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f364297f9c0 1 -- 172.21.15.151:0/1090092924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c40af6f030 con 0x55c40af6d800 2024-09-12T16:54:06.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3525ffb640 1 -- 172.21.15.151:0/1090092924 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3638011040 con 0x55c40af6d800 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.443+0000 7f3525ffb640 1 --2- 172.21.15.151:0/1090092924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3518039a70 0x7f351803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3525ffb640 1 -- 172.21.15.151:0/1090092924 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f363801e070 con 0x55c40af6d800 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640485640 1 --2- 172.21.15.151:0/1090092924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3518039a70 0x7f351803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 Processor -- start 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- start start 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640485640 1 --2- 172.21.15.151:0/1090092924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3518039a70 0x7f351803bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55c40af541b0 tx=0x7f36300eb040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af7b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c40af4c000 con 0x55c40af7b150 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640c86640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af7b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640c86640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af7b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51866/0 (socket says 172.21.15.151:51866) 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640c86640 1 -- 172.21.15.151:0/1238022757 learned_addr learned my addr 172.21.15.151:0/1238022757 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640c86640 1 -- 172.21.15.151:0/1238022757 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c40af7bb40 con 0x55c40af7b150 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640c86640 1 --2- 172.21.15.151:0/1238022757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af7b550 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3638050670 tx=0x7f3638011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3978525c2eede27d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f351f7fe640 1 -- 172.21.15.151:0/1238022757 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363804f2a0 con 0x55c40af7b150 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f351f7fe640 1 -- 172.21.15.151:0/1238022757 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638016960 con 0x55c40af7b150 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f351f7fe640 1 -- 172.21.15.151:0/1238022757 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638016440 con 0x55c40af7b150 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- 172.21.15.151:0/1238022757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 msgr2=0x55c40af7b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1238022757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af7b550 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3638050670 tx=0x7f3638011e40 comp rx=0 tx=0).stop 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- 172.21.15.151:0/1238022757 shutdown_connections 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1238022757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af7b550 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- 172.21.15.151:0/1238022757 >> 172.21.15.151:0/1238022757 conn(0x55c40af76570 msgr2=0x55c40af747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- 172.21.15.151:0/1238022757 shutdown_connections 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- 172.21.15.151:0/1238022757 wait complete. 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 Processor -- start 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- start start 2024-09-12T16:54:06.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af81670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f364297f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c40af7a0a0 con 0x55c40af7b150 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640c86640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af81670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640c86640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af81670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51880/0 (socket says 172.21.15.151:51880) 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.447+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 learned_addr learned my addr 172.21.15.151:0/1833282089 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c40af81bd0 con 0x55c40af7b150 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f3640c86640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af81670 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f363802b500 tx=0x7f363804b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f351dffb640 1 -- 172.21.15.151:0/1833282089 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363804f2a0 con 0x55c40af7b150 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c40af81e60 con 0x55c40af7b150 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f351dffb640 1 -- 172.21.15.151:0/1833282089 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363803ea00 con 0x55c40af7b150 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f351dffb640 1 -- 172.21.15.151:0/1833282089 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363803ed20 con 0x55c40af7b150 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c40af82810 con 0x55c40af7b150 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f351dffb640 1 -- 172.21.15.151:0/1833282089 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f363803e3f0 con 0x55c40af7b150 2024-09-12T16:54:06.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f351dffb640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3510039c10 0x7f351003c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f351dffb640 1 -- 172.21.15.151:0/1833282089 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f363800e040 con 0x55c40af7b150 2024-09-12T16:54:06.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f3640485640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3510039c10 0x7f351003c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40af8c920 0x55c40af8edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af8f500 con 0x55c40af8c920 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f363fc84640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40af8c920 0x55c40af8edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f3640485640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3510039c10 0x7f351003c0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36300e9a10 tx=0x7f36300dd000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f363fc84640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40af8c920 0x55c40af8edb0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363400e5a0 con 0x55c40af8c920 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 20 realm 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af8bd30 con 0x55c40af8c920 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363400e5a0 con 0x55c40af8c920 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af90000 con 0x55c40af8c920 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363400e5a0 con 0x55c40af8c920 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.451+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af908d0 con 0x55c40af8c920 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f363400e5a0 con 0x55c40af8c920 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f364297f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af911d0 0x55c40af935c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af93d00 con 0x55c40af911d0 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f3640c86640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af911d0 0x55c40af935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f3640c86640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af911d0 0x55c40af935c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f364297f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f364297f9c0 20 searching for the correct realm 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c40af95c70 0x55c40af98130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f3640485640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c40af95c70 0x55c40af98130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f3640485640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c40af95c70 0x55c40af98130 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f3640485640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f36300e5040 0x7f36300c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x7f36300e5040 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f363fc84640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f36300e5040 0x7f36300c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f363fc84640 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f36300e5040 0x7f36300c1470 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400e5a0 con 0x7f36300e5040 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.455+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af8c920 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400e5a0 con 0x55c40af8c920 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af8c920 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x7f36300e5040 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x7f36300e5040 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af8c920 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af8c920 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.459+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x7f36300e5040 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3634029040 con 0x7f36300e5040 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af8c920 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af8c920 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x7f36300e5040 2024-09-12T16:54:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x7f36300e5040 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.463+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af8c920 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x7f36300e5040 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x7f36300e5040 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af95c70 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af911d0 2024-09-12T16:54:06.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x55c40af8c920 2024-09-12T16:54:06.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c40af98800 con 0x7f36300e5040 2024-09-12T16:54:06.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634029040 con 0x7f36300e5040 2024-09-12T16:54:06.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f364297f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:06.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f364297f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:06.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f364297f9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f364297f9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f364297f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f364297f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.467+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af94650 con 0x55c40af8c920 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af94aa0 con 0x55c40af8c920 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3634029040 con 0x55c40af8c920 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af94ec0 con 0x55c40af8c920 2024-09-12T16:54:06.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 zone default found 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 4 Realm: () 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 zonegroup default 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af94ec0 con 0x55c40af911d0 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9a7c0 con 0x55c40af95c70 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9ac70 con 0x55c40af95c70 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 started sync module instance, tier type = 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af99b10 con 0x7f36300e5040 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x7f36300e5040 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94300486082576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af99b10 con 0x7f36300e5040 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.471+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9b780 con 0x55c40af8c920 2024-09-12T16:54:06.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.475+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94300486082576] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x7f36300e5040 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.475+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.475+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94300486087280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af99b10 con 0x55c40af8c920 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.475+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9c1c0 con 0x55c40af95c70 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.475+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94300486087280] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94300486080096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af99a80 con 0x55c40af95c70 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9cec0 con 0x7f36300e5040 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x7f36300e5040 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94300486093632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9d760 con 0x7f36300e5040 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9e160 con 0x55c40af8c920 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94300486080096] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94300486093632] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x7f36300e5040 2024-09-12T16:54:06.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94300486092128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9d240 con 0x55c40af8c920 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.479+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9ea00 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.483+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94300486092128] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.483+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.483+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94300486100304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9d240 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.483+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9f250 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94300486100304] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94300486098032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9f250 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9fc70 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94300486098032] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94300486104928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40afa00e0 con 0x55c40af911d0 2024-09-12T16:54:06.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 20 add_watcher() i=0 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 20 add_watcher() i=1 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 20 add_watcher() i=2 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 20 add_watcher() i=3 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 20 add_watcher() i=4 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 20 add_watcher() i=5 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.487+0000 7f364297f9c0 20 add_watcher() i=6 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94300486104928] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 20 add_watcher() i=7 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40afa00e0 con 0x55c40af8c920 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94300486106160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40afa0080 con 0x55c40af8c920 2024-09-12T16:54:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94300486106160] v34'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f34f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 5 note: GC not initialized 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f34f57e2640 20 reqs_thread_entry: start 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 20 Filter name: none 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f3466ffd640 20 reqs_thread_entry: start 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40afc5f00 con 0x55c40af8c920 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.491+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c40afc7480 con 0x55c40af911d0 2024-09-12T16:54:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.495+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.495+0000 7f34f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:06.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.495+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94300486106160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40afa0a60 con 0x55c40af8c920 2024-09-12T16:54:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.495+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94300486106160] v34'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.495+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94300486082576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9fc30 con 0x7f36300e5040 2024-09-12T16:54:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.499+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94300486082576] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x7f36300e5040 2024-09-12T16:54:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.499+0000 7f364297f9c0 20 remove_watcher() i=0 2024-09-12T16:54:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.499+0000 7f364297f9c0 2 removed watcher, disabling cache 2024-09-12T16:54:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.499+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94300486087280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9fc30 con 0x55c40af8c920 2024-09-12T16:54:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.499+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94300486087280] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.499+0000 7f364297f9c0 20 remove_watcher() i=1 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.499+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94300486080096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9fc30 con 0x55c40af95c70 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f3640485640 1 -- 172.21.15.151:0/1833282089 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94300486080096] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36300f2040 con 0x55c40af95c70 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f364297f9c0 20 remove_watcher() i=2 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94300486093632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af99660 con 0x7f36300e5040 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94300486093632] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x7f36300e5040 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f364297f9c0 20 remove_watcher() i=3 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94300486092128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9cb40 con 0x55c40af8c920 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94300486092128] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36340391c0 con 0x55c40af8c920 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f364297f9c0 20 remove_watcher() i=4 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.503+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94300486100304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af99660 con 0x55c40af911d0 2024-09-12T16:54:06.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.507+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94300486100304] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.507+0000 7f364297f9c0 20 remove_watcher() i=5 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.507+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94300486098032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9c560 con 0x55c40af911d0 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94300486098032] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 20 remove_watcher() i=6 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94300486104928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c40af9cb40 con 0x55c40af911d0 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f3640c86640 1 -- 172.21.15.151:0/1833282089 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94300486104928] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f363802a070 con 0x55c40af911d0 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 20 remove_watcher() i=7 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af911d0 msgr2=0x55c40af935c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af911d0 0x55c40af935c0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40af8c920 msgr2=0x55c40af8edb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40af8c920 0x55c40af8edb0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f36300e5040 msgr2=0x7f36300c1470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f36300e5040 0x7f36300c1470 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c40af95c70 msgr2=0x55c40af98130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55c40af95c70 0x55c40af98130 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3510039c10 msgr2=0x7f351003c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3510039c10 0x7f351003c0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36300e9a10 tx=0x7f36300dd000 comp rx=0 tx=0).stop 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f363fc84640 1 -- 172.21.15.151:0/1833282089 reap_dead start 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 msgr2=0x55c40af81670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af81670 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f363802b500 tx=0x7f363804b040 comp rx=0 tx=0).stop 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 shutdown_connections 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1833282089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af7b150 0x55c40af81670 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 >> 172.21.15.151:0/1833282089 conn(0x55c40af76570 msgr2=0x55c40af74780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 shutdown_connections 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1833282089 wait complete. 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1090092924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3518039a70 msgr2=0x7f351803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1090092924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3518039a70 0x7f351803bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55c40af541b0 tx=0x7f36300eb040 comp rx=0 tx=0).stop 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 -- 172.21.15.151:0/1090092924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af6d800 msgr2=0x55c40af6dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.511+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1090092924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af6d800 0x55c40af6dc20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x55c40af53e00 tx=0x7f3638018830 comp rx=0 tx=0).stop 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/1090092924 shutdown_connections 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1090092924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3518039a70 0x7f351803bf30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/1090092924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40af6d800 0x55c40af6dc20 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/1090092924 >> 172.21.15.151:0/1090092924 conn(0x55c40af631b0 msgr2=0x55c40af63590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/1090092924 shutdown_connections 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/1090092924 wait complete. 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af5c690 msgr2=0x55c40af5ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af5c690 0x55c40af5ea80 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40ae63340 msgr2=0x55c40af59f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40ae63340 0x55c40af59f40 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3528039a70 msgr2=0x7f352803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3528039a70 0x7f352803bf30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3634001d80 tx=0x7f36340012e0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 msgr2=0x55c40af52dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af52dd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f36300ab510 tx=0x7f3630018020 comp rx=0 tx=0).stop 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 shutdown_connections 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c40af5c690 0x55c40af5ea80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c40ae63340 0x55c40af59f40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3528039a70 0x7f352803bf30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 --2- 172.21.15.151:0/177506622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c40ae60200 0x55c40af52dd0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 >> 172.21.15.151:0/177506622 conn(0x55c40add3b10 msgr2=0x55c40af45fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 shutdown_connections 2024-09-12T16:54:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.515+0000 7f364297f9c0 1 -- 172.21.15.151:0/177506622 wait complete. 2024-09-12T16:54:06.532 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[],"summary":[]} 2024-09-12T16:54:06.532 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-12T16:54:06.532 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-12T16:54:06.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-12T16:54:06.533 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-12T16:54:06.608 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:06.609 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:06.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.603+0000 7fb5c1fd69c0 1 Processor -- start 2024-09-12T16:54:06.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.603+0000 7fb5c1fd69c0 1 -- start start 2024-09-12T16:54:06.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.603+0000 7fb5c1fd69c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x562a5ed8a1f0 0x562a5ee1b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.603+0000 7fb5c1fd69c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a5ecca9c0 con 0x562a5ed8a5d0 2024-09-12T16:54:06.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.603+0000 7fb5c1fd69c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x562a5ed1a6d0 con 0x562a5ed8a1f0 2024-09-12T16:54:06.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.603+0000 7fb5bfadc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x562a5ed8a1f0 0x562a5ee1b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.603+0000 7fb5bf2db640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x562a5ed8a5d0 0x562a5ee1d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49150/0 (socket says 172.21.15.151:49150) 2024-09-12T16:54:06.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2330001916 learned_addr learned my addr 172.21.15.151:0/2330001916 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:06.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2330001916 >> v1:172.21.15.122:6789/0 conn(0x562a5ed8a5d0 legacy=0x562a5ee1d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2330001916 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5ecbeca0 con 0x562a5ed8a1f0 2024-09-12T16:54:06.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2330001916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ee1b020 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800a420 tx=0x7fb5b801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0b9f154dc6cacb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5beada640 1 -- 172.21.15.151:0/2330001916 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b80af070 con 0x562a5ed8a1f0 2024-09-12T16:54:06.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5beada640 1 -- 172.21.15.151:0/2330001916 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b80aa530 con 0x562a5ed8a1f0 2024-09-12T16:54:06.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5beada640 1 -- 172.21.15.151:0/2330001916 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b80aa850 con 0x562a5ed8a1f0 2024-09-12T16:54:06.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2330001916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 msgr2=0x562a5ee1b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.607+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2330001916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ee1b020 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800a420 tx=0x7fb5b801afd0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.611+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2330001916 shutdown_connections 2024-09-12T16:54:06.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.611+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2330001916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ee1b020 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.611+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2330001916 >> 172.21.15.151:0/2330001916 conn(0x562a5ee10910 msgr2=0x562a5ee12d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.611+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2330001916 shutdown_connections 2024-09-12T16:54:06.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.611+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2330001916 wait complete. 2024-09-12T16:54:06.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.623+0000 7fb5c1fd69c0 1 Processor -- start 2024-09-12T16:54:06.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.623+0000 7fb5c1fd69c0 1 -- start start 2024-09-12T16:54:06.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.623+0000 7fb5c1fd69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef03880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.623+0000 7fb5c1fd69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562a5ed1e680 con 0x562a5ed8a1f0 2024-09-12T16:54:06.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5bfadc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef03880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5bfadc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef03880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51902/0 (socket says 172.21.15.151:51902) 2024-09-12T16:54:06.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2405492884 learned_addr learned my addr 172.21.15.151:0/2405492884 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2405492884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5ec99da0 con 0x562a5ed8a1f0 2024-09-12T16:54:06.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2405492884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef03880 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80ad040 tx=0x7fb5b80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc559fa74176b1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb4ade0b640 1 -- 172.21.15.151:0/2405492884 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b80af050 con 0x562a5ed8a1f0 2024-09-12T16:54:06.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb4ade0b640 1 -- 172.21.15.151:0/2405492884 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b80b0040 con 0x562a5ed8a1f0 2024-09-12T16:54:06.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb4ade0b640 1 -- 172.21.15.151:0/2405492884 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b80aaad0 con 0x562a5ed8a1f0 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2405492884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 msgr2=0x562a5ef03880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2405492884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef03880 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80ad040 tx=0x7fb5b80033b0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2405492884 shutdown_connections 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2405492884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef03880 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2405492884 >> 172.21.15.151:0/2405492884 conn(0x562a5ee10910 msgr2=0x562a5eeff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2405492884 shutdown_connections 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2405492884 wait complete. 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 Processor -- start 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 -- start start 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef0adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5c1fd69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562a5ecc0a50 con 0x562a5ed8a1f0 2024-09-12T16:54:06.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5bfadc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef0adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5bfadc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef0adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51916/0 (socket says 172.21.15.151:51916) 2024-09-12T16:54:06.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.627+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2976119681 learned_addr learned my addr 172.21.15.151:0/2976119681 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2976119681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5ef0b350 con 0x562a5ed8a1f0 2024-09-12T16:54:06.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef0adf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80aa500 tx=0x7fb5b8017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb4a7fff640 1 -- 172.21.15.151:0/2976119681 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b80b6c40 con 0x562a5ed8a1f0 2024-09-12T16:54:06.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb4a7fff640 1 -- 172.21.15.151:0/2976119681 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b80b6de0 con 0x562a5ed8a1f0 2024-09-12T16:54:06.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a5ef0b5e0 con 0x562a5ed8a1f0 2024-09-12T16:54:06.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb4a7fff640 1 -- 172.21.15.151:0/2976119681 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b80bf590 con 0x562a5ed8a1f0 2024-09-12T16:54:06.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5ef0bf90 con 0x562a5ed8a1f0 2024-09-12T16:54:06.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb4a7fff640 1 -- 172.21.15.151:0/2976119681 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb5b80bf800 con 0x562a5ed8a1f0 2024-09-12T16:54:06.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb4a7fff640 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb4a8039a70 0x7fb4a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb4a7fff640 1 -- 172.21.15.151:0/2976119681 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb5b80bb070 con 0x562a5ed8a1f0 2024-09-12T16:54:06.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5bf2db640 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb4a8039a70 0x7fb4a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ed8a5d0 0x562a5ef11f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef124a0 con 0x562a5ed8a5d0 2024-09-12T16:54:06.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c02dd640 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ed8a5d0 0x562a5ef11f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5bf2db640 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb4a8039a70 0x7fb4a803bf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8004180 tx=0x7fb5a8001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c02dd640 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ed8a5d0 0x562a5ef11f60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2976119681 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5b00083f0 con 0x562a5ed8a5d0 2024-09-12T16:54:06.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef0c2b0 con 0x562a5ed8a5d0 2024-09-12T16:54:06.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2976119681 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5b00083f0 con 0x562a5ed8a5d0 2024-09-12T16:54:06.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef14710 0x562a5ef16b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.631+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef171d0 con 0x562a5ef14710 2024-09-12T16:54:06.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef14710 0x562a5ef16b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef14710 0x562a5ef16b00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2976119681 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef14710 2024-09-12T16:54:06.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef135b0 con 0x562a5ed8a5d0 2024-09-12T16:54:06.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2976119681 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5b00083f0 con 0x562a5ed8a5d0 2024-09-12T16:54:06.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef13a50 con 0x562a5ed8a5d0 2024-09-12T16:54:06.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2976119681 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb5b00083f0 con 0x562a5ed8a5d0 2024-09-12T16:54:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c1fd69c0 1 Processor -- start 2024-09-12T16:54:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c1fd69c0 1 -- start start 2024-09-12T16:54:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c1fd69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef25860 0x562a5ef25c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c1fd69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562a5ed2b450 con 0x562a5ef25860 2024-09-12T16:54:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c02dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef25860 0x562a5ef25c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c02dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef25860 0x562a5ef25c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51932/0 (socket says 172.21.15.151:51932) 2024-09-12T16:54:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c02dd640 1 -- 172.21.15.151:0/4169927625 learned_addr learned my addr 172.21.15.151:0/4169927625 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.635+0000 7fb5c02dd640 1 -- 172.21.15.151:0/4169927625 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5ef262c0 con 0x562a5ef25860 2024-09-12T16:54:06.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c02dd640 1 --2- 172.21.15.151:0/4169927625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef25860 0x562a5ef25c80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x562a5ef0c180 tx=0x7fb5b000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb4a57fa640 1 -- 172.21.15.151:0/4169927625 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b0007d70 con 0x562a5ef25860 2024-09-12T16:54:06.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb4a57fa640 1 -- 172.21.15.151:0/4169927625 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b001e020 con 0x562a5ef25860 2024-09-12T16:54:06.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/4169927625 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a5ef26b20 con 0x562a5ef25860 2024-09-12T16:54:06.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb4a57fa640 1 -- 172.21.15.151:0/4169927625 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b0019590 con 0x562a5ef25860 2024-09-12T16:54:06.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/4169927625 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5ef27090 con 0x562a5ef25860 2024-09-12T16:54:06.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb4a57fa640 1 -- 172.21.15.151:0/4169927625 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb5b0016040 con 0x562a5ef25860 2024-09-12T16:54:06.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb4a57fa640 1 --2- 172.21.15.151:0/4169927625 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb498039a70 0x7fb49803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb4a57fa640 1 -- 172.21.15.151:0/4169927625 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb5b001f030 con 0x562a5ef25860 2024-09-12T16:54:06.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/4169927625 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb498039a70 0x7fb49803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c1fd69c0 1 Processor -- start 2024-09-12T16:54:06.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c1fd69c0 1 -- start start 2024-09-12T16:54:06.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/4169927625 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb498039a70 0x7fb49803bf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x562a5ef128b0 tx=0x7fb5b80bee60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c1fd69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef335d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c1fd69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562a5ef04010 con 0x562a5ef331d0 2024-09-12T16:54:06.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c02dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef335d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c02dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef335d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51944/0 (socket says 172.21.15.151:51944) 2024-09-12T16:54:06.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2853699630 learned_addr learned my addr 172.21.15.151:0/2853699630 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2853699630 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5ef33bc0 con 0x562a5ef331d0 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb5c02dd640 1 --2- 172.21.15.151:0/2853699630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef335d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00508d0 tx=0x7fb5b00174f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff00e74b2cb863d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb49effd640 1 -- 172.21.15.151:0/2853699630 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b001d040 con 0x562a5ef331d0 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb49effd640 1 -- 172.21.15.151:0/2853699630 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b004f340 con 0x562a5ef331d0 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.639+0000 7fb49effd640 1 -- 172.21.15.151:0/2853699630 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b0022b10 con 0x562a5ef331d0 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2853699630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 msgr2=0x562a5ef335d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2853699630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef335d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00508d0 tx=0x7fb5b00174f0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2853699630 shutdown_connections 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2853699630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef335d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2853699630 >> 172.21.15.151:0/2853699630 conn(0x562a5ef2e5f0 msgr2=0x562a5ef2c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2853699630 shutdown_connections 2024-09-12T16:54:06.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2853699630 wait complete. 2024-09-12T16:54:06.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 Processor -- start 2024-09-12T16:54:06.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- start start 2024-09-12T16:54:06.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef39680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562a5ef32120 con 0x562a5ef331d0 2024-09-12T16:54:06.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c02dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef39680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c02dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef39680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51960/0 (socket says 172.21.15.151:51960) 2024-09-12T16:54:06.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 learned_addr learned my addr 172.21.15.151:0/2758038924 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5ef39be0 con 0x562a5ef331d0 2024-09-12T16:54:06.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c02dd640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef39680 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb5b004b010 tx=0x7fb5b0050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb49d7fa640 1 -- 172.21.15.151:0/2758038924 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b001d030 con 0x562a5ef331d0 2024-09-12T16:54:06.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a5ef39e70 con 0x562a5ef331d0 2024-09-12T16:54:06.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb49d7fa640 1 -- 172.21.15.151:0/2758038924 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b0031030 con 0x562a5ef331d0 2024-09-12T16:54:06.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb49d7fa640 1 -- 172.21.15.151:0/2758038924 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b0048040 con 0x562a5ef331d0 2024-09-12T16:54:06.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5ef3a820 con 0x562a5ef331d0 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb49d7fa640 1 -- 172.21.15.151:0/2758038924 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb5b003ea80 con 0x562a5ef331d0 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb49d7fa640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb488039a70 0x7fb48803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb49d7fa640 1 -- 172.21.15.151:0/2758038924 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb5b0037d40 con 0x562a5ef331d0 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb488039a70 0x7fb48803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ef44980 0x562a5ef46e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.643+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef47560 con 0x562a5ef44980 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5bf2db640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ef44980 0x562a5ef46e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb488039a70 0x7fb48803bf30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80bd4f0 tx=0x7fb5b80da000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5bf2db640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ef44980 0x562a5ef46e10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5a800e640 con 0x562a5ef44980 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 realm 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef43d70 con 0x562a5ef44980 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5a800e640 con 0x562a5ef44980 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef48060 con 0x562a5ef44980 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5a800e640 con 0x562a5ef44980 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef48930 con 0x562a5ef44980 2024-09-12T16:54:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5a800e640 con 0x562a5ef44980 2024-09-12T16:54:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef49350 0x562a5ef4b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef4be10 con 0x562a5ef49350 2024-09-12T16:54:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c02dd640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef49350 0x562a5ef4b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c02dd640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef49350 0x562a5ef4b740 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 20 searching for the correct realm 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x562a5ef4dd60 0x562a5ef50190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.647+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x562a5ef4dd60 0x562a5ef50190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x562a5ef4dd60 0x562a5ef50190 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bfadc640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb5b80b6070 0x7fb5b80eb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x7fb5b80b6070 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bf2db640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb5b80b6070 0x7fb5b80eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bf2db640 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb5b80b6070 0x7fb5b80eb050 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a800e640 con 0x7fb5b80b6070 2024-09-12T16:54:06.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef44980 2024-09-12T16:54:06.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a800e640 con 0x562a5ef44980 2024-09-12T16:54:06.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef44980 2024-09-12T16:54:06.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.651+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x7fb5b80b6070 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x7fb5b80b6070 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef44980 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef44980 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x7fb5b80b6070 2024-09-12T16:54:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb5a8029040 con 0x7fb5b80b6070 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.655+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef44980 2024-09-12T16:54:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef44980 2024-09-12T16:54:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x7fb5b80b6070 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x7fb5b80b6070 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef44980 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x7fb5b80b6070 2024-09-12T16:54:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x7fb5b80b6070 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.659+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef4dd60 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef49350 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x562a5ef44980 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef50860 con 0x7fb5b80b6070 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5a8029040 con 0x7fb5b80b6070 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef4c7d0 con 0x562a5ef44980 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef4c410 con 0x562a5ef44980 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5a8029040 con 0x562a5ef44980 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef4d0f0 con 0x562a5ef44980 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 zone default found 2024-09-12T16:54:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 4 Realm: () 2024-09-12T16:54:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 zonegroup default 2024-09-12T16:54:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef4d0f0 con 0x562a5ef49350 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef52b80 con 0x562a5ef4dd60 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef52f20 con 0x562a5ef4dd60 2024-09-12T16:54:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 started sync module instance, tier type = 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.663+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef52010 con 0x7fb5b80b6070 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.667+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.667+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94739981739280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef52010 con 0x7fb5b80b6070 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.667+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef539b0 con 0x562a5ef44980 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.667+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94739981739280] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.667+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.667+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94739981743264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef52010 con 0x562a5ef44980 2024-09-12T16:54:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.667+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef543c0 con 0x562a5ef4dd60 2024-09-12T16:54:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94739981743264] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94739981736800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef51f80 con 0x562a5ef4dd60 2024-09-12T16:54:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef55110 con 0x7fb5b80b6070 2024-09-12T16:54:06.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94739981749616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef557e0 con 0x7fb5b80b6070 2024-09-12T16:54:06.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef56300 con 0x562a5ef44980 2024-09-12T16:54:06.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94739981749616] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.671+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94739981736800] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.675+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.675+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94739981748144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef562c0 con 0x562a5ef44980 2024-09-12T16:54:06.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.675+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef56ba0 con 0x562a5ef49350 2024-09-12T16:54:06.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.675+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94739981748144] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.675+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.675+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94739981756144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef562c0 con 0x562a5ef49350 2024-09-12T16:54:06.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.675+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef562c0 con 0x562a5ef49350 2024-09-12T16:54:06.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94739981756144] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94739981753808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef57470 con 0x562a5ef49350 2024-09-12T16:54:06.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef57e70 con 0x562a5ef49350 2024-09-12T16:54:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94739981753808] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94739981758272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef57e30 con 0x562a5ef49350 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 20 add_watcher() i=0 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 20 add_watcher() i=1 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 20 add_watcher() i=2 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 20 add_watcher() i=3 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 20 add_watcher() i=4 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 20 add_watcher() i=5 2024-09-12T16:54:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.679+0000 7fb5c1fd69c0 20 add_watcher() i=6 2024-09-12T16:54:06.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94739981758272] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5c1fd69c0 20 add_watcher() i=7 2024-09-12T16:54:06.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5c1fd69c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:06.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef5b290 con 0x562a5ef44980 2024-09-12T16:54:06.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94739981761360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef58820 con 0x562a5ef44980 2024-09-12T16:54:06.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94739981761360] v34'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb475fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:06.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5c1fd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:06.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5c1fd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:06.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.683+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef63c20 con 0x562a5ef44980 2024-09-12T16:54:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.687+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.687+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef63c20 con 0x562a5ef49350 2024-09-12T16:54:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.687+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.687+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef63c20 con 0x562a5ef4dd60 2024-09-12T16:54:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.691+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.691+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef63290 con 0x562a5ef44980 2024-09-12T16:54:06.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.691+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'235 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.691+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef63290 con 0x7fb5b80b6070 2024-09-12T16:54:06.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.691+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.691+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef653c0 con 0x562a5ef4dd60 2024-09-12T16:54:06.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.691+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.691+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65760 con 0x562a5ef44980 2024-09-12T16:54:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.695+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.695+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65760 con 0x562a5ef49350 2024-09-12T16:54:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.695+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.695+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65760 con 0x7fb5b80b6070 2024-09-12T16:54:06.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.699+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.699+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65760 con 0x562a5ef4dd60 2024-09-12T16:54:06.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.699+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.699+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef659b0 con 0x7fb5b80b6070 2024-09-12T16:54:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.699+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'75 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.699+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65980 con 0x562a5ef49350 2024-09-12T16:54:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.703+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.703+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65980 con 0x7fb5b80b6070 2024-09-12T16:54:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.703+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.703+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65f50 con 0x562a5ef49350 2024-09-12T16:54:06.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.707+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.707+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65f10 con 0x562a5ef44980 2024-09-12T16:54:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.707+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'236 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.707+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65d20 con 0x562a5ef4dd60 2024-09-12T16:54:06.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.711+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.711+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65cf0 con 0x7fb5b80b6070 2024-09-12T16:54:06.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.711+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.711+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65cf0 con 0x562a5ef4dd60 2024-09-12T16:54:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.711+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.711+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65c60 con 0x562a5ef44980 2024-09-12T16:54:06.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.715+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.715+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65c60 con 0x562a5ef44980 2024-09-12T16:54:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.715+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'237 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.715+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65c60 con 0x562a5ef4dd60 2024-09-12T16:54:06.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.715+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.715+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65c60 con 0x7fb5b80b6070 2024-09-12T16:54:06.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.719+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.719+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65c60 con 0x562a5ef4dd60 2024-09-12T16:54:06.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.719+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.719+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65c80 con 0x562a5ef4dd60 2024-09-12T16:54:06.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.719+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.719+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65cd0 con 0x562a5ef4dd60 2024-09-12T16:54:06.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.723+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.723+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65cd0 con 0x562a5ef4dd60 2024-09-12T16:54:06.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.723+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.723+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65d10 con 0x562a5ef49350 2024-09-12T16:54:06.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.723+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.723+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65d50 con 0x562a5ef4dd60 2024-09-12T16:54:06.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.727+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.727+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65d50 con 0x562a5ef49350 2024-09-12T16:54:06.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.727+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.727+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65d80 con 0x562a5ef4dd60 2024-09-12T16:54:06.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.731+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.731+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65d80 con 0x562a5ef49350 2024-09-12T16:54:06.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.731+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.731+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef65db0 con 0x7fb5b80b6070 2024-09-12T16:54:06.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb474fe1640 20 reqs_thread_entry: start 2024-09-12T16:54:06.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:06.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 20 Filter name: none 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb3ee7fc640 20 reqs_thread_entry: start 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef62380 con 0x562a5ef44980 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:06.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef834b0 con 0x7fb5b80b6070 2024-09-12T16:54:06.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 : miss 2024-09-12T16:54:06.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.735+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:96 8.14 8:2e38d51f:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef833a0 con 0x562a5ef4dd60 2024-09-12T16:54:06.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(96 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T16:54:06.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 info.flags=0x17 2024-09-12T16:54:06.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 to cache LRU end 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:97 4.15 4:a81c4fa5:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f000930 con 0x562a5ef4dd60 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(97 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:98 4.27 4:e4e3c82b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f000930 con 0x562a5ef44980 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(98 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:99 4.3a 4:5e2c6fdb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f000930 con 0x562a5ef4dd60 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(99 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:100 4.19 4:9ae34c80:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f000930 con 0x562a5ef4dd60 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(100 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:101 4.14 4:294d2792:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f000930 con 0x562a5ef4dd60 2024-09-12T16:54:06.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(101 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4 [call out=429b] v0'0 uv7 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-12T16:54:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:102 4.31 4:8cf19252:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f0009d0 con 0x562a5ef44980 2024-09-12T16:54:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(102 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:103 4.3d 4:bdc4baeb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f0010d0 con 0x562a5ef4dd60 2024-09-12T16:54:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== osd_op_reply(103 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:104 4.1 4:8083a272:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f0010d0 con 0x7fb5b80b6070 2024-09-12T16:54:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(104 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.7 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:105 4.1d 4:ba675ddb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f0010d0 con 0x562a5ef4dd60 2024-09-12T16:54:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(105 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.739+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:106 4.24 4:27846cd2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f0010b0 con 0x562a5ef49350 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(106 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:107 4.26 4:661afea9:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5f0010b0 con 0x562a5ef49350 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(107 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.10 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 20 get_obj_state: octx=0x7fb5a800e5c0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x562a5effe998 s->prefetch_data=0 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:108 3.23s0 3:c48f1be7:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5efff370 con 0x562a5ef49350 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(108 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 10 manifest: total_size = 6 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 20 get_obj_state: setting s->obj_tag to 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.2033534352149224814 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 20 get_obj_state: octx=0x7fb5a800e5c0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x562a5effe998 s->prefetch_data=0 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 20 prepare_atomic_modification: state is not atomic. state=0x562a5effe998 2024-09-12T16:54:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 20 bucket index object: :.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4 2024-09-12T16:54:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.743+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:109 4.14 4:294d2792:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5efffe10 con 0x562a5ef4dd60 2024-09-12T16:54:06.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(109 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:110 3.23s0 3:c48f1be7:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5efff820 con 0x562a5ef49350 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(110 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:111 4.14 4:294d2792:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef88150 con 0x562a5ef4dd60 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:112 4.15 4:a81c4fa5:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef88150 con 0x562a5ef4dd60 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:113 4.27 4:e4e3c82b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c440 con 0x562a5ef44980 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:114 4.3a 4:5e2c6fdb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef88150 con 0x562a5ef4dd60 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:115 4.19 4:9ae34c80:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c440 con 0x562a5ef4dd60 2024-09-12T16:54:06.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:116 4.14 4:294d2792:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef93bd0 con 0x562a5ef4dd60 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== osd_op_reply(112 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:117 4.31 4:8cf19252:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef969a0 con 0x562a5ef44980 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.747+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(113 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:118 4.3d 4:bdc4baeb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef93bd0 con 0x562a5ef4dd60 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:119 4.1 4:8083a272:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef96dc0 con 0x7fb5b80b6070 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:120 4.1d 4:ba675ddb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef996d0 con 0x562a5ef4dd60 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:121 4.24 4:27846cd2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9c550 con 0x562a5ef49350 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:122 4.26 4:661afea9:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9f340 con 0x562a5ef49350 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 35 ==== osd_op_reply(115 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 36 ==== osd_op_reply(114 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(117 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(119 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.7 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 37 ==== osd_op_reply(118 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 38 ==== osd_op_reply(120 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(121 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(122 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.10 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 39 ==== osd_op_reply(111 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb49e7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 40 ==== osd_op_reply(116 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7])"; uploads.size()=0; is_truncated=0 2024-09-12T16:54:06.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:123 4.15 4:a81c4fa5:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef93bd0 con 0x562a5ef4dd60 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:124 4.27 4:e4e3c82b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9f2c0 con 0x562a5ef44980 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:125 4.3a 4:5e2c6fdb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9c550 con 0x562a5ef4dd60 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:126 4.19 4:9ae34c80:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef93bd0 con 0x562a5ef4dd60 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:127 4.14 4:294d2792:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9f2c0 con 0x562a5ef4dd60 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:128 4.31 4:8cf19252:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9c550 con 0x562a5ef44980 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:129 4.3d 4:bdc4baeb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9f2c0 con 0x562a5ef4dd60 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:130 4.1 4:8083a272:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef93bd0 con 0x7fb5b80b6070 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:131 4.1d 4:ba675ddb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9c550 con 0x562a5ef4dd60 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:132 4.24 4:27846cd2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9c0c0 con 0x562a5ef49350 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:133 4.26 4:661afea9:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5efa0730 con 0x562a5ef49350 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(124 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 41 ==== osd_op_reply(123 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(128 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 42 ==== osd_op_reply(125 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 43 ==== osd_op_reply(126 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 44 ==== osd_op_reply(127 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(130 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.7 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 45 ==== osd_op_reply(129 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 46 ==== osd_op_reply(131 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(132 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(133 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.10 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.751+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(134 foo.buckets [call] v34'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5efa06b0 con 0x7fb5b80b6070 2024-09-12T16:54:06.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 24 ==== osd_op_reply(136 myfoo [call,call,delete] v34'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T16:54:06.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T16:54:06.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.755+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94739981958144 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef93550 con 0x562a5ef49350 2024-09-12T16:54:06.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== watch-notify(notify (1) cookie 94739981753808 notify 146028888092 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562a5ef62de0 con 0x562a5ef49350 2024-09-12T16:54:06.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb49effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94739981753808 notifier 4781 bl.length()=149 2024-09-12T16:54:06.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== osd_op_reply(137 notify.6 [notify cookie 94739981958144 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb49effd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb484003d70 con 0x562a5ef49350 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== watch-notify(notify_complete (2) cookie 94739981958144 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a5ef39be0 con 0x562a5ef49350 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:139 8.14 8:2e38d51f:root::.bucket.meta.myfoo%3a1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef4dd60 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 47 ==== osd_op_reply(139 .bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 from cache 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7, ofs0, ns] 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94739981939472 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef44980 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== watch-notify(notify (1) cookie 94739981743264 notify 146028888107 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562a5ef651f0 con 0x562a5ef44980 2024-09-12T16:54:06.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb49effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94739981743264 notifier 4781 bl.length()=206 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(140 notify.1 [notify cookie 94739981939472 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb49effd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb484003d70 con 0x562a5ef44980 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== watch-notify(notify_complete (2) cookie 94739981939472 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a5ef63820 con 0x562a5ef44980 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:142 4.15 4:a81c4fa5:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef4dd60 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:143 4.27 4:e4e3c82b:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef93510 con 0x562a5ef44980 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:144 4.3a 4:5e2c6fdb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9eb50 con 0x562a5ef4dd60 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:145 4.19 4:9ae34c80:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef912a0 con 0x562a5ef4dd60 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:146 4.14 4:294d2792:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef4dd60 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:147 4.31 4:8cf19252:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9eb50 con 0x562a5ef44980 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:148 4.3d 4:bdc4baeb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef912a0 con 0x562a5ef4dd60 2024-09-12T16:54:06.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:149 4.1 4:8083a272:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:150 4.1d 4:ba675ddb:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef9eb50 con 0x562a5ef4dd60 2024-09-12T16:54:06.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:151 4.24 4:27846cd2:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef912a0 con 0x562a5ef49350 2024-09-12T16:54:06.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.759+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:152 4.26 4:661afea9:::.dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef49350 2024-09-12T16:54:06.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 48 ==== osd_op_reply(145 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 49 ==== osd_op_reply(146 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.4 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 50 ==== osd_op_reply(144 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.2 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 51 ==== osd_op_reply(142 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.0 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 39 ==== osd_op_reply(147 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.5 [delete] v34'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 40 ==== osd_op_reply(143 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.1 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 25 ==== osd_op_reply(149 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.7 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== osd_op_reply(151 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.9 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 52 ==== osd_op_reply(148 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 53 ==== osd_op_reply(150 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.8 [delete] v34'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(152 .dir.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7.10 [delete] v34'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5c1fd69c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 : miss 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5c1fd69c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.763+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:153 6.1d 6:b94a0f53:::pubsub..bucket.myfoo%2f1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef49350 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.767+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(153 pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.767+0000 7fb5c1fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.767+0000 7fb5c1fd69c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 info.flags=0x0 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.767+0000 7fb5c1fd69c0 10 adding default.rgw.log++pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 to cache LRU end 2024-09-12T16:54:06.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.767+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:154 6.1d 6:b94a0f53:::pubsub..bucket.myfoo%2f1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef49350 2024-09-12T16:54:06.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.767+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(154 pubsub..bucket.myfoo/1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.7 [delete] v34'52 uv36 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.767+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 26 ==== osd_op_reply(155 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5c1fd69c0 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-12T16:54:06.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef49350 2024-09-12T16:54:06.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5c1fd69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-12T16:54:06.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94739981939472 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 27 ==== watch-notify(notify (1) cookie 94739981749616 notify 146028888085 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562a5ef63820 con 0x7fb5b80b6070 2024-09-12T16:54:06.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb49effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94739981749616 notifier 4781 bl.length()=170 2024-09-12T16:54:06.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 28 ==== osd_op_reply(157 notify.3 [notify cookie 94739981939472 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb49effd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb484003d70 con 0x7fb5b80b6070 2024-09-12T16:54:06.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 29 ==== watch-notify(notify_complete (2) cookie 94739981939472 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a5ef63630 con 0x7fb5b80b6070 2024-09-12T16:54:06.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5c1fd69c0 10 removing email index: foo@foo.com 2024-09-12T16:54:06.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 30 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.771+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef44980 2024-09-12T16:54:06.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 41 ==== osd_op_reply(159 foo@foo.com [delete] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5c1fd69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-12T16:54:06.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94739981939472 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 31 ==== watch-notify(notify (1) cookie 94739981749616 notify 146028888086 ret 0) ==== 204+0+0 (crc 0 0 0) 0x562a5ef63630 con 0x7fb5b80b6070 2024-09-12T16:54:06.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb49effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94739981749616 notifier 4781 bl.length()=162 2024-09-12T16:54:06.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb49effd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb484003d70 con 0x7fb5b80b6070 2024-09-12T16:54:06.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 32 ==== osd_op_reply(160 notify.3 [notify cookie 94739981939472 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 33 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 34 ==== watch-notify(notify_complete (2) cookie 94739981939472 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a5ef62c10 con 0x7fb5b80b6070 2024-09-12T16:54:06.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5c1fd69c0 10 removing user buckets index 2024-09-12T16:54:06.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.775+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 35 ==== osd_op_reply(162 foo.buckets [delete] v34'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x7fb5b80b6070 2024-09-12T16:54:06.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c1fd69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-12T16:54:06.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94739981939472 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef49350 2024-09-12T16:54:06.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== watch-notify(notify (1) cookie 94739981756144 notify 146028888093 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562a5ef39be0 con 0x562a5ef49350 2024-09-12T16:54:06.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 43 ==== osd_op_reply(163 notify.5 [notify cookie 94739981939472 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb49e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94739981756144 notifier 4781 bl.length()=160 2024-09-12T16:54:06.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb49e7fc640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb3f40032d0 con 0x562a5ef49350 2024-09-12T16:54:06.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 44 ==== watch-notify(notify_complete (2) cookie 94739981939472 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a5ef33bc0 con 0x562a5ef49350 2024-09-12T16:54:06.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c1fd69c0 10 removing user index: foo 2024-09-12T16:54:06.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef44980 2024-09-12T16:54:06.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 42 ==== osd_op_reply(165 foo [call,call,delete] v34'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c1fd69c0 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-12T16:54:06.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c1fd69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T16:54:06.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94739981939472 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef44980 2024-09-12T16:54:06.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 43 ==== watch-notify(notify (1) cookie 94739981748144 notify 146028888108 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562a5ef62c10 con 0x562a5ef44980 2024-09-12T16:54:06.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb49effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94739981748144 notifier 4781 bl.length()=152 2024-09-12T16:54:06.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb49effd640 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb484003d70 con 0x562a5ef44980 2024-09-12T16:54:06.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.779+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 44 ==== osd_op_reply(166 notify.4 [notify cookie 94739981939472 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 45 ==== watch-notify(notify_complete (2) cookie 94739981939472 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a5ef63fc0 con 0x562a5ef44980 2024-09-12T16:54:06.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 46 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a80391c0 con 0x562a5ef44980 2024-09-12T16:54:06.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb475fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:06.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94739981761360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef44980 2024-09-12T16:54:06.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 47 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94739981761360] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5a802fd70 con 0x562a5ef44980 2024-09-12T16:54:06.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94739981739280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 36 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94739981739280] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a802fd70 con 0x7fb5b80b6070 2024-09-12T16:54:06.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5c1fd69c0 20 remove_watcher() i=0 2024-09-12T16:54:06.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5c1fd69c0 2 removed watcher, disabling cache 2024-09-12T16:54:06.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.783+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94739981743264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef44980 2024-09-12T16:54:06.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.787+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 48 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94739981743264] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a802fd70 con 0x562a5ef44980 2024-09-12T16:54:06.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.787+0000 7fb5c1fd69c0 20 remove_watcher() i=1 2024-09-12T16:54:06.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.787+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94739981736800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef4dd60 2024-09-12T16:54:06.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.787+0000 7fb5bfadc640 1 -- 172.21.15.151:0/2758038924 <== osd.3 v2:172.21.15.151:6808/987175333 54 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94739981736800] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b80cf070 con 0x562a5ef4dd60 2024-09-12T16:54:06.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.787+0000 7fb5c1fd69c0 20 remove_watcher() i=2 2024-09-12T16:54:06.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.787+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94739981749616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x7fb5b80b6070 2024-09-12T16:54:06.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.791+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.2 v2:172.21.15.151:6800/1197700885 37 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94739981749616] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a802fd70 con 0x7fb5b80b6070 2024-09-12T16:54:06.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.791+0000 7fb5c1fd69c0 20 remove_watcher() i=3 2024-09-12T16:54:06.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.791+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94739981748144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef44980 2024-09-12T16:54:06.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.791+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 <== osd.1 v2:172.21.15.151:6816/883447514 49 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94739981748144] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5a802fd70 con 0x562a5ef44980 2024-09-12T16:54:06.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.791+0000 7fb5c1fd69c0 20 remove_watcher() i=4 2024-09-12T16:54:06.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.791+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94739981756144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef49350 2024-09-12T16:54:06.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.795+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 46 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94739981756144] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.795+0000 7fb5c1fd69c0 20 remove_watcher() i=5 2024-09-12T16:54:06.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.795+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94739981753808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef49350 2024-09-12T16:54:06.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.795+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 47 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94739981753808] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.795+0000 7fb5c1fd69c0 20 remove_watcher() i=6 2024-09-12T16:54:06.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.795+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94739981758272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a5ef8c0a0 con 0x562a5ef49350 2024-09-12T16:54:06.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c02dd640 1 -- 172.21.15.151:0/2758038924 <== osd.0 v2:172.21.15.122:6800/3868153603 48 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94739981758272] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5b002a070 con 0x562a5ef49350 2024-09-12T16:54:06.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 20 remove_watcher() i=7 2024-09-12T16:54:06.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef49350 msgr2=0x562a5ef4b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef49350 0x562a5ef4b740 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ef44980 msgr2=0x562a5ef46e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ef44980 0x562a5ef46e10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb5b80b6070 msgr2=0x7fb5b80eb050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fb5b80b6070 0x7fb5b80eb050 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x562a5ef4dd60 msgr2=0x562a5ef50190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x562a5ef4dd60 0x562a5ef50190 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb488039a70 msgr2=0x7fb48803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb488039a70 0x7fb48803bf30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80bd4f0 tx=0x7fb5b80da000 comp rx=0 tx=0).stop 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 msgr2=0x562a5ef39680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5bf2db640 1 -- 172.21.15.151:0/2758038924 reap_dead start 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef39680 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb5b004b010 tx=0x7fb5b0050860 comp rx=0 tx=0).stop 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 shutdown_connections 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2758038924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef331d0 0x562a5ef39680 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 >> 172.21.15.151:0/2758038924 conn(0x562a5ef2e5f0 msgr2=0x562a5ef2c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 shutdown_connections 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2758038924 wait complete. 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/4169927625 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb498039a70 msgr2=0x7fb49803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/4169927625 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb498039a70 0x7fb49803bf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x562a5ef128b0 tx=0x7fb5b80bee60 comp rx=0 tx=0).stop 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/4169927625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef25860 msgr2=0x562a5ef25c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/4169927625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef25860 0x562a5ef25c80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x562a5ef0c180 tx=0x7fb5b000af40 comp rx=0 tx=0).stop 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/4169927625 shutdown_connections 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/4169927625 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb498039a70 0x7fb49803bf30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/4169927625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ef25860 0x562a5ef25c80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/4169927625 >> 172.21.15.151:0/4169927625 conn(0x562a5ef1b210 msgr2=0x562a5ef1b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/4169927625 shutdown_connections 2024-09-12T16:54:06.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/4169927625 wait complete. 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef14710 msgr2=0x562a5ef16b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef14710 0x562a5ef16b00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ed8a5d0 msgr2=0x562a5ef11f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ed8a5d0 0x562a5ef11f60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb4a8039a70 msgr2=0x7fb4a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb4a8039a70 0x7fb4a803bf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8004180 tx=0x7fb5a8001340 comp rx=0 tx=0).stop 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 msgr2=0x562a5ef0adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef0adf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80aa500 tx=0x7fb5b8017d70 comp rx=0 tx=0).stop 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 shutdown_connections 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562a5ef14710 0x562a5ef16b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562a5ed8a5d0 0x562a5ef11f60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fb4a8039a70 0x7fb4a803bf30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 --2- 172.21.15.151:0/2976119681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562a5ed8a1f0 0x562a5ef0adf0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 >> 172.21.15.151:0/2976119681 conn(0x562a5ee10910 msgr2=0x562a5eefdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 shutdown_connections 2024-09-12T16:54:06.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.799+0000 7fb5c1fd69c0 1 -- 172.21.15.151:0/2976119681 wait complete. 2024-09-12T16:54:06.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T16:54:06.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T16:54:06.815 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T16:54:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.887+0000 7f882cdb29c0 1 Processor -- start 2024-09-12T16:54:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.887+0000 7f882cdb29c0 1 -- start start 2024-09-12T16:54:06.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.887+0000 7f882cdb29c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55997ffc25e0 0x559980056760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.887+0000 7f882cdb29c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55997ff029c0 con 0x55997ffc2200 2024-09-12T16:54:06.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.887+0000 7f882cdb29c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55997ff526d0 con 0x55997ffc25e0 2024-09-12T16:54:06.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.887+0000 7f882a0b7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55997ffc25e0 0x559980056760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.887+0000 7f882a8b8640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55997ffc2200 0x559980053030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49162/0 (socket says 172.21.15.151:49162) 2024-09-12T16:54:06.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.887+0000 7f882a8b8640 1 -- 172.21.15.151:0/1000614647 learned_addr learned my addr 172.21.15.151:0/1000614647 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:06.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882a0b7640 1 -- 172.21.15.151:0/1000614647 >> v1:172.21.15.122:6789/0 conn(0x55997ffc2200 legacy=0x559980053030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882a0b7640 1 -- 172.21.15.151:0/1000614647 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55997fef6ca0 con 0x55997ffc25e0 2024-09-12T16:54:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882a0b7640 1 --2- 172.21.15.151:0/1000614647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc25e0 0x559980056760 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f881400a480 tx=0x7f881401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63a584e681069e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f88298b6640 1 -- 172.21.15.151:0/1000614647 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88140b0070 con 0x55997ffc25e0 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f88298b6640 1 -- 172.21.15.151:0/1000614647 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88140ab540 con 0x55997ffc25e0 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f88298b6640 1 -- 172.21.15.151:0/1000614647 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88140ab840 con 0x55997ffc25e0 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1000614647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc25e0 msgr2=0x559980056760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1000614647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc25e0 0x559980056760 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f881400a480 tx=0x7f881401b280 comp rx=0 tx=0).stop 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1000614647 shutdown_connections 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1000614647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc25e0 0x559980056760 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1000614647 >> 172.21.15.151:0/1000614647 conn(0x559980048920 msgr2=0x55998004ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1000614647 shutdown_connections 2024-09-12T16:54:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.891+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1000614647 wait complete. 2024-09-12T16:54:06.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 Processor -- start 2024-09-12T16:54:06.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 -- start start 2024-09-12T16:54:06.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x55998013b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55997ff56680 con 0x55997ffc2200 2024-09-12T16:54:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882a8b8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x55998013b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882a8b8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x55998013b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51974/0 (socket says 172.21.15.151:51974) 2024-09-12T16:54:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882a8b8640 1 -- 172.21.15.151:0/3431767325 learned_addr learned my addr 172.21.15.151:0/3431767325 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882a8b8640 1 -- 172.21.15.151:0/3431767325 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55997fed1da0 con 0x55997ffc2200 2024-09-12T16:54:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882a8b8640 1 --2- 172.21.15.151:0/3431767325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x55998013b900 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8824001e00 tx=0x7f882400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a83718c2d521d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f8718e09640 1 -- 172.21.15.151:0/3431767325 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824012020 con 0x55997ffc2200 2024-09-12T16:54:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f8718e09640 1 -- 172.21.15.151:0/3431767325 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882400e690 con 0x55997ffc2200 2024-09-12T16:54:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f8718e09640 1 -- 172.21.15.151:0/3431767325 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f882400ea10 con 0x55997ffc2200 2024-09-12T16:54:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 -- 172.21.15.151:0/3431767325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 msgr2=0x55998013b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/3431767325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x55998013b900 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8824001e00 tx=0x7f882400b6d0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 -- 172.21.15.151:0/3431767325 shutdown_connections 2024-09-12T16:54:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/3431767325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x55998013b900 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 -- 172.21.15.151:0/3431767325 >> 172.21.15.151:0/3431767325 conn(0x559980048920 msgr2=0x559980137540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 -- 172.21.15.151:0/3431767325 shutdown_connections 2024-09-12T16:54:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.907+0000 7f882cdb29c0 1 -- 172.21.15.151:0/3431767325 wait complete. 2024-09-12T16:54:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882cdb29c0 1 Processor -- start 2024-09-12T16:54:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882cdb29c0 1 -- start start 2024-09-12T16:54:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882cdb29c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x559980142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882cdb29c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55997fef8a50 con 0x55997ffc2200 2024-09-12T16:54:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882a8b8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x559980142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882a8b8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x559980142f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:51986/0 (socket says 172.21.15.151:51986) 2024-09-12T16:54:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882a8b8640 1 -- 172.21.15.151:0/2133210966 learned_addr learned my addr 172.21.15.151:0/2133210966 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882a8b8640 1 -- 172.21.15.151:0/2133210966 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599801434e0 con 0x55997ffc2200 2024-09-12T16:54:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882a8b8640 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x559980142f80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55998013c890 tx=0x7f8824000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f8717606640 1 -- 172.21.15.151:0/2133210966 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8824012030 con 0x55997ffc2200 2024-09-12T16:54:06.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559980143770 con 0x55997ffc2200 2024-09-12T16:54:06.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f8717606640 1 -- 172.21.15.151:0/2133210966 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882401a750 con 0x55997ffc2200 2024-09-12T16:54:06.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f8717606640 1 -- 172.21.15.151:0/2133210966 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f882401aa50 con 0x55997ffc2200 2024-09-12T16:54:06.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559980144120 con 0x55997ffc2200 2024-09-12T16:54:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f8717606640 1 -- 172.21.15.151:0/2133210966 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8824015020 con 0x55997ffc2200 2024-09-12T16:54:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f8717606640 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8710039a70 0x7f871003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f8717606640 1 -- 172.21.15.151:0/2133210966 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8824020030 con 0x55997ffc2200 2024-09-12T16:54:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882a0b7640 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8710039a70 0x7f871003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55997ffc25e0 0x55998014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998014a630 con 0x55997ffc25e0 2024-09-12T16:54:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882b0b9640 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55997ffc25e0 0x55998014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.911+0000 7f882a0b7640 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8710039a70 0x7f871003bf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f88140ad000 tx=0x7f88140a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882b0b9640 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55997ffc25e0 0x55998014a0f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882b0b9640 1 -- 172.21.15.151:0/2133210966 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f881c00a4d0 con 0x55997ffc25e0 2024-09-12T16:54:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998014aa80 con 0x55997ffc25e0 2024-09-12T16:54:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882b0b9640 1 -- 172.21.15.151:0/2133210966 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f881c00a4d0 con 0x55997ffc25e0 2024-09-12T16:54:06.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55998014c890 0x55998014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998014f350 con 0x55998014c890 2024-09-12T16:54:06.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882a8b8640 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55998014c890 0x55998014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882a8b8640 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55998014c890 0x55998014ec80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882a8b8640 1 -- 172.21.15.151:0/2133210966 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8824008030 con 0x55998014c890 2024-09-12T16:54:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998014b700 con 0x55997ffc25e0 2024-09-12T16:54:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882b0b9640 1 -- 172.21.15.151:0/2133210966 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f881c00a4d0 con 0x55997ffc25e0 2024-09-12T16:54:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998014bba0 con 0x55997ffc25e0 2024-09-12T16:54:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882b0b9640 1 -- 172.21.15.151:0/2133210966 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f881c00a4d0 con 0x55997ffc25e0 2024-09-12T16:54:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 Processor -- start 2024-09-12T16:54:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 -- start start 2024-09-12T16:54:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998015d9a0 0x55998015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882cdb29c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55997ff63450 con 0x55998015d9a0 2024-09-12T16:54:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.915+0000 7f882b0b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998015d9a0 0x55998015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882b0b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998015d9a0 0x55998015ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52000/0 (socket says 172.21.15.151:52000) 2024-09-12T16:54:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882b0b9640 1 -- 172.21.15.151:0/4244633332 learned_addr learned my addr 172.21.15.151:0/4244633332 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882b0b9640 1 -- 172.21.15.151:0/4244633332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55998015e400 con 0x55998015d9a0 2024-09-12T16:54:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882b0b9640 1 --2- 172.21.15.151:0/4244633332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998015d9a0 0x55998015ddc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x559980143fb0 tx=0x7f881c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f8714e01640 1 -- 172.21.15.151:0/4244633332 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f881c014450 con 0x55998015d9a0 2024-09-12T16:54:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f8714e01640 1 -- 172.21.15.151:0/4244633332 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c0145f0 con 0x55998015d9a0 2024-09-12T16:54:06.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882cdb29c0 1 -- 172.21.15.151:0/4244633332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55998015ec60 con 0x55998015d9a0 2024-09-12T16:54:06.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f8714e01640 1 -- 172.21.15.151:0/4244633332 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f881c0148f0 con 0x55998015d9a0 2024-09-12T16:54:06.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882cdb29c0 1 -- 172.21.15.151:0/4244633332 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55998015f1d0 con 0x55998015d9a0 2024-09-12T16:54:06.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f8714e01640 1 -- 172.21.15.151:0/4244633332 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f881c011040 con 0x55998015d9a0 2024-09-12T16:54:06.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f8714e01640 1 --2- 172.21.15.151:0/4244633332 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8704039a70 0x7f870403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f8714e01640 1 -- 172.21.15.151:0/4244633332 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f881c01e070 con 0x55998015d9a0 2024-09-12T16:54:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882a8b8640 1 --2- 172.21.15.151:0/4244633332 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8704039a70 0x7f870403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882cdb29c0 1 Processor -- start 2024-09-12T16:54:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882cdb29c0 1 -- start start 2024-09-12T16:54:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882a8b8640 1 --2- 172.21.15.151:0/4244633332 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8704039a70 0x7f870403bf30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8824001560 tx=0x7f882402c950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882cdb29c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x55998016b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882cdb29c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55998013c150 con 0x55998016b2d0 2024-09-12T16:54:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882b0b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x55998016b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882b0b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x55998016b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52004/0 (socket says 172.21.15.151:52004) 2024-09-12T16:54:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.919+0000 7f882b0b9640 1 -- 172.21.15.151:0/2965234403 learned_addr learned my addr 172.21.15.151:0/2965234403 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882b0b9640 1 -- 172.21.15.151:0/2965234403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55998016bcc0 con 0x55998016b2d0 2024-09-12T16:54:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882b0b9640 1 --2- 172.21.15.151:0/2965234403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x55998016b6d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f881c050730 tx=0x7f881c0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e11eecf1e89abd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f870e7fc640 1 -- 172.21.15.151:0/2965234403 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f881c016770 con 0x55998016b2d0 2024-09-12T16:54:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f870e7fc640 1 -- 172.21.15.151:0/2965234403 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c022c70 con 0x55998016b2d0 2024-09-12T16:54:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f870e7fc640 1 -- 172.21.15.151:0/2965234403 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f881c016910 con 0x55998016b2d0 2024-09-12T16:54:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2965234403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 msgr2=0x55998016b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2965234403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x55998016b6d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f881c050730 tx=0x7f881c0118e0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2965234403 shutdown_connections 2024-09-12T16:54:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2965234403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x55998016b6d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2965234403 >> 172.21.15.151:0/2965234403 conn(0x5599801666f0 msgr2=0x559980164930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2965234403 shutdown_connections 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2965234403 wait complete. 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 Processor -- start 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- start start 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x559980171780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55998016a220 con 0x55998016b2d0 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882b0b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x559980171780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882b0b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x559980171780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52006/0 (socket says 172.21.15.151:52006) 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 learned_addr learned my addr 172.21.15.151:0/1753423119 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559980171ce0 con 0x55998016b2d0 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882b0b9640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x559980171780 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f881c052360 tx=0x7f881c050690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f870cff9640 1 -- 172.21.15.151:0/1753423119 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f881c03eac0 con 0x55998016b2d0 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559980171f70 con 0x55998016b2d0 2024-09-12T16:54:06.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f870cff9640 1 -- 172.21.15.151:0/1753423119 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c03ec60 con 0x55998016b2d0 2024-09-12T16:54:06.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f870cff9640 1 -- 172.21.15.151:0/1753423119 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f881c050840 con 0x55998016b2d0 2024-09-12T16:54:06.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.923+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559980172920 con 0x55998016b2d0 2024-09-12T16:54:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f870cff9640 1 -- 172.21.15.151:0/1753423119 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f881c03e3f0 con 0x55998016b2d0 2024-09-12T16:54:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f870cff9640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f86f4039a70 0x7f86f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f870cff9640 1 -- 172.21.15.151:0/1753423119 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f881c048050 con 0x55998016b2d0 2024-09-12T16:54:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882a8b8640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f86f4039a70 0x7f86f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55998017ca00 0x55998017ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998017f5e0 con 0x55998017ca00 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882a0b7640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55998017ca00 0x55998017ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882a8b8640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f86f4039a70 0x7f86f403bf30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55998014f730 tx=0x7f882402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882a0b7640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55998017ca00 0x55998017ee90 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 realm 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998017f9b0 con 0x55998017ca00 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559980180280 con 0x55998017ca00 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559980180620 con 0x55998017ca00 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559980181110 0x559980183500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559980183c40 con 0x559980181110 2024-09-12T16:54:06.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882b0b9640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559980181110 0x559980183500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.927+0000 7f882b0b9640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559980181110 0x559980183500 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882cdb29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882cdb29c0 20 searching for the correct realm 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559980185be0 0x5599801880a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a8b8640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559980185be0 0x5599801880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a8b8640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559980185be0 0x5599801880a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a8b8640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8824017050 0x7f882404d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x7f8824017050 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a0b7640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8824017050 0x7f882404d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a0b7640 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8824017050 0x7f882404d3b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x55998017ca00 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x55998017ca00 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.931+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x7f8824017050 2024-09-12T16:54:06.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x55998017ca00 2024-09-12T16:54:06.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x55998017ca00 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x7f8824017050 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x55998017ca00 2024-09-12T16:54:06.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.935+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x55998017ca00 2024-09-12T16:54:06.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x7f8824017050 2024-09-12T16:54:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x55998017ca00 2024-09-12T16:54:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x7f8824017050 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980185be0 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.939+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x559980181110 2024-09-12T16:54:06.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x55998017ca00 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559980188770 con 0x7f8824017050 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559980184600 con 0x55998017ca00 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559980184a20 con 0x55998017ca00 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559980184e40 con 0x55998017ca00 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 zone default found 2024-09-12T16:54:06.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 4 Realm: () 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 zonegroup default 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559980184e40 con 0x559980181110 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998018a760 con 0x559980185be0 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55998018ac10 con 0x559980185be0 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 started sync module instance, tier type = 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.943+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559980189a80 con 0x7f8824017050 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.947+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.947+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117767454592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559980189a80 con 0x7f8824017050 2024-09-12T16:54:06.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.947+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018b6f0 con 0x55998017ca00 2024-09-12T16:54:06.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.947+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94117767454592] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.947+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.947+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117767459296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559980189a80 con 0x55998017ca00 2024-09-12T16:54:06.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.947+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018c130 con 0x559980185be0 2024-09-12T16:54:06.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94117767459296] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117767452112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801899f0 con 0x559980185be0 2024-09-12T16:54:06.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018ce30 con 0x7f8824017050 2024-09-12T16:54:06.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117767465648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018d700 con 0x7f8824017050 2024-09-12T16:54:06.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018e0c0 con 0x55998017ca00 2024-09-12T16:54:06.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94117767452112] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94117767465648] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117767464144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018dc10 con 0x55998017ca00 2024-09-12T16:54:06.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.951+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018e460 con 0x559980181110 2024-09-12T16:54:06.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.955+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94117767464144] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.955+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.955+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117767470096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018e030 con 0x559980181110 2024-09-12T16:54:06.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.955+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018f1e0 con 0x559980181110 2024-09-12T16:54:06.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.955+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94117767470096] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.959+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.959+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117767473280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018f150 con 0x559980181110 2024-09-12T16:54:06.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.959+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018fc00 con 0x559980181110 2024-09-12T16:54:06.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.959+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94117767473280] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117767476960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55998018fde0 con 0x559980181110 2024-09-12T16:54:06.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 20 add_watcher() i=0 2024-09-12T16:54:06.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 20 add_watcher() i=1 2024-09-12T16:54:06.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 20 add_watcher() i=2 2024-09-12T16:54:06.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 20 add_watcher() i=3 2024-09-12T16:54:06.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 20 add_watcher() i=4 2024-09-12T16:54:06.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 20 add_watcher() i=5 2024-09-12T16:54:06.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 20 add_watcher() i=6 2024-09-12T16:54:06.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94117767476960] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 20 add_watcher() i=7 2024-09-12T16:54:06.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:06.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599801931b0 con 0x55998017ca00 2024-09-12T16:54:06.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.963+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117767478480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801905a0 con 0x55998017ca00 2024-09-12T16:54:06.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94117767478480] v34'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f86e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:06.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:06.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 5 note: GC not initialized 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f865bfff640 20 reqs_thread_entry: start 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 20 Filter name: none 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f8659ffb640 20 reqs_thread_entry: start 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5de0 con 0x55998017ca00 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:06.972 INFO:teuthology.orchestra.run.smithi151.stderr:could not fetch user info: no user info saved 2024-09-12T16:54:06.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f86e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:06.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117767478480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x55998017ca00 2024-09-12T16:54:06.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94117767478480] v34'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.967+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117767454592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x7f8824017050 2024-09-12T16:54:06.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.971+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94117767454592] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.971+0000 7f882cdb29c0 20 remove_watcher() i=0 2024-09-12T16:54:06.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.971+0000 7f882cdb29c0 2 removed watcher, disabling cache 2024-09-12T16:54:06.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.971+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117767459296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x55998017ca00 2024-09-12T16:54:06.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.971+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94117767459296] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.971+0000 7f882cdb29c0 20 remove_watcher() i=1 2024-09-12T16:54:06.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.971+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117767452112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x559980185be0 2024-09-12T16:54:06.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882a8b8640 1 -- 172.21.15.151:0/1753423119 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94117767452112] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8824008030 con 0x559980185be0 2024-09-12T16:54:06.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882cdb29c0 20 remove_watcher() i=2 2024-09-12T16:54:06.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117767465648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x7f8824017050 2024-09-12T16:54:06.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94117767465648] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x7f8824017050 2024-09-12T16:54:06.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882cdb29c0 20 remove_watcher() i=3 2024-09-12T16:54:06.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117767464144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x55998017ca00 2024-09-12T16:54:06.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94117767464144] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88140b3040 con 0x55998017ca00 2024-09-12T16:54:06.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882cdb29c0 20 remove_watcher() i=4 2024-09-12T16:54:06.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.975+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117767470096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x559980181110 2024-09-12T16:54:06.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.979+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94117767470096] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.979+0000 7f882cdb29c0 20 remove_watcher() i=5 2024-09-12T16:54:06.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.979+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117767473280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x559980181110 2024-09-12T16:54:06.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.979+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94117767473280] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.979+0000 7f882cdb29c0 20 remove_watcher() i=6 2024-09-12T16:54:06.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.979+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117767476960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5599801b5da0 con 0x559980181110 2024-09-12T16:54:06.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882b0b9640 1 -- 172.21.15.151:0/1753423119 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94117767476960] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f881c02a070 con 0x559980181110 2024-09-12T16:54:06.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 20 remove_watcher() i=7 2024-09-12T16:54:06.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559980181110 msgr2=0x559980183500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559980181110 0x559980183500 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55998017ca00 msgr2=0x55998017ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55998017ca00 0x55998017ee90 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8824017050 msgr2=0x7f882404d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8824017050 0x7f882404d3b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559980185be0 msgr2=0x5599801880a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559980185be0 0x5599801880a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f86f4039a70 msgr2=0x7f86f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f86f4039a70 0x7f86f403bf30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55998014f730 tx=0x7f882402f000 comp rx=0 tx=0).stop 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882a0b7640 1 -- 172.21.15.151:0/1753423119 reap_dead start 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 msgr2=0x559980171780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x559980171780 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f881c052360 tx=0x7f881c050690 comp rx=0 tx=0).stop 2024-09-12T16:54:06.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 shutdown_connections 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/1753423119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998016b2d0 0x559980171780 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 >> 172.21.15.151:0/1753423119 conn(0x5599801666f0 msgr2=0x559980164900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 shutdown_connections 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/1753423119 wait complete. 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/4244633332 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8704039a70 msgr2=0x7f870403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/4244633332 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8704039a70 0x7f870403bf30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8824001560 tx=0x7f882402c950 comp rx=0 tx=0).stop 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/4244633332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998015d9a0 msgr2=0x55998015ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/4244633332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998015d9a0 0x55998015ddc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x559980143fb0 tx=0x7f881c018830 comp rx=0 tx=0).stop 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/4244633332 shutdown_connections 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/4244633332 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8704039a70 0x7f870403bf30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/4244633332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55998015d9a0 0x55998015ddc0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/4244633332 >> 172.21.15.151:0/4244633332 conn(0x559980153350 msgr2=0x559980153730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/4244633332 shutdown_connections 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/4244633332 wait complete. 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55998014c890 msgr2=0x55998014ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55998014c890 0x55998014ec80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55997ffc25e0 msgr2=0x55998014a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55997ffc25e0 0x55998014a0f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8710039a70 msgr2=0x7f871003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8710039a70 0x7f871003bf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f88140ad000 tx=0x7f88140a5040 comp rx=0 tx=0).stop 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 msgr2=0x559980142f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x559980142f80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55998013c890 tx=0x7f8824000bd0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 shutdown_connections 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55998014c890 0x55998014ec80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55997ffc25e0 0x55998014a0f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8710039a70 0x7f871003bf30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 --2- 172.21.15.151:0/2133210966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55997ffc2200 0x559980142f80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:06.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 >> 172.21.15.151:0/2133210966 conn(0x559980048920 msgr2=0x559980135fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:06.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 shutdown_connections 2024-09-12T16:54:06.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:06.983+0000 7f882cdb29c0 1 -- 172.21.15.151:0/2133210966 wait complete. 2024-09-12T16:54:06.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T16:54:06.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-12T16:54:06.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-12T16:54:06.998 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-12T16:54:07.074 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:07.074 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1d0329c0 1 Processor -- start 2024-09-12T16:54:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1d0329c0 1 -- start start 2024-09-12T16:54:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1d0329c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c071219450 0x55c07121b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1d0329c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0710c99c0 con 0x55c071189350 2024-09-12T16:54:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1d0329c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55c0711196d0 con 0x55c071219450 2024-09-12T16:54:07.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1a337640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55c071219450 0x55c07121b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1ab38640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55c071189350 0x55c071217d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49164/0 (socket says 172.21.15.151:49164) 2024-09-12T16:54:07.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1ab38640 1 -- 172.21.15.151:0/474005766 learned_addr learned my addr 172.21.15.151:0/474005766 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:07.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1a337640 1 -- 172.21.15.151:0/474005766 >> v1:172.21.15.122:6789/0 conn(0x55c071189350 legacy=0x55c071217d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.071+0000 7f6a1a337640 1 -- 172.21.15.151:0/474005766 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0710bdca0 con 0x55c071219450 2024-09-12T16:54:07.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a1a337640 1 --2- 172.21.15.151:0/474005766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071219450 0x55c07121b840 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000a480 tx=0x7f6a1001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3bd4ad1b2105ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a19b36640 1 -- 172.21.15.151:0/474005766 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a100af070 con 0x55c071219450 2024-09-12T16:54:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a19b36640 1 -- 172.21.15.151:0/474005766 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a100aa530 con 0x55c071219450 2024-09-12T16:54:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a19b36640 1 -- 172.21.15.151:0/474005766 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a100aa830 con 0x55c071219450 2024-09-12T16:54:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/474005766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071219450 msgr2=0x55c07121b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/474005766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071219450 0x55c07121b840 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000a480 tx=0x7f6a1001b280 comp rx=0 tx=0).stop 2024-09-12T16:54:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/474005766 shutdown_connections 2024-09-12T16:54:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/474005766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071219450 0x55c07121b840 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/474005766 >> 172.21.15.151:0/474005766 conn(0x55c07120fa20 msgr2=0x55c071211e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/474005766 shutdown_connections 2024-09-12T16:54:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.075+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/474005766 wait complete. 2024-09-12T16:54:07.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.087+0000 7f6a1d0329c0 1 Processor -- start 2024-09-12T16:54:07.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.087+0000 7f6a1d0329c0 1 -- start start 2024-09-12T16:54:07.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.087+0000 7f6a1d0329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c0713008d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.087+0000 7f6a1d0329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c07111d680 con 0x55c071189350 2024-09-12T16:54:07.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.087+0000 7f6a1ab38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c0713008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.087+0000 7f6a1ab38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c0713008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52024/0 (socket says 172.21.15.151:52024) 2024-09-12T16:54:07.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.087+0000 7f6a1ab38640 1 -- 172.21.15.151:0/2162734212 learned_addr learned my addr 172.21.15.151:0/2162734212 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1ab38640 1 -- 172.21.15.151:0/2162734212 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c071098da0 con 0x55c071189350 2024-09-12T16:54:07.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1ab38640 1 --2- 172.21.15.151:0/2162734212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c0713008d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c001e00 tx=0x7f6a0c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e8e259d725e387 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6908e09640 1 -- 172.21.15.151:0/2162734212 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c012020 con 0x55c071189350 2024-09-12T16:54:07.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6908e09640 1 -- 172.21.15.151:0/2162734212 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c00e690 con 0x55c071189350 2024-09-12T16:54:07.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6908e09640 1 -- 172.21.15.151:0/2162734212 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c00ea10 con 0x55c071189350 2024-09-12T16:54:07.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/2162734212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 msgr2=0x55c0713008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/2162734212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c0713008d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c001e00 tx=0x7f6a0c00b6d0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/2162734212 shutdown_connections 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/2162734212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c0713008d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/2162734212 >> 172.21.15.151:0/2162734212 conn(0x55c07120fa20 msgr2=0x55c0712fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/2162734212 shutdown_connections 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/2162734212 wait complete. 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 Processor -- start 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- start start 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c071215410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c0710bfa50 con 0x55c071189350 2024-09-12T16:54:07.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1ab38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c071215410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1ab38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c071215410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52028/0 (socket says 172.21.15.151:52028) 2024-09-12T16:54:07.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1ab38640 1 -- 172.21.15.151:0/1126200729 learned_addr learned my addr 172.21.15.151:0/1126200729 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1ab38640 1 -- 172.21.15.151:0/1126200729 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c071215970 con 0x55c071189350 2024-09-12T16:54:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1ab38640 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c071215410 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x55c0713018c0 tx=0x7f6a0c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6907606640 1 -- 172.21.15.151:0/1126200729 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c012030 con 0x55c071189350 2024-09-12T16:54:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c071213d50 con 0x55c071189350 2024-09-12T16:54:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6907606640 1 -- 172.21.15.151:0/1126200729 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c01a750 con 0x55c071189350 2024-09-12T16:54:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6907606640 1 -- 172.21.15.151:0/1126200729 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c01aa50 con 0x55c071189350 2024-09-12T16:54:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.091+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0712142e0 con 0x55c071189350 2024-09-12T16:54:07.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 Processor -- start 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- start start 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c0713171a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c07112a450 con 0x55c071316da0 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c0713171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c0713171a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52034/0 (socket says 172.21.15.151:52034) 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 -- 172.21.15.151:0/244494863 learned_addr learned my addr 172.21.15.151:0/244494863 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6907606640 1 -- 172.21.15.151:0/1126200729 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a0c015020 con 0x55c071189350 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6907606640 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6900039a70 0x7f690003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 -- 172.21.15.151:0/244494863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c071317790 con 0x55c071316da0 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6907606640 1 -- 172.21.15.151:0/1126200729 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6a0c020030 con 0x55c071189350 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1ab38640 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6900039a70 0x7f690003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 --2- 172.21.15.151:0/244494863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c0713171a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400a430 tx=0x7f6a1400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1375ca38e6b34bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1ab38640 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6900039a70 0x7f690003bf30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c04ece0 tx=0x7f6a0c03f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6905602640 1 -- 172.21.15.151:0/244494863 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1400f6e0 con 0x55c071316da0 2024-09-12T16:54:07.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6905602640 1 -- 172.21.15.151:0/244494863 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a14015070 con 0x55c071316da0 2024-09-12T16:54:07.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6905602640 1 -- 172.21.15.151:0/244494863 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1400fa10 con 0x55c071316da0 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/244494863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 msgr2=0x55c0713171a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/244494863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c0713171a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400a430 tx=0x7f6a1400a8f0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/244494863 shutdown_connections 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/244494863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c0713171a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/244494863 >> 172.21.15.151:0/244494863 conn(0x55c071219450 msgr2=0x55c0713127e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/244494863 shutdown_connections 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/244494863 wait complete. 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 Processor -- start 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- start start 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c07131e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1d0329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c071317f80 con 0x55c071316da0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c07131e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c07131e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52036/0 (socket says 172.21.15.151:52036) 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 -- 172.21.15.151:0/426304666 learned_addr learned my addr 172.21.15.151:0/426304666 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.095+0000 7f6a1b339640 1 -- 172.21.15.151:0/426304666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07131e770 con 0x55c071316da0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1b339640 1 --2- 172.21.15.151:0/426304666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c07131e210 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55c071317ca0 tx=0x7f6a14003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68ff7fe640 1 -- 172.21.15.151:0/426304666 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a14010a20 con 0x55c071316da0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/426304666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c07131ea00 con 0x55c071316da0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68ff7fe640 1 -- 172.21.15.151:0/426304666 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a14020070 con 0x55c071316da0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68ff7fe640 1 -- 172.21.15.151:0/426304666 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a14010d50 con 0x55c071316da0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/426304666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c07131f3b0 con 0x55c071316da0 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:07.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68ff7fe640 1 -- 172.21.15.151:0/426304666 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a1401b420 con 0x55c071316da0 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 1 Processor -- start 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68ff7fe640 1 --2- 172.21.15.151:0/426304666 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f68f4039a70 0x7f68f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68ff7fe640 1 -- 172.21.15.151:0/426304666 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6a14050c40 con 0x55c071316da0 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 1 -- start start 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1b339640 1 --2- 172.21.15.151:0/426304666 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f68f4039a70 0x7f68f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071337900 0x55c071337d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c071301120 con 0x55c071337900 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1b339640 1 --2- 172.21.15.151:0/426304666 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f68f4039a70 0x7f68f403bf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a14049500 tx=0x7f6a1404c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1ab38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071337900 0x55c071337d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1ab38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071337900 0x55c071337d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52044/0 (socket says 172.21.15.151:52044) 2024-09-12T16:54:07.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1ab38640 1 -- 172.21.15.151:0/3462201798 learned_addr learned my addr 172.21.15.151:0/3462201798 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1ab38640 1 -- 172.21.15.151:0/3462201798 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c071338360 con 0x55c071337900 2024-09-12T16:54:07.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1ab38640 1 --2- 172.21.15.151:0/3462201798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071337900 0x55c071337d20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c04ec50 tx=0x7f6a0c02c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68db7fe640 1 -- 172.21.15.151:0/3462201798 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c02cb80 con 0x55c071337900 2024-09-12T16:54:07.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/3462201798 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c071338b60 con 0x55c071337900 2024-09-12T16:54:07.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68db7fe640 1 -- 172.21.15.151:0/3462201798 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c02cd20 con 0x55c071337900 2024-09-12T16:54:07.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f68db7fe640 1 -- 172.21.15.151:0/3462201798 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c016570 con 0x55c071337900 2024-09-12T16:54:07.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.099+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/3462201798 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c071338b60 con 0x55c071337900 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f68db7fe640 1 -- 172.21.15.151:0/3462201798 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a0c049040 con 0x55c071337900 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f68db7fe640 1 --2- 172.21.15.151:0/3462201798 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6850039a70 0x7f685003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f68db7fe640 1 -- 172.21.15.151:0/3462201798 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6a0c005050 con 0x55c071337900 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1a337640 1 --2- 172.21.15.151:0/3462201798 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6850039a70 0x7f685003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f68d97fa640 20 reqs_thread_entry: start 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c07133d190 0x55c07133f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1a337640 1 --2- 172.21.15.151:0/3462201798 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6850039a70 0x7f685003bf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6a100ac000 tx=0x7f6a100a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c07133fd20 con 0x55c07133d190 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1b339640 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c07133d190 0x55c07133f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1b339640 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c07133d190 0x55c07133f650 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1b339640 1 -- 172.21.15.151:0/1126200729 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a1400e070 con 0x55c07133d190 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c071341b40 0x55c071343f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:2 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c071344620 con 0x55c071341b40 2024-09-12T16:54:07.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1ab38640 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c071341b40 0x55c071343f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.103+0000 7f6a1ab38640 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c071341b40 0x55c071343f30 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1ab38640 1 -- 172.21.15.151:0/1126200729 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(2 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a0c059040 con 0x55c071341b40 2024-09-12T16:54:07.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/426304666 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f68f4039a70 msgr2=0x7f68f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/426304666 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f68f4039a70 0x7f68f403bf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a14049500 tx=0x7f6a1404c040 comp rx=0 tx=0).stop 2024-09-12T16:54:07.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/426304666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 msgr2=0x55c07131e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/426304666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c07131e210 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55c071317ca0 tx=0x7f6a14003380 comp rx=0 tx=0).stop 2024-09-12T16:54:07.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/426304666 shutdown_connections 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/426304666 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f68f4039a70 0x7f68f403bf30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/426304666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071316da0 0x55c07131e210 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/426304666 >> 172.21.15.151:0/426304666 conn(0x55c071219450 msgr2=0x55c071312330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/426304666 shutdown_connections 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/426304666 wait complete. 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/3462201798 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6850039a70 msgr2=0x7f685003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/3462201798 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6850039a70 0x7f685003bf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6a100ac000 tx=0x7f6a100a5000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/3462201798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071337900 msgr2=0x55c071337d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/3462201798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071337900 0x55c071337d20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c04ec50 tx=0x7f6a0c02c950 comp rx=0 tx=0).stop 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/3462201798 shutdown_connections 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/3462201798 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6850039a70 0x7f685003bf30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/3462201798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071337900 0x55c071337d20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/3462201798 >> 172.21.15.151:0/3462201798 conn(0x55c07132cf00 msgr2=0x55c07132d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/3462201798 shutdown_connections 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/3462201798 wait complete. 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c071341b40 msgr2=0x55c071343f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c071341b40 0x55c071343f30 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c07133d190 msgr2=0x55c07133f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c07133d190 0x55c07133f650 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6900039a70 msgr2=0x7f690003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6900039a70 0x7f690003bf30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c04ece0 tx=0x7f6a0c03f040 comp rx=0 tx=0).stop 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 msgr2=0x55c071215410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c071215410 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x55c0713018c0 tx=0x7f6a0c000bd0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 shutdown_connections 2024-09-12T16:54:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55c071341b40 0x55c071343f30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55c07133d190 0x55c07133f650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6900039a70 0x7f690003bf30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 --2- 172.21.15.151:0/1126200729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c071189350 0x55c071215410 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 >> 172.21.15.151:0/1126200729 conn(0x55c07120fa20 msgr2=0x55c0712fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 shutdown_connections 2024-09-12T16:54:07.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.107+0000 7f6a1d0329c0 1 -- 172.21.15.151:0/1126200729 wait complete. 2024-09-12T16:54:07.122 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T16:54:07.122 DEBUG:tasks.util.rgw: json result: {'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T16:54:07.122 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-12T16:54:07.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-12T16:54:07.123 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-12T16:54:07.203 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:07.204 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:07.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a69b39c0 1 Processor -- start 2024-09-12T16:54:07.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a69b39c0 1 -- start start 2024-09-12T16:54:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a69b39c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5578246b4320 0x5578246b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a69b39c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578245629c0 con 0x5578246b01d0 2024-09-12T16:54:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a69b39c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5578245b26d0 con 0x5578246b4320 2024-09-12T16:54:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a3cb8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5578246b4320 0x5578246b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a3cb8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5578246b4320 0x5578246b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52046/0 (socket says 172.21.15.151:52046) 2024-09-12T16:54:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a3cb8640 1 -- 172.21.15.151:0/498249582 learned_addr learned my addr 172.21.15.151:0/498249582 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a3cb8640 1 -- 172.21.15.151:0/498249582 >> v1:172.21.15.122:6789/0 conn(0x5578246b01d0 legacy=0x5578246b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.199+0000 7f07a3cb8640 1 -- 172.21.15.151:0/498249582 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557824556ca0 con 0x5578246b4320 2024-09-12T16:54:07.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a3cb8640 1 --2- 172.21.15.151:0/498249582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b4320 0x5578246b6710 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f078c00a5c0 tx=0x7f078c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609ec617ad44f4a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a34b7640 1 -- 172.21.15.151:0/498249582 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c0a9590 con 0x5578246b4320 2024-09-12T16:54:07.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a34b7640 1 -- 172.21.15.151:0/498249582 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c0ae070 con 0x5578246b4320 2024-09-12T16:54:07.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a34b7640 1 -- 172.21.15.151:0/498249582 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c0a9880 con 0x5578246b4320 2024-09-12T16:54:07.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a69b39c0 1 -- 172.21.15.151:0/498249582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b4320 msgr2=0x5578246b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/498249582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b4320 0x5578246b6710 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f078c00a5c0 tx=0x7f078c01b3d0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a69b39c0 1 -- 172.21.15.151:0/498249582 shutdown_connections 2024-09-12T16:54:07.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/498249582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b4320 0x5578246b6710 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a69b39c0 1 -- 172.21.15.151:0/498249582 >> 172.21.15.151:0/498249582 conn(0x557824623ae0 msgr2=0x557824623ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a69b39c0 1 -- 172.21.15.151:0/498249582 shutdown_connections 2024-09-12T16:54:07.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.203+0000 7f07a69b39c0 1 -- 172.21.15.151:0/498249582 wait complete. 2024-09-12T16:54:07.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a69b39c0 1 Processor -- start 2024-09-12T16:54:07.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a69b39c0 1 -- start start 2024-09-12T16:54:07.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a69b39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x55782479b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a69b39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5578245b6680 con 0x5578246b01d0 2024-09-12T16:54:07.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a44b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x55782479b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a44b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x55782479b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52060/0 (socket says 172.21.15.151:52060) 2024-09-12T16:54:07.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a44b9640 1 -- 172.21.15.151:0/2544865426 learned_addr learned my addr 172.21.15.151:0/2544865426 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a44b9640 1 -- 172.21.15.151:0/2544865426 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557824531da0 con 0x5578246b01d0 2024-09-12T16:54:07.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f07a44b9640 1 --2- 172.21.15.151:0/2544865426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x55782479b870 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f079c001690 tx=0x7f079c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d127125373bf959 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f069260c640 1 -- 172.21.15.151:0/2544865426 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079c016070 con 0x5578246b01d0 2024-09-12T16:54:07.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f069260c640 1 -- 172.21.15.151:0/2544865426 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079c00f640 con 0x5578246b01d0 2024-09-12T16:54:07.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.219+0000 7f069260c640 1 -- 172.21.15.151:0/2544865426 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079c00f960 con 0x5578246b01d0 2024-09-12T16:54:07.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- 172.21.15.151:0/2544865426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 msgr2=0x55782479b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/2544865426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x55782479b870 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f079c001690 tx=0x7f079c001b50 comp rx=0 tx=0).stop 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- 172.21.15.151:0/2544865426 shutdown_connections 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/2544865426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x55782479b870 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- 172.21.15.151:0/2544865426 >> 172.21.15.151:0/2544865426 conn(0x557824623ae0 msgr2=0x5578247974b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- 172.21.15.151:0/2544865426 shutdown_connections 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- 172.21.15.151:0/2544865426 wait complete. 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 Processor -- start 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- start start 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x5578247a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557824558a50 con 0x5578246b01d0 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a44b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x5578247a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a44b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x5578247a2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52066/0 (socket says 172.21.15.151:52066) 2024-09-12T16:54:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 learned_addr learned my addr 172.21.15.151:0/3726578953 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578247a34a0 con 0x5578246b01d0 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a44b9640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x5578247a2f40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55782479c800 tx=0x7f079c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f0690e09640 1 -- 172.21.15.151:0/3726578953 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079c021020 con 0x5578246b01d0 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f0690e09640 1 -- 172.21.15.151:0/3726578953 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079c0115f0 con 0x5578246b01d0 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f0690e09640 1 -- 172.21.15.151:0/3726578953 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079c016040 con 0x5578246b01d0 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578247a3730 con 0x5578246b01d0 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578247a40e0 con 0x5578246b01d0 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 Processor -- start 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- start start 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.223+0000 7f07a69b39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5578245c3450 con 0x5578247afb60 2024-09-12T16:54:07.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52074/0 (socket says 172.21.15.151:52074) 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 -- 172.21.15.151:0/906135048 learned_addr learned my addr 172.21.15.151:0/906135048 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f0690e09640 1 -- 172.21.15.151:0/3726578953 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f079c024020 con 0x5578246b01d0 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 -- 172.21.15.151:0/906135048 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578247b0550 con 0x5578247afb60 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f0690e09640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f068c039a70 0x7f068c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f0690e09640 1 -- 172.21.15.151:0/3726578953 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f079c04fd00 con 0x5578246b01d0 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a44b9640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f068c039a70 0x7f068c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 --2- 172.21.15.151:0/906135048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247aff60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f079400a440 tx=0x7f079400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1395a30c3bb0dcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a44b9640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f068c039a70 0x7f068c03bf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f079c011000 tx=0x7f079c018f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f068a7fc640 1 -- 172.21.15.151:0/906135048 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794008850 con 0x5578247afb60 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f068a7fc640 1 -- 172.21.15.151:0/906135048 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794008a10 con 0x5578247afb60 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f068a7fc640 1 -- 172.21.15.151:0/906135048 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794008d30 con 0x5578247afb60 2024-09-12T16:54:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 -- 172.21.15.151:0/906135048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 msgr2=0x5578247aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/906135048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247aff60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f079400a440 tx=0x7f079400a900 comp rx=0 tx=0).stop 2024-09-12T16:54:07.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 -- 172.21.15.151:0/906135048 shutdown_connections 2024-09-12T16:54:07.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/906135048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247aff60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 -- 172.21.15.151:0/906135048 >> 172.21.15.151:0/906135048 conn(0x5578246b4320 msgr2=0x5578247ab5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 -- 172.21.15.151:0/906135048 shutdown_connections 2024-09-12T16:54:07.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 -- 172.21.15.151:0/906135048 wait complete. 2024-09-12T16:54:07.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 Processor -- start 2024-09-12T16:54:07.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 -- start start 2024-09-12T16:54:07.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a69b39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5578247b0d40 con 0x5578247afb60 2024-09-12T16:54:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247b6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52084/0 (socket says 172.21.15.151:52084) 2024-09-12T16:54:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 -- 172.21.15.151:0/826488592 learned_addr learned my addr 172.21.15.151:0/826488592 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 -- 172.21.15.151:0/826488592 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578247b7540 con 0x5578247afb60 2024-09-12T16:54:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.227+0000 7f07a4cba640 1 --2- 172.21.15.151:0/826488592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247b6fe0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x5578247b0a60 tx=0x7f0794003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f0688ff9640 1 -- 172.21.15.151:0/826488592 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794013a70 con 0x5578247afb60 2024-09-12T16:54:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f0688ff9640 1 -- 172.21.15.151:0/826488592 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794023070 con 0x5578247afb60 2024-09-12T16:54:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 1 -- 172.21.15.151:0/826488592 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578247b77d0 con 0x5578247afb60 2024-09-12T16:54:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f0688ff9640 1 -- 172.21.15.151:0/826488592 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0794013d80 con 0x5578247afb60 2024-09-12T16:54:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 1 -- 172.21.15.151:0/826488592 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578247b8180 con 0x5578247afb60 2024-09-12T16:54:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f0688ff9640 1 -- 172.21.15.151:0/826488592 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0794028460 con 0x5578247afb60 2024-09-12T16:54:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 1 Processor -- start 2024-09-12T16:54:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f0688ff9640 1 --2- 172.21.15.151:0/826488592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f067c039ac0 0x7f067c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f0688ff9640 1 -- 172.21.15.151:0/826488592 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0794050720 con 0x5578247afb60 2024-09-12T16:54:07.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 1 -- start start 2024-09-12T16:54:07.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a4cba640 1 --2- 172.21.15.151:0/826488592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f067c039ac0 0x7f067c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247d0680 0x5578247d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55782479c0c0 con 0x5578247d0680 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a4cba640 1 --2- 172.21.15.151:0/826488592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f067c039ac0 0x7f067c03bf80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f079402a030 tx=0x7f0794042040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a44b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247d0680 0x5578247d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a44b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247d0680 0x5578247d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52094/0 (socket says 172.21.15.151:52094) 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a44b9640 1 -- 172.21.15.151:0/3268903437 learned_addr learned my addr 172.21.15.151:0/3268903437 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a44b9640 1 -- 172.21.15.151:0/3268903437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578247d10e0 con 0x5578247d0680 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a44b9640 1 --2- 172.21.15.151:0/3268903437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247d0680 0x5578247d0aa0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f079c00ff00 tx=0x7f079c018aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f06697e2640 1 -- 172.21.15.151:0/3268903437 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079c010c60 con 0x5578247d0680 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f06697e2640 1 -- 172.21.15.151:0/3268903437 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079c01d400 con 0x5578247d0680 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3268903437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578247d1880 con 0x5578247d0680 2024-09-12T16:54:07.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f06697e2640 1 -- 172.21.15.151:0/3268903437 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f079c01c7b0 con 0x5578247d0680 2024-09-12T16:54:07.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.231+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3268903437 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578247d1df0 con 0x5578247d0680 2024-09-12T16:54:07.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f06697e2640 1 -- 172.21.15.151:0/3268903437 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f079c03b040 con 0x5578247d0680 2024-09-12T16:54:07.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f06697e2640 1 --2- 172.21.15.151:0/3268903437 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f05dc039a70 0x7f05dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f06697e2640 1 -- 172.21.15.151:0/3268903437 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f079c047d20 con 0x5578247d0680 2024-09-12T16:54:07.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a3cb8640 1 --2- 172.21.15.151:0/3268903437 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f05dc039a70 0x7f05dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f06627fc640 20 reqs_thread_entry: start 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5578247d60e0 0x5578247d8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5578247d8bf0 con 0x5578247d60e0 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a3cb8640 1 --2- 172.21.15.151:0/3268903437 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f05dc039a70 0x7f05dc03bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f078c0ad000 tx=0x7f078c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a4cba640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5578247d60e0 0x5578247d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a4cba640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5578247d60e0 0x5578247d8570 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5578247d9480 con 0x5578247d60e0 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5578247dad40 0x5578247dd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5578247dd960 con 0x5578247dad40 2024-09-12T16:54:07.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a44b9640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5578247dad40 0x5578247dd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.235+0000 7f07a44b9640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5578247dad40 0x5578247dd1d0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5578247e44a0 con 0x5578247d60e0 2024-09-12T16:54:07.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.246 INFO:teuthology.orchestra.run.smithi151.stderr:NOTICE: set zone's realm_id= 2024-09-12T16:54:07.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5578247e8500 0x5578247e4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a3cb8640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5578247e8500 0x5578247e4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a3cb8640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5578247e8500 0x5578247e4920 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a3cb8640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f078c009040 0x7f078c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x7f078c009040 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a4cba640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f078c009040 0x7f078c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a4cba640 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f078c009040 0x7f078c0b3400 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x7f078c009040 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247d60e0 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.239+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247d60e0 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x7f078c009040 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x7f078c009040 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247d60e0 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247d60e0 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x7f078c009040 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f079401e420 con 0x7f078c009040 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.243+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247d60e0 2024-09-12T16:54:07.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247d60e0 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x7f078c009040 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x7f078c009040 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247d60e0 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.247+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x7f078c009040 2024-09-12T16:54:07.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x7f078c009040 2024-09-12T16:54:07.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247e8500 2024-09-12T16:54:07.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c0a99e0 con 0x5578247e8500 2024-09-12T16:54:07.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a3cb8640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247dad40 2024-09-12T16:54:07.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x5578247d60e0 2024-09-12T16:54:07.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(35 [pgnls start_epoch 34 out=178b] v25'3 uv3 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5578247e3d30 con 0x7f078c009040 2024-09-12T16:54:07.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f079401e420 con 0x7f078c009040 2024-09-12T16:54:07.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5578247e5ad0 con 0x5578247d60e0 2024-09-12T16:54:07.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.251+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:38 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5578247e6350 con 0x5578247dad40 2024-09-12T16:54:07.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.255+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(38 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.255+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:39 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5578247e66f0 con 0x5578247dad40 2024-09-12T16:54:07.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.255+0000 7f07a44b9640 1 -- 172.21.15.151:0/3726578953 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(39 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f079c00f070 con 0x5578247dad40 2024-09-12T16:54:07.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.255+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5578247e2ff0 con 0x5578247d60e0 2024-09-12T16:54:07.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'4 uv4 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5578247e8f50 con 0x5578247d60e0 2024-09-12T16:54:07.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f079401e420 con 0x5578247d60e0 2024-09-12T16:54:07.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/826488592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f067c039ac0 msgr2=0x7f067c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/826488592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f067c039ac0 0x7f067c03bf80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f079402a030 tx=0x7f0794042040 comp rx=0 tx=0).stop 2024-09-12T16:54:07.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/826488592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 msgr2=0x5578247b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/826488592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247b6fe0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x5578247b0a60 tx=0x7f0794003000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/826488592 shutdown_connections 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/826488592 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f067c039ac0 0x7f067c03bf80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/826488592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247afb60 0x5578247b6fe0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/826488592 >> 172.21.15.151:0/826488592 conn(0x5578246b4320 msgr2=0x5578247ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/826488592 shutdown_connections 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/826488592 wait complete. 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3268903437 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f05dc039a70 msgr2=0x7f05dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3268903437 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f05dc039a70 0x7f05dc03bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f078c0ad000 tx=0x7f078c0a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3268903437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247d0680 msgr2=0x5578247d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3268903437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247d0680 0x5578247d0aa0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f079c00ff00 tx=0x7f079c018aa0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3268903437 shutdown_connections 2024-09-12T16:54:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3268903437 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f05dc039a70 0x7f05dc03bf30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3268903437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578247d0680 0x5578247d0aa0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3268903437 >> 172.21.15.151:0/3268903437 conn(0x5578247c5c80 msgr2=0x5578247c6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3268903437 shutdown_connections 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3268903437 wait complete. 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5578247dad40 msgr2=0x5578247dd1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5578247dad40 0x5578247dd1d0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5578247d60e0 msgr2=0x5578247d8570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5578247d60e0 0x5578247d8570 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f078c009040 msgr2=0x7f078c0b3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f078c009040 0x7f078c0b3400 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5578247e8500 msgr2=0x5578247e4920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5578247e8500 0x5578247e4920 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f068c039a70 msgr2=0x7f068c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f068c039a70 0x7f068c03bf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f079c011000 tx=0x7f079c018f90 comp rx=0 tx=0).stop 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 msgr2=0x5578247a2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x5578247a2f40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x55782479c800 tx=0x7f079c001260 comp rx=0 tx=0).stop 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a4cba640 1 -- 172.21.15.151:0/3726578953 reap_dead start 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 shutdown_connections 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 --2- 172.21.15.151:0/3726578953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5578246b01d0 0x5578247a2f40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 >> 172.21.15.151:0/3726578953 conn(0x557824623ae0 msgr2=0x557824795f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 shutdown_connections 2024-09-12T16:54:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.259+0000 7f07a69b39c0 1 -- 172.21.15.151:0/3726578953 wait complete. 2024-09-12T16:54:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T16:54:07.276 DEBUG:tasks.util.rgw: json result: {'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T16:54:07.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-12T16:54:07.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-12T16:54:07.277 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-12T16:54:07.349 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:07.350 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:07.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1d7509c0 1 Processor -- start 2024-09-12T16:54:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1d7509c0 1 -- start start 2024-09-12T16:54:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1d7509c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x562b77c28320 0x562b77c2a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1d7509c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b77ad89c0 con 0x562b77b981d0 2024-09-12T16:54:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1d7509c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x562b77b286d0 con 0x562b77c28320 2024-09-12T16:54:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1aa55640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x562b77c28320 0x562b77c2a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1b256640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x562b77b981d0 0x562b77c26c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49180/0 (socket says 172.21.15.151:49180) 2024-09-12T16:54:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1b256640 1 -- 172.21.15.151:0/134659386 learned_addr learned my addr 172.21.15.151:0/134659386 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1a254640 1 -- 172.21.15.151:0/134659386 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198705626 0 0) 0x562b77ad89c0 con 0x562b77b981d0 2024-09-12T16:54:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1a254640 1 -- 172.21.15.151:0/134659386 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f04001e20 con 0x562b77b981d0 2024-09-12T16:54:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1aa55640 1 -- 172.21.15.151:0/134659386 >> v1:172.21.15.122:6789/0 conn(0x562b77b981d0 legacy=0x562b77c26c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1aa55640 1 -- 172.21.15.151:0/134659386 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77accca0 con 0x562b77c28320 2024-09-12T16:54:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.347+0000 7f2f1aa55640 1 --2- 172.21.15.151:0/134659386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77c28320 0x562b77c2a710 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000a480 tx=0x7f2f1001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fc5a6c2b3912f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1a254640 1 -- 172.21.15.151:0/134659386 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f100af070 con 0x562b77c28320 2024-09-12T16:54:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1a254640 1 -- 172.21.15.151:0/134659386 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f100aa530 con 0x562b77c28320 2024-09-12T16:54:07.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1a254640 1 -- 172.21.15.151:0/134659386 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f100aa810 con 0x562b77c28320 2024-09-12T16:54:07.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/134659386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77c28320 msgr2=0x562b77c2a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/134659386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77c28320 0x562b77c2a710 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000a480 tx=0x7f2f1001b280 comp rx=0 tx=0).stop 2024-09-12T16:54:07.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/134659386 shutdown_connections 2024-09-12T16:54:07.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/134659386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77c28320 0x562b77c2a710 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/134659386 >> 172.21.15.151:0/134659386 conn(0x562b77c1e8f0 msgr2=0x562b77c20d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/134659386 shutdown_connections 2024-09-12T16:54:07.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.351+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/134659386 wait complete. 2024-09-12T16:54:07.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.363+0000 7f2f1d7509c0 1 Processor -- start 2024-09-12T16:54:07.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.363+0000 7f2f1d7509c0 1 -- start start 2024-09-12T16:54:07.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d0f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b77b2c680 con 0x562b77b981d0 2024-09-12T16:54:07.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1b256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d0f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1b256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d0f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52106/0 (socket says 172.21.15.151:52106) 2024-09-12T16:54:07.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1b256640 1 -- 172.21.15.151:0/2649790173 learned_addr learned my addr 172.21.15.151:0/2649790173 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1b256640 1 -- 172.21.15.151:0/2649790173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77aa7da0 con 0x562b77b981d0 2024-09-12T16:54:07.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1b256640 1 --2- 172.21.15.151:0/2649790173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d0f5c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2f140016a0 tx=0x7f2f14001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e16b59f91b6f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2e0960a640 1 -- 172.21.15.151:0/2649790173 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14004530 con 0x562b77b981d0 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2e0960a640 1 -- 172.21.15.151:0/2649790173 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f140046d0 con 0x562b77b981d0 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2e0960a640 1 -- 172.21.15.151:0/2649790173 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f140049f0 con 0x562b77b981d0 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2649790173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 msgr2=0x562b77d0f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2649790173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d0f5c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2f140016a0 tx=0x7f2f14001b60 comp rx=0 tx=0).stop 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2649790173 shutdown_connections 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2649790173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d0f5c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2649790173 >> 172.21.15.151:0/2649790173 conn(0x562b77c1e8f0 msgr2=0x562b77d0b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2649790173 shutdown_connections 2024-09-12T16:54:07.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2649790173 wait complete. 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 Processor -- start 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 -- start start 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d16c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1d7509c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b77acea50 con 0x562b77b981d0 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1b256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d16c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1b256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d16c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52122/0 (socket says 172.21.15.151:52122) 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.367+0000 7f2f1b256640 1 -- 172.21.15.151:0/2474076987 learned_addr learned my addr 172.21.15.151:0/2474076987 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1b256640 1 -- 172.21.15.151:0/2474076987 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77d171b0 con 0x562b77b981d0 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1b256640 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d16c50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2f14001ba0 tx=0x7f2f14004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e07e07640 1 -- 172.21.15.151:0/2474076987 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14013760 con 0x562b77b981d0 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b77d17440 con 0x562b77b981d0 2024-09-12T16:54:07.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e07e07640 1 -- 172.21.15.151:0/2474076987 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f14013900 con 0x562b77b981d0 2024-09-12T16:54:07.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e07e07640 1 -- 172.21.15.151:0/2474076987 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14013c00 con 0x562b77b981d0 2024-09-12T16:54:07.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b77d17df0 con 0x562b77b981d0 2024-09-12T16:54:07.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 Processor -- start 2024-09-12T16:54:07.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- start start 2024-09-12T16:54:07.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77d23c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b77b39450 con 0x562b77d23890 2024-09-12T16:54:07.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e07e07640 1 -- 172.21.15.151:0/2474076987 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2f14010070 con 0x562b77b981d0 2024-09-12T16:54:07.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1ba57640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77d23c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1ba57640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77d23c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52124/0 (socket says 172.21.15.151:52124) 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1ba57640 1 -- 172.21.15.151:0/1209832602 learned_addr learned my addr 172.21.15.151:0/1209832602 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e07e07640 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2e00039a70 0x7f2e0003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e07e07640 1 -- 172.21.15.151:0/2474076987 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f14018070 con 0x562b77b981d0 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1b256640 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2e00039a70 0x7f2e0003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1ba57640 1 -- 172.21.15.151:0/1209832602 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77d24280 con 0x562b77d23890 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1ba57640 1 --2- 172.21.15.151:0/1209832602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77d23c90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00a440 tx=0x7f2f0c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de6ab46ce549080 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1b256640 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2e00039a70 0x7f2e0003bf30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2f1401e750 tx=0x7f2f1401e6e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e05e03640 1 -- 172.21.15.151:0/1209832602 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0c008850 con 0x562b77d23890 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e05e03640 1 -- 172.21.15.151:0/1209832602 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c008a10 con 0x562b77d23890 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2e05e03640 1 -- 172.21.15.151:0/1209832602 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0c008d30 con 0x562b77d23890 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1209832602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 msgr2=0x562b77d23c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/1209832602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77d23c90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00a440 tx=0x7f2f0c00a900 comp rx=0 tx=0).stop 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1209832602 shutdown_connections 2024-09-12T16:54:07.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/1209832602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77d23c90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1209832602 >> 172.21.15.151:0/1209832602 conn(0x562b77c28320 msgr2=0x562b77d1f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1209832602 shutdown_connections 2024-09-12T16:54:07.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.371+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1209832602 wait complete. 2024-09-12T16:54:07.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 Processor -- start 2024-09-12T16:54:07.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 -- start start 2024-09-12T16:54:07.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77c242c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b77d24a70 con 0x562b77d23890 2024-09-12T16:54:07.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1ba57640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77c242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1ba57640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77c242c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52130/0 (socket says 172.21.15.151:52130) 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1ba57640 1 -- 172.21.15.151:0/3655415677 learned_addr learned my addr 172.21.15.151:0/3655415677 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1ba57640 1 -- 172.21.15.151:0/3655415677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77c24820 con 0x562b77d23890 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1ba57640 1 --2- 172.21.15.151:0/3655415677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77c242c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x562b77d24790 tx=0x7f2f0c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2df7fff640 1 -- 172.21.15.151:0/3655415677 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0c013a20 con 0x562b77d23890 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/3655415677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b77c22c00 con 0x562b77d23890 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2df7fff640 1 -- 172.21.15.151:0/3655415677 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c023070 con 0x562b77d23890 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2df7fff640 1 -- 172.21.15.151:0/3655415677 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0c013cf0 con 0x562b77d23890 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/3655415677 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b77c23110 con 0x562b77d23890 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2df7fff640 1 -- 172.21.15.151:0/3655415677 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2f0c028460 con 0x562b77d23890 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 Processor -- start 2024-09-12T16:54:07.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2df7fff640 1 --2- 172.21.15.151:0/3655415677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2dfc039a70 0x7f2dfc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2df7fff640 1 -- 172.21.15.151:0/3655415677 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f0c0506d0 con 0x562b77d23890 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 -- start start 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1ba57640 1 --2- 172.21.15.151:0/3655415677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2dfc039a70 0x7f2dfc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d46610 0x562b77d46a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.375+0000 7f2f1d7509c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b77d0fe10 con 0x562b77d46610 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1ba57640 1 --2- 172.21.15.151:0/3655415677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2dfc039a70 0x7f2dfc03bf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c027fd0 tx=0x7f2f0c042040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1b256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d46610 0x562b77d46a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1b256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d46610 0x562b77d46a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52136/0 (socket says 172.21.15.151:52136) 2024-09-12T16:54:07.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1b256640 1 -- 172.21.15.151:0/1809745848 learned_addr learned my addr 172.21.15.151:0/1809745848 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1b256640 1 -- 172.21.15.151:0/1809745848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b77d47070 con 0x562b77d46610 2024-09-12T16:54:07.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1b256640 1 --2- 172.21.15.151:0/1809745848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d46610 0x562b77d46a30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2f14004ef0 tx=0x7f2f1401d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2d7bfff640 1 -- 172.21.15.151:0/1809745848 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f140108e0 con 0x562b77d46610 2024-09-12T16:54:07.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2d7bfff640 1 -- 172.21.15.151:0/1809745848 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f14047020 con 0x562b77d46610 2024-09-12T16:54:07.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1809745848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b77d47810 con 0x562b77d46610 2024-09-12T16:54:07.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2d7bfff640 1 -- 172.21.15.151:0/1809745848 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1401d790 con 0x562b77d46610 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1809745848 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b77d47d80 con 0x562b77d46610 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2d7bfff640 1 -- 172.21.15.151:0/1809745848 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2f1403b030 con 0x562b77d46610 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2d7bfff640 1 --2- 172.21.15.151:0/1809745848 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d54039a20 0x7f2d5403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2d7bfff640 1 -- 172.21.15.151:0/1809745848 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f14048030 con 0x562b77d46610 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1aa55640 1 --2- 172.21.15.151:0/1809745848 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d54039a20 0x7f2d5403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2d79ffb640 20 reqs_thread_entry: start 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562b77d4c070 0x562b77d4e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b77d4eb80 con 0x562b77d4c070 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1aa55640 1 --2- 172.21.15.151:0/1809745848 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d54039a20 0x7f2d5403bee0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f100ac000 tx=0x7f2f100a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1ba57640 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562b77d4c070 0x562b77d4e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.379+0000 7f2f1ba57640 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562b77d4c070 0x562b77d4e500 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1ba57640 1 -- 172.21.15.151:0/2474076987 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c01e7a0 con 0x562b77d4c070 2024-09-12T16:54:07.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b77d4f430 con 0x562b77d4c070 2024-09-12T16:54:07.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1ba57640 1 -- 172.21.15.151:0/2474076987 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f0c01e7a0 con 0x562b77d4c070 2024-09-12T16:54:07.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562b77d50d40 0x562b77d531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b77d53960 con 0x562b77d50d40 2024-09-12T16:54:07.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1b256640 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562b77d50d40 0x562b77d531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1b256640 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562b77d50d40 0x562b77d531d0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1b256640 1 -- 172.21.15.151:0/2474076987 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f2f1401b030 con 0x562b77d50d40 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/3655415677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2dfc039a70 msgr2=0x7f2dfc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/3655415677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2dfc039a70 0x7f2dfc03bf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c027fd0 tx=0x7f2f0c042040 comp rx=0 tx=0).stop 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/3655415677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 msgr2=0x562b77c242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/3655415677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77c242c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x562b77d24790 tx=0x7f2f0c003000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/3655415677 shutdown_connections 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/3655415677 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2dfc039a70 0x7f2dfc03bf30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/3655415677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d23890 0x562b77c242c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/3655415677 >> 172.21.15.151:0/3655415677 conn(0x562b77c28320 msgr2=0x562b77d1edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/3655415677 shutdown_connections 2024-09-12T16:54:07.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/3655415677 wait complete. 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1809745848 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d54039a20 msgr2=0x7f2d5403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/1809745848 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d54039a20 0x7f2d5403bee0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f100ac000 tx=0x7f2f100a5000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1809745848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d46610 msgr2=0x562b77d46a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/1809745848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d46610 0x562b77d46a30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2f14004ef0 tx=0x7f2f1401d720 comp rx=0 tx=0).stop 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1809745848 shutdown_connections 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/1809745848 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2d54039a20 0x7f2d5403bee0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/1809745848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77d46610 0x562b77d46a30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1809745848 >> 172.21.15.151:0/1809745848 conn(0x562b77d3bc10 msgr2=0x562b77d3bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1809745848 shutdown_connections 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.383+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/1809745848 wait complete. 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562b77d50d40 msgr2=0x562b77d531d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562b77d50d40 0x562b77d531d0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562b77d4c070 msgr2=0x562b77d4e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562b77d4c070 0x562b77d4e500 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2e00039a70 msgr2=0x7f2e0003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2e00039a70 0x7f2e0003bf30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2f1401e750 tx=0x7f2f1401e6e0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 msgr2=0x562b77d16c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d16c50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2f14001ba0 tx=0x7f2f14004470 comp rx=0 tx=0).stop 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 shutdown_connections 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x562b77d50d40 0x562b77d531d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x562b77d4c070 0x562b77d4e500 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f2e00039a70 0x7f2e0003bf30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 --2- 172.21.15.151:0/2474076987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b77b981d0 0x562b77d16c50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 >> 172.21.15.151:0/2474076987 conn(0x562b77c1e8f0 msgr2=0x562b77d09c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 shutdown_connections 2024-09-12T16:54:07.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.387+0000 7f2f1d7509c0 1 -- 172.21.15.151:0/2474076987 wait complete. 2024-09-12T16:54:07.401 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T16:54:07.401 DEBUG:tasks.util.rgw: json result: {'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T16:54:07.401 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T16:54:07.401 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T16:54:07.401 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-12T16:54:07.483 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:07.483 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6defeba9c0 1 Processor -- start 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6defeba9c0 1 -- start start 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6defeba9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d31c0816b0 0x55d31c1157c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6defeba9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d31bfc19c0 con 0x55d31c0812d0 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6defeba9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55d31c0116d0 con 0x55d31c0816b0 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6ded1bf640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d31c0816b0 0x55d31c1157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6ded1bf640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55d31c0816b0 0x55d31c1157c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52150/0 (socket says 172.21.15.151:52150) 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6ded9c0640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55d31c0812d0 0x55d31c112090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49186/0 (socket says 172.21.15.151:49186) 2024-09-12T16:54:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6ded1bf640 1 -- 172.21.15.151:0/376083186 learned_addr learned my addr 172.21.15.151:0/376083186 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6ded1bf640 1 -- 172.21.15.151:0/376083186 >> v1:172.21.15.122:6789/0 conn(0x55d31c0812d0 legacy=0x55d31c112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.479+0000 7f6ded1bf640 1 -- 172.21.15.151:0/376083186 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31bfb5ca0 con 0x55d31c0816b0 2024-09-12T16:54:07.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6ded1bf640 1 --2- 172.21.15.151:0/376083186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0816b0 0x55d31c1157c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6de400a5c0 tx=0x7f6de401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452f6883c230ce13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6dec9be640 1 -- 172.21.15.151:0/376083186 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de40a6070 con 0x55d31c0816b0 2024-09-12T16:54:07.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6dec9be640 1 -- 172.21.15.151:0/376083186 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de40af070 con 0x55d31c0816b0 2024-09-12T16:54:07.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6dec9be640 1 -- 172.21.15.151:0/376083186 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de40aa5c0 con 0x55d31c0816b0 2024-09-12T16:54:07.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6defeba9c0 1 -- 172.21.15.151:0/376083186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0816b0 msgr2=0x55d31c1157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/376083186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0816b0 0x55d31c1157c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6de400a5c0 tx=0x7f6de401b340 comp rx=0 tx=0).stop 2024-09-12T16:54:07.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6defeba9c0 1 -- 172.21.15.151:0/376083186 shutdown_connections 2024-09-12T16:54:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/376083186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0816b0 0x55d31c1157c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6defeba9c0 1 -- 172.21.15.151:0/376083186 >> 172.21.15.151:0/376083186 conn(0x55d31c107980 msgr2=0x55d31c109da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6defeba9c0 1 -- 172.21.15.151:0/376083186 shutdown_connections 2024-09-12T16:54:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.483+0000 7f6defeba9c0 1 -- 172.21.15.151:0/376083186 wait complete. 2024-09-12T16:54:07.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 Processor -- start 2024-09-12T16:54:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 -- start start 2024-09-12T16:54:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c1fa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d31c015680 con 0x55d31c0812d0 2024-09-12T16:54:07.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6ded9c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c1fa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6ded9c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c1fa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52158/0 (socket says 172.21.15.151:52158) 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6ded9c0640 1 -- 172.21.15.151:0/1816306390 learned_addr learned my addr 172.21.15.151:0/1816306390 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6ded9c0640 1 -- 172.21.15.151:0/1816306390 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31bf90da0 con 0x55d31c0812d0 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6ded9c0640 1 --2- 172.21.15.151:0/1816306390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c1fa9e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6de000b270 tx=0x7f6de000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5c02859be723c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6cdbe07640 1 -- 172.21.15.151:0/1816306390 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de000e5d0 con 0x55d31c0812d0 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6cdbe07640 1 -- 172.21.15.151:0/1816306390 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de000e770 con 0x55d31c0812d0 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6cdbe07640 1 -- 172.21.15.151:0/1816306390 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de000ea70 con 0x55d31c0812d0 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1816306390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 msgr2=0x55d31c1fa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/1816306390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c1fa9e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6de000b270 tx=0x7f6de000b670 comp rx=0 tx=0).stop 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1816306390 shutdown_connections 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/1816306390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c1fa9e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1816306390 >> 172.21.15.151:0/1816306390 conn(0x55d31c107980 msgr2=0x55d31c1f6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1816306390 shutdown_connections 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.499+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1816306390 wait complete. 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 Processor -- start 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 -- start start 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c2020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d31bfb7a50 con 0x55d31c0812d0 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6ded9c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c2020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6ded9c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c2020a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52170/0 (socket says 172.21.15.151:52170) 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6ded9c0640 1 -- 172.21.15.151:0/3241920854 learned_addr learned my addr 172.21.15.151:0/3241920854 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6ded9c0640 1 -- 172.21.15.151:0/3241920854 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31c202600 con 0x55d31c0812d0 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6ded9c0640 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c2020a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x55d31c1fb9d0 tx=0x7f6de0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6cda604640 1 -- 172.21.15.151:0/3241920854 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de000be70 con 0x55d31c0812d0 2024-09-12T16:54:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6cda604640 1 -- 172.21.15.151:0/3241920854 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de000f9f0 con 0x55d31c0812d0 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d31c202890 con 0x55d31c0812d0 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6cda604640 1 -- 172.21.15.151:0/3241920854 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de000fcf0 con 0x55d31c0812d0 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31c203240 con 0x55d31c0812d0 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 Processor -- start 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 -- start start 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c20f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6defeba9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d31c022450 con 0x55d31c20ecc0 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6dee1c1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c20f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6cda604640 1 -- 172.21.15.151:0/3241920854 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6de0017070 con 0x55d31c0812d0 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6dee1c1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c20f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52176/0 (socket says 172.21.15.151:52176) 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6dee1c1640 1 -- 172.21.15.151:0/3949206898 learned_addr learned my addr 172.21.15.151:0/3949206898 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6cda604640 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cd4039a70 0x7f6cd403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6cda604640 1 -- 172.21.15.151:0/3241920854 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6de0015020 con 0x55d31c0812d0 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6ded9c0640 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cd4039a70 0x7f6cd403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.503+0000 7f6dee1c1640 1 -- 172.21.15.151:0/3949206898 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31c20f6b0 con 0x55d31c20ecc0 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6ded9c0640 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cd4039a70 0x7f6cd403bf30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6de000ffd0 tx=0x7f6de0035040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6dee1c1640 1 --2- 172.21.15.151:0/3949206898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c20f0c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6de800a430 tx=0x7f6de800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5c4331090e2ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6cd3fff640 1 -- 172.21.15.151:0/3949206898 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de800f6e0 con 0x55d31c20ecc0 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6cd3fff640 1 -- 172.21.15.151:0/3949206898 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de8015070 con 0x55d31c20ecc0 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6cd3fff640 1 -- 172.21.15.151:0/3949206898 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de800fa10 con 0x55d31c20ecc0 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3949206898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 msgr2=0x55d31c20f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3949206898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c20f0c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6de800a430 tx=0x7f6de800a8f0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3949206898 shutdown_connections 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3949206898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c20f0c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3949206898 >> 172.21.15.151:0/3949206898 conn(0x55d31c0816b0 msgr2=0x55d31c20a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3949206898 shutdown_connections 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3949206898 wait complete. 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 Processor -- start 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- start start 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c2160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d31c20fea0 con 0x55d31c20ecc0 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6dee1c1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c2160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6dee1c1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c2160c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52178/0 (socket says 172.21.15.151:52178) 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6dee1c1640 1 -- 172.21.15.151:0/572259687 learned_addr learned my addr 172.21.15.151:0/572259687 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6dee1c1640 1 -- 172.21.15.151:0/572259687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31c216620 con 0x55d31c20ecc0 2024-09-12T16:54:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6dee1c1640 1 --2- 172.21.15.151:0/572259687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c2160c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6de800adf0 tx=0x7f6de8003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6cd27fc640 1 -- 172.21.15.151:0/572259687 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de8010a10 con 0x55d31c20ecc0 2024-09-12T16:54:07.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6cd27fc640 1 -- 172.21.15.151:0/572259687 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de8020070 con 0x55d31c20ecc0 2024-09-12T16:54:07.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- 172.21.15.151:0/572259687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d31c2168b0 con 0x55d31c20ecc0 2024-09-12T16:54:07.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6cd27fc640 1 -- 172.21.15.151:0/572259687 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de8010d40 con 0x55d31c20ecc0 2024-09-12T16:54:07.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.507+0000 7f6defeba9c0 1 -- 172.21.15.151:0/572259687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31c217260 con 0x55d31c20ecc0 2024-09-12T16:54:07.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6cd27fc640 1 -- 172.21.15.151:0/572259687 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6de801b420 con 0x55d31c20ecc0 2024-09-12T16:54:07.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6defeba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6defeba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6cd27fc640 1 --2- 172.21.15.151:0/572259687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cc8039a70 0x7f6cc803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6cd27fc640 1 -- 172.21.15.151:0/572259687 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6de8050d20 con 0x55d31c20ecc0 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6defeba9c0 1 Processor -- start 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6dee1c1640 1 --2- 172.21.15.151:0/572259687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cc8039a70 0x7f6cc803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6defeba9c0 1 -- start start 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6defeba9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c22f780 0x55d31c22fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6defeba9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d31c1fb210 con 0x55d31c22f780 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6dee1c1640 1 --2- 172.21.15.151:0/572259687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cc8039a70 0x7f6cc803bf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6de8010fd0 tx=0x7f6de8031040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6ded9c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c22f780 0x55d31c22fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6ded9c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c22f780 0x55d31c22fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52180/0 (socket says 172.21.15.151:52180) 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6ded9c0640 1 -- 172.21.15.151:0/1328885749 learned_addr learned my addr 172.21.15.151:0/1328885749 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6ded9c0640 1 -- 172.21.15.151:0/1328885749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31c2301e0 con 0x55d31c22f780 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6ded9c0640 1 --2- 172.21.15.151:0/1328885749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c22f780 0x55d31c22fba0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6de004f430 tx=0x7f6de0050920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6cb2fe5640 1 -- 172.21.15.151:0/1328885749 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de0019d00 con 0x55d31c22f780 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6cb2fe5640 1 -- 172.21.15.151:0/1328885749 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de001a9d0 con 0x55d31c22f780 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1328885749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d31c2309e0 con 0x55d31c22f780 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6cb2fe5640 1 -- 172.21.15.151:0/1328885749 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de001dd80 con 0x55d31c22f780 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.511+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1328885749 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31c2309e0 con 0x55d31c22f780 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6cb2fe5640 1 -- 172.21.15.151:0/1328885749 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6de001d980 con 0x55d31c22f780 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6cb2fe5640 1 --2- 172.21.15.151:0/1328885749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c2c039a70 0x7f6c2c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6cb2fe5640 1 -- 172.21.15.151:0/1328885749 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6de0048d10 con 0x55d31c22f780 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6ded1bf640 1 --2- 172.21.15.151:0/1328885749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c2c039a70 0x7f6c2c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6cb0fe1640 20 reqs_thread_entry: start 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d31c235010 0x55d31c2374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d31c237ba0 con 0x55d31c235010 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6ded1bf640 1 --2- 172.21.15.151:0/1328885749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c2c039a70 0x7f6c2c03bf30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6de40ae000 tx=0x7f6de40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6dee1c1640 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d31c235010 0x55d31c2374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6dee1c1640 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d31c235010 0x55d31c2374d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6dee1c1640 1 -- 172.21.15.151:0/3241920854 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6de800e070 con 0x55d31c235010 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d31c2399c0 0x55d31c23bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:2 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d31c23c480 con 0x55d31c2399c0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6ded9c0640 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d31c2399c0 0x55d31c23bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6ded9c0640 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d31c2399c0 0x55d31c23bdb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6ded9c0640 1 -- 172.21.15.151:0/3241920854 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(2 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f6de004e070 con 0x55d31c2399c0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.515+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d31c241290 con 0x55d31c2399c0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6ded9c0640 1 -- 172.21.15.151:0/3241920854 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f6de004e070 con 0x55d31c2399c0 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/572259687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cc8039a70 msgr2=0x7f6cc803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/572259687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cc8039a70 0x7f6cc803bf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6de8010fd0 tx=0x7f6de8031040 comp rx=0 tx=0).stop 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/572259687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 msgr2=0x55d31c2160c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/572259687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c2160c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6de800adf0 tx=0x7f6de8003380 comp rx=0 tx=0).stop 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/572259687 shutdown_connections 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/572259687 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cc8039a70 0x7f6cc803bf30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/572259687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c20ecc0 0x55d31c2160c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/572259687 >> 172.21.15.151:0/572259687 conn(0x55d31c0816b0 msgr2=0x55d31c20a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/572259687 shutdown_connections 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/572259687 wait complete. 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1328885749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c2c039a70 msgr2=0x7f6c2c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/1328885749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c2c039a70 0x7f6c2c03bf30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6de40ae000 tx=0x7f6de40a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1328885749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c22f780 msgr2=0x55d31c22fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/1328885749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c22f780 0x55d31c22fba0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6de004f430 tx=0x7f6de0050920 comp rx=0 tx=0).stop 2024-09-12T16:54:07.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1328885749 shutdown_connections 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/1328885749 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6c2c039a70 0x7f6c2c03bf30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/1328885749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c22f780 0x55d31c22fba0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1328885749 >> 172.21.15.151:0/1328885749 conn(0x55d31c224db0 msgr2=0x55d31c225190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1328885749 shutdown_connections 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/1328885749 wait complete. 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d31c2399c0 msgr2=0x55d31c23bdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d31c2399c0 0x55d31c23bdb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d31c235010 msgr2=0x55d31c2374d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d31c235010 0x55d31c2374d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cd4039a70 msgr2=0x7f6cd403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cd4039a70 0x7f6cd403bf30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6de000ffd0 tx=0x7f6de0035040 comp rx=0 tx=0).stop 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 msgr2=0x55d31c2020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c2020a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x55d31c1fb9d0 tx=0x7f6de0000ee0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 shutdown_connections 2024-09-12T16:54:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55d31c2399c0 0x55d31c23bdb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55d31c235010 0x55d31c2374d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6cd4039a70 0x7f6cd403bf30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 --2- 172.21.15.151:0/3241920854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d31c0812d0 0x55d31c2020a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.519+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 >> 172.21.15.151:0/3241920854 conn(0x55d31c107980 msgr2=0x55d31c1f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.523+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 shutdown_connections 2024-09-12T16:54:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.523+0000 7f6defeba9c0 1 -- 172.21.15.151:0/3241920854 wait complete. 2024-09-12T16:54:07.550 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T16:54:07.550 DEBUG:tasks.util.rgw: json result: {'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T16:54:07.550 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-12T16:54:07.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-12T16:54:07.550 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-12T16:54:07.638 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:07.638 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:07.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3e38a9c0 1 Processor -- start 2024-09-12T16:54:07.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3e38a9c0 1 -- start start 2024-09-12T16:54:07.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3e38a9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55fe1c3afff0 0x55fe1c3aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3e38a9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe1c2ed9c0 con 0x55fe1c3afac0 2024-09-12T16:54:07.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3e38a9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55fe1c33d6d0 con 0x55fe1c3afff0 2024-09-12T16:54:07.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3b68f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55fe1c3afff0 0x55fe1c3aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3be90640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55fe1c3afac0 0x55fe1c3ae460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49192/0 (socket says 172.21.15.151:49192) 2024-09-12T16:54:07.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3b68f640 1 --2- 172.21.15.151:0/2116342867 >> v2:172.21.15.122:3300/0 conn(0x55fe1c3afff0 0x55fe1c3aeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52190/0 (socket says 172.21.15.151:52190) 2024-09-12T16:54:07.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3be90640 1 -- 172.21.15.151:0/2116342867 learned_addr learned my addr 172.21.15.151:0/2116342867 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:07.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3b68f640 1 -- 172.21.15.151:0/2116342867 >> v1:172.21.15.122:6789/0 conn(0x55fe1c3afac0 legacy=0x55fe1c3ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.635+0000 7f8d3b68f640 1 -- 172.21.15.151:0/2116342867 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1c2e1ca0 con 0x55fe1c3afff0 2024-09-12T16:54:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3b68f640 1 --2- 172.21.15.151:0/2116342867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afff0 0x55fe1c3aeb70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000a480 tx=0x7f8d3001b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fc6737e1caed40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3ae8e640 1 -- 172.21.15.151:0/2116342867 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d300af070 con 0x55fe1c3afff0 2024-09-12T16:54:07.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3ae8e640 1 -- 172.21.15.151:0/2116342867 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d300aa570 con 0x55fe1c3afff0 2024-09-12T16:54:07.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3ae8e640 1 -- 172.21.15.151:0/2116342867 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d300aa8b0 con 0x55fe1c3afff0 2024-09-12T16:54:07.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/2116342867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afff0 msgr2=0x55fe1c3aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/2116342867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afff0 0x55fe1c3aeb70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000a480 tx=0x7f8d3001b220 comp rx=0 tx=0).stop 2024-09-12T16:54:07.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/2116342867 shutdown_connections 2024-09-12T16:54:07.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/2116342867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afff0 0x55fe1c3aeb70 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/2116342867 >> 172.21.15.151:0/2116342867 conn(0x55fe1c434aa0 msgr2=0x55fe1c436ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/2116342867 shutdown_connections 2024-09-12T16:54:07.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.639+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/2116342867 wait complete. 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 Processor -- start 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- start start 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c526b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c341680 con 0x55fe1c3afac0 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3be90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c526b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3be90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c526b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52194/0 (socket says 172.21.15.151:52194) 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3be90640 1 -- 172.21.15.151:0/1013475812 learned_addr learned my addr 172.21.15.151:0/1013475812 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3be90640 1 -- 172.21.15.151:0/1013475812 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1c2bcda0 con 0x55fe1c3afac0 2024-09-12T16:54:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3be90640 1 --2- 172.21.15.151:0/1013475812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c526b60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8d34001810 tx=0x7f8d34001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b9cff15f21c6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8c29e0b640 1 -- 172.21.15.151:0/1013475812 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d34004530 con 0x55fe1c3afac0 2024-09-12T16:54:07.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8c29e0b640 1 -- 172.21.15.151:0/1013475812 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d340046d0 con 0x55fe1c3afac0 2024-09-12T16:54:07.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8c29e0b640 1 -- 172.21.15.151:0/1013475812 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d340049f0 con 0x55fe1c3afac0 2024-09-12T16:54:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1013475812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 msgr2=0x55fe1c526b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/1013475812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c526b60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8d34001810 tx=0x7f8d34001cd0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1013475812 shutdown_connections 2024-09-12T16:54:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/1013475812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c526b60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1013475812 >> 172.21.15.151:0/1013475812 conn(0x55fe1c434aa0 msgr2=0x55fe1c522800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1013475812 shutdown_connections 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1013475812 wait complete. 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 Processor -- start 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- start start 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c52e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.655+0000 7f8d3e38a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c2e3a50 con 0x55fe1c3afac0 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3be90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c52e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3be90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c52e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52210/0 (socket says 172.21.15.151:52210) 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3be90640 1 -- 172.21.15.151:0/3332435959 learned_addr learned my addr 172.21.15.151:0/3332435959 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3be90640 1 -- 172.21.15.151:0/3332435959 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1c52e720 con 0x55fe1c3afac0 2024-09-12T16:54:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3be90640 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c52e1c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8d34001d10 tx=0x7f8d34001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c23fff640 1 -- 172.21.15.151:0/3332435959 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d34013760 con 0x55fe1c3afac0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe1c52e9b0 con 0x55fe1c3afac0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c23fff640 1 -- 172.21.15.151:0/3332435959 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d34013900 con 0x55fe1c3afac0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c23fff640 1 -- 172.21.15.151:0/3332435959 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d34013c20 con 0x55fe1c3afac0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1c52f360 con 0x55fe1c3afac0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3e38a9c0 1 Processor -- start 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3e38a9c0 1 -- start start 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3e38a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c53b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3e38a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c34e450 con 0x55fe1c53ade0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c23fff640 1 -- 172.21.15.151:0/3332435959 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8d34010070 con 0x55fe1c3afac0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3c691640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c53b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3c691640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c53b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52218/0 (socket says 172.21.15.151:52218) 2024-09-12T16:54:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3c691640 1 -- 172.21.15.151:0/1425646407 learned_addr learned my addr 172.21.15.151:0/1425646407 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c23fff640 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c24039a70 0x7f8c2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c23fff640 1 -- 172.21.15.151:0/3332435959 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8d34018070 con 0x55fe1c3afac0 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3be90640 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c24039a70 0x7f8c2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3c691640 1 -- 172.21.15.151:0/1425646407 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1c53b7d0 con 0x55fe1c53ade0 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3be90640 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c24039a70 0x7f8c2403bf30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8d34002260 tx=0x7f8d34004b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8d3c691640 1 --2- 172.21.15.151:0/1425646407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c53b1e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00a440 tx=0x7f8d2c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e85e7fc586cac0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c21ffb640 1 -- 172.21.15.151:0/1425646407 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d2c008850 con 0x55fe1c53ade0 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c21ffb640 1 -- 172.21.15.151:0/1425646407 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c008a10 con 0x55fe1c53ade0 2024-09-12T16:54:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.659+0000 7f8c21ffb640 1 -- 172.21.15.151:0/1425646407 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d2c008d30 con 0x55fe1c53ade0 2024-09-12T16:54:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1425646407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 msgr2=0x55fe1c53b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/1425646407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c53b1e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00a440 tx=0x7f8d2c00a900 comp rx=0 tx=0).stop 2024-09-12T16:54:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1425646407 shutdown_connections 2024-09-12T16:54:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/1425646407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c53b1e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1425646407 >> 172.21.15.151:0/1425646407 conn(0x55fe1c3afff0 msgr2=0x55fe1c536820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1425646407 shutdown_connections 2024-09-12T16:54:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1425646407 wait complete. 2024-09-12T16:54:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 Processor -- start 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- start start 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c5421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c53bfc0 con 0x55fe1c53ade0 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3c691640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c5421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3c691640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c5421c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52228/0 (socket says 172.21.15.151:52228) 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3c691640 1 -- 172.21.15.151:0/924729037 learned_addr learned my addr 172.21.15.151:0/924729037 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3c691640 1 -- 172.21.15.151:0/924729037 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1c542720 con 0x55fe1c53ade0 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3c691640 1 --2- 172.21.15.151:0/924729037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c5421c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55fe1c53bce0 tx=0x7f8d2c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8c1bfff640 1 -- 172.21.15.151:0/924729037 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d2c013a70 con 0x55fe1c53ade0 2024-09-12T16:54:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/924729037 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe1c5429b0 con 0x55fe1c53ade0 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8c1bfff640 1 -- 172.21.15.151:0/924729037 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c023070 con 0x55fe1c53ade0 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8c1bfff640 1 -- 172.21.15.151:0/924729037 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d2c013d80 con 0x55fe1c53ade0 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/924729037 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1c543360 con 0x55fe1c53ade0 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8c1bfff640 1 -- 172.21.15.151:0/924729037 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8d2c028460 con 0x55fe1c53ade0 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 Processor -- start 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8c1bfff640 1 --2- 172.21.15.151:0/924729037 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c14039a70 0x7f8c1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8d3e38a9c0 1 -- start start 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.663+0000 7f8c1bfff640 1 -- 172.21.15.151:0/924729037 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8d2c050750 con 0x55fe1c53ade0 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3c691640 1 --2- 172.21.15.151:0/924729037 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c14039a70 0x7f8c1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3e38a9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c55b8d0 0x55fe1c55bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3e38a9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c527390 con 0x55fe1c55b8d0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3c691640 1 --2- 172.21.15.151:0/924729037 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c14039a70 0x7f8c1403bf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c01eca0 tx=0x7f8d2c042040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3be90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c55b8d0 0x55fe1c55bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3be90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c55b8d0 0x55fe1c55bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52240/0 (socket says 172.21.15.151:52240) 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3be90640 1 -- 172.21.15.151:0/1312988618 learned_addr learned my addr 172.21.15.151:0/1312988618 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3be90640 1 -- 172.21.15.151:0/1312988618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1c55c330 con 0x55fe1c55b8d0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3be90640 1 --2- 172.21.15.151:0/1312988618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c55b8d0 0x55fe1c55bcf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8d34028fb0 tx=0x7f8d3404e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8c00fe1640 1 -- 172.21.15.151:0/1312988618 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d34045020 con 0x55fe1c55b8d0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1312988618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe1c55cad0 con 0x55fe1c55b8d0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8c00fe1640 1 -- 172.21.15.151:0/1312988618 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d340123c0 con 0x55fe1c55b8d0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8c00fe1640 1 -- 172.21.15.151:0/1312988618 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d34012570 con 0x55fe1c55b8d0 2024-09-12T16:54:07.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1312988618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1c55d040 con 0x55fe1c55b8d0 2024-09-12T16:54:07.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8c00fe1640 1 -- 172.21.15.151:0/1312988618 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8d34048020 con 0x55fe1c55b8d0 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8c00fe1640 1 --2- 172.21.15.151:0/1312988618 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b74039a70 0x7f8b7403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8c00fe1640 1 -- 172.21.15.151:0/1312988618 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8d3404bd20 con 0x55fe1c55b8d0 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3b68f640 1 --2- 172.21.15.151:0/1312988618 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b74039a70 0x7f8b7403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8bf9ffb640 20 reqs_thread_entry: start 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55fe1c5612a0 0x55fe1c5636f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe1c563d70 con 0x55fe1c5612a0 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.667+0000 7f8d3b68f640 1 --2- 172.21.15.151:0/1312988618 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b74039a70 0x7f8b7403bf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8d300ac000 tx=0x7f8d300a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3c691640 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55fe1c5612a0 0x55fe1c5636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3c691640 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55fe1c5612a0 0x55fe1c5636f0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3c691640 1 -- 172.21.15.151:0/3332435959 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d2c01e7a0 con 0x55fe1c5612a0 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe1c564620 con 0x55fe1c5612a0 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3c691640 1 -- 172.21.15.151:0/3332435959 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d2c01e7a0 con 0x55fe1c5612a0 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fe1c5659d0 con 0x55fe1c5612a0 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3c691640 1 -- 172.21.15.151:0/3332435959 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8d2c01e7a0 con 0x55fe1c5612a0 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/924729037 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c14039a70 msgr2=0x7f8c1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/924729037 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c14039a70 0x7f8c1403bf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c01eca0 tx=0x7f8d2c042040 comp rx=0 tx=0).stop 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/924729037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 msgr2=0x55fe1c5421c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/924729037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c5421c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55fe1c53bce0 tx=0x7f8d2c003000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/924729037 shutdown_connections 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/924729037 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c14039a70 0x7f8c1403bf30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/924729037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c53ade0 0x55fe1c5421c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/924729037 >> 172.21.15.151:0/924729037 conn(0x55fe1c3afff0 msgr2=0x55fe1c536310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/924729037 shutdown_connections 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/924729037 wait complete. 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1312988618 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b74039a70 msgr2=0x7f8b7403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/1312988618 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b74039a70 0x7f8b7403bf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8d300ac000 tx=0x7f8d300a5000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1312988618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c55b8d0 msgr2=0x55fe1c55bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/1312988618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c55b8d0 0x55fe1c55bcf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8d34028fb0 tx=0x7f8d3404e8c0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1312988618 shutdown_connections 2024-09-12T16:54:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/1312988618 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b74039a70 0x7f8b7403bf30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/1312988618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c55b8d0 0x55fe1c55bcf0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1312988618 >> 172.21.15.151:0/1312988618 conn(0x55fe1c550ed0 msgr2=0x55fe1c5512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1312988618 shutdown_connections 2024-09-12T16:54:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/1312988618 wait complete. 2024-09-12T16:54:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55fe1c5612a0 msgr2=0x55fe1c5636f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55fe1c5612a0 0x55fe1c5636f0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c24039a70 msgr2=0x7f8c2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c24039a70 0x7f8c2403bf30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8d34002260 tx=0x7f8d34004b80 comp rx=0 tx=0).stop 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 msgr2=0x55fe1c52e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c52e1c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8d34001d10 tx=0x7f8d34001260 comp rx=0 tx=0).stop 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 shutdown_connections 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55fe1c5612a0 0x55fe1c5636f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8c24039a70 0x7f8c2403bf30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 --2- 172.21.15.151:0/3332435959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1c3afac0 0x55fe1c52e1c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 >> 172.21.15.151:0/3332435959 conn(0x55fe1c434aa0 msgr2=0x55fe1c521290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 shutdown_connections 2024-09-12T16:54:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.671+0000 7f8d3e38a9c0 1 -- 172.21.15.151:0/3332435959 wait complete. 2024-09-12T16:54:07.688 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"2480af9e-559e-4103-b02c-bfde6a0f7fec","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87","zones":[{"id":"1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-12T16:54:07.689 DEBUG:tasks.util.rgw: json result: {'id': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87', 'zones': [{'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-12T16:54:07.692 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-12T16:54:07.783 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-12T16:54:07.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-12T16:54:07.784 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-12T16:54:07.834 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:07.834 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f35735779c0 1 Processor -- start 2024-09-12T16:54:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f35735779c0 1 -- start start 2024-09-12T16:54:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f35735779c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x561a6e525200 0x561a6e5255e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f35735779c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a6e4639c0 con 0x561a6e523bf0 2024-09-12T16:54:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f35735779c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x561a6e4b36d0 con 0x561a6e525200 2024-09-12T16:54:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f357107d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x561a6e525200 0x561a6e5255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f357107d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x561a6e525200 0x561a6e5255e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52246/0 (socket says 172.21.15.151:52246) 2024-09-12T16:54:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f357107d640 1 -- 172.21.15.151:0/2079173975 learned_addr learned my addr 172.21.15.151:0/2079173975 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f357107d640 1 -- 172.21.15.151:0/2079173975 >> v1:172.21.15.122:6789/0 conn(0x561a6e523bf0 legacy=0x561a6e524000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f357107d640 1 -- 172.21.15.151:0/2079173975 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6e457ca0 con 0x561a6e525200 2024-09-12T16:54:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.831+0000 7f357107d640 1 --2- 172.21.15.151:0/2079173975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e525200 0x561a6e5255e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f356c00a4e0 tx=0x7f356c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f72a1489fafe95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f3563fff640 1 -- 172.21.15.151:0/2079173975 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0aa540 con 0x561a6e525200 2024-09-12T16:54:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f3563fff640 1 -- 172.21.15.151:0/2079173975 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c0aa6e0 con 0x561a6e525200 2024-09-12T16:54:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f3563fff640 1 -- 172.21.15.151:0/2079173975 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0aaa40 con 0x561a6e525200 2024-09-12T16:54:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f35735779c0 1 -- 172.21.15.151:0/2079173975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e525200 msgr2=0x561a6e5255e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f35735779c0 1 --2- 172.21.15.151:0/2079173975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e525200 0x561a6e5255e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f356c00a4e0 tx=0x7f356c01b090 comp rx=0 tx=0).stop 2024-09-12T16:54:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f35735779c0 1 -- 172.21.15.151:0/2079173975 shutdown_connections 2024-09-12T16:54:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f35735779c0 1 --2- 172.21.15.151:0/2079173975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e525200 0x561a6e5255e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f35735779c0 1 -- 172.21.15.151:0/2079173975 >> 172.21.15.151:0/2079173975 conn(0x561a6e5aaa20 msgr2=0x561a6e5ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f35735779c0 1 -- 172.21.15.151:0/2079173975 shutdown_connections 2024-09-12T16:54:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.835+0000 7f35735779c0 1 -- 172.21.15.151:0/2079173975 wait complete. 2024-09-12T16:54:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.847+0000 7f35735779c0 1 Processor -- start 2024-09-12T16:54:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.847+0000 7f35735779c0 1 -- start start 2024-09-12T16:54:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e69cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561a6e4b7680 con 0x561a6e523bf0 2024-09-12T16:54:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e69cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e69cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52260/0 (socket says 172.21.15.151:52260) 2024-09-12T16:54:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 -- 172.21.15.151:0/1649680450 learned_addr learned my addr 172.21.15.151:0/1649680450 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 -- 172.21.15.151:0/1649680450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6e432da0 con 0x561a6e523bf0 2024-09-12T16:54:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 --2- 172.21.15.151:0/1649680450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e69cc90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f356c018cc0 tx=0x7f356c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebb11eadc413fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f345f606640 1 -- 172.21.15.151:0/1649680450 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0b9070 con 0x561a6e523bf0 2024-09-12T16:54:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f345f606640 1 -- 172.21.15.151:0/1649680450 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c0aaa80 con 0x561a6e523bf0 2024-09-12T16:54:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f345f606640 1 -- 172.21.15.151:0/1649680450 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0aad60 con 0x561a6e523bf0 2024-09-12T16:54:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 -- 172.21.15.151:0/1649680450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 msgr2=0x561a6e69cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 --2- 172.21.15.151:0/1649680450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e69cc90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f356c018cc0 tx=0x7f356c0033b0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 -- 172.21.15.151:0/1649680450 shutdown_connections 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 --2- 172.21.15.151:0/1649680450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e69cc90 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 -- 172.21.15.151:0/1649680450 >> 172.21.15.151:0/1649680450 conn(0x561a6e5aaa20 msgr2=0x561a6e6988d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 -- 172.21.15.151:0/1649680450 shutdown_connections 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 -- 172.21.15.151:0/1649680450 wait complete. 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 Processor -- start 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 -- start start 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e6a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f35735779c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561a6e459a50 con 0x561a6e523bf0 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e6a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e6a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52266/0 (socket says 172.21.15.151:52266) 2024-09-12T16:54:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 -- 172.21.15.151:0/778726732 learned_addr learned my addr 172.21.15.151:0/778726732 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.851+0000 7f357107d640 1 -- 172.21.15.151:0/778726732 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6e6a4780 con 0x561a6e523bf0 2024-09-12T16:54:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f357107d640 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e6a4220 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f356c018cc0 tx=0x7f356c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f345de03640 1 -- 172.21.15.151:0/778726732 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0b9070 con 0x561a6e523bf0 2024-09-12T16:54:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a6e6a4a10 con 0x561a6e523bf0 2024-09-12T16:54:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f345de03640 1 -- 172.21.15.151:0/778726732 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c0b5840 con 0x561a6e523bf0 2024-09-12T16:54:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f345de03640 1 -- 172.21.15.151:0/778726732 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0b5b20 con 0x561a6e523bf0 2024-09-12T16:54:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6e6a53c0 con 0x561a6e523bf0 2024-09-12T16:54:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f345de03640 1 -- 172.21.15.151:0/778726732 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f356c0b3040 con 0x561a6e523bf0 2024-09-12T16:54:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f345de03640 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3458039a70 0x7f345803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f345de03640 1 -- 172.21.15.151:0/778726732 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f356c0c4070 con 0x561a6e523bf0 2024-09-12T16:54:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f357087c640 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3458039a70 0x7f345803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e525200 0x561a6e6ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ab8d0 con 0x561a6e525200 2024-09-12T16:54:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f357187e640 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e525200 0x561a6e6ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f357087c640 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3458039a70 0x7f345803bf30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3568001ec0 tx=0x7f3568001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f357187e640 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e525200 0x561a6e6ab390 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f357187e640 1 -- 172.21.15.151:0/778726732 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35640083f0 con 0x561a6e525200 2024-09-12T16:54:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ac120 con 0x561a6e525200 2024-09-12T16:54:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f357187e640 1 -- 172.21.15.151:0/778726732 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35640083f0 con 0x561a6e525200 2024-09-12T16:54:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6ada70 0x561a6e6aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6b0690 con 0x561a6e6ada70 2024-09-12T16:54:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.855+0000 7f357107d640 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6ada70 0x561a6e6aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357107d640 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6ada70 0x561a6e6aff00 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357107d640 1 -- 172.21.15.151:0/778726732 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6ada70 2024-09-12T16:54:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ac970 con 0x561a6e525200 2024-09-12T16:54:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357187e640 1 -- 172.21.15.151:0/778726732 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35640083f0 con 0x561a6e525200 2024-09-12T16:54:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6acd10 con 0x561a6e525200 2024-09-12T16:54:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357187e640 1 -- 172.21.15.151:0/778726732 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f35640083f0 con 0x561a6e525200 2024-09-12T16:54:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f35735779c0 1 Processor -- start 2024-09-12T16:54:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f35735779c0 1 -- start start 2024-09-12T16:54:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f35735779c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6bed20 0x561a6e6bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f35735779c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561a6e4c4450 con 0x561a6e6bed20 2024-09-12T16:54:07.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357187e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6bed20 0x561a6e6bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357187e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6bed20 0x561a6e6bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52272/0 (socket says 172.21.15.151:52272) 2024-09-12T16:54:07.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357187e640 1 -- 172.21.15.151:0/2380152688 learned_addr learned my addr 172.21.15.151:0/2380152688 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357187e640 1 -- 172.21.15.151:0/2380152688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6e6bf780 con 0x561a6e6bed20 2024-09-12T16:54:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f357187e640 1 --2- 172.21.15.151:0/2380152688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6bed20 0x561a6e6bf140 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x561a6e6a55b0 tx=0x7f356400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f3456ffd640 1 -- 172.21.15.151:0/2380152688 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3564007d70 con 0x561a6e6bed20 2024-09-12T16:54:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f35735779c0 1 -- 172.21.15.151:0/2380152688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a6e6bffe0 con 0x561a6e6bed20 2024-09-12T16:54:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.859+0000 7f3456ffd640 1 -- 172.21.15.151:0/2380152688 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356401e020 con 0x561a6e6bed20 2024-09-12T16:54:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f35735779c0 1 -- 172.21.15.151:0/2380152688 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6e6c0550 con 0x561a6e6bed20 2024-09-12T16:54:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f3456ffd640 1 -- 172.21.15.151:0/2380152688 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3564019550 con 0x561a6e6bed20 2024-09-12T16:54:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f3456ffd640 1 -- 172.21.15.151:0/2380152688 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3564016040 con 0x561a6e6bed20 2024-09-12T16:54:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f3456ffd640 1 --2- 172.21.15.151:0/2380152688 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3448039a70 0x7f344803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f3456ffd640 1 -- 172.21.15.151:0/2380152688 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f356401f030 con 0x561a6e6bed20 2024-09-12T16:54:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f357107d640 1 --2- 172.21.15.151:0/2380152688 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3448039a70 0x7f344803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f35735779c0 1 Processor -- start 2024-09-12T16:54:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f35735779c0 1 -- start start 2024-09-12T16:54:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f357107d640 1 --2- 172.21.15.151:0/2380152688 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3448039a70 0x7f344803bf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561a6e6a58e0 tx=0x7f356c0a4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f35735779c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f35735779c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561a6e69d420 con 0x561a6e6cc6b0 2024-09-12T16:54:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f357187e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f357187e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52274/0 (socket says 172.21.15.151:52274) 2024-09-12T16:54:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f357187e640 1 -- 172.21.15.151:0/3007287011 learned_addr learned my addr 172.21.15.151:0/3007287011 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f357187e640 1 -- 172.21.15.151:0/3007287011 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6e6cd080 con 0x561a6e6cc6b0 2024-09-12T16:54:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f357187e640 1 --2- 172.21.15.151:0/3007287011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6ccab0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3564022fd0 tx=0x7f3564014b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e569cfcf791eef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f3454ff9640 1 -- 172.21.15.151:0/3007287011 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356401d040 con 0x561a6e6cc6b0 2024-09-12T16:54:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f3454ff9640 1 -- 172.21.15.151:0/3007287011 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3564015e40 con 0x561a6e6cc6b0 2024-09-12T16:54:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.863+0000 7f3454ff9640 1 -- 172.21.15.151:0/3007287011 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3564043210 con 0x561a6e6cc6b0 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- 172.21.15.151:0/3007287011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 msgr2=0x561a6e6ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 --2- 172.21.15.151:0/3007287011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6ccab0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3564022fd0 tx=0x7f3564014b40 comp rx=0 tx=0).stop 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- 172.21.15.151:0/3007287011 shutdown_connections 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 --2- 172.21.15.151:0/3007287011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6ccab0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- 172.21.15.151:0/3007287011 >> 172.21.15.151:0/3007287011 conn(0x561a6e6c7ad0 msgr2=0x561a6e6c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- 172.21.15.151:0/3007287011 shutdown_connections 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- 172.21.15.151:0/3007287011 wait complete. 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 Processor -- start 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- start start 2024-09-12T16:54:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561a6e6cb600 con 0x561a6e6cc6b0 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f357187e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f357187e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6d2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52290/0 (socket says 172.21.15.151:52290) 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 learned_addr learned my addr 172.21.15.151:0/2938579672 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6e6d3020 con 0x561a6e6cc6b0 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f357187e640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6d2ac0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3564014b80 tx=0x7f3564050530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f3446ffd640 1 -- 172.21.15.151:0/2938579672 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3564030070 con 0x561a6e6cc6b0 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f3446ffd640 1 -- 172.21.15.151:0/2938579672 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3564015e40 con 0x561a6e6cc6b0 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a6e6d32b0 con 0x561a6e6cc6b0 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f3446ffd640 1 -- 172.21.15.151:0/2938579672 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356401d040 con 0x561a6e6cc6b0 2024-09-12T16:54:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6e6d3c60 con 0x561a6e6cc6b0 2024-09-12T16:54:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f3446ffd640 1 -- 172.21.15.151:0/2938579672 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3564033070 con 0x561a6e6cc6b0 2024-09-12T16:54:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.867+0000 7f3446ffd640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f343c0399d0 0x7f343c03be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f3446ffd640 1 -- 172.21.15.151:0/2938579672 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3564036d70 con 0x561a6e6cc6b0 2024-09-12T16:54:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357107d640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f343c0399d0 0x7f343c03be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e6dddc0 0x561a6e6e0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e09d0 con 0x561a6e6dddc0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357087c640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e6dddc0 0x561a6e6e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357107d640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f343c0399d0 0x7f343c03be90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f356c0e8d90 tx=0x7f356c0e3000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357087c640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e6dddc0 0x561a6e6e0280 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f356800d040 con 0x561a6e6dddc0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 realm 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6dd1a0 con 0x561a6e6dddc0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f356800d040 con 0x561a6e6dddc0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e14d0 con 0x561a6e6dddc0 2024-09-12T16:54:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f356800d040 con 0x561a6e6dddc0 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e1da0 con 0x561a6e6dddc0 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f356800d040 con 0x561a6e6dddc0 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6e27c0 0x561a6e6e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e5320 con 0x561a6e6e27c0 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357187e640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6e27c0 0x561a6e6e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357187e640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6e27c0 0x561a6e6e4bb0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:07.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 20 searching for the correct realm 2024-09-12T16:54:07.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561a6e6e7270 0x561a6e6e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.871+0000 7f357107d640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561a6e6e7270 0x561a6e6e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357107d640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561a6e6e7270 0x561a6e6e96a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357107d640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f356c0bd400 0x7f356c0e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x7f356c0bd400 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357087c640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f356c0bd400 0x7f356c0e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357087c640 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f356c0bd400 0x7f356c0e7420 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356800d040 con 0x7f356c0bd400 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6dddc0 2024-09-12T16:54:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356800d040 con 0x561a6e6dddc0 2024-09-12T16:54:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6dddc0 2024-09-12T16:54:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.875+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x7f356c0bd400 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6dddc0 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6dddc0 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x7f356c0bd400 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.879+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6dddc0 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6dddc0 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x7f356c0bd400 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6dddc0 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.883+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x7f356c0bd400 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e7270 2024-09-12T16:54:07.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6e27c0 2024-09-12T16:54:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x561a6e6dddc0 2024-09-12T16:54:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e9d20 con 0x7f356c0bd400 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e5ce0 con 0x561a6e6dddc0 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e5920 con 0x561a6e6dddc0 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e6600 con 0x561a6e6dddc0 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 zone default found 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 4 Realm: () 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 zonegroup default 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6e6600 con 0x561a6e6e27c0 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ec0c0 con 0x561a6e6e7270 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.887+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ec460 con 0x561a6e6e7270 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f35735779c0 20 started sync module instance, tier type = 2024-09-12T16:54:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f35735779c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6eb550 con 0x7f356c0bd400 2024-09-12T16:54:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94671521888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6eb550 con 0x7f356c0bd400 2024-09-12T16:54:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ecf50 con 0x561a6e6dddc0 2024-09-12T16:54:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94671521888848] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94671521892960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6eb550 con 0x561a6e6dddc0 2024-09-12T16:54:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.891+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ed960 con 0x561a6e6e7270 2024-09-12T16:54:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.895+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94671521892960] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.895+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.895+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94671521886368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6eb4c0 con 0x561a6e6e7270 2024-09-12T16:54:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.895+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ee6b0 con 0x7f356c0bd400 2024-09-12T16:54:07.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.895+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.895+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94671521899344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6eef50 con 0x7f356c0bd400 2024-09-12T16:54:07.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.895+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ef950 con 0x561a6e6dddc0 2024-09-12T16:54:07.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.899+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94671521886368] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.899+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94671521899344] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.899+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.899+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94671521897808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6eea50 con 0x561a6e6dddc0 2024-09-12T16:54:07.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.899+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6f01f0 con 0x561a6e6e27c0 2024-09-12T16:54:07.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.899+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94671521897808] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.903+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.903+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94671521905984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6eea50 con 0x561a6e6e27c0 2024-09-12T16:54:07.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.903+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6f0a40 con 0x561a6e6e27c0 2024-09-12T16:54:07.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.903+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.903+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94671521905984] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.903+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94671521908112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6f0ea0 con 0x561a6e6e27c0 2024-09-12T16:54:07.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.903+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6ef480 con 0x561a6e6e27c0 2024-09-12T16:54:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94671521908112] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94671521909168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6f0dd0 con 0x561a6e6e27c0 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 20 add_watcher() i=0 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 20 add_watcher() i=1 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 20 add_watcher() i=2 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 20 add_watcher() i=3 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 20 add_watcher() i=4 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 20 add_watcher() i=5 2024-09-12T16:54:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 20 add_watcher() i=6 2024-09-12T16:54:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94671521909168] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 20 add_watcher() i=7 2024-09-12T16:54:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6f4970 con 0x561a6e6dddc0 2024-09-12T16:54:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.907+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94671521911952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e6f1e00 con 0x561a6e6dddc0 2024-09-12T16:54:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94671521911952] v34'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f34277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 5 note: GC not initialized 2024-09-12T16:54:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f34267e4640 20 reqs_thread_entry: start 2024-09-12T16:54:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 20 Filter name: none 2024-09-12T16:54:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f3397fff640 20 reqs_thread_entry: start 2024-09-12T16:54:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e717b60 con 0x561a6e6e27c0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e716200 con 0x561a6e6dddc0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-12T16:54:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T16:54:07.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-12T16:54:07.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-12T16:54:07.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.911+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e716bc0 con 0x561a6e6e27c0 2024-09-12T16:54:07.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:07.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:07.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:07.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94671522063904 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e716d80 con 0x561a6e6dddc0 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== watch-notify(notify (1) cookie 94671521897808 notify 146028888109 ret 0) ==== 691+0+0 (crc 0 0 0) 0x561a6e4639c0 con 0x561a6e6dddc0 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f3454ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888109 cookie 94671521897808 notifier 4830 bl.length()=649 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify cookie 94671522063904 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f3454ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f3454ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f3454ff9640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3434003eb0 con 0x561a6e6dddc0 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 94671522063904 notify 146028888109 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f356803d930 con 0x561a6e6dddc0 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e716620 con 0x561a6e6dddc0 2024-09-12T16:54:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-12T16:54:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T16:54:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-12T16:54:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94671522063904 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a6e71a790 con 0x561a6e6e7270 2024-09-12T16:54:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== watch-notify(notify (1) cookie 94671521886368 notify 146028888072 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f356c100040 con 0x561a6e6e7270 2024-09-12T16:54:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f3454ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94671521886368 notifier 4830 bl.length()=177 2024-09-12T16:54:07.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f3454ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-12T16:54:07.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f3454ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T16:54:07.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(68 notify.2 [notify cookie 94671522063904 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f3454ff9640 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3434003eb0 con 0x561a6e6e7270 2024-09-12T16:54:07.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.915+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== watch-notify(notify_complete (2) cookie 94671522063904 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a6e6a53c0 con 0x561a6e6e7270 2024-09-12T16:54:07.924 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:07.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.919+0000 7f34277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:07.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.919+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94671521911952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x561a6e6dddc0 2024-09-12T16:54:07.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.919+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94671521911952] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.919+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94671521888848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x7f356c0bd400 2024-09-12T16:54:07.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.919+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94671521888848] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.919+0000 7f35735779c0 20 remove_watcher() i=0 2024-09-12T16:54:07.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.919+0000 7f35735779c0 2 removed watcher, disabling cache 2024-09-12T16:54:07.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.919+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94671521892960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x561a6e6dddc0 2024-09-12T16:54:07.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.923+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94671521892960] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.923+0000 7f35735779c0 20 remove_watcher() i=1 2024-09-12T16:54:07.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.923+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94671521886368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x561a6e6e7270 2024-09-12T16:54:07.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.923+0000 7f357107d640 1 -- 172.21.15.151:0/2938579672 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94671521886368] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356c0cd060 con 0x561a6e6e7270 2024-09-12T16:54:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.923+0000 7f35735779c0 20 remove_watcher() i=2 2024-09-12T16:54:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.923+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94671521899344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x7f356c0bd400 2024-09-12T16:54:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.927+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94671521899344] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x7f356c0bd400 2024-09-12T16:54:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.927+0000 7f35735779c0 20 remove_watcher() i=3 2024-09-12T16:54:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.927+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94671521897808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x561a6e6dddc0 2024-09-12T16:54:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.927+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94671521897808] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802a040 con 0x561a6e6dddc0 2024-09-12T16:54:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.927+0000 7f35735779c0 20 remove_watcher() i=4 2024-09-12T16:54:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.927+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94671521905984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x561a6e6e27c0 2024-09-12T16:54:07.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.931+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94671521905984] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.931+0000 7f35735779c0 20 remove_watcher() i=5 2024-09-12T16:54:07.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.931+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94671521908112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x561a6e6e27c0 2024-09-12T16:54:07.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.931+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94671521908112] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.931+0000 7f35735779c0 20 remove_watcher() i=6 2024-09-12T16:54:07.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.931+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94671521909168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a6e7158e0 con 0x561a6e6e27c0 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f357187e640 1 -- 172.21.15.151:0/2938579672 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94671521909168] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3564032030 con 0x561a6e6e27c0 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 20 remove_watcher() i=7 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6e27c0 msgr2=0x561a6e6e4bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6e27c0 0x561a6e6e4bb0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e6dddc0 msgr2=0x561a6e6e0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e6dddc0 0x561a6e6e0280 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f356c0bd400 msgr2=0x7f356c0e7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f356c0bd400 0x7f356c0e7420 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561a6e6e7270 msgr2=0x561a6e6e96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x561a6e6e7270 0x561a6e6e96a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f343c0399d0 msgr2=0x7f343c03be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f343c0399d0 0x7f343c03be90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f356c0e8d90 tx=0x7f356c0e3000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 msgr2=0x561a6e6d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f357087c640 1 -- 172.21.15.151:0/2938579672 reap_dead start 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6d2ac0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3564014b80 tx=0x7f3564050530 comp rx=0 tx=0).stop 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 shutdown_connections 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2938579672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6cc6b0 0x561a6e6d2ac0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 >> 172.21.15.151:0/2938579672 conn(0x561a6e6c7ad0 msgr2=0x561a6e6c5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 shutdown_connections 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2938579672 wait complete. 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2380152688 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3448039a70 msgr2=0x7f344803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2380152688 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3448039a70 0x7f344803bf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561a6e6a58e0 tx=0x7f356c0a4000 comp rx=0 tx=0).stop 2024-09-12T16:54:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2380152688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6bed20 msgr2=0x561a6e6bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2380152688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6bed20 0x561a6e6bf140 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x561a6e6a55b0 tx=0x7f356400af40 comp rx=0 tx=0).stop 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2380152688 shutdown_connections 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2380152688 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3448039a70 0x7f344803bf30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/2380152688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e6bed20 0x561a6e6bf140 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2380152688 >> 172.21.15.151:0/2380152688 conn(0x561a6e6b46d0 msgr2=0x561a6e6b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2380152688 shutdown_connections 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/2380152688 wait complete. 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6ada70 msgr2=0x561a6e6aff00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6ada70 0x561a6e6aff00 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e525200 msgr2=0x561a6e6ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.935+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e525200 0x561a6e6ab390 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3458039a70 msgr2=0x7f345803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3458039a70 0x7f345803bf30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3568001ec0 tx=0x7f3568001440 comp rx=0 tx=0).stop 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 msgr2=0x561a6e6a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e6a4220 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f356c018cc0 tx=0x7f356c017e30 comp rx=0 tx=0).stop 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 shutdown_connections 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x561a6e6ada70 0x561a6e6aff00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x561a6e525200 0x561a6e6ab390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f3458039a70 0x7f345803bf30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 --2- 172.21.15.151:0/778726732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561a6e523bf0 0x561a6e6a4220 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 >> 172.21.15.151:0/778726732 conn(0x561a6e5aaa20 msgr2=0x561a6e697360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 shutdown_connections 2024-09-12T16:54:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:07.939+0000 7f35735779c0 1 -- 172.21.15.151:0/778726732 wait complete. 2024-09-12T16:54:07.953 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:07.954 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:07.954 ERROR:root:0 2024-09-12T16:54:07.955 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:07.962 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000091624116cdb7f651-0066e31caf-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:54:07.962 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-12T16:54:07.977 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:07.978 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-12T16:54:07.996 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-12T16:54:07.997 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-12T16:54:08.023 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-12T16:54:08.024 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-12T16:54:08.038 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-12T16:54:08.039 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:08.043 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:08.043 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-12T16:54:08.047 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:08.048 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T16:54:08.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T16:54:08.048 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-12T16:54:08.090 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:08.090 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:08.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74d0059c0 1 Processor -- start 2024-09-12T16:54:08.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74d0059c0 1 -- start start 2024-09-12T16:54:08.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74d0059c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x557b268481f0 0x557b268d9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74d0059c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b267889c0 con 0x557b268485d0 2024-09-12T16:54:08.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74d0059c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x557b267d86d0 con 0x557b268481f0 2024-09-12T16:54:08.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74ab0b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x557b268481f0 0x557b268d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74a30a640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x557b268485d0 0x557b268db570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49212/0 (socket says 172.21.15.151:49212) 2024-09-12T16:54:08.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74ab0b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x557b268481f0 0x557b268d9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52306/0 (socket says 172.21.15.151:52306) 2024-09-12T16:54:08.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74a30a640 1 -- 172.21.15.151:0/105296647 learned_addr learned my addr 172.21.15.151:0/105296647 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:08.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74ab0b640 1 -- 172.21.15.151:0/105296647 >> v1:172.21.15.122:6789/0 conn(0x557b268485d0 legacy=0x557b268db570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa749b09640 1 -- 172.21.15.151:0/105296647 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550823420 0 0) 0x557b267889c0 con 0x557b268485d0 2024-09-12T16:54:08.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.087+0000 7fa74ab0b640 1 -- 172.21.15.151:0/105296647 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2677cca0 con 0x557b268481f0 2024-09-12T16:54:08.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/105296647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b268d9020 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00a420 tx=0x7fa73c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb9bbb52cc0f3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa749b09640 1 -- 172.21.15.151:0/105296647 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73c0af070 con 0x557b268481f0 2024-09-12T16:54:08.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa749b09640 1 -- 172.21.15.151:0/105296647 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c0aa530 con 0x557b268481f0 2024-09-12T16:54:08.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa749b09640 1 -- 172.21.15.151:0/105296647 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73c0aa810 con 0x557b268481f0 2024-09-12T16:54:08.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa74d0059c0 1 -- 172.21.15.151:0/105296647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 msgr2=0x557b268d9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/105296647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b268d9020 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00a420 tx=0x7fa73c01afd0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa74d0059c0 1 -- 172.21.15.151:0/105296647 shutdown_connections 2024-09-12T16:54:08.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/105296647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b268d9020 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa74d0059c0 1 -- 172.21.15.151:0/105296647 >> 172.21.15.151:0/105296647 conn(0x557b268ce910 msgr2=0x557b268d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa74d0059c0 1 -- 172.21.15.151:0/105296647 shutdown_connections 2024-09-12T16:54:08.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.091+0000 7fa74d0059c0 1 -- 172.21.15.151:0/105296647 wait complete. 2024-09-12T16:54:08.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74d0059c0 1 Processor -- start 2024-09-12T16:54:08.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74d0059c0 1 -- start start 2024-09-12T16:54:08.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74d0059c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74d0059c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b267dc680 con 0x557b268481f0 2024-09-12T16:54:08.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74ab0b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74ab0b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52316/0 (socket says 172.21.15.151:52316) 2024-09-12T16:54:08.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74ab0b640 1 -- 172.21.15.151:0/2323671335 learned_addr learned my addr 172.21.15.151:0/2323671335 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74ab0b640 1 -- 172.21.15.151:0/2323671335 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b26757da0 con 0x557b268481f0 2024-09-12T16:54:08.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/2323671335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c1750 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ad040 tx=0x7fa73c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34676db3130907cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa637e17640 1 -- 172.21.15.151:0/2323671335 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73c0af050 con 0x557b268481f0 2024-09-12T16:54:08.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa637e17640 1 -- 172.21.15.151:0/2323671335 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c0b0040 con 0x557b268481f0 2024-09-12T16:54:08.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.107+0000 7fa637e17640 1 -- 172.21.15.151:0/2323671335 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73c0aaad0 con 0x557b268481f0 2024-09-12T16:54:08.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2323671335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 msgr2=0x557b269c1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2323671335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c1750 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ad040 tx=0x7fa73c0033b0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2323671335 shutdown_connections 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2323671335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c1750 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2323671335 >> 172.21.15.151:0/2323671335 conn(0x557b268ce910 msgr2=0x557b269bd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2323671335 shutdown_connections 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2323671335 wait complete. 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 Processor -- start 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- start start 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b2677ea50 con 0x557b268481f0 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74ab0b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74ab0b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52328/0 (socket says 172.21.15.151:52328) 2024-09-12T16:54:08.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74ab0b640 1 -- 172.21.15.151:0/2533093295 learned_addr learned my addr 172.21.15.151:0/2533093295 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74ab0b640 1 -- 172.21.15.151:0/2533093295 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b269c9250 con 0x557b268481f0 2024-09-12T16:54:08.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c8cf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0aa500 tx=0x7fa73c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa636614640 1 -- 172.21.15.151:0/2533093295 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73c0b6c40 con 0x557b268481f0 2024-09-12T16:54:08.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b269c94e0 con 0x557b268481f0 2024-09-12T16:54:08.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa636614640 1 -- 172.21.15.151:0/2533093295 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c0b6de0 con 0x557b268481f0 2024-09-12T16:54:08.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa636614640 1 -- 172.21.15.151:0/2533093295 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73c0cd060 con 0x557b268481f0 2024-09-12T16:54:08.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.111+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b269c9e90 con 0x557b268481f0 2024-09-12T16:54:08.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa636614640 1 -- 172.21.15.151:0/2533093295 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa73c0bf590 con 0x557b268481f0 2024-09-12T16:54:08.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa636614640 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa630039a70 0x7fa63003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa636614640 1 -- 172.21.15.151:0/2533093295 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa73c0bb070 con 0x557b268481f0 2024-09-12T16:54:08.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74a30a640 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa630039a70 0x7fa63003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b268485d0 0x557b269cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b269d03a0 con 0x557b268485d0 2024-09-12T16:54:08.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74b30c640 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b268485d0 0x557b269cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74a30a640 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa630039a70 0x7fa63003bf30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa744000c10 tx=0x7fa7440013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74b30c640 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b268485d0 0x557b269cfe60 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74b30c640 1 -- 172.21.15.151:0/2533093295 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7340083f0 con 0x557b268485d0 2024-09-12T16:54:08.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b269d0740 con 0x557b268485d0 2024-09-12T16:54:08.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74b30c640 1 -- 172.21.15.151:0/2533093295 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7340083f0 con 0x557b268485d0 2024-09-12T16:54:08.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b269d2530 0x557b269d4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b269d4ff0 con 0x557b269d2530 2024-09-12T16:54:08.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b269d2530 0x557b269d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.115+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b269d2530 0x557b269d4920 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74ab0b640 1 -- 172.21.15.151:0/2533093295 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b269d2530 2024-09-12T16:54:08.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b269d13d0 con 0x557b268485d0 2024-09-12T16:54:08.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74b30c640 1 -- 172.21.15.151:0/2533093295 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7340083f0 con 0x557b268485d0 2024-09-12T16:54:08.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b269d1850 con 0x557b268485d0 2024-09-12T16:54:08.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74b30c640 1 -- 172.21.15.151:0/2533093295 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7340083f0 con 0x557b268485d0 2024-09-12T16:54:08.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74d0059c0 1 Processor -- start 2024-09-12T16:54:08.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74d0059c0 1 -- start start 2024-09-12T16:54:08.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74d0059c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269e3640 0x557b269e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74d0059c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b267e9450 con 0x557b269e3640 2024-09-12T16:54:08.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74b30c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269e3640 0x557b269e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74b30c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269e3640 0x557b269e3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52334/0 (socket says 172.21.15.151:52334) 2024-09-12T16:54:08.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74b30c640 1 -- 172.21.15.151:0/1589307210 learned_addr learned my addr 172.21.15.151:0/1589307210 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74b30c640 1 -- 172.21.15.151:0/1589307210 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b269e40a0 con 0x557b269e3640 2024-09-12T16:54:08.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74b30c640 1 --2- 172.21.15.151:0/1589307210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269e3640 0x557b269e3a60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x557b269cad60 tx=0x7fa73400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa62f7fe640 1 -- 172.21.15.151:0/1589307210 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa734007e00 con 0x557b269e3640 2024-09-12T16:54:08.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa62f7fe640 1 -- 172.21.15.151:0/1589307210 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73401e020 con 0x557b269e3640 2024-09-12T16:54:08.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa62f7fe640 1 -- 172.21.15.151:0/1589307210 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa734019590 con 0x557b269e3640 2024-09-12T16:54:08.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1589307210 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b269e4900 con 0x557b269e3640 2024-09-12T16:54:08.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.119+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1589307210 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b269e4e70 con 0x557b269e3640 2024-09-12T16:54:08.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa62f7fe640 1 -- 172.21.15.151:0/1589307210 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa734016040 con 0x557b269e3640 2024-09-12T16:54:08.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa62f7fe640 1 --2- 172.21.15.151:0/1589307210 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa624039ac0 0x7fa62403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa62f7fe640 1 -- 172.21.15.151:0/1589307210 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa73401f030 con 0x557b269e3640 2024-09-12T16:54:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/1589307210 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa624039ac0 0x7fa62403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 Processor -- start 2024-09-12T16:54:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 -- start start 2024-09-12T16:54:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/1589307210 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa624039ac0 0x7fa62403bf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x557b269ca180 tx=0x7fa73c0c7f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b269c1ee0 con 0x557b269eff80 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74b30c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74b30c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52338/0 (socket says 172.21.15.151:52338) 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74b30c640 1 -- 172.21.15.151:0/1505198618 learned_addr learned my addr 172.21.15.151:0/1505198618 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74b30c640 1 -- 172.21.15.151:0/1505198618 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b269f0950 con 0x557b269eff80 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74b30c640 1 --2- 172.21.15.151:0/1505198618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f0360 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa734050970 tx=0x7fa734019b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14556a47964a033 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa62d7fa640 1 -- 172.21.15.151:0/1505198618 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73401d040 con 0x557b269eff80 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa62d7fa640 1 -- 172.21.15.151:0/1505198618 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa734019c50 con 0x557b269eff80 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa62d7fa640 1 -- 172.21.15.151:0/1505198618 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa734022cc0 con 0x557b269eff80 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1505198618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 msgr2=0x557b269f0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/1505198618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f0360 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa734050970 tx=0x7fa734019b00 comp rx=0 tx=0).stop 2024-09-12T16:54:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1505198618 shutdown_connections 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/1505198618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f0360 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1505198618 >> 172.21.15.151:0/1505198618 conn(0x557b269ec3b0 msgr2=0x557b269ea5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1505198618 shutdown_connections 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1505198618 wait complete. 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 Processor -- start 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.123+0000 7fa74d0059c0 1 -- start start 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74d0059c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74d0059c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b269f0f90 con 0x557b269eff80 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74b30c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74b30c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52346/0 (socket says 172.21.15.151:52346) 2024-09-12T16:54:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 learned_addr learned my addr 172.21.15.151:0/3734698148 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b269f79d0 con 0x557b269eff80 2024-09-12T16:54:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74b30c640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f7470 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa734017e00 tx=0x7fa734050900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa61b7fe640 1 -- 172.21.15.151:0/3734698148 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73401d070 con 0x557b269eff80 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b269f7c60 con 0x557b269eff80 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa61b7fe640 1 -- 172.21.15.151:0/3734698148 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa734031030 con 0x557b269eff80 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa61b7fe640 1 -- 172.21.15.151:0/3734698148 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa734048040 con 0x557b269eff80 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b269f8610 con 0x557b269eff80 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa61b7fe640 1 -- 172.21.15.151:0/3734698148 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa734050be0 con 0x557b269eff80 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa61b7fe640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa614039a70 0x7fa61403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa61b7fe640 1 -- 172.21.15.151:0/3734698148 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa7340158c0 con 0x557b269eff80 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa614039a70 0x7fa61403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b26a027c0 0x557b26a04c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a053d0 con 0x557b26a027c0 2024-09-12T16:54:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74a30a640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b26a027c0 0x557b26a04c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa614039a70 0x7fa61403bf30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0e9ea0 tx=0x7fa73c0e2000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.127+0000 7fa74a30a640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b26a027c0 0x557b26a04c80 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74400f600 con 0x557b26a027c0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 realm 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a01b10 con 0x557b26a027c0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74400f600 con 0x557b26a027c0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a05ed0 con 0x557b26a027c0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74400f600 con 0x557b26a027c0 2024-09-12T16:54:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a067a0 con 0x557b26a027c0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa74400f600 con 0x557b26a027c0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b26a071c0 0x557b26a095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a09d20 con 0x557b26a071c0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74b30c640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b26a071c0 0x557b26a095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74b30c640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b26a071c0 0x557b26a095b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 20 searching for the correct realm 2024-09-12T16:54:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x557b26a0bc70 0x557b26a0e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x557b26a0bc70 0x557b26a0e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.131+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x557b26a0bc70 0x557b26a0e0a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74ab0b640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa73c0b6070 0x7fa73c0bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x7fa73c0b6070 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa73c0b6070 0x7fa73c0bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa73c0b6070 0x7fa73c0bf8d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74400f600 con 0x7fa73c0b6070 2024-09-12T16:54:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a027c0 2024-09-12T16:54:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74400f600 con 0x557b26a027c0 2024-09-12T16:54:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a027c0 2024-09-12T16:54:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x7fa73c0b6070 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.135+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a027c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a027c0 2024-09-12T16:54:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x7fa73c0b6070 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a027c0 2024-09-12T16:54:08.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.139+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a027c0 2024-09-12T16:54:08.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x7fa73c0b6070 2024-09-12T16:54:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a027c0 2024-09-12T16:54:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x7fa73c0b6070 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.143+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a0bc70 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a071c0 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x557b26a027c0 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0e720 con 0x7fa73c0b6070 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0a6e0 con 0x557b26a027c0 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0a320 con 0x557b26a027c0 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0b100 con 0x557b26a027c0 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 zone default found 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 4 Realm: () 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 zonegroup default 2024-09-12T16:54:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0eba0 con 0x557b26a071c0 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a10de0 con 0x557b26a0bc70 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.147+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a11230 con 0x557b26a0bc70 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74d0059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74d0059c0 20 started sync module instance, tier type = 2024-09-12T16:54:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74d0059c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a10270 con 0x7fa73c0b6070 2024-09-12T16:54:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93987417425808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a10270 con 0x7fa73c0b6070 2024-09-12T16:54:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a11d10 con 0x557b26a027c0 2024-09-12T16:54:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93987417425808] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93987417430016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a10270 con 0x557b26a027c0 2024-09-12T16:54:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.151+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a12720 con 0x557b26a0bc70 2024-09-12T16:54:08.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.155+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93987417430016] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.155+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.155+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93987417423296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a101e0 con 0x557b26a0bc70 2024-09-12T16:54:08.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.155+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a13420 con 0x7fa73c0b6070 2024-09-12T16:54:08.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.155+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.159+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93987417436352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a13cc0 con 0x7fa73c0b6070 2024-09-12T16:54:08.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.159+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a146c0 con 0x557b26a027c0 2024-09-12T16:54:08.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.159+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93987417423296] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.159+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93987417436352] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.159+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.159+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93987417434816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a137c0 con 0x557b26a027c0 2024-09-12T16:54:08.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.159+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a14f60 con 0x557b26a071c0 2024-09-12T16:54:08.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.163+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93987417434816] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.163+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.163+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93987417442992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a137c0 con 0x557b26a071c0 2024-09-12T16:54:08.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.163+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a157b0 con 0x557b26a071c0 2024-09-12T16:54:08.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.163+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93987417442992] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93987417440720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a157b0 con 0x557b26a071c0 2024-09-12T16:54:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a16220 con 0x557b26a071c0 2024-09-12T16:54:08.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93987417440720] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93987417447696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a16400 con 0x557b26a071c0 2024-09-12T16:54:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 20 add_watcher() i=0 2024-09-12T16:54:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 20 add_watcher() i=1 2024-09-12T16:54:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 20 add_watcher() i=2 2024-09-12T16:54:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 20 add_watcher() i=3 2024-09-12T16:54:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 20 add_watcher() i=4 2024-09-12T16:54:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 20 add_watcher() i=5 2024-09-12T16:54:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.167+0000 7fa74d0059c0 20 add_watcher() i=6 2024-09-12T16:54:08.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93987417447696] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74d0059c0 20 add_watcher() i=7 2024-09-12T16:54:08.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74d0059c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:08.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a197d0 con 0x557b26a027c0 2024-09-12T16:54:08.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93987417449200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a16c00 con 0x557b26a027c0 2024-09-12T16:54:08.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93987417449200] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa5fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74d0059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:08.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74d0059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:08.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74d0059c0 5 note: GC not initialized 2024-09-12T16:54:08.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa5fa7fc640 20 reqs_thread_entry: start 2024-09-12T16:54:08.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.171+0000 7fa74d0059c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:08.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 20 Filter name: none 2024-09-12T16:54:08.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa56bfff640 20 reqs_thread_entry: start 2024-09-12T16:54:08.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:08.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a3c940 con 0x557b26a071c0 2024-09-12T16:54:08.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fa73402a070 con 0x557b26a071c0 2024-09-12T16:54:08.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-12T16:54:08.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:08.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:08.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:08.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a43160 con 0x557b26a071c0 2024-09-12T16:54:08.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa73406c040 con 0x557b26a071c0 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93987417631760 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b26a3e910 con 0x557b26a027c0 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 93987417434816 notify 146028888111 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fa744018040 con 0x557b26a027c0 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa62d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888111 cookie 93987417434816 notifier 4837 bl.length()=636 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa62d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.175+0000 7fa62d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.179+0000 7fa62d7fa640 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa60c003eb0 con 0x557b26a027c0 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.179+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 93987417631760 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.179+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.179+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 93987417631760 notify 146028888111 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa74400a040 con 0x557b26a027c0 2024-09-12T16:54:08.184 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:08.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.179+0000 7fa5fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.179+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93987417449200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a3a720 con 0x557b26a027c0 2024-09-12T16:54:08.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.179+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93987417449200] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.179+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93987417425808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a3a720 con 0x7fa73c0b6070 2024-09-12T16:54:08.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.183+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93987417425808] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.183+0000 7fa74d0059c0 20 remove_watcher() i=0 2024-09-12T16:54:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.183+0000 7fa74d0059c0 2 removed watcher, disabling cache 2024-09-12T16:54:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.183+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93987417430016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a3a720 con 0x557b26a027c0 2024-09-12T16:54:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.183+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93987417430016] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.183+0000 7fa74d0059c0 20 remove_watcher() i=1 2024-09-12T16:54:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.183+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93987417423296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a3a720 con 0x557b26a0bc70 2024-09-12T16:54:08.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74ab0b640 1 -- 172.21.15.151:0/3734698148 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93987417423296] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73c0b2070 con 0x557b26a0bc70 2024-09-12T16:54:08.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74d0059c0 20 remove_watcher() i=2 2024-09-12T16:54:08.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93987417436352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0fdc0 con 0x7fa73c0b6070 2024-09-12T16:54:08.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93987417436352] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x7fa73c0b6070 2024-09-12T16:54:08.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74d0059c0 20 remove_watcher() i=3 2024-09-12T16:54:08.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93987417434816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0fdc0 con 0x557b26a027c0 2024-09-12T16:54:08.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93987417434816] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74402b040 con 0x557b26a027c0 2024-09-12T16:54:08.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74d0059c0 20 remove_watcher() i=4 2024-09-12T16:54:08.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.187+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93987417442992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a12ac0 con 0x557b26a071c0 2024-09-12T16:54:08.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.191+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93987417442992] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73406c040 con 0x557b26a071c0 2024-09-12T16:54:08.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.191+0000 7fa74d0059c0 20 remove_watcher() i=5 2024-09-12T16:54:08.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.191+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93987417440720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a0fdc0 con 0x557b26a071c0 2024-09-12T16:54:08.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93987417440720] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73406c040 con 0x557b26a071c0 2024-09-12T16:54:08.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 20 remove_watcher() i=6 2024-09-12T16:54:08.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93987417447696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b26a12ac0 con 0x557b26a071c0 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74b30c640 1 -- 172.21.15.151:0/3734698148 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93987417447696] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa73406c040 con 0x557b26a071c0 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 20 remove_watcher() i=7 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b26a071c0 msgr2=0x557b26a095b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b26a071c0 0x557b26a095b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b26a027c0 msgr2=0x557b26a04c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b26a027c0 0x557b26a04c80 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa73c0b6070 msgr2=0x7fa73c0bf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa73c0b6070 0x7fa73c0bf8d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x557b26a0bc70 msgr2=0x557b26a0e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x557b26a0bc70 0x557b26a0e0a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa614039a70 msgr2=0x7fa61403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa614039a70 0x7fa61403bf30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0e9ea0 tx=0x7fa73c0e2000 comp rx=0 tx=0).stop 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 msgr2=0x557b269f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/3734698148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269eff80 0x557b269f7470 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa734017e00 tx=0x7fa734050900 comp rx=0 tx=0).stop 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74a30a640 1 -- 172.21.15.151:0/3734698148 reap_dead start 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 shutdown_connections 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 >> 172.21.15.151:0/3734698148 conn(0x557b269ec3b0 msgr2=0x557b269ea5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 shutdown_connections 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/3734698148 wait complete. 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1589307210 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa624039ac0 msgr2=0x7fa62403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/1589307210 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa624039ac0 0x7fa62403bf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x557b269ca180 tx=0x7fa73c0c7f90 comp rx=0 tx=0).stop 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1589307210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269e3640 msgr2=0x557b269e3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/1589307210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269e3640 0x557b269e3a60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x557b269cad60 tx=0x7fa73400af40 comp rx=0 tx=0).stop 2024-09-12T16:54:08.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1589307210 shutdown_connections 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/1589307210 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa624039ac0 0x7fa62403bf80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/1589307210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b269e3640 0x557b269e3a60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1589307210 >> 172.21.15.151:0/1589307210 conn(0x557b269d8ff0 msgr2=0x557b269d93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1589307210 shutdown_connections 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/1589307210 wait complete. 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b269d2530 msgr2=0x557b269d4920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.195+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b269d2530 0x557b269d4920 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b268485d0 msgr2=0x557b269cfe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b268485d0 0x557b269cfe60 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa630039a70 msgr2=0x7fa63003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa630039a70 0x7fa63003bf30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa744000c10 tx=0x7fa7440013c0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 msgr2=0x557b269c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c8cf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0aa500 tx=0x7fa73c017d70 comp rx=0 tx=0).stop 2024-09-12T16:54:08.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 shutdown_connections 2024-09-12T16:54:08.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x557b269d2530 0x557b269d4920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x557b268485d0 0x557b269cfe60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa630039a70 0x7fa63003bf30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 --2- 172.21.15.151:0/2533093295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b268481f0 0x557b269c8cf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 >> 172.21.15.151:0/2533093295 conn(0x557b268ce910 msgr2=0x557b269bbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 shutdown_connections 2024-09-12T16:54:08.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.199+0000 7fa74d0059c0 1 -- 172.21.15.151:0/2533093295 wait complete. 2024-09-12T16:54:08.214 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:08.214 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:08.214 ERROR:root:0 2024-09-12T16:54:08.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-12T16:54:08.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-12T16:54:08.215 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-12T16:54:08.305 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:08.306 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:08.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97eee39c0 1 Processor -- start 2024-09-12T16:54:08.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97eee39c0 1 -- start start 2024-09-12T16:54:08.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97eee39c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55eeb8b98d80 0x55eeb8b99160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97eee39c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eeb8a4e9c0 con 0x55eeb8b9bf60 2024-09-12T16:54:08.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97eee39c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55eeb8a9e6d0 con 0x55eeb8b98d80 2024-09-12T16:54:08.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97c9e9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55eeb8b98d80 0x55eeb8b99160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97c9e9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55eeb8b98d80 0x55eeb8b99160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52348/0 (socket says 172.21.15.151:52348) 2024-09-12T16:54:08.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97c9e9640 1 -- 172.21.15.151:0/1301377381 learned_addr learned my addr 172.21.15.151:0/1301377381 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97c9e9640 1 -- 172.21.15.151:0/1301377381 >> v1:172.21.15.122:6789/0 conn(0x55eeb8b9bf60 legacy=0x55eeb8b9e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97c9e9640 1 -- 172.21.15.151:0/1301377381 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb8a42ca0 con 0x55eeb8b98d80 2024-09-12T16:54:08.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/1301377381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b98d80 0x55eeb8b99160 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe96400a5c0 tx=0x7fe96401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42aecc683921990f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97b9e7640 1 -- 172.21.15.151:0/1301377381 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9640a6070 con 0x55eeb8b98d80 2024-09-12T16:54:08.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.303+0000 7fe97b9e7640 1 -- 172.21.15.151:0/1301377381 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9640af070 con 0x55eeb8b98d80 2024-09-12T16:54:08.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.307+0000 7fe97b9e7640 1 -- 172.21.15.151:0/1301377381 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9640aa5c0 con 0x55eeb8b98d80 2024-09-12T16:54:08.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.307+0000 7fe97eee39c0 1 -- 172.21.15.151:0/1301377381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b98d80 msgr2=0x55eeb8b99160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.307+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/1301377381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b98d80 0x55eeb8b99160 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe96400a5c0 tx=0x7fe96401b340 comp rx=0 tx=0).stop 2024-09-12T16:54:08.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.307+0000 7fe97eee39c0 1 -- 172.21.15.151:0/1301377381 shutdown_connections 2024-09-12T16:54:08.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.307+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/1301377381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b98d80 0x55eeb8b99160 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.307+0000 7fe97eee39c0 1 -- 172.21.15.151:0/1301377381 >> 172.21.15.151:0/1301377381 conn(0x55eeb8b948a0 msgr2=0x55eeb8b96cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.307+0000 7fe97eee39c0 1 -- 172.21.15.151:0/1301377381 shutdown_connections 2024-09-12T16:54:08.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.307+0000 7fe97eee39c0 1 -- 172.21.15.151:0/1301377381 wait complete. 2024-09-12T16:54:08.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.319+0000 7fe97eee39c0 1 Processor -- start 2024-09-12T16:54:08.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.319+0000 7fe97eee39c0 1 -- start start 2024-09-12T16:54:08.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.319+0000 7fe97eee39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b9bf60 0x55eeb8c85a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.319+0000 7fe97eee39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eeb8aa2680 con 0x55eeb8b9bf60 2024-09-12T16:54:08.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b9bf60 0x55eeb8c85a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b9bf60 0x55eeb8c85a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52352/0 (socket says 172.21.15.151:52352) 2024-09-12T16:54:08.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 -- 172.21.15.151:0/3772318890 learned_addr learned my addr 172.21.15.151:0/3772318890 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 -- 172.21.15.151:0/3772318890 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb8a1dda0 con 0x55eeb8b9bf60 2024-09-12T16:54:08.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/3772318890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b9bf60 0x55eeb8c85a30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe964018f70 tx=0x7fe964003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8201181c23a99cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe86ae0d640 1 -- 172.21.15.151:0/3772318890 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9640aa840 con 0x55eeb8b9bf60 2024-09-12T16:54:08.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe86ae0d640 1 -- 172.21.15.151:0/3772318890 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9640aaa00 con 0x55eeb8b9bf60 2024-09-12T16:54:08.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe86ae0d640 1 -- 172.21.15.151:0/3772318890 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9640aad20 con 0x55eeb8b9bf60 2024-09-12T16:54:08.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3772318890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b9bf60 msgr2=0x55eeb8c85a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/3772318890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b9bf60 0x55eeb8c85a30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe964018f70 tx=0x7fe964003030 comp rx=0 tx=0).stop 2024-09-12T16:54:08.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3772318890 shutdown_connections 2024-09-12T16:54:08.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/3772318890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8b9bf60 0x55eeb8c85a30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3772318890 >> 172.21.15.151:0/3772318890 conn(0x55eeb8b948a0 msgr2=0x55eeb8c802a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3772318890 shutdown_connections 2024-09-12T16:54:08.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3772318890 wait complete. 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 Processor -- start 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 -- start start 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8c8f260 0x55eeb8c8f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97eee39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eeb8a44a50 con 0x55eeb8c8f260 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8c8f260 0x55eeb8c8f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8c8f260 0x55eeb8c8f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52364/0 (socket says 172.21.15.151:52364) 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 -- 172.21.15.151:0/2172443545 learned_addr learned my addr 172.21.15.151:0/2172443545 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 -- 172.21.15.151:0/2172443545 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb8c8fbe0 con 0x55eeb8c8f260 2024-09-12T16:54:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.323+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8c8f260 0x55eeb8c8f680 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe964018f70 tx=0x7fe9640180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe86960a640 1 -- 172.21.15.151:0/2172443545 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9640cb020 con 0x55eeb8c8f260 2024-09-12T16:54:08.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe86960a640 1 -- 172.21.15.151:0/2172443545 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9640abe80 con 0x55eeb8c8f260 2024-09-12T16:54:08.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe86960a640 1 -- 172.21.15.151:0/2172443545 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9640c6650 con 0x55eeb8c8f260 2024-09-12T16:54:08.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb8c8fe70 con 0x55eeb8c8f260 2024-09-12T16:54:08.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb8c906c0 con 0x55eeb8c8f260 2024-09-12T16:54:08.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe86960a640 1 -- 172.21.15.151:0/2172443545 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe9640ce020 con 0x55eeb8c8f260 2024-09-12T16:54:08.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe86960a640 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe864039a70 0x7fe86403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe86960a640 1 -- 172.21.15.151:0/2172443545 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe9640eb9b0 con 0x55eeb8c8f260 2024-09-12T16:54:08.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97c1e8640 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe864039a70 0x7fe86403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8c947d0 0x55eeb8c96bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8c97100 con 0x55eeb8c947d0 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97d1ea640 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8c947d0 0x55eeb8c96bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97c1e8640 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe864039a70 0x7fe86403bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0015d0 tx=0x7fe96c0066b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97d1ea640 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8c947d0 0x55eeb8c96bc0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97d1ea640 1 -- 172.21.15.151:0/2172443545 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8c947d0 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8c974a0 con 0x55eeb8c947d0 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97d1ea640 1 -- 172.21.15.151:0/2172443545 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8c947d0 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8c99280 0x55eeb8c9b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8c9bd40 con 0x55eeb8c99280 2024-09-12T16:54:08.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.327+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8c99280 0x55eeb8c9b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8c99280 0x55eeb8c9b670 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97c9e9640 1 -- 172.21.15.151:0/2172443545 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8c99280 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8c98120 con 0x55eeb8c947d0 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97d1ea640 1 -- 172.21.15.151:0/2172443545 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8c947d0 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8c985c0 con 0x55eeb8c947d0 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97d1ea640 1 -- 172.21.15.151:0/2172443545 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8c947d0 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97eee39c0 1 Processor -- start 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97eee39c0 1 -- start start 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97eee39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8caa410 0x55eeb8caa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97eee39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eeb8aaf450 con 0x55eeb8caa410 2024-09-12T16:54:08.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97d1ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8caa410 0x55eeb8caa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97d1ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8caa410 0x55eeb8caa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52370/0 (socket says 172.21.15.151:52370) 2024-09-12T16:54:08.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97d1ea640 1 -- 172.21.15.151:0/411824358 learned_addr learned my addr 172.21.15.151:0/411824358 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97d1ea640 1 -- 172.21.15.151:0/411824358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb8caae70 con 0x55eeb8caa410 2024-09-12T16:54:08.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97d1ea640 1 --2- 172.21.15.151:0/411824358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8caa410 0x55eeb8caa830 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55eeb8c91230 tx=0x7fe97400aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe8627fc640 1 -- 172.21.15.151:0/411824358 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974007d10 con 0x55eeb8caa410 2024-09-12T16:54:08.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe8627fc640 1 -- 172.21.15.151:0/411824358 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97401e020 con 0x55eeb8caa410 2024-09-12T16:54:08.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97eee39c0 1 -- 172.21.15.151:0/411824358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb8cab6d0 con 0x55eeb8caa410 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe8627fc640 1 -- 172.21.15.151:0/411824358 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974019420 con 0x55eeb8caa410 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.331+0000 7fe97eee39c0 1 -- 172.21.15.151:0/411824358 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb8cabc40 con 0x55eeb8caa410 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe8627fc640 1 -- 172.21.15.151:0/411824358 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe974016040 con 0x55eeb8caa410 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe8627fc640 1 --2- 172.21.15.151:0/411824358 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe854039ac0 0x7fe85403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe8627fc640 1 -- 172.21.15.151:0/411824358 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe97401f030 con 0x55eeb8caa410 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/411824358 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe854039ac0 0x7fe85403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97eee39c0 1 Processor -- start 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97eee39c0 1 -- start start 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/411824358 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe854039ac0 0x7fe85403bf80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55eeb8c909b0 tx=0x7fe9640dc040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97eee39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cb81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97eee39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eeb8c861c0 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97d1ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cb81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97d1ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cb81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52378/0 (socket says 172.21.15.151:52378) 2024-09-12T16:54:08.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97d1ea640 1 -- 172.21.15.151:0/3403173366 learned_addr learned my addr 172.21.15.151:0/3403173366 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97d1ea640 1 -- 172.21.15.151:0/3403173366 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb8cb87b0 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe97d1ea640 1 --2- 172.21.15.151:0/3403173366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cb81c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe9740186a0 tx=0x7fe974016f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae00504a756d5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe853fff640 1 -- 172.21.15.151:0/3403173366 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97401d070 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe853fff640 1 -- 172.21.15.151:0/3403173366 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974014340 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.335+0000 7fe853fff640 1 -- 172.21.15.151:0/3403173366 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974014640 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3403173366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 msgr2=0x55eeb8cb81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/3403173366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cb81c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe9740186a0 tx=0x7fe974016f70 comp rx=0 tx=0).stop 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3403173366 shutdown_connections 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/3403173366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cb81c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3403173366 >> 172.21.15.151:0/3403173366 conn(0x55eeb8cb31e0 msgr2=0x55eeb8cb1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3403173366 shutdown_connections 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- 172.21.15.151:0/3403173366 wait complete. 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 Processor -- start 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- start start 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cbe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eeb8cb6d10 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97d1ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cbe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97d1ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cbe2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52380/0 (socket says 172.21.15.151:52380) 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 learned_addr learned my addr 172.21.15.151:0/790071913 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb8cbe850 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97d1ea640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cbe2f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe9740186c0 tx=0x7fe974050560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe8527fc640 1 -- 172.21.15.151:0/790071913 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97401d050 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb8cbeae0 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe8527fc640 1 -- 172.21.15.151:0/790071913 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974031070 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe8527fc640 1 -- 172.21.15.151:0/790071913 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974017820 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb8cbf490 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe8527fc640 1 -- 172.21.15.151:0/790071913 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe974019610 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe8527fc640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe848039a20 0x7fe84803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe8527fc640 1 -- 172.21.15.151:0/790071913 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe974001040 con 0x55eeb8cb7dc0 2024-09-12T16:54:08.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe848039a20 0x7fe84803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8cc9550 0x55eeb8ccba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.339+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8ccc160 con 0x55eeb8cc9550 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97c1e8640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8cc9550 0x55eeb8ccba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe848039a20 0x7fe84803bee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9640c7fd0 tx=0x7fe9640e4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97c1e8640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8cc9550 0x55eeb8ccba10 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 realm 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cc88e0 con 0x55eeb8cc9550 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cccc50 con 0x55eeb8cc9550 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8ccd520 con 0x55eeb8cc9550 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8ccdf40 0x55eeb8cd0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd0a20 con 0x55eeb8ccdf40 2024-09-12T16:54:08.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97d1ea640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8ccdf40 0x55eeb8cd0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97d1ea640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8ccdf40 0x55eeb8cd0330 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:08.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 20 searching for the correct realm 2024-09-12T16:54:08.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55eeb8cd2970 0x55eeb8cd4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.343+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55eeb8cd2970 0x55eeb8cd4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55eeb8cd2970 0x55eeb8cd4da0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c9e9640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe9640da040 0x7fe9640e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x7fe9640da040 2024-09-12T16:54:08.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c1e8640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe9640da040 0x7fe9640e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c1e8640 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe9640da040 0x7fe9640e85d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cc9550 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cc9550 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.347+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x7fe9640da040 2024-09-12T16:54:08.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cc9550 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cc9550 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x7fe9640da040 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.351+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cc9550 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cc9550 2024-09-12T16:54:08.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x7fe9640da040 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cc9550 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.355+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x7fe9640da040 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cd2970 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8ccdf40 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x55eeb8cc9550 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd5470 con 0x7fe9640da040 2024-09-12T16:54:08.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd13e0 con 0x55eeb8cc9550 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd1c80 con 0x55eeb8cc9550 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd1020 con 0x55eeb8cc9550 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 zone default found 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 4 Realm: () 2024-09-12T16:54:08.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 zonegroup default 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd58f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.359+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd7b80 con 0x55eeb8cd2970 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd7f20 con 0x55eeb8cd2970 2024-09-12T16:54:08.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 20 started sync module instance, tier type = 2024-09-12T16:54:08.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:08.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd7010 con 0x7fe9640da040 2024-09-12T16:54:08.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483791050048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd7010 con 0x7fe9640da040 2024-09-12T16:54:08.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd8ad0 con 0x55eeb8cc9550 2024-09-12T16:54:08.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483791050048] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483791054240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd7010 con 0x55eeb8cc9550 2024-09-12T16:54:08.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.363+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd94e0 con 0x55eeb8cd2970 2024-09-12T16:54:08.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.367+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483791054240] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.367+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.367+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483791047520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd6f80 con 0x55eeb8cd2970 2024-09-12T16:54:08.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.367+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cda1e0 con 0x7fe9640da040 2024-09-12T16:54:08.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.367+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.367+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483791060544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cda8f0 con 0x7fe9640da040 2024-09-12T16:54:08.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.367+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdb410 con 0x55eeb8cc9550 2024-09-12T16:54:08.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.371+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483791047520] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.371+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483791060544] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.371+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.371+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483791064800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdb3d0 con 0x55eeb8cc9550 2024-09-12T16:54:08.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.371+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdbcb0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.375+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483791064800] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.375+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.375+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483791067136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdb3d0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.375+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdc500 con 0x55eeb8ccdf40 2024-09-12T16:54:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.375+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.375+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483791069264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdc980 con 0x55eeb8ccdf40 2024-09-12T16:54:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.375+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdd490 con 0x55eeb8ccdf40 2024-09-12T16:54:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.375+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483791067136] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483791069264] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483791073088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd9880 con 0x55eeb8ccdf40 2024-09-12T16:54:08.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 20 add_watcher() i=0 2024-09-12T16:54:08.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 20 add_watcher() i=1 2024-09-12T16:54:08.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 20 add_watcher() i=2 2024-09-12T16:54:08.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 20 add_watcher() i=3 2024-09-12T16:54:08.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 20 add_watcher() i=4 2024-09-12T16:54:08.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 20 add_watcher() i=5 2024-09-12T16:54:08.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 20 add_watcher() i=6 2024-09-12T16:54:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483791073088] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 20 add_watcher() i=7 2024-09-12T16:54:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8ce0480 con 0x55eeb8cc9550 2024-09-12T16:54:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.379+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483791070320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdd930 con 0x55eeb8cc9550 2024-09-12T16:54:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483791070320] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe8337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 5 note: GC not initialized 2024-09-12T16:54:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe8327e4640 20 reqs_thread_entry: start 2024-09-12T16:54:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 20 Filter name: none 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe82b7fe640 20 reqs_thread_entry: start 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d03600 con 0x55eeb8ccdf40 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d01ca0 con 0x55eeb8cd2970 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-12T16:54:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T16:54:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-12T16:54:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-12T16:54:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.383+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d026f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'9 uv9 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97eee39c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-12T16:54:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97eee39c0 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T16:54:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97eee39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-12T16:54:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94483791225120 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d07110 con 0x7fe9640da040 2024-09-12T16:54:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== watch-notify(notify (1) cookie 94483791050048 notify 146028888089 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7fe96c02a040 con 0x7fe9640da040 2024-09-12T16:54:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe853fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94483791050048 notifier 4844 bl.length()=533 2024-09-12T16:54:08.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(65 notify.0 [notify cookie 94483791225120 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe853fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-12T16:54:08.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe853fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T16:54:08.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe853fff640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe840003eb0 con 0x7fe9640da040 2024-09-12T16:54:08.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== watch-notify(notify_complete (2) cookie 94483791225120 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eeb8a4e9c0 con 0x7fe9640da040 2024-09-12T16:54:08.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.387+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d02120 con 0x55eeb8cd2970 2024-09-12T16:54:08.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97eee39c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-12T16:54:08.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97eee39c0 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T16:54:08.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97eee39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-12T16:54:08.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94483791225120 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d07110 con 0x55eeb8cc9550 2024-09-12T16:54:08.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 94483791054240 notify 146028888112 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55eeb8a4e9c0 con 0x55eeb8cc9550 2024-09-12T16:54:08.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe853fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888112 cookie 94483791054240 notifier 4844 bl.length()=176 2024-09-12T16:54:08.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe853fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-12T16:54:08.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe853fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T16:54:08.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(68 notify.1 [notify cookie 94483791225120 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe853fff640 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe840003eb0 con 0x55eeb8cc9550 2024-09-12T16:54:08.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify_complete (2) cookie 94483791225120 notify 146028888112 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe96c02f650 con 0x55eeb8cc9550 2024-09-12T16:54:08.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.397 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-12T16:54:08.389140Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:08.389125Z","tags":[],"group_ids":[]} 2024-09-12T16:54:08.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe8337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483791070320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d013b0 con 0x55eeb8cc9550 2024-09-12T16:54:08.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94483791070320] v34'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.391+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483791050048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d013b0 con 0x7fe9640da040 2024-09-12T16:54:08.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.395+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94483791050048] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.395+0000 7fe97eee39c0 20 remove_watcher() i=0 2024-09-12T16:54:08.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.395+0000 7fe97eee39c0 2 removed watcher, disabling cache 2024-09-12T16:54:08.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.395+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483791054240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d013b0 con 0x55eeb8cc9550 2024-09-12T16:54:08.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.395+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94483791054240] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.395+0000 7fe97eee39c0 20 remove_watcher() i=1 2024-09-12T16:54:08.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.395+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483791047520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d013b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.399+0000 7fe97c9e9640 1 -- 172.21.15.151:0/790071913 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94483791047520] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9640cf3b0 con 0x55eeb8cd2970 2024-09-12T16:54:08.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.399+0000 7fe97eee39c0 20 remove_watcher() i=2 2024-09-12T16:54:08.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.399+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483791060544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd6b60 con 0x7fe9640da040 2024-09-12T16:54:08.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.399+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94483791060544] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x7fe9640da040 2024-09-12T16:54:08.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.399+0000 7fe97eee39c0 20 remove_watcher() i=3 2024-09-12T16:54:08.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.399+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483791064800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d013b0 con 0x55eeb8cc9550 2024-09-12T16:54:08.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.403+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94483791064800] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c00f030 con 0x55eeb8cc9550 2024-09-12T16:54:08.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.403+0000 7fe97eee39c0 20 remove_watcher() i=4 2024-09-12T16:54:08.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.403+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483791067136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cd6b60 con 0x55eeb8ccdf40 2024-09-12T16:54:08.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.403+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94483791067136] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.403+0000 7fe97eee39c0 20 remove_watcher() i=5 2024-09-12T16:54:08.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.403+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483791069264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8cdaee0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94483791069264] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 20 remove_watcher() i=6 2024-09-12T16:54:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483791073088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eeb8d013b0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97d1ea640 1 -- 172.21.15.151:0/790071913 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94483791073088] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9740083f0 con 0x55eeb8ccdf40 2024-09-12T16:54:08.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 20 remove_watcher() i=7 2024-09-12T16:54:08.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8ccdf40 msgr2=0x55eeb8cd0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8ccdf40 0x55eeb8cd0330 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8cc9550 msgr2=0x55eeb8ccba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8cc9550 0x55eeb8ccba10 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe9640da040 msgr2=0x7fe9640e85d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe9640da040 0x7fe9640e85d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55eeb8cd2970 msgr2=0x55eeb8cd4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55eeb8cd2970 0x55eeb8cd4da0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe848039a20 msgr2=0x7fe84803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe848039a20 0x7fe84803bee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9640c7fd0 tx=0x7fe9640e4000 comp rx=0 tx=0).stop 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 msgr2=0x55eeb8cbe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/790071913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8cb7dc0 0x55eeb8cbe2f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe9740186c0 tx=0x7fe974050560 comp rx=0 tx=0).stop 2024-09-12T16:54:08.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 reap_dead start 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97c1e8640 1 -- 172.21.15.151:0/790071913 reap_dead start 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 shutdown_connections 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 >> 172.21.15.151:0/790071913 conn(0x55eeb8cb31e0 msgr2=0x55eeb8cb13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 shutdown_connections 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.407+0000 7fe97eee39c0 1 -- 172.21.15.151:0/790071913 wait complete. 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/411824358 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe854039ac0 msgr2=0x7fe85403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/411824358 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe854039ac0 0x7fe85403bf80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55eeb8c909b0 tx=0x7fe9640dc040 comp rx=0 tx=0).stop 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/411824358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8caa410 msgr2=0x55eeb8caa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/411824358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8caa410 0x55eeb8caa830 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x55eeb8c91230 tx=0x7fe97400aed0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/411824358 shutdown_connections 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/411824358 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe854039ac0 0x7fe85403bf80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/411824358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8caa410 0x55eeb8caa830 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/411824358 >> 172.21.15.151:0/411824358 conn(0x55eeb8c9fdc0 msgr2=0x55eeb8ca01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/411824358 shutdown_connections 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/411824358 wait complete. 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8c99280 msgr2=0x55eeb8c9b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8c99280 0x55eeb8c9b670 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8c947d0 msgr2=0x55eeb8c96bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8c947d0 0x55eeb8c96bc0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe864039a70 msgr2=0x7fe86403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe864039a70 0x7fe86403bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0015d0 tx=0x7fe96c0066b0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8c8f260 msgr2=0x55eeb8c8f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8c8f260 0x55eeb8c8f680 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe964018f70 tx=0x7fe9640180e0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 shutdown_connections 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55eeb8c99280 0x55eeb8c9b670 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55eeb8c947d0 0x55eeb8c96bc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe864039a70 0x7fe86403bf30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 --2- 172.21.15.151:0/2172443545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eeb8c8f260 0x55eeb8c8f680 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 >> 172.21.15.151:0/2172443545 conn(0x55eeb8b948a0 msgr2=0x55eeb8c849f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 shutdown_connections 2024-09-12T16:54:08.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.411+0000 7fe97eee39c0 1 -- 172.21.15.151:0/2172443545 wait complete. 2024-09-12T16:54:08.426 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-12T16:54:08.389140Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:08.389125Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:08.426 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-12T16:54:08.389140Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:08.389125Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:08.426 ERROR:root:0 2024-09-12T16:54:08.427 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:08.432 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:08.433 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-12T16:54:08.433 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-12T16:54:08.433 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-12T16:54:08.465 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:08.465 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:08.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.459+0000 7f1be8dfb9c0 1 Processor -- start 2024-09-12T16:54:08.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.459+0000 7f1be8dfb9c0 1 -- start start 2024-09-12T16:54:08.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be8dfb9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55802e0543a0 0x55802e056790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be8dfb9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55802df049c0 con 0x55802dfc4a20 2024-09-12T16:54:08.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be8dfb9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55802df546d0 con 0x55802e0543a0 2024-09-12T16:54:08.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be6100640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55802e0543a0 0x55802e056790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be6100640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55802e0543a0 0x55802e056790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52382/0 (socket says 172.21.15.151:52382) 2024-09-12T16:54:08.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be6100640 1 -- 172.21.15.151:0/3569051533 learned_addr learned my addr 172.21.15.151:0/3569051533 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be6901640 1 --1- 172.21.15.151:0/3569051533 >> v1:172.21.15.122:6789/0 conn(0x55802dfc4a20 0x55802e052c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49244/0 (socket says 172.21.15.151:49244) 2024-09-12T16:54:08.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be6100640 1 -- 172.21.15.151:0/3569051533 >> v1:172.21.15.122:6789/0 conn(0x55802dfc4a20 legacy=0x55802e052c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be6100640 1 -- 172.21.15.151:0/3569051533 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802def8ca0 con 0x55802e0543a0 2024-09-12T16:54:08.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be6100640 1 --2- 172.21.15.151:0/3569051533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e0543a0 0x55802e056790 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000a5c0 tx=0x7f1bd001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c9c6b17700eee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be58ff640 1 -- 172.21.15.151:0/3569051533 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00b1070 con 0x55802e0543a0 2024-09-12T16:54:08.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be58ff640 1 -- 172.21.15.151:0/3569051533 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd00a8070 con 0x55802e0543a0 2024-09-12T16:54:08.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.463+0000 7f1be58ff640 1 -- 172.21.15.151:0/3569051533 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd00ac5b0 con 0x55802e0543a0 2024-09-12T16:54:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.467+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3569051533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e0543a0 msgr2=0x55802e056790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.467+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/3569051533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e0543a0 0x55802e056790 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000a5c0 tx=0x7f1bd001b340 comp rx=0 tx=0).stop 2024-09-12T16:54:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.467+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3569051533 shutdown_connections 2024-09-12T16:54:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.467+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/3569051533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e0543a0 0x55802e056790 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.467+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3569051533 >> 172.21.15.151:0/3569051533 conn(0x55802e04a970 msgr2=0x55802e04cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.467+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3569051533 shutdown_connections 2024-09-12T16:54:08.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.467+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3569051533 wait complete. 2024-09-12T16:54:08.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.479+0000 7f1be8dfb9c0 1 Processor -- start 2024-09-12T16:54:08.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.479+0000 7f1be8dfb9c0 1 -- start start 2024-09-12T16:54:08.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.479+0000 7f1be8dfb9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e13b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.479+0000 7f1be8dfb9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55802df58680 con 0x55802dfc4a20 2024-09-12T16:54:08.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.479+0000 7f1be6901640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e13b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.479+0000 7f1be6901640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e13b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52394/0 (socket says 172.21.15.151:52394) 2024-09-12T16:54:08.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.479+0000 7f1be6901640 1 -- 172.21.15.151:0/3078325717 learned_addr learned my addr 172.21.15.151:0/3078325717 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be6901640 1 -- 172.21.15.151:0/3078325717 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802ded3da0 con 0x55802dfc4a20 2024-09-12T16:54:08.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be6901640 1 --2- 172.21.15.151:0/3078325717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e13b790 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1be0001ec0 tx=0x7f1be000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f7f364fb3faad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1ad4e09640 1 -- 172.21.15.151:0/3078325717 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be000e5d0 con 0x55802dfc4a20 2024-09-12T16:54:08.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1ad4e09640 1 -- 172.21.15.151:0/3078325717 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be000e770 con 0x55802dfc4a20 2024-09-12T16:54:08.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1ad4e09640 1 -- 172.21.15.151:0/3078325717 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be000ea70 con 0x55802dfc4a20 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3078325717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 msgr2=0x55802e13b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/3078325717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e13b790 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1be0001ec0 tx=0x7f1be000b6d0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3078325717 shutdown_connections 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/3078325717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e13b790 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3078325717 >> 172.21.15.151:0/3078325717 conn(0x55802e04a970 msgr2=0x55802e137430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3078325717 shutdown_connections 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/3078325717 wait complete. 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 Processor -- start 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- start start 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55802defaa50 con 0x55802dfc4a20 2024-09-12T16:54:08.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be6901640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be6901640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52404/0 (socket says 172.21.15.151:52404) 2024-09-12T16:54:08.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be6901640 1 -- 172.21.15.151:0/2416684730 learned_addr learned my addr 172.21.15.151:0/2416684730 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be6901640 1 -- 172.21.15.151:0/2416684730 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802e143380 con 0x55802dfc4a20 2024-09-12T16:54:08.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be6901640 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e142e20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55802e13c780 tx=0x7f1be0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1ad3606640 1 -- 172.21.15.151:0/2416684730 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be000f8e0 con 0x55802dfc4a20 2024-09-12T16:54:08.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1ad3606640 1 -- 172.21.15.151:0/2416684730 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be000fa80 con 0x55802dfc4a20 2024-09-12T16:54:08.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55802e143610 con 0x55802dfc4a20 2024-09-12T16:54:08.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1ad3606640 1 -- 172.21.15.151:0/2416684730 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be000fda0 con 0x55802dfc4a20 2024-09-12T16:54:08.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.483+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802e143fc0 con 0x55802dfc4a20 2024-09-12T16:54:08.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1ad3606640 1 -- 172.21.15.151:0/2416684730 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1be0017070 con 0x55802dfc4a20 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1ad3606640 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1acc039b10 0x7f1acc03bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1ad3606640 1 -- 172.21.15.151:0/2416684730 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1be0015020 con 0x55802dfc4a20 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be6100640 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1acc039b10 0x7f1acc03bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e0543a0 0x55802e149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e14a4d0 con 0x55802e0543a0 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be7102640 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e0543a0 0x55802e149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be6100640 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1acc039b10 0x7f1acc03bfd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ae000 tx=0x7f1bd00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be7102640 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e0543a0 0x55802e149f90 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be7102640 1 -- 172.21.15.151:0/2416684730 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bd800a4d0 con 0x55802e0543a0 2024-09-12T16:54:08.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e14a920 con 0x55802e0543a0 2024-09-12T16:54:08.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be7102640 1 -- 172.21.15.151:0/2416684730 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bd800a4d0 con 0x55802e0543a0 2024-09-12T16:54:08.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e14c730 0x55802e14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e14f1f0 con 0x55802e14c730 2024-09-12T16:54:08.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be6901640 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e14c730 0x55802e14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.487+0000 7f1be6901640 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e14c730 0x55802e14eb20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be6901640 1 -- 172.21.15.151:0/2416684730 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1be002e070 con 0x55802e14c730 2024-09-12T16:54:08.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e14b5d0 con 0x55802e0543a0 2024-09-12T16:54:08.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be7102640 1 -- 172.21.15.151:0/2416684730 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bd800a4d0 con 0x55802e0543a0 2024-09-12T16:54:08.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e14ba50 con 0x55802e0543a0 2024-09-12T16:54:08.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be7102640 1 -- 172.21.15.151:0/2416684730 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1bd800a4d0 con 0x55802e0543a0 2024-09-12T16:54:08.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be8dfb9c0 1 Processor -- start 2024-09-12T16:54:08.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be8dfb9c0 1 -- start start 2024-09-12T16:54:08.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be8dfb9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e15d840 0x55802e15dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be8dfb9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55802df65450 con 0x55802e15d840 2024-09-12T16:54:08.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be7102640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e15d840 0x55802e15dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be7102640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e15d840 0x55802e15dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52414/0 (socket says 172.21.15.151:52414) 2024-09-12T16:54:08.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be7102640 1 -- 172.21.15.151:0/1597316252 learned_addr learned my addr 172.21.15.151:0/1597316252 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be7102640 1 -- 172.21.15.151:0/1597316252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802e15e2a0 con 0x55802e15d840 2024-09-12T16:54:08.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be7102640 1 --2- 172.21.15.151:0/1597316252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e15d840 0x55802e15dc60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55802e144f40 tx=0x7f1bd8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1ad0e01640 1 -- 172.21.15.151:0/1597316252 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8014450 con 0x55802e15d840 2024-09-12T16:54:08.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1ad0e01640 1 -- 172.21.15.151:0/1597316252 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd80145f0 con 0x55802e15d840 2024-09-12T16:54:08.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1597316252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55802e15eb00 con 0x55802e15d840 2024-09-12T16:54:08.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1ad0e01640 1 -- 172.21.15.151:0/1597316252 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8014910 con 0x55802e15d840 2024-09-12T16:54:08.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.491+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1597316252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802e15f070 con 0x55802e15d840 2024-09-12T16:54:08.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1ad0e01640 1 -- 172.21.15.151:0/1597316252 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1bd8011040 con 0x55802e15d840 2024-09-12T16:54:08.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1ad0e01640 1 --2- 172.21.15.151:0/1597316252 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ac0039a70 0x7f1ac003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1ad0e01640 1 -- 172.21.15.151:0/1597316252 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bd801e070 con 0x55802e15d840 2024-09-12T16:54:08.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be6901640 1 --2- 172.21.15.151:0/1597316252 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ac0039a70 0x7f1ac003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be8dfb9c0 1 Processor -- start 2024-09-12T16:54:08.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be8dfb9c0 1 -- start start 2024-09-12T16:54:08.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be6901640 1 --2- 172.21.15.151:0/1597316252 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ac0039a70 0x7f1ac003bf30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55802e1442b0 tx=0x7f1be0017630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be8dfb9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e16a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be8dfb9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55802e13bfc0 con 0x55802e16a180 2024-09-12T16:54:08.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be7102640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e16a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be7102640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e16a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52426/0 (socket says 172.21.15.151:52426) 2024-09-12T16:54:08.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be7102640 1 -- 172.21.15.151:0/1468384185 learned_addr learned my addr 172.21.15.151:0/1468384185 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be7102640 1 -- 172.21.15.151:0/1468384185 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802e16ab50 con 0x55802e16a180 2024-09-12T16:54:08.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be7102640 1 --2- 172.21.15.151:0/1468384185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e16a560 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8050740 tx=0x7f1bd8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308c383a494ee582 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1aca7fc640 1 -- 172.21.15.151:0/1468384185 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8028070 con 0x55802e16a180 2024-09-12T16:54:08.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1aca7fc640 1 -- 172.21.15.151:0/1468384185 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd8022de0 con 0x55802e16a180 2024-09-12T16:54:08.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1aca7fc640 1 -- 172.21.15.151:0/1468384185 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd80167c0 con 0x55802e16a180 2024-09-12T16:54:08.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1468384185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 msgr2=0x55802e16a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.495+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/1468384185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e16a560 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8050740 tx=0x7f1bd8011a80 comp rx=0 tx=0).stop 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1468384185 shutdown_connections 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/1468384185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e16a560 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1468384185 >> 172.21.15.151:0/1468384185 conn(0x55802e1665b0 msgr2=0x55802e1647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1468384185 shutdown_connections 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1468384185 wait complete. 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 Processor -- start 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- start start 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e050360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55802e16b190 con 0x55802e16a180 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be7102640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e050360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be7102640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e050360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52440/0 (socket says 172.21.15.151:52440) 2024-09-12T16:54:08.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 learned_addr learned my addr 172.21.15.151:0/804226693 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802e0508c0 con 0x55802e16a180 2024-09-12T16:54:08.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be7102640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e050360 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8001490 tx=0x7f1bd80506a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1ac8ff9640 1 -- 172.21.15.151:0/804226693 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd8032030 con 0x55802e16a180 2024-09-12T16:54:08.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55802e04eca0 con 0x55802e16a180 2024-09-12T16:54:08.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1ac8ff9640 1 -- 172.21.15.151:0/804226693 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd804f280 con 0x55802e16a180 2024-09-12T16:54:08.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1ac8ff9640 1 -- 172.21.15.151:0/804226693 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd80520d0 con 0x55802e16a180 2024-09-12T16:54:08.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802e04f1b0 con 0x55802e16a180 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1ac8ff9640 1 -- 172.21.15.151:0/804226693 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1bd8035070 con 0x55802e16a180 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1ac8ff9640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ab0039a70 0x7f1ab003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1ac8ff9640 1 -- 172.21.15.151:0/804226693 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bd8033070 con 0x55802e16a180 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be6901640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ab0039a70 0x7f1ab003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e17eba0 0x55802e181060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e1817b0 con 0x55802e17eba0 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.499+0000 7f1be6100640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e17eba0 0x55802e181060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be6901640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ab0039a70 0x7f1ab003bf30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1be001afd0 tx=0x7f1be0028000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be6100640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e17eba0 0x55802e181060 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 realm 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e181b80 con 0x55802e17eba0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e182450 con 0x55802e17eba0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e1827f0 con 0x55802e17eba0 2024-09-12T16:54:08.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e183550 0x55802e185940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e185f00 con 0x55802e183550 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be7102640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e183550 0x55802e185940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be7102640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e183550 0x55802e185940 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 20 searching for the correct realm 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55802e187e50 0x55802e18a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be6901640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55802e187e50 0x55802e18a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.503+0000 7f1be6901640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55802e187e50 0x55802e18a280 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6901640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1be001b3d0 0x7f1be0042540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x7f1be001b3d0 2024-09-12T16:54:08.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1be001b3d0 0x7f1be0042540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1be001b3d0 0x7f1be0042540 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e17eba0 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e17eba0 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x7f1be001b3d0 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.507+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e17eba0 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e17eba0 2024-09-12T16:54:08.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x7f1be001b3d0 2024-09-12T16:54:08.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e17eba0 2024-09-12T16:54:08.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.511+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e17eba0 2024-09-12T16:54:08.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x7f1be001b3d0 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e17eba0 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x7f1be001b3d0 2024-09-12T16:54:08.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e187e50 2024-09-12T16:54:08.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.515+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e183550 2024-09-12T16:54:08.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x55802e17eba0 2024-09-12T16:54:08.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55802e18a950 con 0x7f1be001b3d0 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e1868c0 con 0x55802e17eba0 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e186500 con 0x55802e17eba0 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e1872a0 con 0x55802e17eba0 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 zone default found 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 4 Realm: () 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 zonegroup default 2024-09-12T16:54:08.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e18adf0 con 0x55802e183550 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e18d0d0 con 0x55802e187e50 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e18d470 con 0x55802e187e50 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 started sync module instance, tier type = 2024-09-12T16:54:08.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:08.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.519+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e18c560 con 0x7f1be001b3d0 2024-09-12T16:54:08.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.523+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.523+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009017551456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e18c560 con 0x7f1be001b3d0 2024-09-12T16:54:08.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.523+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e18df50 con 0x55802e17eba0 2024-09-12T16:54:08.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.523+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009017551456] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.523+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.523+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009017555520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e18c560 con 0x55802e17eba0 2024-09-12T16:54:08.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.523+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e18e960 con 0x55802e187e50 2024-09-12T16:54:08.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009017555520] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009017548976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e18ed00 con 0x55802e187e50 2024-09-12T16:54:08.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e18f6c0 con 0x7f1be001b3d0 2024-09-12T16:54:08.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009017561888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e18fd70 con 0x7f1be001b3d0 2024-09-12T16:54:08.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e190890 con 0x55802e17eba0 2024-09-12T16:54:08.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009017548976] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.527+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009017561888] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.531+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.531+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009017566048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e190850 con 0x55802e17eba0 2024-09-12T16:54:08.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.531+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e190c80 con 0x55802e183550 2024-09-12T16:54:08.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.531+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009017566048] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.531+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.531+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009017558192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e191070 con 0x55802e183550 2024-09-12T16:54:08.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.531+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e191a30 con 0x55802e183550 2024-09-12T16:54:08.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009017570688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e191e50 con 0x55802e183550 2024-09-12T16:54:08.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e192920 con 0x55802e183550 2024-09-12T16:54:08.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009017558192] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009017570688] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009017574416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1919e0 con 0x55802e183550 2024-09-12T16:54:08.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 20 add_watcher() i=0 2024-09-12T16:54:08.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 20 add_watcher() i=1 2024-09-12T16:54:08.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 20 add_watcher() i=2 2024-09-12T16:54:08.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 20 add_watcher() i=3 2024-09-12T16:54:08.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 20 add_watcher() i=4 2024-09-12T16:54:08.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 20 add_watcher() i=5 2024-09-12T16:54:08.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.535+0000 7f1be8dfb9c0 20 add_watcher() i=6 2024-09-12T16:54:08.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009017574416] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be8dfb9c0 20 add_watcher() i=7 2024-09-12T16:54:08.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be8dfb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:08.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e195a20 con 0x55802e17eba0 2024-09-12T16:54:08.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009017563072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e192ea0 con 0x55802e17eba0 2024-09-12T16:54:08.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009017563072] v34'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1a9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be8dfb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:08.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be8dfb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:08.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.539+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e19e110 con 0x55802e17eba0 2024-09-12T16:54:08.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.543+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.543+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e19e110 con 0x55802e183550 2024-09-12T16:54:08.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.543+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.543+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e19e110 con 0x55802e187e50 2024-09-12T16:54:08.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.547+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.547+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e19d870 con 0x55802e17eba0 2024-09-12T16:54:08.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.547+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'248 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.547+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e19d870 con 0x7f1be001b3d0 2024-09-12T16:54:08.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.547+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.547+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e19f900 con 0x55802e187e50 2024-09-12T16:54:08.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.551+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.551+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e19fca0 con 0x55802e17eba0 2024-09-12T16:54:08.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.551+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.551+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e183550 2024-09-12T16:54:08.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.555+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.555+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x7f1be001b3d0 2024-09-12T16:54:08.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.555+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.555+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e187e50 2024-09-12T16:54:08.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.559+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.559+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x7f1be001b3d0 2024-09-12T16:54:08.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.559+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'78 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.559+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e183550 2024-09-12T16:54:08.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.559+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.559+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x7f1be001b3d0 2024-09-12T16:54:08.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.563+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.563+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e183550 2024-09-12T16:54:08.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.563+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.563+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e17eba0 2024-09-12T16:54:08.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.567+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'249 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.567+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e187e50 2024-09-12T16:54:08.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.567+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.567+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x7f1be001b3d0 2024-09-12T16:54:08.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.567+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.567+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e187e50 2024-09-12T16:54:08.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.571+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.571+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e17eba0 2024-09-12T16:54:08.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.571+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.571+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0190 con 0x55802e17eba0 2024-09-12T16:54:08.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.575+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'250 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.575+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x55802e187e50 2024-09-12T16:54:08.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.575+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.575+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0150 con 0x7f1be001b3d0 2024-09-12T16:54:08.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.579+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.579+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a01e0 con 0x55802e187e50 2024-09-12T16:54:08.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.579+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.579+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0220 con 0x55802e187e50 2024-09-12T16:54:08.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.579+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.579+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0260 con 0x55802e187e50 2024-09-12T16:54:08.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.583+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.583+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0260 con 0x55802e187e50 2024-09-12T16:54:08.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.583+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.583+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a02a0 con 0x55802e183550 2024-09-12T16:54:08.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.587+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.587+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a02e0 con 0x55802e187e50 2024-09-12T16:54:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.587+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.587+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a02e0 con 0x55802e183550 2024-09-12T16:54:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.591+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.591+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a02e0 con 0x55802e187e50 2024-09-12T16:54:08.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.591+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.591+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a02e0 con 0x55802e183550 2024-09-12T16:54:08.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.595+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.595+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1a0320 con 0x7f1be001b3d0 2024-09-12T16:54:08.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.595+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.595+0000 7f1a17fff640 20 reqs_thread_entry: start 2024-09-12T16:54:08.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.595+0000 7f1be8dfb9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:08.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 20 Filter name: none 2024-09-12T16:54:08.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1a15ffb640 20 reqs_thread_entry: start 2024-09-12T16:54:08.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-12T16:54:08.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e19c960 con 0x55802e183550 2024-09-12T16:54:08.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 20 rados_obj.operate() r=0 bl.length=349 2024-09-12T16:54:08.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-12T16:54:08.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T16:54:08.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:08.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bd9c0 con 0x55802e183550 2024-09-12T16:54:08.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 10 removing key index: system_akey 2024-09-12T16:54:08.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bb9a0 con 0x55802e187e50 2024-09-12T16:54:08.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(96 system_akey [delete] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-12T16:54:08.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94009017616336 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e1be010 con 0x55802e17eba0 2024-09-12T16:54:08.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== watch-notify(notify (1) cookie 94009017555520 notify 146028888113 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55802e19d2d0 con 0x55802e17eba0 2024-09-12T16:54:08.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1aca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888113 cookie 94009017555520 notifier 4851 bl.length()=161 2024-09-12T16:54:08.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(97 notify.1 [notify cookie 94009017616336 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.599+0000 7f1aca7fc640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1aac003d70 con 0x55802e17eba0 2024-09-12T16:54:08.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.603+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.603+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== watch-notify(notify_complete (2) cookie 94009017616336 notify 146028888113 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55802e19de80 con 0x55802e17eba0 2024-09-12T16:54:08.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.603+0000 7f1be8dfb9c0 10 removing email index: 2024-09-12T16:54:08.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.603+0000 7f1be8dfb9c0 10 removing user buckets index 2024-09-12T16:54:08.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.603+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bdf90 con 0x55802e183550 2024-09-12T16:54:08.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.603+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(99 system_user.buckets [delete] v34'10 uv9 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.603+0000 7f1be8dfb9c0 10 removing user index: system_user 2024-09-12T16:54:08.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.603+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda40 con 0x55802e183550 2024-09-12T16:54:08.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(100 system_user [call,call,delete] v34'11 uv11 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be8dfb9c0 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-12T16:54:08.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be8dfb9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-12T16:54:08.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94009017616288 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda40 con 0x7f1be001b3d0 2024-09-12T16:54:08.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== watch-notify(notify (1) cookie 94009017551456 notify 146028888090 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55802e19de80 con 0x7f1be001b3d0 2024-09-12T16:54:08.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1ac9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94009017551456 notifier 4851 bl.length()=160 2024-09-12T16:54:08.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(101 notify.0 [notify cookie 94009017616288 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1ac9ffb640 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1a1c0032d0 con 0x7f1be001b3d0 2024-09-12T16:54:08.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== watch-notify(notify_complete (2) cookie 94009017616288 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55802e19dc10 con 0x7f1be001b3d0 2024-09-12T16:54:08.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1a9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.607+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009017563072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x55802e17eba0 2024-09-12T16:54:08.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.611+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94009017563072] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.611+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009017551456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x7f1be001b3d0 2024-09-12T16:54:08.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.611+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94009017551456] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.611+0000 7f1be8dfb9c0 20 remove_watcher() i=0 2024-09-12T16:54:08.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.611+0000 7f1be8dfb9c0 2 removed watcher, disabling cache 2024-09-12T16:54:08.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.611+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009017555520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x55802e17eba0 2024-09-12T16:54:08.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.615+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94009017555520] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.615+0000 7f1be8dfb9c0 20 remove_watcher() i=1 2024-09-12T16:54:08.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.615+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009017548976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x55802e187e50 2024-09-12T16:54:08.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.615+0000 7f1be6901640 1 -- 172.21.15.151:0/804226693 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94009017548976] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be002e070 con 0x55802e187e50 2024-09-12T16:54:08.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.615+0000 7f1be8dfb9c0 20 remove_watcher() i=2 2024-09-12T16:54:08.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.615+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009017561888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x7f1be001b3d0 2024-09-12T16:54:08.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.615+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94009017561888] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x7f1be001b3d0 2024-09-12T16:54:08.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.615+0000 7f1be8dfb9c0 20 remove_watcher() i=3 2024-09-12T16:54:08.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.619+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009017566048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x55802e17eba0 2024-09-12T16:54:08.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.619+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94009017566048] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd00b4040 con 0x55802e17eba0 2024-09-12T16:54:08.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.619+0000 7f1be8dfb9c0 20 remove_watcher() i=4 2024-09-12T16:54:08.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.619+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009017558192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x55802e183550 2024-09-12T16:54:08.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.623+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94009017558192] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.623+0000 7f1be8dfb9c0 20 remove_watcher() i=5 2024-09-12T16:54:08.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.623+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009017570688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x55802e183550 2024-09-12T16:54:08.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.623+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94009017570688] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.623+0000 7f1be8dfb9c0 20 remove_watcher() i=6 2024-09-12T16:54:08.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.623+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009017574416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55802e1bda20 con 0x55802e183550 2024-09-12T16:54:08.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be7102640 1 -- 172.21.15.151:0/804226693 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94009017574416] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd805c040 con 0x55802e183550 2024-09-12T16:54:08.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 20 remove_watcher() i=7 2024-09-12T16:54:08.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e183550 msgr2=0x55802e185940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e183550 0x55802e185940 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e17eba0 msgr2=0x55802e181060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e17eba0 0x55802e181060 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1be001b3d0 msgr2=0x7f1be0042540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1be001b3d0 0x7f1be0042540 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55802e187e50 msgr2=0x55802e18a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55802e187e50 0x55802e18a280 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ab0039a70 msgr2=0x7f1ab003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ab0039a70 0x7f1ab003bf30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1be001afd0 tx=0x7f1be0028000 comp rx=0 tx=0).stop 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 msgr2=0x55802e050360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be6100640 1 -- 172.21.15.151:0/804226693 reap_dead start 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e050360 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8001490 tx=0x7f1bd80506a0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 shutdown_connections 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/804226693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e16a180 0x55802e050360 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 >> 172.21.15.151:0/804226693 conn(0x55802e1665b0 msgr2=0x55802e1647c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 shutdown_connections 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/804226693 wait complete. 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1597316252 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ac0039a70 msgr2=0x7f1ac003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/1597316252 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ac0039a70 0x7f1ac003bf30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55802e1442b0 tx=0x7f1be0017630 comp rx=0 tx=0).stop 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1597316252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e15d840 msgr2=0x55802e15dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/1597316252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e15d840 0x55802e15dc60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55802e144f40 tx=0x7f1bd8018830 comp rx=0 tx=0).stop 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1597316252 shutdown_connections 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/1597316252 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1ac0039a70 0x7f1ac003bf30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/1597316252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802e15d840 0x55802e15dc60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1597316252 >> 172.21.15.151:0/1597316252 conn(0x55802e1531f0 msgr2=0x55802e1535d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1597316252 shutdown_connections 2024-09-12T16:54:08.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/1597316252 wait complete. 2024-09-12T16:54:08.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e14c730 msgr2=0x55802e14eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e14c730 0x55802e14eb20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e0543a0 msgr2=0x55802e149f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e0543a0 0x55802e149f90 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1acc039b10 msgr2=0x7f1acc03bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1acc039b10 0x7f1acc03bfd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ae000 tx=0x7f1bd00a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:08.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 msgr2=0x55802e142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e142e20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55802e13c780 tx=0x7f1be0000bd0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 shutdown_connections 2024-09-12T16:54:08.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55802e14c730 0x55802e14eb20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55802e0543a0 0x55802e149f90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1acc039b10 0x7f1acc03bfd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 --2- 172.21.15.151:0/2416684730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55802dfc4a20 0x55802e142e20 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 >> 172.21.15.151:0/2416684730 conn(0x55802e04a970 msgr2=0x55802e135ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 shutdown_connections 2024-09-12T16:54:08.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.627+0000 7f1be8dfb9c0 1 -- 172.21.15.151:0/2416684730 wait complete. 2024-09-12T16:54:08.645 ERROR:root:None 2024-09-12T16:54:08.645 ERROR:root:0 2024-09-12T16:54:08.646 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-12T16:54:08.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-12T16:54:08.646 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-12T16:54:08.732 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:08.732 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:08.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f102070f9c0 1 Processor -- start 2024-09-12T16:54:08.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f102070f9c0 1 -- start start 2024-09-12T16:54:08.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f102070f9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55f015402f00 0x55f0154032e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f102070f9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0152b79c0 con 0x55f015406040 2024-09-12T16:54:08.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f102070f9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55f0153076d0 con 0x55f015402f00 2024-09-12T16:54:08.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f101e215640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55f015402f00 0x55f0154032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f101da14640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55f015406040 0x55f015408430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49252/0 (socket says 172.21.15.151:49252) 2024-09-12T16:54:08.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f101da14640 1 -- 172.21.15.151:0/884569896 learned_addr learned my addr 172.21.15.151:0/884569896 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:08.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f101e215640 1 -- 172.21.15.151:0/884569896 >> v1:172.21.15.122:6789/0 conn(0x55f015406040 legacy=0x55f015408430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.727+0000 7f101e215640 1 -- 172.21.15.151:0/884569896 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0152abca0 con 0x55f015402f00 2024-09-12T16:54:08.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f101e215640 1 --2- 172.21.15.151:0/884569896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154032e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f101000a420 tx=0x7f101001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a57e0f4d5862b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f101d213640 1 -- 172.21.15.151:0/884569896 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10100af070 con 0x55f015402f00 2024-09-12T16:54:08.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f101d213640 1 -- 172.21.15.151:0/884569896 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10100aa530 con 0x55f015402f00 2024-09-12T16:54:08.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f101d213640 1 -- 172.21.15.151:0/884569896 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10100aa850 con 0x55f015402f00 2024-09-12T16:54:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f102070f9c0 1 -- 172.21.15.151:0/884569896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 msgr2=0x55f0154032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f102070f9c0 1 --2- 172.21.15.151:0/884569896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154032e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f101000a420 tx=0x7f101001afd0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f102070f9c0 1 -- 172.21.15.151:0/884569896 shutdown_connections 2024-09-12T16:54:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f102070f9c0 1 --2- 172.21.15.151:0/884569896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154032e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f102070f9c0 1 -- 172.21.15.151:0/884569896 >> 172.21.15.151:0/884569896 conn(0x55f0153fea20 msgr2=0x55f015400e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f102070f9c0 1 -- 172.21.15.151:0/884569896 shutdown_connections 2024-09-12T16:54:08.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.731+0000 7f102070f9c0 1 -- 172.21.15.151:0/884569896 wait complete. 2024-09-12T16:54:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.747+0000 7f102070f9c0 1 Processor -- start 2024-09-12T16:54:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.747+0000 7f102070f9c0 1 -- start start 2024-09-12T16:54:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.747+0000 7f102070f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154ee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.747+0000 7f102070f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f01530b680 con 0x55f015402f00 2024-09-12T16:54:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.747+0000 7f101e215640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.747+0000 7f101e215640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154ee690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52454/0 (socket says 172.21.15.151:52454) 2024-09-12T16:54:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.747+0000 7f101e215640 1 -- 172.21.15.151:0/4284197022 learned_addr learned my addr 172.21.15.151:0/4284197022 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.747+0000 7f101e215640 1 -- 172.21.15.151:0/4284197022 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f015286da0 con 0x55f015402f00 2024-09-12T16:54:08.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f101e215640 1 --2- 172.21.15.151:0/4284197022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154ee690 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1010018c00 tx=0x7f10100033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd14accedc6e578 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f0f0c608640 1 -- 172.21.15.151:0/4284197022 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10100af040 con 0x55f015402f00 2024-09-12T16:54:08.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f0f0c608640 1 -- 172.21.15.151:0/4284197022 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10100aaa00 con 0x55f015402f00 2024-09-12T16:54:08.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f0f0c608640 1 -- 172.21.15.151:0/4284197022 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10100aace0 con 0x55f015402f00 2024-09-12T16:54:08.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- 172.21.15.151:0/4284197022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 msgr2=0x55f0154ee690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 --2- 172.21.15.151:0/4284197022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154ee690 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1010018c00 tx=0x7f10100033b0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- 172.21.15.151:0/4284197022 shutdown_connections 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 --2- 172.21.15.151:0/4284197022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154ee690 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- 172.21.15.151:0/4284197022 >> 172.21.15.151:0/4284197022 conn(0x55f0153fea20 msgr2=0x55f0154ea2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- 172.21.15.151:0/4284197022 shutdown_connections 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- 172.21.15.151:0/4284197022 wait complete. 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 Processor -- start 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- start start 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f0152ada50 con 0x55f015402f00 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f101e215640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f101e215640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154f5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52470/0 (socket says 172.21.15.151:52470) 2024-09-12T16:54:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f101e215640 1 -- 172.21.15.151:0/1908030402 learned_addr learned my addr 172.21.15.151:0/1908030402 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f101e215640 1 -- 172.21.15.151:0/1908030402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0154f6160 con 0x55f015402f00 2024-09-12T16:54:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f101e215640 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154f5c00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1010018c00 tx=0x7f1010017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f0f0ae05640 1 -- 172.21.15.151:0/1908030402 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10100c5070 con 0x55f015402f00 2024-09-12T16:54:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0154f63f0 con 0x55f015402f00 2024-09-12T16:54:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f0f0ae05640 1 -- 172.21.15.151:0/1908030402 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10100c1690 con 0x55f015402f00 2024-09-12T16:54:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f0f0ae05640 1 -- 172.21.15.151:0/1908030402 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10100c19b0 con 0x55f015402f00 2024-09-12T16:54:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.751+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0154f6e20 con 0x55f015402f00 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f0f0ae05640 1 -- 172.21.15.151:0/1908030402 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f10100b5470 con 0x55f015402f00 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f0f0ae05640 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0f04039a70 0x7f0f0403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f0f0ae05640 1 -- 172.21.15.151:0/1908030402 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f10100bb070 con 0x55f015402f00 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f101da14640 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0f04039a70 0x7f0f0403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f015406040 0x55f0154fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0154fd2b0 con 0x55f015406040 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f101ea16640 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f015406040 0x55f0154fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f101da14640 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0f04039a70 0x7f0f0403bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1008001d80 tx=0x7f10080012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f101ea16640 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f015406040 0x55f0154fcd70 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f101ea16640 1 -- 172.21.15.151:0/1908030402 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10180083f0 con 0x55f015406040 2024-09-12T16:54:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0154fd720 con 0x55f015406040 2024-09-12T16:54:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f101ea16640 1 -- 172.21.15.151:0/1908030402 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10180083f0 con 0x55f015406040 2024-09-12T16:54:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f0154ff530 0x55f015501920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015502010 con 0x55f0154ff530 2024-09-12T16:54:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f101e215640 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f0154ff530 0x55f015501920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.755+0000 7f101e215640 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f0154ff530 0x55f015501920 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f101e215640 1 -- 172.21.15.151:0/1908030402 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f10100c7070 con 0x55f0154ff530 2024-09-12T16:54:08.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0154fe3d0 con 0x55f015406040 2024-09-12T16:54:08.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f101ea16640 1 -- 172.21.15.151:0/1908030402 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10180083f0 con 0x55f015406040 2024-09-12T16:54:08.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0154fe870 con 0x55f015406040 2024-09-12T16:54:08.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f101ea16640 1 -- 172.21.15.151:0/1908030402 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f10180083f0 con 0x55f015406040 2024-09-12T16:54:08.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f102070f9c0 1 Processor -- start 2024-09-12T16:54:08.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f102070f9c0 1 -- start start 2024-09-12T16:54:08.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f102070f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f0155106a0 0x55f015510ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f102070f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f015318450 con 0x55f0155106a0 2024-09-12T16:54:08.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f101ea16640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f0155106a0 0x55f015510ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f101ea16640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f0155106a0 0x55f015510ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52476/0 (socket says 172.21.15.151:52476) 2024-09-12T16:54:08.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f101ea16640 1 -- 172.21.15.151:0/2897965259 learned_addr learned my addr 172.21.15.151:0/2897965259 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f101ea16640 1 -- 172.21.15.151:0/2897965259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f015511100 con 0x55f0155106a0 2024-09-12T16:54:08.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f101ea16640 1 --2- 172.21.15.151:0/2897965259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f0155106a0 0x55f015510ac0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55f0154f6640 tx=0x7f101800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f0f03fff640 1 -- 172.21.15.151:0/2897965259 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1018007d70 con 0x55f0155106a0 2024-09-12T16:54:08.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f0f03fff640 1 -- 172.21.15.151:0/2897965259 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101801e020 con 0x55f0155106a0 2024-09-12T16:54:08.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f102070f9c0 1 -- 172.21.15.151:0/2897965259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f015511960 con 0x55f0155106a0 2024-09-12T16:54:08.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.759+0000 7f0f03fff640 1 -- 172.21.15.151:0/2897965259 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1018019590 con 0x55f0155106a0 2024-09-12T16:54:08.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f102070f9c0 1 -- 172.21.15.151:0/2897965259 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f015511ed0 con 0x55f0155106a0 2024-09-12T16:54:08.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f0f03fff640 1 -- 172.21.15.151:0/2897965259 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1018016040 con 0x55f0155106a0 2024-09-12T16:54:08.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f0f03fff640 1 --2- 172.21.15.151:0/2897965259 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ef8039b10 0x7f0ef803bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f0f03fff640 1 -- 172.21.15.151:0/2897965259 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f101801f030 con 0x55f0155106a0 2024-09-12T16:54:08.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f101e215640 1 --2- 172.21.15.151:0/2897965259 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ef8039b10 0x7f0ef803bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f102070f9c0 1 Processor -- start 2024-09-12T16:54:08.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f102070f9c0 1 -- start start 2024-09-12T16:54:08.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f101e215640 1 --2- 172.21.15.151:0/2897965259 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ef8039b10 0x7f0ef803bfd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55f0154f70c0 tx=0x7f10100b6940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f102070f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f01551e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f102070f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f0154eee20 con 0x55f01551df50 2024-09-12T16:54:08.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f101ea16640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f01551e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f101ea16640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f01551e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52490/0 (socket says 172.21.15.151:52490) 2024-09-12T16:54:08.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f101ea16640 1 -- 172.21.15.151:0/348671691 learned_addr learned my addr 172.21.15.151:0/348671691 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f101ea16640 1 -- 172.21.15.151:0/348671691 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f01551e940 con 0x55f01551df50 2024-09-12T16:54:08.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.763+0000 7f101ea16640 1 --2- 172.21.15.151:0/348671691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f01551e350 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f10180508d0 tx=0x7f1018019b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b5398578d3b10c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f0f01ffb640 1 -- 172.21.15.151:0/348671691 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f101801d070 con 0x55f01551df50 2024-09-12T16:54:08.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f0f01ffb640 1 -- 172.21.15.151:0/348671691 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1018019c50 con 0x55f01551df50 2024-09-12T16:54:08.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f0f01ffb640 1 -- 172.21.15.151:0/348671691 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10180153e0 con 0x55f01551df50 2024-09-12T16:54:08.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- 172.21.15.151:0/348671691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 msgr2=0x55f01551e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 --2- 172.21.15.151:0/348671691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f01551e350 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f10180508d0 tx=0x7f1018019b00 comp rx=0 tx=0).stop 2024-09-12T16:54:08.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- 172.21.15.151:0/348671691 shutdown_connections 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 --2- 172.21.15.151:0/348671691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f01551e350 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- 172.21.15.151:0/348671691 >> 172.21.15.151:0/348671691 conn(0x55f015519370 msgr2=0x55f0155175b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- 172.21.15.151:0/348671691 shutdown_connections 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- 172.21.15.151:0/348671691 wait complete. 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 Processor -- start 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- start start 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f015524460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f01551cea0 con 0x55f01551df50 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f101ea16640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f015524460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f101ea16640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f015524460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52504/0 (socket says 172.21.15.151:52504) 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 learned_addr learned my addr 172.21.15.151:0/537358676 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0155249c0 con 0x55f01551df50 2024-09-12T16:54:08.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f101ea16640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f015524460 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1018019b40 tx=0x7f1018050830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f0eeffff640 1 -- 172.21.15.151:0/537358676 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1018052410 con 0x55f01551df50 2024-09-12T16:54:08.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f0eeffff640 1 -- 172.21.15.151:0/537358676 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1018032020 con 0x55f01551df50 2024-09-12T16:54:08.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f015524c50 con 0x55f01551df50 2024-09-12T16:54:08.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f0eeffff640 1 -- 172.21.15.151:0/537358676 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f101803eba0 con 0x55f01551df50 2024-09-12T16:54:08.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f015524c50 con 0x55f01551df50 2024-09-12T16:54:08.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.767+0000 7f0eeffff640 1 -- 172.21.15.151:0/537358676 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f101802ba10 con 0x55f01551df50 2024-09-12T16:54:08.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f0eeffff640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ee8039ac0 0x7f0ee803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f0eeffff640 1 -- 172.21.15.151:0/537358676 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1018033030 con 0x55f01551df50 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f01552f5b0 0x55f015531a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0155321c0 con 0x55f01552f5b0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101e215640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ee8039ac0 0x7f0ee803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101da14640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f01552f5b0 0x55f015531a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101e215640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ee8039ac0 0x7f0ee803bf80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1010019680 tx=0x7f10100d3000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101da14640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f01552f5b0 0x55f015531a70 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f100800e5a0 con 0x55f01552f5b0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 realm 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f01552e900 con 0x55f01552f5b0 2024-09-12T16:54:08.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f100800e5a0 con 0x55f01552f5b0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015532cc0 con 0x55f01552f5b0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f100800e5a0 con 0x55f01552f5b0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015533590 con 0x55f01552f5b0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f100800e5a0 con 0x55f01552f5b0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f015533fb0 0x55f0155363a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015536a90 con 0x55f015533fb0 2024-09-12T16:54:08.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101ea16640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f015533fb0 0x55f0155363a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.771+0000 7f101ea16640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f015533fb0 0x55f0155363a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f101802a070 con 0x55f015533fb0 2024-09-12T16:54:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f102070f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f102070f9c0 20 searching for the correct realm 2024-09-12T16:54:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f0155389e0 0x55f01553ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101e215640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f0155389e0 0x55f01553ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101e215640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f0155389e0 0x55f01553ae10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101e215640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f10100f5040 0x7f10100a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x7f10100f5040 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101da14640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f10100f5040 0x7f10100a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101da14640 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f10100f5040 0x7f10100a93a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100800e5a0 con 0x7f10100f5040 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f01552f5b0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100800e5a0 con 0x55f01552f5b0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f01552f5b0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.775+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x7f10100f5040 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x7f10100f5040 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f01552f5b0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f01552f5b0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x7f10100f5040 2024-09-12T16:54:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1008029040 con 0x7f10100f5040 2024-09-12T16:54:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.779+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f01552f5b0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f01552f5b0 2024-09-12T16:54:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x7f10100f5040 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x7f10100f5040 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f01552f5b0 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.783+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x7f10100f5040 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x7f10100f5040 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f0155389e0 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f015533fb0 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x55f01552f5b0 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f01553b4e0 con 0x7f10100f5040 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1008029040 con 0x7f10100f5040 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015537450 con 0x55f01552f5b0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015537090 con 0x55f01552f5b0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1008029040 con 0x55f01552f5b0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015537d70 con 0x55f01552f5b0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 zone default found 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 4 Realm: () 2024-09-12T16:54:08.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 zonegroup default 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015537d70 con 0x55f015533fb0 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.787+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f01553d880 con 0x55f0155389e0 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f01553dc20 con 0x55f0155389e0 2024-09-12T16:54:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 20 started sync module instance, tier type = 2024-09-12T16:54:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f01553cd10 con 0x7f10100f5040 2024-09-12T16:54:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x7f10100f5040 2024-09-12T16:54:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94489638326800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f01553cd10 con 0x7f10100f5040 2024-09-12T16:54:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f01553e680 con 0x55f01552f5b0 2024-09-12T16:54:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.791+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94489638326800] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x7f10100f5040 2024-09-12T16:54:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.795+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.795+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94489638331104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f01553cd10 con 0x55f01552f5b0 2024-09-12T16:54:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.795+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f01553f090 con 0x55f0155389e0 2024-09-12T16:54:08.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.795+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.795+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94489638333408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f01553f930 con 0x55f0155389e0 2024-09-12T16:54:08.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.795+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f015540330 con 0x7f10100f5040 2024-09-12T16:54:08.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.795+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94489638331104] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x7f10100f5040 2024-09-12T16:54:08.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94489638324320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155402f0 con 0x7f10100f5040 2024-09-12T16:54:08.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f015540d40 con 0x55f01552f5b0 2024-09-12T16:54:08.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94489638333408] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94489638324320] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x7f10100f5040 2024-09-12T16:54:08.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94489638338112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f01553f590 con 0x55f01552f5b0 2024-09-12T16:54:08.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155411f0 con 0x55f015533fb0 2024-09-12T16:54:08.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.799+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94489638338112] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.803+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.803+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94489638340752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f015541160 con 0x55f015533fb0 2024-09-12T16:54:08.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.803+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155419b0 con 0x55f015533fb0 2024-09-12T16:54:08.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.803+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.803+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94489638343488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f015541e10 con 0x55f015533fb0 2024-09-12T16:54:08.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.803+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f015542930 con 0x55f015533fb0 2024-09-12T16:54:08.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.803+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94489638340752] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94489638347776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155428f0 con 0x55f015533fb0 2024-09-12T16:54:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 20 add_watcher() i=0 2024-09-12T16:54:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 20 add_watcher() i=1 2024-09-12T16:54:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 20 add_watcher() i=2 2024-09-12T16:54:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 20 add_watcher() i=3 2024-09-12T16:54:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 20 add_watcher() i=4 2024-09-12T16:54:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 20 add_watcher() i=5 2024-09-12T16:54:08.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94489638343488] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 20 add_watcher() i=6 2024-09-12T16:54:08.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94489638347776] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 20 add_watcher() i=7 2024-09-12T16:54:08.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:08.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0155418a0 con 0x55f01552f5b0 2024-09-12T16:54:08.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.807+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94489638344800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f015542df0 con 0x55f01552f5b0 2024-09-12T16:54:08.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94489638344800] v34'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f0ed4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 5 note: GC not initialized 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f0e4f7fe640 20 reqs_thread_entry: start 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 20 Filter name: none 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f0e4d7fa640 20 reqs_thread_entry: start 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015568ac0 con 0x55f0155389e0 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f015567160 con 0x55f0155389e0 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-12T16:54:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f015567a00 con 0x55f0155389e0 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94489638499664 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f01556c560 con 0x55f0155389e0 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== watch-notify(notify (1) cookie 94489638333408 notify 146028888073 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55f015567da0 con 0x55f0155389e0 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f0f01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94489638333408 notifier 4858 bl.length()=542 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f0f01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f0f01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T16:54:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(65 notify.2 [notify cookie 94489638499664 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.811+0000 7f0f01ffb640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0ee4003eb0 con 0x55f0155389e0 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== watch-notify(notify_complete (2) cookie 94489638499664 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f015568410 con 0x55f0155389e0 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f015567550 con 0x55f0155389e0 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f102070f9c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f102070f9c0 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f102070f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-12T16:54:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94489638499664 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f01556c5c0 con 0x55f015533fb0 2024-09-12T16:54:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== watch-notify(notify (1) cookie 94489638340752 notify 146028888094 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55f0155249c0 con 0x55f015533fb0 2024-09-12T16:54:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f0f01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94489638340752 notifier 4858 bl.length()=175 2024-09-12T16:54:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f0f01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-12T16:54:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f0f01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T16:54:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f0f01ffb640 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0ee4003eb0 con 0x55f015533fb0 2024-09-12T16:54:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(68 notify.5 [notify cookie 94489638499664 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.815+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== watch-notify(notify_complete (2) cookie 94489638499664 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1018046070 con 0x55f015533fb0 2024-09-12T16:54:08.823 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-12T16:54:08.816268Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:08.816248Z","tags":[],"group_ids":[]} 2024-09-12T16:54:08.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.819+0000 7f0ed4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.819+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94489638344800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x55f01552f5b0 2024-09-12T16:54:08.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.819+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94489638344800] v34'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.819+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94489638326800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x7f10100f5040 2024-09-12T16:54:08.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.819+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94489638326800] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x7f10100f5040 2024-09-12T16:54:08.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.819+0000 7f102070f9c0 20 remove_watcher() i=0 2024-09-12T16:54:08.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.819+0000 7f102070f9c0 2 removed watcher, disabling cache 2024-09-12T16:54:08.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.819+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94489638331104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x55f01552f5b0 2024-09-12T16:54:08.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.823+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94489638331104] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.823+0000 7f102070f9c0 20 remove_watcher() i=1 2024-09-12T16:54:08.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.823+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94489638333408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x55f0155389e0 2024-09-12T16:54:08.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.823+0000 7f101e215640 1 -- 172.21.15.151:0/537358676 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94489638333408] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10100f2040 con 0x55f0155389e0 2024-09-12T16:54:08.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.823+0000 7f102070f9c0 20 remove_watcher() i=2 2024-09-12T16:54:08.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.823+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94489638324320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x7f10100f5040 2024-09-12T16:54:08.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.827+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94489638324320] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x7f10100f5040 2024-09-12T16:54:08.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.827+0000 7f102070f9c0 20 remove_watcher() i=3 2024-09-12T16:54:08.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.827+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94489638338112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x55f01552f5b0 2024-09-12T16:54:08.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.827+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94489638338112] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10080391c0 con 0x55f01552f5b0 2024-09-12T16:54:08.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.827+0000 7f102070f9c0 20 remove_watcher() i=4 2024-09-12T16:54:08.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.827+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94489638340752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x55f015533fb0 2024-09-12T16:54:08.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.831+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94489638340752] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.831+0000 7f102070f9c0 20 remove_watcher() i=5 2024-09-12T16:54:08.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.831+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94489638343488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x55f015533fb0 2024-09-12T16:54:08.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.831+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94489638343488] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.831+0000 7f102070f9c0 20 remove_watcher() i=6 2024-09-12T16:54:08.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.831+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94489638347776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0155668a0 con 0x55f015533fb0 2024-09-12T16:54:08.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f101ea16640 1 -- 172.21.15.151:0/537358676 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94489638347776] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f101805c040 con 0x55f015533fb0 2024-09-12T16:54:08.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 20 remove_watcher() i=7 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f015533fb0 msgr2=0x55f0155363a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f015533fb0 0x55f0155363a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f01552f5b0 msgr2=0x55f015531a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f01552f5b0 0x55f015531a70 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f10100f5040 msgr2=0x7f10100a93a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f10100f5040 0x7f10100a93a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f0155389e0 msgr2=0x55f01553ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55f0155389e0 0x55f01553ae10 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ee8039ac0 msgr2=0x7f0ee803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ee8039ac0 0x7f0ee803bf80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1010019680 tx=0x7f10100d3000 comp rx=0 tx=0).stop 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 msgr2=0x55f015524460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f101da14640 1 -- 172.21.15.151:0/537358676 reap_dead start 2024-09-12T16:54:08.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f015524460 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1018019b40 tx=0x7f1018050830 comp rx=0 tx=0).stop 2024-09-12T16:54:08.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 shutdown_connections 2024-09-12T16:54:08.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/537358676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f01551df50 0x55f015524460 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 >> 172.21.15.151:0/537358676 conn(0x55f015519370 msgr2=0x55f015517580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 shutdown_connections 2024-09-12T16:54:08.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/537358676 wait complete. 2024-09-12T16:54:08.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/2897965259 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ef8039b10 msgr2=0x7f0ef803bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/2897965259 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ef8039b10 0x7f0ef803bfd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55f0154f70c0 tx=0x7f10100b6940 comp rx=0 tx=0).stop 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/2897965259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f0155106a0 msgr2=0x55f015510ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/2897965259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f0155106a0 0x55f015510ac0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55f0154f6640 tx=0x7f101800af40 comp rx=0 tx=0).stop 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/2897965259 shutdown_connections 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/2897965259 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0ef8039b10 0x7f0ef803bfd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/2897965259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f0155106a0 0x55f015510ac0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/2897965259 >> 172.21.15.151:0/2897965259 conn(0x55f015506050 msgr2=0x55f015506430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/2897965259 shutdown_connections 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/2897965259 wait complete. 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f0154ff530 msgr2=0x55f015501920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f0154ff530 0x55f015501920 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f015406040 msgr2=0x55f0154fcd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f015406040 0x55f0154fcd70 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0f04039a70 msgr2=0x7f0f0403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0f04039a70 0x7f0f0403bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1008001d80 tx=0x7f10080012e0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 msgr2=0x55f0154f5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154f5c00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1010018c00 tx=0x7f1010017d70 comp rx=0 tx=0).stop 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 shutdown_connections 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55f0154ff530 0x55f015501920 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55f015406040 0x55f0154fcd70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f0f04039a70 0x7f0f0403bf30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 --2- 172.21.15.151:0/1908030402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f015402f00 0x55f0154f5c00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 >> 172.21.15.151:0/1908030402 conn(0x55f0153fea20 msgr2=0x55f0154e8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 shutdown_connections 2024-09-12T16:54:08.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.835+0000 7f102070f9c0 1 -- 172.21.15.151:0/1908030402 wait complete. 2024-09-12T16:54:08.852 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-12T16:54:08.816268Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:08.816248Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:08.852 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-12T16:54:08.816268Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:08.816248Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:08.852 ERROR:root:0 2024-09-12T16:54:08.853 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:08.858 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:08.858 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-12T16:54:08.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-12T16:54:08.858 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-12T16:54:08.889 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:08.889 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:08.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.883+0000 7fe1923219c0 1 Processor -- start 2024-09-12T16:54:08.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe1923219c0 1 -- start start 2024-09-12T16:54:08.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe1923219c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a53fbc4ff0 0x55a53fbc73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe1923219c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a53fa769c0 con 0x55a53fbc0e00 2024-09-12T16:54:08.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe1923219c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55a53fac66d0 con 0x55a53fbc4ff0 2024-09-12T16:54:08.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18f626640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55a53fbc4ff0 0x55a53fbc73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18fe27640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55a53fbc0e00 0x55a53fbc11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49260/0 (socket says 172.21.15.151:49260) 2024-09-12T16:54:08.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18fe27640 1 -- 172.21.15.151:0/2084184284 learned_addr learned my addr 172.21.15.151:0/2084184284 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:08.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18f626640 1 -- 172.21.15.151:0/2084184284 >> v1:172.21.15.122:6789/0 conn(0x55a53fbc0e00 legacy=0x55a53fbc11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18f626640 1 -- 172.21.15.151:0/2084184284 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53fa6aca0 con 0x55a53fbc4ff0 2024-09-12T16:54:08.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18f626640 1 --2- 172.21.15.151:0/2084184284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc4ff0 0x55a53fbc73e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe18400a480 tx=0x7fe18401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de12ee226157f1c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18ee25640 1 -- 172.21.15.151:0/2084184284 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1840aa570 con 0x55a53fbc4ff0 2024-09-12T16:54:08.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18ee25640 1 -- 172.21.15.151:0/2084184284 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1840af070 con 0x55a53fbc4ff0 2024-09-12T16:54:08.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.887+0000 7fe18ee25640 1 -- 172.21.15.151:0/2084184284 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1840aa860 con 0x55a53fbc4ff0 2024-09-12T16:54:08.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.891+0000 7fe1923219c0 1 -- 172.21.15.151:0/2084184284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc4ff0 msgr2=0x55a53fbc73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.891+0000 7fe1923219c0 1 --2- 172.21.15.151:0/2084184284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc4ff0 0x55a53fbc73e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe18400a480 tx=0x7fe18401b310 comp rx=0 tx=0).stop 2024-09-12T16:54:08.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.891+0000 7fe1923219c0 1 -- 172.21.15.151:0/2084184284 shutdown_connections 2024-09-12T16:54:08.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.891+0000 7fe1923219c0 1 --2- 172.21.15.151:0/2084184284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc4ff0 0x55a53fbc73e0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.891+0000 7fe1923219c0 1 -- 172.21.15.151:0/2084184284 >> 172.21.15.151:0/2084184284 conn(0x55a53fbbc920 msgr2=0x55a53fbbed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.891+0000 7fe1923219c0 1 -- 172.21.15.151:0/2084184284 shutdown_connections 2024-09-12T16:54:08.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.891+0000 7fe1923219c0 1 -- 172.21.15.151:0/2084184284 wait complete. 2024-09-12T16:54:08.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.903+0000 7fe1923219c0 1 Processor -- start 2024-09-12T16:54:08.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.903+0000 7fe1923219c0 1 -- start start 2024-09-12T16:54:08.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.903+0000 7fe1923219c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fcac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.903+0000 7fe1923219c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a53faca680 con 0x55a53fbc0e00 2024-09-12T16:54:08.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.903+0000 7fe18fe27640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fcac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fcac5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52520/0 (socket says 172.21.15.151:52520) 2024-09-12T16:54:08.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 -- 172.21.15.151:0/196633928 learned_addr learned my addr 172.21.15.151:0/196633928 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 -- 172.21.15.151:0/196633928 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53fa45da0 con 0x55a53fbc0e00 2024-09-12T16:54:08.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 --2- 172.21.15.151:0/196633928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fcac5e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe180001e00 tx=0x7fe18000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55892ec66c987737 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe07de0b640 1 -- 172.21.15.151:0/196633928 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe180012020 con 0x55a53fbc0e00 2024-09-12T16:54:08.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe07de0b640 1 -- 172.21.15.151:0/196633928 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18000e690 con 0x55a53fbc0e00 2024-09-12T16:54:08.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe07de0b640 1 -- 172.21.15.151:0/196633928 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18000ea10 con 0x55a53fbc0e00 2024-09-12T16:54:08.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- 172.21.15.151:0/196633928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 msgr2=0x55a53fcac5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 --2- 172.21.15.151:0/196633928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fcac5e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe180001e00 tx=0x7fe18000b6d0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- 172.21.15.151:0/196633928 shutdown_connections 2024-09-12T16:54:08.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 --2- 172.21.15.151:0/196633928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fcac5e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- 172.21.15.151:0/196633928 >> 172.21.15.151:0/196633928 conn(0x55a53fbbc920 msgr2=0x55a53fca8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- 172.21.15.151:0/196633928 shutdown_connections 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- 172.21.15.151:0/196633928 wait complete. 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 Processor -- start 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- start start 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fb362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a53fa6ca50 con 0x55a53fbc0e00 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fb362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fb362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52524/0 (socket says 172.21.15.151:52524) 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 -- 172.21.15.151:0/3646525541 learned_addr learned my addr 172.21.15.151:0/3646525541 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 -- 172.21.15.151:0/3646525541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53fb36830 con 0x55a53fbc0e00 2024-09-12T16:54:08.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe18fe27640 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fb362d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55a53fcad570 tx=0x7fe180000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe077fff640 1 -- 172.21.15.151:0/3646525541 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe180012030 con 0x55a53fbc0e00 2024-09-12T16:54:08.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe077fff640 1 -- 172.21.15.151:0/3646525541 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18001a750 con 0x55a53fbc0e00 2024-09-12T16:54:08.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53fcb7a00 con 0x55a53fbc0e00 2024-09-12T16:54:08.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe077fff640 1 -- 172.21.15.151:0/3646525541 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18001aa50 con 0x55a53fbc0e00 2024-09-12T16:54:08.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.907+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53fcb7f90 con 0x55a53fbc0e00 2024-09-12T16:54:08.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe077fff640 1 -- 172.21.15.151:0/3646525541 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe180015020 con 0x55a53fbc0e00 2024-09-12T16:54:08.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe077fff640 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe078039ac0 0x7fe07803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe077fff640 1 -- 172.21.15.151:0/3646525541 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe180020030 con 0x55a53fbc0e00 2024-09-12T16:54:08.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe18f626640 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe078039ac0 0x7fe07803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fbc4ff0 0x55a53fcbbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcbc380 con 0x55a53fbc4ff0 2024-09-12T16:54:08.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe190628640 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fbc4ff0 0x55a53fcbbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe18f626640 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe078039ac0 0x7fe07803bf80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe1840ae000 tx=0x7fe1840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe190628640 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fbc4ff0 0x55a53fcbbd10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe190628640 1 -- 172.21.15.151:0/3646525541 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18800a4d0 con 0x55a53fbc4ff0 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcb9260 con 0x55a53fbc4ff0 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe190628640 1 -- 172.21.15.151:0/3646525541 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe18800a4d0 con 0x55a53fbc4ff0 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcbe700 0x55a53fcc0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcc11c0 con 0x55a53fcbe700 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe18fe27640 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcbe700 0x55a53fcc0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.911+0000 7fe18fe27640 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcbe700 0x55a53fcc0af0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe18fe27640 1 -- 172.21.15.151:0/3646525541 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcbe700 2024-09-12T16:54:08.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcbd570 con 0x55a53fbc4ff0 2024-09-12T16:54:08.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe190628640 1 -- 172.21.15.151:0/3646525541 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe18800a4d0 con 0x55a53fbc4ff0 2024-09-12T16:54:08.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcbda10 con 0x55a53fbc4ff0 2024-09-12T16:54:08.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe190628640 1 -- 172.21.15.151:0/3646525541 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe18800a4d0 con 0x55a53fbc4ff0 2024-09-12T16:54:08.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe1923219c0 1 Processor -- start 2024-09-12T16:54:08.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe1923219c0 1 -- start start 2024-09-12T16:54:08.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe1923219c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fccf810 0x55a53fccfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe1923219c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a53fad7450 con 0x55a53fccf810 2024-09-12T16:54:08.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe190628640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fccf810 0x55a53fccfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe190628640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fccf810 0x55a53fccfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52540/0 (socket says 172.21.15.151:52540) 2024-09-12T16:54:08.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe190628640 1 -- 172.21.15.151:0/70666999 learned_addr learned my addr 172.21.15.151:0/70666999 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe190628640 1 -- 172.21.15.151:0/70666999 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53fcd0270 con 0x55a53fccf810 2024-09-12T16:54:08.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe190628640 1 --2- 172.21.15.151:0/70666999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fccf810 0x55a53fccfc30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55a53fcbc760 tx=0x7fe188018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe0757fa640 1 -- 172.21.15.151:0/70666999 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188014450 con 0x55a53fccf810 2024-09-12T16:54:08.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe0757fa640 1 -- 172.21.15.151:0/70666999 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1880145f0 con 0x55a53fccf810 2024-09-12T16:54:08.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe1923219c0 1 -- 172.21.15.151:0/70666999 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53fcd0ad0 con 0x55a53fccf810 2024-09-12T16:54:08.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe0757fa640 1 -- 172.21.15.151:0/70666999 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188014910 con 0x55a53fccf810 2024-09-12T16:54:08.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.915+0000 7fe1923219c0 1 -- 172.21.15.151:0/70666999 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53fcd1040 con 0x55a53fccf810 2024-09-12T16:54:08.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe0757fa640 1 -- 172.21.15.151:0/70666999 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe188011040 con 0x55a53fccf810 2024-09-12T16:54:08.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe0757fa640 1 --2- 172.21.15.151:0/70666999 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe068039a70 0x7fe06803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe0757fa640 1 -- 172.21.15.151:0/70666999 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe18801e070 con 0x55a53fccf810 2024-09-12T16:54:08.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe18fe27640 1 --2- 172.21.15.151:0/70666999 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe068039a70 0x7fe06803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 Processor -- start 2024-09-12T16:54:08.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- start start 2024-09-12T16:54:08.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe18fe27640 1 --2- 172.21.15.151:0/70666999 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe068039a70 0x7fe06803bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe180001560 tx=0x7fe18002c950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fcb3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a53fcace30 con 0x55a53fcb39c0 2024-09-12T16:54:08.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe190628640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fcb3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe190628640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fcb3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52546/0 (socket says 172.21.15.151:52546) 2024-09-12T16:54:08.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe190628640 1 -- 172.21.15.151:0/1557101535 learned_addr learned my addr 172.21.15.151:0/1557101535 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe190628640 1 -- 172.21.15.151:0/1557101535 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53fcb4300 con 0x55a53fcb39c0 2024-09-12T16:54:08.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe190628640 1 --2- 172.21.15.151:0/1557101535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fcb3dc0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe18802bfb0 tx=0x7fe188040f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22058be7ac328d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe06effd640 1 -- 172.21.15.151:0/1557101535 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188028070 con 0x55a53fcb39c0 2024-09-12T16:54:08.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe06effd640 1 -- 172.21.15.151:0/1557101535 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18804f280 con 0x55a53fcb39c0 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe06effd640 1 -- 172.21.15.151:0/1557101535 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188016440 con 0x55a53fcb39c0 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- 172.21.15.151:0/1557101535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 msgr2=0x55a53fcb3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1557101535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fcb3dc0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe18802bfb0 tx=0x7fe188040f70 comp rx=0 tx=0).stop 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- 172.21.15.151:0/1557101535 shutdown_connections 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1557101535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fcb3dc0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- 172.21.15.151:0/1557101535 >> 172.21.15.151:0/1557101535 conn(0x55a53fcd8560 msgr2=0x55a53fcd67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- 172.21.15.151:0/1557101535 shutdown_connections 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- 172.21.15.151:0/1557101535 wait complete. 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 Processor -- start 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- start start 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fce58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.919+0000 7fe1923219c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a53fcb4880 con 0x55a53fcb39c0 2024-09-12T16:54:08.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe190628640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fce58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe190628640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fce58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52558/0 (socket says 172.21.15.151:52558) 2024-09-12T16:54:08.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 learned_addr learned my addr 172.21.15.151:0/1620960511 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:08.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53fce5e40 con 0x55a53fcb39c0 2024-09-12T16:54:08.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe190628640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fce58e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe18802bfb0 tx=0x7fe1880505d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe06d7fa640 1 -- 172.21.15.151:0/1620960511 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188011da0 con 0x55a53fcb39c0 2024-09-12T16:54:08.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe06d7fa640 1 -- 172.21.15.151:0/1620960511 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1880520d0 con 0x55a53fcb39c0 2024-09-12T16:54:08.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53fce60d0 con 0x55a53fcb39c0 2024-09-12T16:54:08.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe06d7fa640 1 -- 172.21.15.151:0/1620960511 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18803eb30 con 0x55a53fcb39c0 2024-09-12T16:54:08.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53fce6a80 con 0x55a53fcb39c0 2024-09-12T16:54:08.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe06d7fa640 1 -- 172.21.15.151:0/1620960511 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe188034020 con 0x55a53fcb39c0 2024-09-12T16:54:08.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe06d7fa640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe058039ac0 0x7fe05803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe06d7fa640 1 -- 172.21.15.151:0/1620960511 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe188032020 con 0x55a53fcb39c0 2024-09-12T16:54:08.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe18fe27640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe058039ac0 0x7fe05803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fcf0db0 0x55a53fcf3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcf39c0 con 0x55a53fcf0db0 2024-09-12T16:54:08.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe18f626640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fcf0db0 0x55a53fcf3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe18fe27640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe058039ac0 0x7fe05803bf80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55a53fcc15a0 tx=0x7fe18002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe18f626640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fcf0db0 0x55a53fcf3270 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 20 realm 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.923+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcf3df0 con 0x55a53fcf0db0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcf46c0 con 0x55a53fcf0db0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcf4a60 con 0x55a53fcf0db0 2024-09-12T16:54:08.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcf57c0 0x55a53fcf7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcf81c0 con 0x55a53fcf57c0 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe190628640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcf57c0 0x55a53fcf7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe190628640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcf57c0 0x55a53fcf7bb0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 20 searching for the correct realm 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a53fcfa110 0x55a53fcfc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18fe27640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a53fcfa110 0x55a53fcfc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18fe27640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a53fcfa110 0x55a53fcfc540 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18fe27640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe180017050 0x7fe18004d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:08.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x7fe180017050 2024-09-12T16:54:08.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18f626640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe180017050 0x7fe18004d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:08.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.927+0000 7fe18f626640 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe180017050 0x7fe18004d3b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:08.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x7fe180017050 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.931+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x7fe180017050 2024-09-12T16:54:08.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.935+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x7fe180017050 2024-09-12T16:54:08.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x7fe180017050 2024-09-12T16:54:08.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcfa110 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.939+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf57c0 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfcbc0 con 0x7fe180017050 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:08.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcf8b80 con 0x55a53fcf0db0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcf9420 con 0x55a53fcf0db0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcf87c0 con 0x55a53fcf0db0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 zone default found 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 4 Realm: () 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 zonegroup default 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfd040 con 0x55a53fcf57c0 2024-09-12T16:54:08.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcff300 con 0x55a53fcfa110 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcff6d0 con 0x55a53fcfa110 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 started sync module instance, tier type = 2024-09-12T16:54:08.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:08.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.943+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfe790 con 0x7fe180017050 2024-09-12T16:54:08.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.947+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.947+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94168228555920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfe790 con 0x7fe180017050 2024-09-12T16:54:08.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.947+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd001e0 con 0x55a53fcf0db0 2024-09-12T16:54:08.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.947+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94168228555920] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.947+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.947+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94168228560048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfe790 con 0x55a53fcf0db0 2024-09-12T16:54:08.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.947+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd00bf0 con 0x55a53fcfa110 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.951+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94168228560048] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.951+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.951+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94168228553440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fcfe700 con 0x55a53fcfa110 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.951+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd01940 con 0x7fe180017050 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.951+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.951+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94168228566432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd02050 con 0x7fe180017050 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.951+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd02b50 con 0x55a53fcf0db0 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.951+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94168228553440] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.955+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94168228566432] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.955+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.955+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94168228570688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd02b10 con 0x55a53fcf0db0 2024-09-12T16:54:08.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.955+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd02f70 con 0x55a53fcf57c0 2024-09-12T16:54:08.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.955+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94168228570688] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.955+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.955+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94168228567712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd02f70 con 0x55a53fcf57c0 2024-09-12T16:54:08.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.955+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd03930 con 0x55a53fcf57c0 2024-09-12T16:54:08.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94168228574336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd03d50 con 0x55a53fcf57c0 2024-09-12T16:54:08.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd04840 con 0x55a53fcf57c0 2024-09-12T16:54:08.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94168228567712] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94168228574336] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94168228578064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd038e0 con 0x55a53fcf57c0 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 20 add_watcher() i=0 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 20 add_watcher() i=1 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 20 add_watcher() i=2 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 20 add_watcher() i=3 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 20 add_watcher() i=4 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 20 add_watcher() i=5 2024-09-12T16:54:08.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.959+0000 7fe1923219c0 20 add_watcher() i=6 2024-09-12T16:54:08.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94168228578064] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe1923219c0 20 add_watcher() i=7 2024-09-12T16:54:08.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe1923219c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:08.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd07940 con 0x55a53fcf0db0 2024-09-12T16:54:08.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94168228564960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd04dc0 con 0x55a53fcf0db0 2024-09-12T16:54:08.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94168228564960] v34'254 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:08.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe1923219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:08.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe1923219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:08.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.963+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x55a53fcf0db0 2024-09-12T16:54:08.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.967+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.967+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x55a53fcf57c0 2024-09-12T16:54:08.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.967+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.967+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x55a53fcfa110 2024-09-12T16:54:08.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.971+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.971+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x55a53fcf0db0 2024-09-12T16:54:08.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.971+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'255 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.971+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x7fe180017050 2024-09-12T16:54:08.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.971+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.971+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x55a53fcfa110 2024-09-12T16:54:08.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.975+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.975+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x55a53fcf0db0 2024-09-12T16:54:08.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.975+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.975+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x55a53fcf57c0 2024-09-12T16:54:08.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.979+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.979+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x7fe180017050 2024-09-12T16:54:08.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.979+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.979+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd10040 con 0x55a53fcfa110 2024-09-12T16:54:08.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.979+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.983+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd117f0 con 0x7fe180017050 2024-09-12T16:54:08.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.983+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'81 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.983+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd117f0 con 0x55a53fcf57c0 2024-09-12T16:54:08.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.983+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.983+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd117f0 con 0x7fe180017050 2024-09-12T16:54:08.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.987+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.987+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd117f0 con 0x55a53fcf57c0 2024-09-12T16:54:08.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.987+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:08.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.987+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd117f0 con 0x55a53fcf0db0 2024-09-12T16:54:08.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.987+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'256 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:08.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.991+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd117f0 con 0x55a53fcfa110 2024-09-12T16:54:08.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.991+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.991+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11230 con 0x7fe180017050 2024-09-12T16:54:08.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.991+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:08.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.991+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11230 con 0x55a53fcfa110 2024-09-12T16:54:08.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.995+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:08.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.995+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11230 con 0x55a53fcf0db0 2024-09-12T16:54:09.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.995+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:09.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.995+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11230 con 0x55a53fcf0db0 2024-09-12T16:54:09.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.995+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'257 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:09.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.995+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11230 con 0x55a53fcfa110 2024-09-12T16:54:09.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.999+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.999+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11230 con 0x7fe180017050 2024-09-12T16:54:09.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.999+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:09.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:08.999+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcfa110 2024-09-12T16:54:09.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.003+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.003+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcfa110 2024-09-12T16:54:09.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.003+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.003+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcfa110 2024-09-12T16:54:09.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.003+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.003+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcfa110 2024-09-12T16:54:09.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.003+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.003+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcf57c0 2024-09-12T16:54:09.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.007+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:09.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.007+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcfa110 2024-09-12T16:54:09.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.007+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.007+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcf57c0 2024-09-12T16:54:09.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.011+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:09.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.011+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcfa110 2024-09-12T16:54:09.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.011+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.011+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x55a53fcf57c0 2024-09-12T16:54:09.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.015+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:09.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.015+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd11060 con 0x7fe180017050 2024-09-12T16:54:09.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.015+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.015+0000 7fe044fe1640 20 reqs_thread_entry: start 2024-09-12T16:54:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 20 Filter name: none 2024-09-12T16:54:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fdfbe7fc640 20 reqs_thread_entry: start 2024-09-12T16:54:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-12T16:54:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd0f790 con 0x55a53fcfa110 2024-09-12T16:54:09.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 20 rados_obj.operate() r=0 bl.length=363 2024-09-12T16:54:09.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-12T16:54:09.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T16:54:09.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:09.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd0f1e0 con 0x55a53fcfa110 2024-09-12T16:54:09.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fe180008030 con 0x55a53fcfa110 2024-09-12T16:54:09.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 10 removing key index: true_admin_akey 2024-09-12T16:54:09.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd0f1a0 con 0x55a53fcfa110 2024-09-12T16:54:09.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(96 true_admin_akey [delete] v34'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fe180061040 con 0x55a53fcfa110 2024-09-12T16:54:09.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-12T16:54:09.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94168228622752 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd2f6e0 con 0x55a53fcf57c0 2024-09-12T16:54:09.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== watch-notify(notify (1) cookie 94168228567712 notify 146028888095 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55a53fd10c50 con 0x55a53fcf57c0 2024-09-12T16:54:09.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe06effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94168228567712 notifier 4865 bl.length()=165 2024-09-12T16:54:09.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe06effd640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe054003d70 con 0x55a53fcf57c0 2024-09-12T16:54:09.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.019+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(97 notify.5 [notify cookie 94168228622752 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:09.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:09.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== watch-notify(notify_complete (2) cookie 94168228622752 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a53fce60d0 con 0x55a53fcf57c0 2024-09-12T16:54:09.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe1923219c0 10 removing email index: 2024-09-12T16:54:09.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe1923219c0 10 removing user buckets index 2024-09-12T16:54:09.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd0f1a0 con 0x55a53fcfa110 2024-09-12T16:54:09.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(99 a_user.buckets [delete] v34'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fe180061040 con 0x55a53fcfa110 2024-09-12T16:54:09.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe1923219c0 10 removing user index: a_user 2024-09-12T16:54:09.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd2f640 con 0x55a53fcfa110 2024-09-12T16:54:09.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(100 a_user [call,call,delete] v34'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fe180061040 con 0x55a53fcfa110 2024-09-12T16:54:09.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe1923219c0 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-12T16:54:09.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe1923219c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-12T16:54:09.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94168228755008 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd2dfa0 con 0x55a53fcfa110 2024-09-12T16:54:09.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== watch-notify(notify (1) cookie 94168228553440 notify 146028888074 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55a53fd10080 con 0x55a53fcfa110 2024-09-12T16:54:09.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe06e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94168228553440 notifier 4865 bl.length()=155 2024-09-12T16:54:09.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe06e7fc640 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdfc40032d0 con 0x55a53fcfa110 2024-09-12T16:54:09.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(101 notify.2 [notify cookie 94168228755008 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe180061040 con 0x55a53fcfa110 2024-09-12T16:54:09.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.023+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe180061040 con 0x55a53fcfa110 2024-09-12T16:54:09.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== watch-notify(notify_complete (2) cookie 94168228755008 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe180056040 con 0x55a53fcfa110 2024-09-12T16:54:09.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94168228564960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd2f640 con 0x55a53fcf0db0 2024-09-12T16:54:09.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94168228564960] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:09.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94168228555920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd00fe0 con 0x7fe180017050 2024-09-12T16:54:09.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94168228555920] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:09.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe1923219c0 20 remove_watcher() i=0 2024-09-12T16:54:09.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe1923219c0 2 removed watcher, disabling cache 2024-09-12T16:54:09.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.027+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94168228560048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd00fe0 con 0x55a53fcf0db0 2024-09-12T16:54:09.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.031+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94168228560048] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:09.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.031+0000 7fe1923219c0 20 remove_watcher() i=1 2024-09-12T16:54:09.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.031+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94168228553440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd00fe0 con 0x55a53fcfa110 2024-09-12T16:54:09.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe18fe27640 1 -- 172.21.15.151:0/1620960511 <== osd.3 v2:172.21.15.151:6808/987175333 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94168228553440] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe180061040 con 0x55a53fcfa110 2024-09-12T16:54:09.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe1923219c0 20 remove_watcher() i=2 2024-09-12T16:54:09.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94168228566432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd00fe0 con 0x7fe180017050 2024-09-12T16:54:09.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94168228566432] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x7fe180017050 2024-09-12T16:54:09.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe1923219c0 20 remove_watcher() i=3 2024-09-12T16:54:09.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94168228570688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd00fe0 con 0x55a53fcf0db0 2024-09-12T16:54:09.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94168228570688] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1840a8070 con 0x55a53fcf0db0 2024-09-12T16:54:09.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe1923219c0 20 remove_watcher() i=4 2024-09-12T16:54:09.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.035+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94168228567712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd02640 con 0x55a53fcf57c0 2024-09-12T16:54:09.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.039+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94168228567712] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:09.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.039+0000 7fe1923219c0 20 remove_watcher() i=5 2024-09-12T16:54:09.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.039+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94168228574336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd00fe0 con 0x55a53fcf57c0 2024-09-12T16:54:09.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94168228574336] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:09.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 20 remove_watcher() i=6 2024-09-12T16:54:09.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94168228578064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a53fd00fe0 con 0x55a53fcf57c0 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe190628640 1 -- 172.21.15.151:0/1620960511 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94168228578064] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18802a070 con 0x55a53fcf57c0 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 20 remove_watcher() i=7 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcf57c0 msgr2=0x55a53fcf7bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcf57c0 0x55a53fcf7bb0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fcf0db0 msgr2=0x55a53fcf3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fcf0db0 0x55a53fcf3270 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe180017050 msgr2=0x7fe18004d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fe180017050 0x7fe18004d3b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a53fcfa110 msgr2=0x55a53fcfc540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55a53fcfa110 0x55a53fcfc540 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe058039ac0 msgr2=0x7fe05803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe058039ac0 0x7fe05803bf80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55a53fcc15a0 tx=0x7fe18002f000 comp rx=0 tx=0).stop 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 msgr2=0x55a53fce58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/1620960511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fcb39c0 0x55a53fce58e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe18802bfb0 tx=0x7fe1880505d0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 reap_dead start 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe18f626640 1 -- 172.21.15.151:0/1620960511 reap_dead start 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 shutdown_connections 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 >> 172.21.15.151:0/1620960511 conn(0x55a53fcd8560 msgr2=0x55a53fcd6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 shutdown_connections 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/1620960511 wait complete. 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/70666999 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe068039a70 msgr2=0x7fe06803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/70666999 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe068039a70 0x7fe06803bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe180001560 tx=0x7fe18002c950 comp rx=0 tx=0).stop 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/70666999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fccf810 msgr2=0x55a53fccfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/70666999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fccf810 0x55a53fccfc30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55a53fcbc760 tx=0x7fe188018830 comp rx=0 tx=0).stop 2024-09-12T16:54:09.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/70666999 shutdown_connections 2024-09-12T16:54:09.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/70666999 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe068039a70 0x7fe06803bf30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 --2- 172.21.15.151:0/70666999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fccf810 0x55a53fccfc30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/70666999 >> 172.21.15.151:0/70666999 conn(0x55a53fcc51c0 msgr2=0x55a53fcc55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/70666999 shutdown_connections 2024-09-12T16:54:09.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.043+0000 7fe1923219c0 1 -- 172.21.15.151:0/70666999 wait complete. 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcbe700 msgr2=0x55a53fcc0af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcbe700 0x55a53fcc0af0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fbc4ff0 msgr2=0x55a53fcbbd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fbc4ff0 0x55a53fcbbd10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe078039ac0 msgr2=0x7fe07803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe078039ac0 0x7fe07803bf80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe1840ae000 tx=0x7fe1840a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 msgr2=0x55a53fb362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fb362d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55a53fcad570 tx=0x7fe180000bd0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 shutdown_connections 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55a53fcbe700 0x55a53fcc0af0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55a53fbc4ff0 0x55a53fcbbd10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe078039ac0 0x7fe07803bf80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 --2- 172.21.15.151:0/3646525541 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53fbc0e00 0x55a53fb362d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 >> 172.21.15.151:0/3646525541 conn(0x55a53fbbc920 msgr2=0x55a53fca6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 shutdown_connections 2024-09-12T16:54:09.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.047+0000 7fe1923219c0 1 -- 172.21.15.151:0/3646525541 wait complete. 2024-09-12T16:54:09.061 ERROR:root:None 2024-09-12T16:54:09.062 ERROR:root:0 2024-09-12T16:54:09.062 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-12T16:54:09.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-12T16:54:09.062 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-12T16:54:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.135+0000 7fbdea8769c0 1 Processor -- start 2024-09-12T16:54:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.135+0000 7fbdea8769c0 1 -- start start 2024-09-12T16:54:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbdea8769c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559fddfb9140 0x559fddfbb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbdea8769c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559fdde699c0 con 0x559fddfb4fa0 2024-09-12T16:54:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbdea8769c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x559fddeb96d0 con 0x559fddfb9140 2024-09-12T16:54:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde7b7b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559fddfb9140 0x559fddfbb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde837c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x559fddfb4fa0 0x559fddfb5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49262/0 (socket says 172.21.15.151:49262) 2024-09-12T16:54:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde7b7b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x559fddfb9140 0x559fddfbb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52572/0 (socket says 172.21.15.151:52572) 2024-09-12T16:54:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde837c640 1 -- 172.21.15.151:0/277769754 learned_addr learned my addr 172.21.15.151:0/277769754 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:09.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde7b7b640 1 -- 172.21.15.151:0/277769754 >> v1:172.21.15.122:6789/0 conn(0x559fddfb4fa0 legacy=0x559fddfb5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde7b7b640 1 -- 172.21.15.151:0/277769754 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fdde5dca0 con 0x559fddfb9140 2024-09-12T16:54:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde7b7b640 1 --2- 172.21.15.151:0/277769754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb9140 0x559fddfbb530 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000a480 tx=0x7fbdd001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7542a739037a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde737a640 1 -- 172.21.15.151:0/277769754 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdd00aa570 con 0x559fddfb9140 2024-09-12T16:54:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde737a640 1 -- 172.21.15.151:0/277769754 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd00af070 con 0x559fddfb9140 2024-09-12T16:54:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.139+0000 7fbde737a640 1 -- 172.21.15.151:0/277769754 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdd00aa860 con 0x559fddfb9140 2024-09-12T16:54:09.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.143+0000 7fbdea8769c0 1 -- 172.21.15.151:0/277769754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb9140 msgr2=0x559fddfbb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.143+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/277769754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb9140 0x559fddfbb530 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000a480 tx=0x7fbdd001b310 comp rx=0 tx=0).stop 2024-09-12T16:54:09.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.143+0000 7fbdea8769c0 1 -- 172.21.15.151:0/277769754 shutdown_connections 2024-09-12T16:54:09.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.143+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/277769754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb9140 0x559fddfbb530 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.143+0000 7fbdea8769c0 1 -- 172.21.15.151:0/277769754 >> 172.21.15.151:0/277769754 conn(0x559fddfb0ac0 msgr2=0x559fddfb2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.143+0000 7fbdea8769c0 1 -- 172.21.15.151:0/277769754 shutdown_connections 2024-09-12T16:54:09.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.143+0000 7fbdea8769c0 1 -- 172.21.15.151:0/277769754 wait complete. 2024-09-12T16:54:09.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 Processor -- start 2024-09-12T16:54:09.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- start start 2024-09-12T16:54:09.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fddebd680 con 0x559fddfb4fa0 2024-09-12T16:54:09.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbde837c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbde837c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52576/0 (socket says 172.21.15.151:52576) 2024-09-12T16:54:09.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbde837c640 1 -- 172.21.15.151:0/4152316809 learned_addr learned my addr 172.21.15.151:0/4152316809 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbde837c640 1 -- 172.21.15.151:0/4152316809 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fdde38da0 con 0x559fddfb4fa0 2024-09-12T16:54:09.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbde837c640 1 --2- 172.21.15.151:0/4152316809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a0730 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8001e50 tx=0x7fbdd8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6d58b14000e5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbcd660c640 1 -- 172.21.15.151:0/4152316809 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdd8012020 con 0x559fddfb4fa0 2024-09-12T16:54:09.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbcd660c640 1 -- 172.21.15.151:0/4152316809 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd800e7c0 con 0x559fddfb4fa0 2024-09-12T16:54:09.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbcd660c640 1 -- 172.21.15.151:0/4152316809 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdd800eaa0 con 0x559fddfb4fa0 2024-09-12T16:54:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4152316809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 msgr2=0x559fde0a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4152316809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a0730 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8001e50 tx=0x7fbdd8001e80 comp rx=0 tx=0).stop 2024-09-12T16:54:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4152316809 shutdown_connections 2024-09-12T16:54:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4152316809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a0730 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4152316809 >> 172.21.15.151:0/4152316809 conn(0x559fddfb0ac0 msgr2=0x559fde09c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4152316809 shutdown_connections 2024-09-12T16:54:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4152316809 wait complete. 2024-09-12T16:54:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 Processor -- start 2024-09-12T16:54:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- start start 2024-09-12T16:54:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.159+0000 7fbdea8769c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fdde5fa50 con 0x559fddfb4fa0 2024-09-12T16:54:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbde837c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbde837c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52590/0 (socket says 172.21.15.151:52590) 2024-09-12T16:54:09.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbde837c640 1 -- 172.21.15.151:0/18551484 learned_addr learned my addr 172.21.15.151:0/18551484 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbde837c640 1 -- 172.21.15.151:0/18551484 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fde0a8350 con 0x559fddfb4fa0 2024-09-12T16:54:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbde837c640 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a7df0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8001ec0 tx=0x7fbdd8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbcd4e09640 1 -- 172.21.15.151:0/18551484 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdd8012030 con 0x559fddfb4fa0 2024-09-12T16:54:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbcd4e09640 1 -- 172.21.15.151:0/18551484 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd80014b0 con 0x559fddfb4fa0 2024-09-12T16:54:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbcd4e09640 1 -- 172.21.15.151:0/18551484 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdd801a8f0 con 0x559fddfb4fa0 2024-09-12T16:54:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fde0a85e0 con 0x559fddfb4fa0 2024-09-12T16:54:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fde0a8f90 con 0x559fddfb4fa0 2024-09-12T16:54:09.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbcd4e09640 1 -- 172.21.15.151:0/18551484 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbdd8015020 con 0x559fddfb4fa0 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbcd4e09640 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcd0039ac0 0x7fbcd003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbcd4e09640 1 -- 172.21.15.151:0/18551484 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbdd8020070 con 0x559fddfb4fa0 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbde7b7b640 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcd0039ac0 0x7fbcd003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fddfb9140 0x559fde0aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0af4a0 con 0x559fddfb9140 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.163+0000 7fbde8b7d640 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fddfb9140 0x559fde0aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde7b7b640 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcd0039ac0 0x7fbcd003bf80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00ae000 tx=0x7fbdd00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde8b7d640 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fddfb9140 0x559fde0aef60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde8b7d640 1 -- 172.21.15.151:0/18551484 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbde000a4d0 con 0x559fddfb9140 2024-09-12T16:54:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0af840 con 0x559fddfb9140 2024-09-12T16:54:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde8b7d640 1 -- 172.21.15.151:0/18551484 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbde000a4d0 con 0x559fddfb9140 2024-09-12T16:54:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0b1650 0x559fde0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0b4130 con 0x559fde0b1650 2024-09-12T16:54:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde837c640 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0b1650 0x559fde0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde837c640 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0b1650 0x559fde0b3a40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde837c640 1 -- 172.21.15.151:0/18551484 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0b1650 2024-09-12T16:54:09.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0b04c0 con 0x559fddfb9140 2024-09-12T16:54:09.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde8b7d640 1 -- 172.21.15.151:0/18551484 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbde000a4d0 con 0x559fddfb9140 2024-09-12T16:54:09.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0b0930 con 0x559fddfb9140 2024-09-12T16:54:09.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbde8b7d640 1 -- 172.21.15.151:0/18551484 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbde000a4d0 con 0x559fddfb9140 2024-09-12T16:54:09.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 Processor -- start 2024-09-12T16:54:09.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 -- start start 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fde0c27a0 0x559fde0c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.167+0000 7fbdea8769c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fddeca450 con 0x559fde0c27a0 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbde8b7d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fde0c27a0 0x559fde0c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbde8b7d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fde0c27a0 0x559fde0c2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52600/0 (socket says 172.21.15.151:52600) 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbde8b7d640 1 -- 172.21.15.151:0/3149373880 learned_addr learned my addr 172.21.15.151:0/3149373880 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbde8b7d640 1 -- 172.21.15.151:0/3149373880 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fde0c3200 con 0x559fde0c27a0 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbde8b7d640 1 --2- 172.21.15.151:0/3149373880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fde0c27a0 0x559fde0c2bc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x559fde0a8d00 tx=0x7fbde00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbccdffb640 1 -- 172.21.15.151:0/3149373880 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbde0014450 con 0x559fde0c27a0 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbccdffb640 1 -- 172.21.15.151:0/3149373880 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde00145f0 con 0x559fde0c27a0 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbdea8769c0 1 -- 172.21.15.151:0/3149373880 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fde0c3a60 con 0x559fde0c27a0 2024-09-12T16:54:09.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbccdffb640 1 -- 172.21.15.151:0/3149373880 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbde00148f0 con 0x559fde0c27a0 2024-09-12T16:54:09.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbdea8769c0 1 -- 172.21.15.151:0/3149373880 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fde0c3fd0 con 0x559fde0c27a0 2024-09-12T16:54:09.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbccdffb640 1 -- 172.21.15.151:0/3149373880 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbde0011040 con 0x559fde0c27a0 2024-09-12T16:54:09.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbccdffb640 1 --2- 172.21.15.151:0/3149373880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcc0039ac0 0x7fbcc003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbccdffb640 1 -- 172.21.15.151:0/3149373880 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbde001e070 con 0x559fde0c27a0 2024-09-12T16:54:09.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbde837c640 1 --2- 172.21.15.151:0/3149373880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcc0039ac0 0x7fbcc003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbdea8769c0 1 Processor -- start 2024-09-12T16:54:09.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbdea8769c0 1 -- start start 2024-09-12T16:54:09.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbde837c640 1 --2- 172.21.15.151:0/3149373880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcc0039ac0 0x7fbcc003bf80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8023b30 tx=0x7fbdd800ef60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbdea8769c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fddf2a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.171+0000 7fbdea8769c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fde0a0f60 con 0x559fddf2a4e0 2024-09-12T16:54:09.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fddf2a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fddf2a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52610/0 (socket says 172.21.15.151:52610) 2024-09-12T16:54:09.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 -- 172.21.15.151:0/1667284792 learned_addr learned my addr 172.21.15.151:0/1667284792 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 -- 172.21.15.151:0/1667284792 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fddf2ae20 con 0x559fddf2a4e0 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 --2- 172.21.15.151:0/1667284792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fddf2a8e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbde00505b0 tx=0x7fbde0011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c88cbe6a01eb7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbcc77fe640 1 -- 172.21.15.151:0/1667284792 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbde004f1e0 con 0x559fddf2a4e0 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbcc77fe640 1 -- 172.21.15.151:0/1667284792 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde002bc50 con 0x559fddf2a4e0 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbcc77fe640 1 -- 172.21.15.151:0/1667284792 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbde0011510 con 0x559fddf2a4e0 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- 172.21.15.151:0/1667284792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 msgr2=0x559fddf2a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/1667284792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fddf2a8e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbde00505b0 tx=0x7fbde0011e80 comp rx=0 tx=0).stop 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- 172.21.15.151:0/1667284792 shutdown_connections 2024-09-12T16:54:09.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/1667284792 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fddf2a8e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- 172.21.15.151:0/1667284792 >> 172.21.15.151:0/1667284792 conn(0x559fde0cb470 msgr2=0x559fde0c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- 172.21.15.151:0/1667284792 shutdown_connections 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- 172.21.15.151:0/1667284792 wait complete. 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 Processor -- start 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- start start 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fde0d8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fddf2b3a0 con 0x559fddf2a4e0 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fde0d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fde0d8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52626/0 (socket says 172.21.15.151:52626) 2024-09-12T16:54:09.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 learned_addr learned my addr 172.21.15.151:0/4067303403 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fde0d8cf0 con 0x559fddf2a4e0 2024-09-12T16:54:09.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbde8b7d640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fde0d8790 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbde0050670 tx=0x7fbde0050540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbcc5ffb640 1 -- 172.21.15.151:0/4067303403 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbde004f1e0 con 0x559fddf2a4e0 2024-09-12T16:54:09.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559fde0d8f80 con 0x559fddf2a4e0 2024-09-12T16:54:09.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbcc5ffb640 1 -- 172.21.15.151:0/4067303403 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde0031030 con 0x559fddf2a4e0 2024-09-12T16:54:09.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbcc5ffb640 1 -- 172.21.15.151:0/4067303403 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbde00496e0 con 0x559fddf2a4e0 2024-09-12T16:54:09.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.175+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fde0d9930 con 0x559fddf2a4e0 2024-09-12T16:54:09.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbcc5ffb640 1 -- 172.21.15.151:0/4067303403 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbde00498d0 con 0x559fddf2a4e0 2024-09-12T16:54:09.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbcc5ffb640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcb8039a70 0x7fbcb803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbcc5ffb640 1 -- 172.21.15.151:0/4067303403 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbde000e040 con 0x559fddf2a4e0 2024-09-12T16:54:09.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde837c640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcb8039a70 0x7fbcb803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fde0e3cd0 0x559fde0e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0e68e0 con 0x559fde0e3cd0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde7b7b640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fde0e3cd0 0x559fde0e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde837c640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcb8039a70 0x7fbcb803bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbdd801a6f0 tx=0x7fbdd8043000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde7b7b640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fde0e3cd0 0x559fde0e6190 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 realm 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0e6d10 con 0x559fde0e3cd0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0e75e0 con 0x559fde0e3cd0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0e7980 con 0x559fde0e3cd0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0e86e0 0x559fde0eaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0eb0e0 con 0x559fde0e86e0 2024-09-12T16:54:09.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.179+0000 7fbde8b7d640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0e86e0 0x559fde0eaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde8b7d640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0e86e0 0x559fde0eaad0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbdea8769c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbdea8769c0 20 searching for the correct realm 2024-09-12T16:54:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559fde0ed030 0x559fde0ef460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde837c640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559fde0ed030 0x559fde0ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde837c640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559fde0ed030 0x559fde0ef460 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde837c640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbdd8017050 0x7fbdd8040370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x7fbdd8017050 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde7b7b640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbdd8017050 0x7fbdd8040370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde7b7b640 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbdd8017050 0x7fbdd8040370 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.183+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e3cd0 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e3cd0 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x7fbdd8017050 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e3cd0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e3cd0 2024-09-12T16:54:09.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x7fbdd8017050 2024-09-12T16:54:09.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.187+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e3cd0 2024-09-12T16:54:09.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e3cd0 2024-09-12T16:54:09.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x7fbdd8017050 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e3cd0 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.191+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x7fbdd8017050 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0ed030 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e86e0 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x559fde0e3cd0 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559fde0efae0 con 0x7fbdd8017050 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0ebad0 con 0x559fde0e3cd0 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.195+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0eb710 con 0x559fde0e3cd0 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0ec4b0 con 0x559fde0e3cd0 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 zone default found 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 4 Realm: () 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:09.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 zonegroup default 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0eff60 con 0x559fde0e86e0 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f21f0 con 0x559fde0ed030 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f25e0 con 0x559fde0ed030 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 started sync module instance, tier type = 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f1680 con 0x7fbdd8017050 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94145113693088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f1680 con 0x7fbdd8017050 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.199+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f30a0 con 0x559fde0e3cd0 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.203+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94145113693088] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.203+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.203+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94145113697200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f1680 con 0x559fde0e3cd0 2024-09-12T16:54:09.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.203+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f3ae0 con 0x559fde0ed030 2024-09-12T16:54:09.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.203+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94145113697200] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.203+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94145113690576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f15f0 con 0x559fde0ed030 2024-09-12T16:54:09.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f47e0 con 0x7fbdd8017050 2024-09-12T16:54:09.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94145113703520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f5080 con 0x7fbdd8017050 2024-09-12T16:54:09.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f5a80 con 0x559fde0e3cd0 2024-09-12T16:54:09.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94145113690576] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94145113703520] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94145113702016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f4b60 con 0x559fde0e3cd0 2024-09-12T16:54:09.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.207+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f6320 con 0x559fde0e86e0 2024-09-12T16:54:09.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.211+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94145113702016] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.211+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.211+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94145113710192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f4b60 con 0x559fde0e86e0 2024-09-12T16:54:09.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.211+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f6b70 con 0x559fde0e86e0 2024-09-12T16:54:09.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.211+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94145113710192] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94145113707920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f6b70 con 0x559fde0e86e0 2024-09-12T16:54:09.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f7590 con 0x559fde0e86e0 2024-09-12T16:54:09.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94145113707920] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94145113714816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f7770 con 0x559fde0e86e0 2024-09-12T16:54:09.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 20 add_watcher() i=0 2024-09-12T16:54:09.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 20 add_watcher() i=1 2024-09-12T16:54:09.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 20 add_watcher() i=2 2024-09-12T16:54:09.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 20 add_watcher() i=3 2024-09-12T16:54:09.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 20 add_watcher() i=4 2024-09-12T16:54:09.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 20 add_watcher() i=5 2024-09-12T16:54:09.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.215+0000 7fbdea8769c0 20 add_watcher() i=6 2024-09-12T16:54:09.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94145113714816] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 20 add_watcher() i=7 2024-09-12T16:54:09.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:09.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde0fab40 con 0x559fde0e3cd0 2024-09-12T16:54:09.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94145113716320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f7f60 con 0x559fde0e3cd0 2024-09-12T16:54:09.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94145113716320] v34'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbc9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 5 note: GC not initialized 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbc9d7e2640 20 reqs_thread_entry: start 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 20 Filter name: none 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbc0effd640 20 reqs_thread_entry: start 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.219+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde11dc50 con 0x559fde0e86e0 2024-09-12T16:54:09.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T16:54:09.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:09.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:09.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde1241b0 con 0x559fde0e86e0 2024-09-12T16:54:09.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:09.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:09.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94145113898016 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559fde11f880 con 0x559fde0e3cd0 2024-09-12T16:54:09.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 94145113702016 notify 146028888114 ret 0) ==== 708+0+0 (crc 0 0 0) 0x559fdde5dca0 con 0x559fde0e3cd0 2024-09-12T16:54:09.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbcc77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888114 cookie 94145113702016 notifier 4872 bl.length()=666 2024-09-12T16:54:09.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbcc77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:09.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbcc77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 94145113898016 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.223+0000 7fbcc77fe640 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbcac003eb0 con 0x559fde0e3cd0 2024-09-12T16:54:09.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.227+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.227+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 94145113898016 notify 146028888114 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbdd00d9770 con 0x559fde0e3cd0 2024-09-12T16:54:09.232 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:09.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.227+0000 7fbc9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.227+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94145113716320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde11ba00 con 0x559fde0e3cd0 2024-09-12T16:54:09.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.227+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94145113716320] v34'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.227+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94145113693088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde11ba00 con 0x7fbdd8017050 2024-09-12T16:54:09.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.231+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94145113693088] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.231+0000 7fbdea8769c0 20 remove_watcher() i=0 2024-09-12T16:54:09.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.231+0000 7fbdea8769c0 2 removed watcher, disabling cache 2024-09-12T16:54:09.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.231+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94145113697200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde11ba00 con 0x559fde0e3cd0 2024-09-12T16:54:09.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.231+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94145113697200] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.231+0000 7fbdea8769c0 20 remove_watcher() i=1 2024-09-12T16:54:09.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.231+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94145113690576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f2bb0 con 0x559fde0ed030 2024-09-12T16:54:09.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbde837c640 1 -- 172.21.15.151:0/4067303403 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94145113690576] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd8008030 con 0x559fde0ed030 2024-09-12T16:54:09.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbdea8769c0 20 remove_watcher() i=2 2024-09-12T16:54:09.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94145113703520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde11ba00 con 0x7fbdd8017050 2024-09-12T16:54:09.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94145113703520] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x7fbdd8017050 2024-09-12T16:54:09.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbdea8769c0 20 remove_watcher() i=3 2024-09-12T16:54:09.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94145113702016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f11d0 con 0x559fde0e3cd0 2024-09-12T16:54:09.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94145113702016] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd00a8070 con 0x559fde0e3cd0 2024-09-12T16:54:09.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbdea8769c0 20 remove_watcher() i=4 2024-09-12T16:54:09.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.235+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94145113710192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f2bb0 con 0x559fde0e86e0 2024-09-12T16:54:09.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.239+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94145113710192] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.239+0000 7fbdea8769c0 20 remove_watcher() i=5 2024-09-12T16:54:09.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.239+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94145113707920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde11ba00 con 0x559fde0e86e0 2024-09-12T16:54:09.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94145113707920] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 20 remove_watcher() i=6 2024-09-12T16:54:09.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94145113714816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559fde0f3e80 con 0x559fde0e86e0 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbde8b7d640 1 -- 172.21.15.151:0/4067303403 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94145113714816] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbde002a070 con 0x559fde0e86e0 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 20 remove_watcher() i=7 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0e86e0 msgr2=0x559fde0eaad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0e86e0 0x559fde0eaad0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fde0e3cd0 msgr2=0x559fde0e6190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fde0e3cd0 0x559fde0e6190 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbdd8017050 msgr2=0x7fbdd8040370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fbdd8017050 0x7fbdd8040370 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559fde0ed030 msgr2=0x559fde0ef460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x559fde0ed030 0x559fde0ef460 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcb8039a70 msgr2=0x7fbcb803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcb8039a70 0x7fbcb803bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbdd801a6f0 tx=0x7fbdd8043000 comp rx=0 tx=0).stop 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 msgr2=0x559fde0d8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/4067303403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddf2a4e0 0x559fde0d8790 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbde0050670 tx=0x7fbde0050540 comp rx=0 tx=0).stop 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 reap_dead start 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbde7b7b640 1 -- 172.21.15.151:0/4067303403 reap_dead start 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 shutdown_connections 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 >> 172.21.15.151:0/4067303403 conn(0x559fde0cb470 msgr2=0x559fde0c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 shutdown_connections 2024-09-12T16:54:09.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/4067303403 wait complete. 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/3149373880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcc0039ac0 msgr2=0x7fbcc003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/3149373880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcc0039ac0 0x7fbcc003bf80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8023b30 tx=0x7fbdd800ef60 comp rx=0 tx=0).stop 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/3149373880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fde0c27a0 msgr2=0x559fde0c2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/3149373880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fde0c27a0 0x559fde0c2bc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x559fde0a8d00 tx=0x7fbde00188f0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/3149373880 shutdown_connections 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/3149373880 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcc0039ac0 0x7fbcc003bf80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/3149373880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fde0c27a0 0x559fde0c2bc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/3149373880 >> 172.21.15.151:0/3149373880 conn(0x559fde0b8150 msgr2=0x559fde0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/3149373880 shutdown_connections 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/3149373880 wait complete. 2024-09-12T16:54:09.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0b1650 msgr2=0x559fde0b3a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0b1650 0x559fde0b3a40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fddfb9140 msgr2=0x559fde0aef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fddfb9140 0x559fde0aef60 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcd0039ac0 msgr2=0x7fbcd003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcd0039ac0 0x7fbcd003bf80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00ae000 tx=0x7fbdd00a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 msgr2=0x559fde0a7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a7df0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8001ec0 tx=0x7fbdd8000ee0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 shutdown_connections 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x559fde0b1650 0x559fde0b3a40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x559fddfb9140 0x559fde0aef60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fbcd0039ac0 0x7fbcd003bf80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 --2- 172.21.15.151:0/18551484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fddfb4fa0 0x559fde0a7df0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.243+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 >> 172.21.15.151:0/18551484 conn(0x559fddfb0ac0 msgr2=0x559fde09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.247+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 shutdown_connections 2024-09-12T16:54:09.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.247+0000 7fbdea8769c0 1 -- 172.21.15.151:0/18551484 wait complete. 2024-09-12T16:54:09.262 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:09.263 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:09.263 ERROR:root:0 2024-09-12T16:54:09.263 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:09.267 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:09.268 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-12T16:54:09.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-12T16:54:09.268 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-12T16:54:09.342 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:09.342 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:09.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a10ae99c0 1 Processor -- start 2024-09-12T16:54:09.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a10ae99c0 1 -- start start 2024-09-12T16:54:09.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a10ae99c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5635ef8a1340 0x5635ef8a3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a10ae99c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635ef74f9c0 con 0x5635ef89d1f0 2024-09-12T16:54:09.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a10ae99c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5635ef79f6d0 con 0x5635ef8a1340 2024-09-12T16:54:09.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a05dee640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5635ef8a1340 0x5635ef8a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a0e5ef640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5635ef89d1f0 0x5635ef89d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49278/0 (socket says 172.21.15.151:49278) 2024-09-12T16:54:09.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/1128403216 learned_addr learned my addr 172.21.15.151:0/1128403216 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:09.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a05dee640 1 -- 172.21.15.151:0/1128403216 >> v1:172.21.15.122:6789/0 conn(0x5635ef89d1f0 legacy=0x5635ef89d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.339+0000 7f2a05dee640 1 -- 172.21.15.151:0/1128403216 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ef743ca0 con 0x5635ef8a1340 2024-09-12T16:54:09.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a05dee640 1 --2- 172.21.15.151:0/1128403216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef8a1340 0x5635ef8a3730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f29f800a480 tx=0x7f29f801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54658c0a5c0537b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a0ddee640 1 -- 172.21.15.151:0/1128403216 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29f80aa570 con 0x5635ef8a1340 2024-09-12T16:54:09.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a0ddee640 1 -- 172.21.15.151:0/1128403216 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f80af070 con 0x5635ef8a1340 2024-09-12T16:54:09.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a0ddee640 1 -- 172.21.15.151:0/1128403216 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29f80aa860 con 0x5635ef8a1340 2024-09-12T16:54:09.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1128403216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef8a1340 msgr2=0x5635ef8a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1128403216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef8a1340 0x5635ef8a3730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f29f800a480 tx=0x7f29f801b310 comp rx=0 tx=0).stop 2024-09-12T16:54:09.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1128403216 shutdown_connections 2024-09-12T16:54:09.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1128403216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef8a1340 0x5635ef8a3730 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1128403216 >> 172.21.15.151:0/1128403216 conn(0x5635ef810b00 msgr2=0x5635ef810f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1128403216 shutdown_connections 2024-09-12T16:54:09.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.343+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1128403216 wait complete. 2024-09-12T16:54:09.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 Processor -- start 2024-09-12T16:54:09.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 -- start start 2024-09-12T16:54:09.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef988940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635ef7a3680 con 0x5635ef89d1f0 2024-09-12T16:54:09.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a0e5ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef988940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a0e5ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef988940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52658/0 (socket says 172.21.15.151:52658) 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/179999309 learned_addr learned my addr 172.21.15.151:0/179999309 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/179999309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ef71eda0 con 0x5635ef89d1f0 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/179999309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef988940 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2a00001e00 tx=0x7f2a0000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b88c45df21c0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f28fc608640 1 -- 172.21.15.151:0/179999309 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00012020 con 0x5635ef89d1f0 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f28fc608640 1 -- 172.21.15.151:0/179999309 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0000e690 con 0x5635ef89d1f0 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f28fc608640 1 -- 172.21.15.151:0/179999309 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0000ea10 con 0x5635ef89d1f0 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/179999309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 msgr2=0x5635ef988940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/179999309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef988940 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2a00001e00 tx=0x7f2a0000b6d0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/179999309 shutdown_connections 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/179999309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef988940 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/179999309 >> 172.21.15.151:0/179999309 conn(0x5635ef810b00 msgr2=0x5635ef984580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/179999309 shutdown_connections 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.359+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/179999309 wait complete. 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a10ae99c0 1 Processor -- start 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a10ae99c0 1 -- start start 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a10ae99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef990010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a10ae99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635ef745a50 con 0x5635ef89d1f0 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a0e5ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef990010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a0e5ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef990010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52670/0 (socket says 172.21.15.151:52670) 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/1571077127 learned_addr learned my addr 172.21.15.151:0/1571077127 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/1571077127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ef990570 con 0x5635ef89d1f0 2024-09-12T16:54:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef990010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x5635ef9898d0 tx=0x7f2a00000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f28fae05640 1 -- 172.21.15.151:0/1571077127 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00012030 con 0x5635ef89d1f0 2024-09-12T16:54:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f28fae05640 1 -- 172.21.15.151:0/1571077127 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0001a750 con 0x5635ef89d1f0 2024-09-12T16:54:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ef990800 con 0x5635ef89d1f0 2024-09-12T16:54:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f28fae05640 1 -- 172.21.15.151:0/1571077127 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0001aa50 con 0x5635ef89d1f0 2024-09-12T16:54:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ef9911b0 con 0x5635ef89d1f0 2024-09-12T16:54:09.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f28fae05640 1 -- 172.21.15.151:0/1571077127 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a00015020 con 0x5635ef89d1f0 2024-09-12T16:54:09.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f28fae05640 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28f4039a70 0x7f28f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f28fae05640 1 -- 172.21.15.151:0/1571077127 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2a00020030 con 0x5635ef89d1f0 2024-09-12T16:54:09.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a05dee640 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28f4039a70 0x7f28f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef8a1340 0x5635ef997180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9976c0 con 0x5635ef8a1340 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.363+0000 7f2a0edf0640 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef8a1340 0x5635ef997180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a05dee640 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28f4039a70 0x7f28f403bf30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f29f80ae000 tx=0x7f29f80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a0edf0640 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef8a1340 0x5635ef997180 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a0edf0640 1 -- 172.21.15.151:0/1571077127 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a0800a4d0 con 0x5635ef8a1340 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef997b10 con 0x5635ef8a1340 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a0edf0640 1 -- 172.21.15.151:0/1571077127 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a0800a4d0 con 0x5635ef8a1340 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef999920 0x5635ef99bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef99c3e0 con 0x5635ef999920 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef999920 0x5635ef99bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef999920 0x5635ef99bd10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/1571077127 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef999920 2024-09-12T16:54:09.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef998790 con 0x5635ef8a1340 2024-09-12T16:54:09.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a0edf0640 1 -- 172.21.15.151:0/1571077127 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a0800a4d0 con 0x5635ef8a1340 2024-09-12T16:54:09.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef998c30 con 0x5635ef8a1340 2024-09-12T16:54:09.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a0edf0640 1 -- 172.21.15.151:0/1571077127 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a0800a4d0 con 0x5635ef8a1340 2024-09-12T16:54:09.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 Processor -- start 2024-09-12T16:54:09.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 -- start start 2024-09-12T16:54:09.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9aaa30 0x5635ef9aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.367+0000 7f2a10ae99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635ef7b0450 con 0x5635ef9aaa30 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a0edf0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9aaa30 0x5635ef9aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a0edf0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9aaa30 0x5635ef9aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52676/0 (socket says 172.21.15.151:52676) 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a0edf0640 1 -- 172.21.15.151:0/2394306876 learned_addr learned my addr 172.21.15.151:0/2394306876 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a0edf0640 1 -- 172.21.15.151:0/2394306876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ef9ab490 con 0x5635ef9aaa30 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a0edf0640 1 --2- 172.21.15.151:0/2394306876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9aaa30 0x5635ef9aae50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x5635ef991040 tx=0x7f2a08018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f28f3fff640 1 -- 172.21.15.151:0/2394306876 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08014450 con 0x5635ef9aaa30 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f28f3fff640 1 -- 172.21.15.151:0/2394306876 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a080145f0 con 0x5635ef9aaa30 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2394306876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ef9abcf0 con 0x5635ef9aaa30 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f28f3fff640 1 -- 172.21.15.151:0/2394306876 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a080148f0 con 0x5635ef9aaa30 2024-09-12T16:54:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2394306876 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ef9ac260 con 0x5635ef9aaa30 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f28f3fff640 1 -- 172.21.15.151:0/2394306876 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a08011040 con 0x5635ef9aaa30 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f28f3fff640 1 --2- 172.21.15.151:0/2394306876 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28e8039ac0 0x7f28e803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f28f3fff640 1 -- 172.21.15.151:0/2394306876 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2a0801e070 con 0x5635ef9aaa30 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/2394306876 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28e8039ac0 0x7f28e803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a10ae99c0 1 Processor -- start 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a10ae99c0 1 -- start start 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/2394306876 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28e8039ac0 0x7f28e803bf80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a00001560 tx=0x7f2a0002c950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a10ae99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.371+0000 7f2a10ae99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635ef989190 con 0x5635ef9b8300 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9b86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52682/0 (socket says 172.21.15.151:52682) 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 -- 172.21.15.151:0/2067066465 learned_addr learned my addr 172.21.15.151:0/2067066465 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 -- 172.21.15.151:0/2067066465 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ef9b8cd0 con 0x5635ef9b8300 2024-09-12T16:54:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 --2- 172.21.15.151:0/2067066465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9b86e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2a08016fd0 tx=0x7f2a080118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a30d5a32f71df49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f28f1ffb640 1 -- 172.21.15.151:0/2067066465 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a080167c0 con 0x5635ef9b8300 2024-09-12T16:54:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f28f1ffb640 1 -- 172.21.15.151:0/2067066465 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08011c00 con 0x5635ef9b8300 2024-09-12T16:54:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f28f1ffb640 1 -- 172.21.15.151:0/2067066465 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08016960 con 0x5635ef9b8300 2024-09-12T16:54:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2067066465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 msgr2=0x5635ef9b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/2067066465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9b86e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2a08016fd0 tx=0x7f2a080118e0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2067066465 shutdown_connections 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/2067066465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9b86e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2067066465 >> 172.21.15.151:0/2067066465 conn(0x5635ef9b3720 msgr2=0x5635ef9b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2067066465 shutdown_connections 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2067066465 wait complete. 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 Processor -- start 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 -- start start 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a10ae99c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5635ef9b7250 con 0x5635ef9b8300 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9be7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52686/0 (socket says 172.21.15.151:52686) 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 learned_addr learned my addr 172.21.15.151:0/244555052 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ef9bed30 con 0x5635ef9b8300 2024-09-12T16:54:09.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f2a0edf0640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9be7d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2a080119b0 tx=0x7f2a08050660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f28dffff640 1 -- 172.21.15.151:0/244555052 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08011d30 con 0x5635ef9b8300 2024-09-12T16:54:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f28dffff640 1 -- 172.21.15.151:0/244555052 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0803e880 con 0x5635ef9b8300 2024-09-12T16:54:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.375+0000 7f28dffff640 1 -- 172.21.15.151:0/244555052 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0803eba0 con 0x5635ef9b8300 2024-09-12T16:54:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ef9befc0 con 0x5635ef9b8300 2024-09-12T16:54:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ef9bf970 con 0x5635ef9b8300 2024-09-12T16:54:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f28dffff640 1 -- 172.21.15.151:0/244555052 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a0803e3f0 con 0x5635ef9b8300 2024-09-12T16:54:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f28dffff640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28d8039ac0 0x7f28d803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f28dffff640 1 -- 172.21.15.151:0/244555052 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2a08048050 con 0x5635ef9b8300 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28d8039ac0 0x7f28d803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef9c9b20 0x5635ef9cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9cc6e0 con 0x5635ef9c9b20 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a05dee640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef9c9b20 0x5635ef9cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28d8039ac0 0x7f28d803bf80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5635ef99c7c0 tx=0x7f2a0002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a05dee640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef9c9b20 0x5635ef9cbf90 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 realm 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9ccb10 con 0x5635ef9c9b20 2024-09-12T16:54:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9cd3e0 con 0x5635ef9c9b20 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9cd780 con 0x5635ef9c9b20 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef9ce4e0 0x5635ef9d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d0f20 con 0x5635ef9ce4e0 2024-09-12T16:54:09.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.379+0000 7f2a0edf0640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef9ce4e0 0x5635ef9d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0edf0640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef9ce4e0 0x5635ef9d08d0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a10ae99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a10ae99c0 20 searching for the correct realm 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5635ef9d2e00 0x5635ef9d5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5635ef9d2e00 0x5635ef9d5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5635ef9d2e00 0x5635ef9d5230 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0e5ef640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2a00017050 0x7f2a0004d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x7f2a00017050 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a05dee640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2a00017050 0x7f2a0004d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a05dee640 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2a00017050 0x7f2a0004d3b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.383+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x7f2a00017050 2024-09-12T16:54:09.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x7f2a00017050 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.387+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x7f2a00017050 2024-09-12T16:54:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.391+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x7f2a00017050 2024-09-12T16:54:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9d2e00 2024-09-12T16:54:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d58b0 con 0x7f2a00017050 2024-09-12T16:54:09.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d1870 con 0x5635ef9c9b20 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.395+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d2110 con 0x5635ef9c9b20 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d14b0 con 0x5635ef9c9b20 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 zone default found 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 4 Realm: () 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 zonegroup default 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d5d30 con 0x5635ef9ce4e0 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d7ff0 con 0x5635ef9d2e00 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d8390 con 0x5635ef9d2e00 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 started sync module instance, tier type = 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d7480 con 0x7f2a00017050 2024-09-12T16:54:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94789653330384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d7480 con 0x7f2a00017050 2024-09-12T16:54:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.399+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d8f20 con 0x5635ef9c9b20 2024-09-12T16:54:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.403+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94789653330384] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.403+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.403+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94789653334512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d7480 con 0x5635ef9c9b20 2024-09-12T16:54:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.403+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d9930 con 0x5635ef9d2e00 2024-09-12T16:54:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.403+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94789653334512] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94789653327824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9d73f0 con 0x5635ef9d2e00 2024-09-12T16:54:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9da680 con 0x7f2a00017050 2024-09-12T16:54:09.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94789653340896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9dad50 con 0x7f2a00017050 2024-09-12T16:54:09.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9db870 con 0x5635ef9c9b20 2024-09-12T16:54:09.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94789653327824] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94789653340896] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94789653345088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9db830 con 0x5635ef9c9b20 2024-09-12T16:54:09.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.407+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9dbc60 con 0x5635ef9ce4e0 2024-09-12T16:54:09.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.411+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94789653345088] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.411+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.411+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94789653342112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9dc050 con 0x5635ef9ce4e0 2024-09-12T16:54:09.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.411+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9dca10 con 0x5635ef9ce4e0 2024-09-12T16:54:09.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94789653342112] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94789653339424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9dca10 con 0x5635ef9ce4e0 2024-09-12T16:54:09.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9dd3d0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94789653339424] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94789653350208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9dd3d0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 20 add_watcher() i=0 2024-09-12T16:54:09.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 20 add_watcher() i=1 2024-09-12T16:54:09.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 20 add_watcher() i=2 2024-09-12T16:54:09.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 20 add_watcher() i=3 2024-09-12T16:54:09.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 20 add_watcher() i=4 2024-09-12T16:54:09.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 20 add_watcher() i=5 2024-09-12T16:54:09.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.415+0000 7f2a10ae99c0 20 add_watcher() i=6 2024-09-12T16:54:09.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94789653350208] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 20 add_watcher() i=7 2024-09-12T16:54:09.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:09.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9e0740 con 0x5635ef9c9b20 2024-09-12T16:54:09.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94789653365040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ef9dd540 con 0x5635ef9c9b20 2024-09-12T16:54:09.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94789653365040] v34'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f28c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:09.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:09.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 5 note: GC not initialized 2024-09-12T16:54:09.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f283f7fe640 20 reqs_thread_entry: start 2024-09-12T16:54:09.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:09.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 20 Filter name: none 2024-09-12T16:54:09.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f283d7fa640 20 reqs_thread_entry: start 2024-09-12T16:54:09.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:09.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.419+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635efa03aa0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T16:54:09.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:09.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:09.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa0a2e0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:09.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:09.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94789653536080 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635efa05a10 con 0x5635ef9c9b20 2024-09-12T16:54:09.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 94789653345088 notify 146028888115 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5635ef743ca0 con 0x5635ef9c9b20 2024-09-12T16:54:09.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f28f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888115 cookie 94789653345088 notifier 4879 bl.length()=666 2024-09-12T16:54:09.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f28f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:09.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f28f1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 94789653536080 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.423+0000 7f28f1ffb640 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f28d4003eb0 con 0x5635ef9c9b20 2024-09-12T16:54:09.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 94789653536080 notify 146028888115 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f29f80d8620 con 0x5635ef9c9b20 2024-09-12T16:54:09.432 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:09.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f28c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94789653365040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x5635ef9c9b20 2024-09-12T16:54:09.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94789653365040] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94789653330384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x7f2a00017050 2024-09-12T16:54:09.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94789653330384] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a10ae99c0 20 remove_watcher() i=0 2024-09-12T16:54:09.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a10ae99c0 2 removed watcher, disabling cache 2024-09-12T16:54:09.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.427+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94789653334512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x5635ef9c9b20 2024-09-12T16:54:09.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.431+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94789653334512] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.431+0000 7f2a10ae99c0 20 remove_watcher() i=1 2024-09-12T16:54:09.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.431+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94789653327824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x5635ef9d2e00 2024-09-12T16:54:09.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a0e5ef640 1 -- 172.21.15.151:0/244555052 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94789653327824] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00008030 con 0x5635ef9d2e00 2024-09-12T16:54:09.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a10ae99c0 20 remove_watcher() i=2 2024-09-12T16:54:09.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94789653340896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x7f2a00017050 2024-09-12T16:54:09.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94789653340896] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x7f2a00017050 2024-09-12T16:54:09.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a10ae99c0 20 remove_watcher() i=3 2024-09-12T16:54:09.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94789653345088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x5635ef9c9b20 2024-09-12T16:54:09.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94789653345088] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29f80a8070 con 0x5635ef9c9b20 2024-09-12T16:54:09.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a10ae99c0 20 remove_watcher() i=4 2024-09-12T16:54:09.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.435+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94789653342112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.439+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94789653342112] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.439+0000 7f2a10ae99c0 20 remove_watcher() i=5 2024-09-12T16:54:09.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.439+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94789653339424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.439+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94789653339424] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.439+0000 7f2a10ae99c0 20 remove_watcher() i=6 2024-09-12T16:54:09.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.439+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94789653350208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635efa018a0 con 0x5635ef9ce4e0 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a0edf0640 1 -- 172.21.15.151:0/244555052 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94789653350208] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a0802a070 con 0x5635ef9ce4e0 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 20 remove_watcher() i=7 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef9ce4e0 msgr2=0x5635ef9d08d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef9ce4e0 0x5635ef9d08d0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef9c9b20 msgr2=0x5635ef9cbf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef9c9b20 0x5635ef9cbf90 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2a00017050 msgr2=0x7f2a0004d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f2a00017050 0x7f2a0004d3b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5635ef9d2e00 msgr2=0x5635ef9d5230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x5635ef9d2e00 0x5635ef9d5230 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28d8039ac0 msgr2=0x7f28d803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28d8039ac0 0x7f28d803bf80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5635ef99c7c0 tx=0x7f2a0002f000 comp rx=0 tx=0).stop 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 msgr2=0x5635ef9be7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/244555052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9b8300 0x5635ef9be7d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2a080119b0 tx=0x7f2a08050660 comp rx=0 tx=0).stop 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 reap_dead start 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a05dee640 1 -- 172.21.15.151:0/244555052 reap_dead start 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 shutdown_connections 2024-09-12T16:54:09.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 >> 172.21.15.151:0/244555052 conn(0x5635ef9b3720 msgr2=0x5635ef9b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 shutdown_connections 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/244555052 wait complete. 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2394306876 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28e8039ac0 msgr2=0x7f28e803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/2394306876 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28e8039ac0 0x7f28e803bf80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a00001560 tx=0x7f2a0002c950 comp rx=0 tx=0).stop 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2394306876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9aaa30 msgr2=0x5635ef9aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/2394306876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9aaa30 0x5635ef9aae50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x5635ef991040 tx=0x7f2a08018830 comp rx=0 tx=0).stop 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2394306876 shutdown_connections 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/2394306876 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28e8039ac0 0x7f28e803bf80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/2394306876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef9aaa30 0x5635ef9aae50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2394306876 >> 172.21.15.151:0/2394306876 conn(0x5635ef9a03e0 msgr2=0x5635ef9a07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2394306876 shutdown_connections 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/2394306876 wait complete. 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef999920 msgr2=0x5635ef99bd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef999920 0x5635ef99bd10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef8a1340 msgr2=0x5635ef997180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef8a1340 0x5635ef997180 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28f4039a70 msgr2=0x7f28f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28f4039a70 0x7f28f403bf30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f29f80ae000 tx=0x7f29f80a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 msgr2=0x5635ef990010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef990010 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x5635ef9898d0 tx=0x7f2a00000bd0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 shutdown_connections 2024-09-12T16:54:09.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5635ef999920 0x5635ef99bd10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5635ef8a1340 0x5635ef997180 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f28f4039a70 0x7f28f403bf30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 --2- 172.21.15.151:0/1571077127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5635ef89d1f0 0x5635ef990010 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 >> 172.21.15.151:0/1571077127 conn(0x5635ef810b00 msgr2=0x5635ef983010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 shutdown_connections 2024-09-12T16:54:09.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.443+0000 7f2a10ae99c0 1 -- 172.21.15.151:0/1571077127 wait complete. 2024-09-12T16:54:09.461 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:09.461 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:09.461 ERROR:root:0 2024-09-12T16:54:09.461 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:09.466 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:09.467 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T16:54:09.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T16:54:09.467 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T16:54:09.537 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:09.537 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:09.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.531+0000 7efee75639c0 1 Processor -- start 2024-09-12T16:54:09.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.531+0000 7efee75639c0 1 -- start start 2024-09-12T16:54:09.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.531+0000 7efee75639c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555d48dfaae0 0x555d48dfaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.531+0000 7efee75639c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d48d389c0 con 0x555d48df94e0 2024-09-12T16:54:09.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.531+0000 7efee75639c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x555d48d886d0 con 0x555d48dfaae0 2024-09-12T16:54:09.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efee5069640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555d48dfaae0 0x555d48dfaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efee5069640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555d48dfaae0 0x555d48dfaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52702/0 (socket says 172.21.15.151:52702) 2024-09-12T16:54:09.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efee5069640 1 -- 172.21.15.151:0/527828914 learned_addr learned my addr 172.21.15.151:0/527828914 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efee5069640 1 -- 172.21.15.151:0/527828914 >> v1:172.21.15.122:6789/0 conn(0x555d48df94e0 legacy=0x555d48df98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efee5069640 1 -- 172.21.15.151:0/527828914 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d48d2cca0 con 0x555d48dfaae0 2024-09-12T16:54:09.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efee5069640 1 --2- 172.21.15.151:0/527828914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48dfaae0 0x555d48dfaec0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efee000a4e0 tx=0x7efee001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8854f036e3242f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efedffff640 1 -- 172.21.15.151:0/527828914 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee00aa540 con 0x555d48dfaae0 2024-09-12T16:54:09.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efedffff640 1 -- 172.21.15.151:0/527828914 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee00aa6e0 con 0x555d48dfaae0 2024-09-12T16:54:09.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efedffff640 1 -- 172.21.15.151:0/527828914 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee00aaa40 con 0x555d48dfaae0 2024-09-12T16:54:09.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efee75639c0 1 -- 172.21.15.151:0/527828914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48dfaae0 msgr2=0x555d48dfaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.535+0000 7efee75639c0 1 --2- 172.21.15.151:0/527828914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48dfaae0 0x555d48dfaec0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efee000a4e0 tx=0x7efee001b090 comp rx=0 tx=0).stop 2024-09-12T16:54:09.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.539+0000 7efee75639c0 1 -- 172.21.15.151:0/527828914 shutdown_connections 2024-09-12T16:54:09.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.539+0000 7efee75639c0 1 --2- 172.21.15.151:0/527828914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48dfaae0 0x555d48dfaec0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.539+0000 7efee75639c0 1 -- 172.21.15.151:0/527828914 >> 172.21.15.151:0/527828914 conn(0x555d48e7fac0 msgr2=0x555d48e81ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.539+0000 7efee75639c0 1 -- 172.21.15.151:0/527828914 shutdown_connections 2024-09-12T16:54:09.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.539+0000 7efee75639c0 1 -- 172.21.15.151:0/527828914 wait complete. 2024-09-12T16:54:09.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.551+0000 7efee75639c0 1 Processor -- start 2024-09-12T16:54:09.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.551+0000 7efee75639c0 1 -- start start 2024-09-12T16:54:09.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.551+0000 7efee75639c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f71bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.551+0000 7efee75639c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555d48d8c680 con 0x555d48df94e0 2024-09-12T16:54:09.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f71bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f71bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52714/0 (socket says 172.21.15.151:52714) 2024-09-12T16:54:09.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 -- 172.21.15.151:0/151980131 learned_addr learned my addr 172.21.15.151:0/151980131 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 -- 172.21.15.151:0/151980131 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d48d07da0 con 0x555d48df94e0 2024-09-12T16:54:09.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 --2- 172.21.15.151:0/151980131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f71bc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7efee00ac040 tx=0x7efee0003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed7077732fc1965 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efdd3606640 1 -- 172.21.15.151:0/151980131 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee00aaa80 con 0x555d48df94e0 2024-09-12T16:54:09.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efdd3606640 1 -- 172.21.15.151:0/151980131 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee00aac20 con 0x555d48df94e0 2024-09-12T16:54:09.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efdd3606640 1 -- 172.21.15.151:0/151980131 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee00b4460 con 0x555d48df94e0 2024-09-12T16:54:09.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 -- 172.21.15.151:0/151980131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 msgr2=0x555d48f71bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 --2- 172.21.15.151:0/151980131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f71bc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7efee00ac040 tx=0x7efee0003340 comp rx=0 tx=0).stop 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 -- 172.21.15.151:0/151980131 shutdown_connections 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 --2- 172.21.15.151:0/151980131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f71bc0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 -- 172.21.15.151:0/151980131 >> 172.21.15.151:0/151980131 conn(0x555d48e7fac0 msgr2=0x555d48f6d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 -- 172.21.15.151:0/151980131 shutdown_connections 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 -- 172.21.15.151:0/151980131 wait complete. 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 Processor -- start 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 -- start start 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f79100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee75639c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555d48d2ea50 con 0x555d48df94e0 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f79100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f79100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52724/0 (socket says 172.21.15.151:52724) 2024-09-12T16:54:09.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 -- 172.21.15.151:0/2878245953 learned_addr learned my addr 172.21.15.151:0/2878245953 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 -- 172.21.15.151:0/2878245953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d48f79660 con 0x555d48df94e0 2024-09-12T16:54:09.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.555+0000 7efee5069640 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f79100 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efee0000f90 tx=0x555d48dfa420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efdd1e03640 1 -- 172.21.15.151:0/2878245953 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee00b4860 con 0x555d48df94e0 2024-09-12T16:54:09.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efdd1e03640 1 -- 172.21.15.151:0/2878245953 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee00c1070 con 0x555d48df94e0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d48f798f0 con 0x555d48df94e0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efdd1e03640 1 -- 172.21.15.151:0/2878245953 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee00b4b50 con 0x555d48df94e0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d48f7a2a0 con 0x555d48df94e0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efdd1e03640 1 -- 172.21.15.151:0/2878245953 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efee00bd440 con 0x555d48df94e0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efdd1e03640 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdcc039a70 0x7efdcc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efdd1e03640 1 -- 172.21.15.151:0/2878245953 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efee00eafc0 con 0x555d48df94e0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee4868640 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdcc039a70 0x7efdcc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48dfaae0 0x555d48f80270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48f807b0 con 0x555d48dfaae0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee586a640 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48dfaae0 0x555d48f80270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee4868640 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdcc039a70 0x7efdcc03bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efed0001ec0 tx=0x7efed0001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee586a640 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48dfaae0 0x555d48f80270 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee586a640 1 -- 172.21.15.151:0/2878245953 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48dfaae0 2024-09-12T16:54:09.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48f7a600 con 0x555d48dfaae0 2024-09-12T16:54:09.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee586a640 1 -- 172.21.15.151:0/2878245953 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efed80083f0 con 0x555d48dfaae0 2024-09-12T16:54:09.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48f82a50 0x555d48f84e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48f85580 con 0x555d48f82a50 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.559+0000 7efee5069640 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48f82a50 0x555d48f84e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee5069640 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48f82a50 0x555d48f84e40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee5069640 1 -- 172.21.15.151:0/2878245953 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efee00b2320 con 0x555d48f82a50 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48f818c0 con 0x555d48dfaae0 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee586a640 1 -- 172.21.15.151:0/2878245953 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efed80083f0 con 0x555d48dfaae0 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48f81cf0 con 0x555d48dfaae0 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee586a640 1 -- 172.21.15.151:0/2878245953 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efed80083f0 con 0x555d48dfaae0 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee75639c0 1 Processor -- start 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee75639c0 1 -- start start 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee75639c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48f93bd0 0x555d48f93ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee75639c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555d48d99450 con 0x555d48f93bd0 2024-09-12T16:54:09.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee586a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48f93bd0 0x555d48f93ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee586a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48f93bd0 0x555d48f93ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52732/0 (socket says 172.21.15.151:52732) 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee586a640 1 -- 172.21.15.151:0/824372187 learned_addr learned my addr 172.21.15.151:0/824372187 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee586a640 1 -- 172.21.15.151:0/824372187 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d48f94630 con 0x555d48f93bd0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee586a640 1 --2- 172.21.15.151:0/824372187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48f93bd0 0x555d48f93ff0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x555d48f7a130 tx=0x7efed800aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efdcaffd640 1 -- 172.21.15.151:0/824372187 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed8007d10 con 0x555d48f93bd0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efdcaffd640 1 -- 172.21.15.151:0/824372187 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed801e020 con 0x555d48f93bd0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efee75639c0 1 -- 172.21.15.151:0/824372187 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d48f94e90 con 0x555d48f93bd0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.563+0000 7efdcaffd640 1 -- 172.21.15.151:0/824372187 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed8019420 con 0x555d48f93bd0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee75639c0 1 -- 172.21.15.151:0/824372187 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d48f95400 con 0x555d48f93bd0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efdcaffd640 1 -- 172.21.15.151:0/824372187 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efed8016040 con 0x555d48f93bd0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efdcaffd640 1 --2- 172.21.15.151:0/824372187 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdbc039b10 0x7efdbc03bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efdcaffd640 1 -- 172.21.15.151:0/824372187 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efed801f030 con 0x555d48f93bd0 2024-09-12T16:54:09.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee5069640 1 --2- 172.21.15.151:0/824372187 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdbc039b10 0x7efdbc03bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee75639c0 1 Processor -- start 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee75639c0 1 -- start start 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee5069640 1 --2- 172.21.15.151:0/824372187 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdbc039b10 0x7efdbc03bfd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x555d48f80bc0 tx=0x7efee00e92a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee75639c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee75639c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555d48f72390 con 0x555d48fa1540 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee586a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee586a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52736/0 (socket says 172.21.15.151:52736) 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee586a640 1 -- 172.21.15.151:0/833834989 learned_addr learned my addr 172.21.15.151:0/833834989 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee586a640 1 -- 172.21.15.151:0/833834989 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d48fa1f30 con 0x555d48fa1540 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efee586a640 1 --2- 172.21.15.151:0/833834989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa1940 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7efed8014840 tx=0x7efed8017b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5253cb112d23c0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efdc8ff9640 1 -- 172.21.15.151:0/833834989 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed801d070 con 0x555d48fa1540 2024-09-12T16:54:09.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efdc8ff9640 1 -- 172.21.15.151:0/833834989 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed80148c0 con 0x555d48fa1540 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.567+0000 7efdc8ff9640 1 -- 172.21.15.151:0/833834989 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed80173b0 con 0x555d48fa1540 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- 172.21.15.151:0/833834989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 msgr2=0x555d48fa1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 --2- 172.21.15.151:0/833834989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa1940 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7efed8014840 tx=0x7efed8017b10 comp rx=0 tx=0).stop 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- 172.21.15.151:0/833834989 shutdown_connections 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 --2- 172.21.15.151:0/833834989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa1940 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- 172.21.15.151:0/833834989 >> 172.21.15.151:0/833834989 conn(0x555d48f9c960 msgr2=0x555d48f9aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- 172.21.15.151:0/833834989 shutdown_connections 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- 172.21.15.151:0/833834989 wait complete. 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 Processor -- start 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- start start 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555d48fa0490 con 0x555d48fa1540 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee586a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee586a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52740/0 (socket says 172.21.15.151:52740) 2024-09-12T16:54:09.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 learned_addr learned my addr 172.21.15.151:0/497356637 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d48fa7fa0 con 0x555d48fa1540 2024-09-12T16:54:09.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee586a640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa7a40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7efed8014ab0 tx=0x7efed80504e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efdbaffd640 1 -- 172.21.15.151:0/497356637 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed8048040 con 0x555d48fa1540 2024-09-12T16:54:09.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d48fa8230 con 0x555d48fa1540 2024-09-12T16:54:09.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efdbaffd640 1 -- 172.21.15.151:0/497356637 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed8031020 con 0x555d48fa1540 2024-09-12T16:54:09.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efdbaffd640 1 -- 172.21.15.151:0/497356637 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efed8015a80 con 0x555d48fa1540 2024-09-12T16:54:09.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d48fa8be0 con 0x555d48fa1540 2024-09-12T16:54:09.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efdbaffd640 1 -- 172.21.15.151:0/497356637 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efed803e390 con 0x555d48fa1540 2024-09-12T16:54:09.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efdbaffd640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdb0039ac0 0x7efdb003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.571+0000 7efdbaffd640 1 -- 172.21.15.151:0/497356637 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efed8032030 con 0x555d48fa1540 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee5069640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdb0039ac0 0x7efdb003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48fb2da0 0x555d48fb5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fb5980 con 0x555d48fb2da0 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee4868640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48fb2da0 0x555d48fb5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee5069640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdb0039ac0 0x7efdb003bf80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efee001b0d0 tx=0x7efee00d4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee4868640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48fb2da0 0x555d48fb5230 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efed000d040 con 0x555d48fb2da0 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 realm 2024-09-12T16:54:09.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fb2150 con 0x555d48fb2da0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efed000d040 con 0x555d48fb2da0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fb6480 con 0x555d48fb2da0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efed000d040 con 0x555d48fb2da0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fb6d50 con 0x555d48fb2da0 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efed000d040 con 0x555d48fb2da0 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48fb7770 0x555d48fb9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fba2d0 con 0x555d48fb7770 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee586a640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48fb7770 0x555d48fb9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee586a640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48fb7770 0x555d48fb9b60 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:09.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 20 searching for the correct realm 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555d48fbc220 0x555d48fbe650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.575+0000 7efee5069640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555d48fbc220 0x555d48fbe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee5069640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555d48fbc220 0x555d48fbe650 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee5069640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efee00de480 0x7efee00de8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x7efee00de480 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee4868640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efee00de480 0x7efee00de8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee4868640 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efee00de480 0x7efee00de8a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed000d040 con 0x7efee00de480 2024-09-12T16:54:09.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb2da0 2024-09-12T16:54:09.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed000d040 con 0x555d48fb2da0 2024-09-12T16:54:09.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb2da0 2024-09-12T16:54:09.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.579+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x7efee00de480 2024-09-12T16:54:09.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb2da0 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb2da0 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x7efee00de480 2024-09-12T16:54:09.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.583+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb2da0 2024-09-12T16:54:09.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb2da0 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x7efee00de480 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb2da0 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.587+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x7efee00de480 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fbc220 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb7770 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x555d48fb2da0 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbecd0 con 0x7efee00de480 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbac90 con 0x555d48fb2da0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fba8d0 con 0x555d48fb2da0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbb5b0 con 0x555d48fb2da0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 zone default found 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 4 Realm: () 2024-09-12T16:54:09.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 zonegroup default 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fbb5b0 con 0x555d48fb7770 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc1070 con 0x555d48fbc220 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.591+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc1460 con 0x555d48fbc220 2024-09-12T16:54:09.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee75639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee75639c0 20 started sync module instance, tier type = 2024-09-12T16:54:09.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee75639c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:09.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc0500 con 0x7efee00de480 2024-09-12T16:54:09.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93859144796672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc0500 con 0x7efee00de480 2024-09-12T16:54:09.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc1f40 con 0x555d48fb2da0 2024-09-12T16:54:09.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93859144796672] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93859144800816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc0500 con 0x555d48fb2da0 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.595+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc2950 con 0x555d48fbc220 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.599+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93859144800816] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.599+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.599+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93859144794192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc0470 con 0x555d48fbc220 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.599+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc3650 con 0x7efee00de480 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.599+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.599+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93859144807120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc3ef0 con 0x7efee00de480 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.599+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc48f0 con 0x555d48fb2da0 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93859144794192] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93859144807120] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93859144805616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc39d0 con 0x555d48fb2da0 2024-09-12T16:54:09.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc5190 con 0x555d48fb7770 2024-09-12T16:54:09.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93859144805616] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93859144813792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc39d0 con 0x555d48fb7770 2024-09-12T16:54:09.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.603+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc59e0 con 0x555d48fb7770 2024-09-12T16:54:09.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.607+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93859144813792] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.607+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.607+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93859144811520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc59e0 con 0x555d48fb7770 2024-09-12T16:54:09.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.607+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc6400 con 0x555d48fb7770 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93859144811520] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93859144818416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc6870 con 0x555d48fb7770 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 20 add_watcher() i=0 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 20 add_watcher() i=1 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 20 add_watcher() i=2 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 20 add_watcher() i=3 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 20 add_watcher() i=4 2024-09-12T16:54:09.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 20 add_watcher() i=5 2024-09-12T16:54:09.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 20 add_watcher() i=6 2024-09-12T16:54:09.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93859144818416] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 20 add_watcher() i=7 2024-09-12T16:54:09.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:09.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc6870 con 0x555d48fb2da0 2024-09-12T16:54:09.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.611+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93859144819648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc6850 con 0x555d48fb2da0 2024-09-12T16:54:09.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93859144819648] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efd9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:09.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:09.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 5 note: GC not initialized 2024-09-12T16:54:09.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efd9a7e4640 20 reqs_thread_entry: start 2024-09-12T16:54:09.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:09.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 20 Filter name: none 2024-09-12T16:54:09.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efd0bfff640 20 reqs_thread_entry: start 2024-09-12T16:54:09.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:09.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48fecb80 con 0x555d48fb7770 2024-09-12T16:54:09.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T16:54:09.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:09.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:09.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.615+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48ff3380 con 0x555d48fb7770 2024-09-12T16:54:09.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee75639c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:09.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee75639c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee75639c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:09.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93859145002544 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d48feea90 con 0x555d48fb2da0 2024-09-12T16:54:09.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 93859144805616 notify 146028888116 ret 0) ==== 721+0+0 (crc 0 0 0) 0x555d48d389c0 con 0x555d48fb2da0 2024-09-12T16:54:09.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efdc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888116 cookie 93859144805616 notifier 4886 bl.length()=679 2024-09-12T16:54:09.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 93859145002544 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efdc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:09.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efdc8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efdc8ff9640 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efda8003eb0 con 0x555d48fb2da0 2024-09-12T16:54:09.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 93859145002544 notify 146028888116 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efed003d880 con 0x555d48fb2da0 2024-09-12T16:54:09.626 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:09.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efd9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.619+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93859144819648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fea960 con 0x555d48fb2da0 2024-09-12T16:54:09.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93859144819648] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93859144796672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fea960 con 0x7efee00de480 2024-09-12T16:54:09.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93859144796672] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee75639c0 20 remove_watcher() i=0 2024-09-12T16:54:09.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee75639c0 2 removed watcher, disabling cache 2024-09-12T16:54:09.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93859144800816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fea960 con 0x555d48fb2da0 2024-09-12T16:54:09.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93859144800816] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee75639c0 20 remove_watcher() i=1 2024-09-12T16:54:09.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.623+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93859144794192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fea960 con 0x555d48fbc220 2024-09-12T16:54:09.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.627+0000 7efee5069640 1 -- 172.21.15.151:0/497356637 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93859144794192] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efee00b2320 con 0x555d48fbc220 2024-09-12T16:54:09.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.627+0000 7efee75639c0 20 remove_watcher() i=2 2024-09-12T16:54:09.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.627+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93859144807120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc0a00 con 0x7efee00de480 2024-09-12T16:54:09.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.627+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93859144807120] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x7efee00de480 2024-09-12T16:54:09.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.627+0000 7efee75639c0 20 remove_watcher() i=3 2024-09-12T16:54:09.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.627+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93859144805616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc0050 con 0x555d48fb2da0 2024-09-12T16:54:09.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.631+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93859144805616] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed002a040 con 0x555d48fb2da0 2024-09-12T16:54:09.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.631+0000 7efee75639c0 20 remove_watcher() i=4 2024-09-12T16:54:09.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.631+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93859144813792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc0a00 con 0x555d48fb7770 2024-09-12T16:54:09.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.631+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93859144813792] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.631+0000 7efee75639c0 20 remove_watcher() i=5 2024-09-12T16:54:09.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.631+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93859144811520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc2cf0 con 0x555d48fb7770 2024-09-12T16:54:09.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93859144811520] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 20 remove_watcher() i=6 2024-09-12T16:54:09.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93859144818416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d48fc0050 con 0x555d48fb7770 2024-09-12T16:54:09.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee586a640 1 -- 172.21.15.151:0/497356637 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93859144818416] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efed80083f0 con 0x555d48fb7770 2024-09-12T16:54:09.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 20 remove_watcher() i=7 2024-09-12T16:54:09.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48fb7770 msgr2=0x555d48fb9b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48fb7770 0x555d48fb9b60 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48fb2da0 msgr2=0x555d48fb5230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48fb2da0 0x555d48fb5230 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efee00de480 msgr2=0x7efee00de8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7efee00de480 0x7efee00de8a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555d48fbc220 msgr2=0x555d48fbe650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.635+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555d48fbc220 0x555d48fbe650 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdb0039ac0 msgr2=0x7efdb003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdb0039ac0 0x7efdb003bf80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efee001b0d0 tx=0x7efee00d4000 comp rx=0 tx=0).stop 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 msgr2=0x555d48fa7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee4868640 1 -- 172.21.15.151:0/497356637 reap_dead start 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa7a40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7efed8014ab0 tx=0x7efed80504e0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 shutdown_connections 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/497356637 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48fa1540 0x555d48fa7a40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 >> 172.21.15.151:0/497356637 conn(0x555d48f9c960 msgr2=0x555d48f9ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 shutdown_connections 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/497356637 wait complete. 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/824372187 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdbc039b10 msgr2=0x7efdbc03bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/824372187 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdbc039b10 0x7efdbc03bfd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x555d48f80bc0 tx=0x7efee00e92a0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/824372187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48f93bd0 msgr2=0x555d48f93ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/824372187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48f93bd0 0x555d48f93ff0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x555d48f7a130 tx=0x7efed800aed0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/824372187 shutdown_connections 2024-09-12T16:54:09.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/824372187 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdbc039b10 0x7efdbc03bfd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/824372187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48f93bd0 0x555d48f93ff0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/824372187 >> 172.21.15.151:0/824372187 conn(0x555d48f89580 msgr2=0x555d48f89960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/824372187 shutdown_connections 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/824372187 wait complete. 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48f82a50 msgr2=0x555d48f84e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48f82a50 0x555d48f84e40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48dfaae0 msgr2=0x555d48f80270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48dfaae0 0x555d48f80270 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdcc039a70 msgr2=0x7efdcc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdcc039a70 0x7efdcc03bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efed0001ec0 tx=0x7efed0001440 comp rx=0 tx=0).stop 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 msgr2=0x555d48f79100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f79100 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efee0000f90 tx=0x555d48dfa420 comp rx=0 tx=0).stop 2024-09-12T16:54:09.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 shutdown_connections 2024-09-12T16:54:09.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555d48f82a50 0x555d48f84e40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555d48dfaae0 0x555d48f80270 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7efdcc039a70 0x7efdcc03bf30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 --2- 172.21.15.151:0/2878245953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555d48df94e0 0x555d48f79100 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 >> 172.21.15.151:0/2878245953 conn(0x555d48e7fac0 msgr2=0x555d48f6c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 shutdown_connections 2024-09-12T16:54:09.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.639+0000 7efee75639c0 1 -- 172.21.15.151:0/2878245953 wait complete. 2024-09-12T16:54:09.655 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:09.655 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:09.655 ERROR:root:0 2024-09-12T16:54:09.656 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:09.660 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:09.660 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-12T16:54:09.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-12T16:54:09.661 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-12T16:54:09.732 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:09.732 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:09.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c278659c0 1 Processor -- start 2024-09-12T16:54:09.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c278659c0 1 -- start start 2024-09-12T16:54:09.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c278659c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555a9d2f4700 0x555a9d2f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c278659c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a9d1a69c0 con 0x555a9d2f7030 2024-09-12T16:54:09.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c278659c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x555a9d1f66d0 con 0x555a9d2f4700 2024-09-12T16:54:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c2536b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555a9d2f4700 0x555a9d2f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c2536b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x555a9d2f4700 0x555a9d2f6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52748/0 (socket says 172.21.15.151:52748) 2024-09-12T16:54:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c2536b640 1 -- 172.21.15.151:0/2803671261 learned_addr learned my addr 172.21.15.151:0/2803671261 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c2536b640 1 -- 172.21.15.151:0/2803671261 >> v1:172.21.15.122:6789/0 conn(0x555a9d2f7030 legacy=0x555a9d2f9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.727+0000 7f8c2536b640 1 -- 172.21.15.151:0/2803671261 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9d19aca0 con 0x555a9d2f4700 2024-09-12T16:54:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c2536b640 1 --2- 172.21.15.151:0/2803671261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d2f6af0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800a5c0 tx=0x7f8c1801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1e89207702b625 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c1ffff640 1 -- 172.21.15.151:0/2803671261 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c180a6070 con 0x555a9d2f4700 2024-09-12T16:54:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c1ffff640 1 -- 172.21.15.151:0/2803671261 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180af070 con 0x555a9d2f4700 2024-09-12T16:54:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c1ffff640 1 -- 172.21.15.151:0/2803671261 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c180aa5c0 con 0x555a9d2f4700 2024-09-12T16:54:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c278659c0 1 -- 172.21.15.151:0/2803671261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 msgr2=0x555a9d2f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c278659c0 1 --2- 172.21.15.151:0/2803671261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d2f6af0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800a5c0 tx=0x7f8c1801b340 comp rx=0 tx=0).stop 2024-09-12T16:54:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c278659c0 1 -- 172.21.15.151:0/2803671261 shutdown_connections 2024-09-12T16:54:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c278659c0 1 --2- 172.21.15.151:0/2803671261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d2f6af0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c278659c0 1 -- 172.21.15.151:0/2803671261 >> 172.21.15.151:0/2803671261 conn(0x555a9d267a90 msgr2=0x555a9d267ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c278659c0 1 -- 172.21.15.151:0/2803671261 shutdown_connections 2024-09-12T16:54:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.731+0000 7f8c278659c0 1 -- 172.21.15.151:0/2803671261 wait complete. 2024-09-12T16:54:09.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.747+0000 7f8c278659c0 1 Processor -- start 2024-09-12T16:54:09.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.747+0000 7f8c278659c0 1 -- start start 2024-09-12T16:54:09.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.747+0000 7f8c278659c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d3df910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.747+0000 7f8c278659c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a9d1fa680 con 0x555a9d2f4700 2024-09-12T16:54:09.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.747+0000 7f8c2536b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d3df910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.747+0000 7f8c2536b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d3df910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52758/0 (socket says 172.21.15.151:52758) 2024-09-12T16:54:09.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.747+0000 7f8c2536b640 1 -- 172.21.15.151:0/4167851036 learned_addr learned my addr 172.21.15.151:0/4167851036 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c2536b640 1 -- 172.21.15.151:0/4167851036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9d175da0 con 0x555a9d2f4700 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c2536b640 1 --2- 172.21.15.151:0/4167851036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d3df910 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8c18018f70 tx=0x7f8c18003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31807e400fbff493 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8b13606640 1 -- 172.21.15.151:0/4167851036 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c180aa9e0 con 0x555a9d2f4700 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8b13606640 1 -- 172.21.15.151:0/4167851036 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180aab80 con 0x555a9d2f4700 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8b13606640 1 -- 172.21.15.151:0/4167851036 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c180aae60 con 0x555a9d2f4700 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- 172.21.15.151:0/4167851036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 msgr2=0x555a9d3df910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 --2- 172.21.15.151:0/4167851036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d3df910 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8c18018f70 tx=0x7f8c18003030 comp rx=0 tx=0).stop 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- 172.21.15.151:0/4167851036 shutdown_connections 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 --2- 172.21.15.151:0/4167851036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f4700 0x555a9d3df910 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- 172.21.15.151:0/4167851036 >> 172.21.15.151:0/4167851036 conn(0x555a9d267a90 msgr2=0x555a9d3db590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- 172.21.15.151:0/4167851036 shutdown_connections 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- 172.21.15.151:0/4167851036 wait complete. 2024-09-12T16:54:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 Processor -- start 2024-09-12T16:54:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- start start 2024-09-12T16:54:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f7030 0x555a9d3e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a9d19ca50 con 0x555a9d2f7030 2024-09-12T16:54:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c2536b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f7030 0x555a9d3e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c2536b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f7030 0x555a9d3e71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52764/0 (socket says 172.21.15.151:52764) 2024-09-12T16:54:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c2536b640 1 -- 172.21.15.151:0/1826261258 learned_addr learned my addr 172.21.15.151:0/1826261258 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c2536b640 1 -- 172.21.15.151:0/1826261258 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9d3e7710 con 0x555a9d2f7030 2024-09-12T16:54:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c2536b640 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f7030 0x555a9d3e71b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000c10 tx=0x7f8c180180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8b11e03640 1 -- 172.21.15.151:0/1826261258 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c180cb020 con 0x555a9d2f7030 2024-09-12T16:54:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8b11e03640 1 -- 172.21.15.151:0/1826261258 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180c6650 con 0x555a9d2f7030 2024-09-12T16:54:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a9d3e79a0 con 0x555a9d2f7030 2024-09-12T16:54:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8b11e03640 1 -- 172.21.15.151:0/1826261258 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c180c6970 con 0x555a9d2f7030 2024-09-12T16:54:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.751+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9d3e82b0 con 0x555a9d2f7030 2024-09-12T16:54:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8b11e03640 1 -- 172.21.15.151:0/1826261258 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8c180ce020 con 0x555a9d2f7030 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8b11e03640 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b0c039a70 0x7f8b0c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8b11e03640 1 -- 172.21.15.151:0/1826261258 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c180eba50 con 0x555a9d2f7030 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c24b6a640 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b0c039a70 0x7f8b0c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d3ec270 0x555a9d3ee660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d3eeba0 con 0x555a9d3ec270 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c25b6c640 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d3ec270 0x555a9d3ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c24b6a640 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b0c039a70 0x7f8b0c03bf30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c10001e60 tx=0x7f8c100013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c25b6c640 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d3ec270 0x555a9d3ee660 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c25b6c640 1 -- 172.21.15.151:0/1826261258 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c2000a4d0 con 0x555a9d3ec270 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d3eeff0 con 0x555a9d3ec270 2024-09-12T16:54:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c25b6c640 1 -- 172.21.15.151:0/1826261258 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c2000a4d0 con 0x555a9d3ec270 2024-09-12T16:54:09.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d3f0e00 0x555a9d3f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d3f38c0 con 0x555a9d3f0e00 2024-09-12T16:54:09.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c2536b640 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d3f0e00 0x555a9d3f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.755+0000 7f8c2536b640 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d3f0e00 0x555a9d3f31f0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c2536b640 1 -- 172.21.15.151:0/1826261258 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c180bd910 con 0x555a9d3f0e00 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d3efca0 con 0x555a9d3ec270 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c25b6c640 1 -- 172.21.15.151:0/1826261258 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c2000a4d0 con 0x555a9d3ec270 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d3f0140 con 0x555a9d3ec270 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c25b6c640 1 -- 172.21.15.151:0/1826261258 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c2000a4d0 con 0x555a9d3ec270 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c278659c0 1 Processor -- start 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c278659c0 1 -- start start 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c278659c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d401f30 0x555a9d402350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c278659c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a9d207450 con 0x555a9d401f30 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c25b6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d401f30 0x555a9d402350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c25b6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d401f30 0x555a9d402350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52768/0 (socket says 172.21.15.151:52768) 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c25b6c640 1 -- 172.21.15.151:0/4191325794 learned_addr learned my addr 172.21.15.151:0/4191325794 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c25b6c640 1 -- 172.21.15.151:0/4191325794 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9d402990 con 0x555a9d401f30 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c25b6c640 1 --2- 172.21.15.151:0/4191325794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d401f30 0x555a9d402350 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x555a9d3e9210 tx=0x7f8c20018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8b0affd640 1 -- 172.21.15.151:0/4191325794 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c20014450 con 0x555a9d401f30 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c278659c0 1 -- 172.21.15.151:0/4191325794 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a9d4031f0 con 0x555a9d401f30 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8b0affd640 1 -- 172.21.15.151:0/4191325794 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c200145f0 con 0x555a9d401f30 2024-09-12T16:54:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8c278659c0 1 -- 172.21.15.151:0/4191325794 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9d403760 con 0x555a9d401f30 2024-09-12T16:54:09.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.759+0000 7f8b0affd640 1 -- 172.21.15.151:0/4191325794 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c20028060 con 0x555a9d401f30 2024-09-12T16:54:09.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8b0affd640 1 -- 172.21.15.151:0/4191325794 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8c20011040 con 0x555a9d401f30 2024-09-12T16:54:09.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8b0affd640 1 --2- 172.21.15.151:0/4191325794 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8afc039a70 0x7f8afc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8b0affd640 1 -- 172.21.15.151:0/4191325794 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c2001e070 con 0x555a9d401f30 2024-09-12T16:54:09.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c2536b640 1 --2- 172.21.15.151:0/4191325794 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8afc039a70 0x7f8afc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 Processor -- start 2024-09-12T16:54:09.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 -- start start 2024-09-12T16:54:09.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c2536b640 1 --2- 172.21.15.151:0/4191325794 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8afc039a70 0x7f8afc03bf30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x555a9d3e85a0 tx=0x7f8c18005890 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d40fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a9d3e00a0 con 0x555a9d40f860 2024-09-12T16:54:09.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c25b6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d40fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c25b6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d40fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52770/0 (socket says 172.21.15.151:52770) 2024-09-12T16:54:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c25b6c640 1 -- 172.21.15.151:0/2946858891 learned_addr learned my addr 172.21.15.151:0/2946858891 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c25b6c640 1 -- 172.21.15.151:0/2946858891 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9d410230 con 0x555a9d40f860 2024-09-12T16:54:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c25b6c640 1 --2- 172.21.15.151:0/2946858891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d40fc40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8c20023fd0 tx=0x7f8c2002baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c6d5350a972c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8b08ff9640 1 -- 172.21.15.151:0/2946858891 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c2004f2a0 con 0x555a9d40f860 2024-09-12T16:54:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8b08ff9640 1 -- 172.21.15.151:0/2946858891 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c200167c0 con 0x555a9d40f860 2024-09-12T16:54:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8b08ff9640 1 -- 172.21.15.151:0/2946858891 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c2002b350 con 0x555a9d40f860 2024-09-12T16:54:09.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 -- 172.21.15.151:0/2946858891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 msgr2=0x555a9d40fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 --2- 172.21.15.151:0/2946858891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d40fc40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8c20023fd0 tx=0x7f8c2002baa0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 -- 172.21.15.151:0/2946858891 shutdown_connections 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 --2- 172.21.15.151:0/2946858891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d40fc40 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 -- 172.21.15.151:0/2946858891 >> 172.21.15.151:0/2946858891 conn(0x555a9d40ac20 msgr2=0x555a9d408e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 -- 172.21.15.151:0/2946858891 shutdown_connections 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 -- 172.21.15.151:0/2946858891 wait complete. 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.763+0000 7f8c278659c0 1 Processor -- start 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c278659c0 1 -- start start 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c278659c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d415c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c278659c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a9d40e750 con 0x555a9d40f860 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c25b6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d415c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c25b6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d415c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52778/0 (socket says 172.21.15.151:52778) 2024-09-12T16:54:09.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 learned_addr learned my addr 172.21.15.151:0/566337327 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9d4161f0 con 0x555a9d40f860 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c25b6c640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d415c90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8c2004f690 tx=0x7f8c200506b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8afaffd640 1 -- 172.21.15.151:0/566337327 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c20016b50 con 0x555a9d40f860 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a9d416480 con 0x555a9d40f860 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8afaffd640 1 -- 172.21.15.151:0/566337327 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2002b350 con 0x555a9d40f860 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8afaffd640 1 -- 172.21.15.151:0/566337327 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c20052110 con 0x555a9d40f860 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9d416480 con 0x555a9d40f860 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8afaffd640 1 -- 172.21.15.151:0/566337327 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8c20049250 con 0x555a9d40f860 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8afaffd640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8af0039a70 0x7f8af003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8afaffd640 1 -- 172.21.15.151:0/566337327 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c20048050 con 0x555a9d40f860 2024-09-12T16:54:09.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c2536b640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8af0039a70 0x7f8af003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d420db0 0x555a9d423270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4239c0 con 0x555a9d420db0 2024-09-12T16:54:09.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.767+0000 7f8c24b6a640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d420db0 0x555a9d423270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c2536b640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8af0039a70 0x7f8af003bf30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x555a9d3f3ca0 tx=0x7f8c180e4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c24b6a640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d420db0 0x555a9d423270 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1000d040 con 0x555a9d420db0 2024-09-12T16:54:09.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 realm 2024-09-12T16:54:09.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d420100 con 0x555a9d420db0 2024-09-12T16:54:09.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1000d040 con 0x555a9d420db0 2024-09-12T16:54:09.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4244c0 con 0x555a9d420db0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1000d040 con 0x555a9d420db0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d424d90 con 0x555a9d420db0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c1000d040 con 0x555a9d420db0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d4257b0 0x555a9d427ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4282e0 con 0x555a9d4257b0 2024-09-12T16:54:09.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c25b6c640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d4257b0 0x555a9d427ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c25b6c640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d4257b0 0x555a9d427ba0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 20 searching for the correct realm 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a9d42a230 0x555a9d42c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c2536b640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a9d42a230 0x555a9d42c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.771+0000 7f8c2536b640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a9d42a230 0x555a9d42c660 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c2536b640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8c180da040 0x7f8c180eb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x7f8c180da040 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8c180da040 0x7f8c180eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8c180da040 0x7f8c180eb050 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1000d040 con 0x7f8c180da040 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d420db0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1000d040 con 0x555a9d420db0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d420db0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x7f8c180da040 2024-09-12T16:54:09.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.775+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d420db0 2024-09-12T16:54:09.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d420db0 2024-09-12T16:54:09.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x7f8c180da040 2024-09-12T16:54:09.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d420db0 2024-09-12T16:54:09.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.779+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d420db0 2024-09-12T16:54:09.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x7f8c180da040 2024-09-12T16:54:09.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d420db0 2024-09-12T16:54:09.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x7f8c180da040 2024-09-12T16:54:09.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d42a230 2024-09-12T16:54:09.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.783+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d4257b0 2024-09-12T16:54:09.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x555a9d420db0 2024-09-12T16:54:09.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42cd30 con 0x7f8c180da040 2024-09-12T16:54:09.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:09.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:09.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:09.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:09.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:09.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:09.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d428ca0 con 0x555a9d420db0 2024-09-12T16:54:09.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d429540 con 0x555a9d420db0 2024-09-12T16:54:09.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4288e0 con 0x555a9d420db0 2024-09-12T16:54:09.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:09.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 zone default found 2024-09-12T16:54:09.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 4 Realm: () 2024-09-12T16:54:09.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:09.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:09.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:09.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 zonegroup default 2024-09-12T16:54:09.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d429540 con 0x555a9d4257b0 2024-09-12T16:54:09.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42f050 con 0x555a9d42a230 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42f3f0 con 0x555a9d42a230 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 started sync module instance, tier type = 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:09.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.787+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42e4e0 con 0x7f8c180da040 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.791+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.791+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93847673825808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42e4e0 con 0x7f8c180da040 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.791+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42fed0 con 0x555a9d420db0 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.791+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93847673825808] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.791+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.791+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93847673829824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42e4e0 con 0x555a9d420db0 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.791+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4308e0 con 0x555a9d42a230 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.795+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.795+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93847673832496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d431180 con 0x555a9d42a230 2024-09-12T16:54:09.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.795+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d431b40 con 0x7f8c180da040 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.795+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93847673829824] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.795+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.795+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93847673837200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d431ab0 con 0x7f8c180da040 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.795+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4328d0 con 0x555a9d420db0 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.795+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93847673832496] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.799+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93847673837200] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.799+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.799+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93847673834704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d432390 con 0x555a9d420db0 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.799+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d433170 con 0x555a9d4257b0 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.799+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93847673834704] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.799+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.799+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93847673842880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d432390 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.799+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4339c0 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93847673845008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d433de0 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4348e0 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93847673842880] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93847673848784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4348a0 con 0x555a9d4257b0 2024-09-12T16:54:09.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 20 add_watcher() i=0 2024-09-12T16:54:09.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 20 add_watcher() i=1 2024-09-12T16:54:09.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 20 add_watcher() i=2 2024-09-12T16:54:09.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 20 add_watcher() i=3 2024-09-12T16:54:09.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 20 add_watcher() i=4 2024-09-12T16:54:09.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 20 add_watcher() i=5 2024-09-12T16:54:09.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93847673845008] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.803+0000 7f8c278659c0 20 add_watcher() i=6 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93847673848784] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c278659c0 20 add_watcher() i=7 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c278659c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d433930 con 0x555a9d420db0 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93847673846064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d434d30 con 0x555a9d420db0 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93847673846064] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8adbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c278659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:09.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c278659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8c278659c0 5 note: GC not initialized 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.807+0000 7f8adafe5640 20 reqs_thread_entry: start 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 20 Filter name: none 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8ad8fe1640 20 reqs_thread_entry: start 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d45ab10 con 0x555a9d4257b0 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 20 rados_obj.operate() r=0 bl.length=503 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d461390 con 0x555a9d4257b0 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:09.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.811+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93847674031712 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a9d45cb60 con 0x555a9d420db0 2024-09-12T16:54:09.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 93847673834704 notify 146028888117 ret 0) ==== 678+0+0 (crc 0 0 0) 0x555a9d1a69c0 con 0x555a9d420db0 2024-09-12T16:54:09.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8b08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888117 cookie 93847673834704 notifier 4893 bl.length()=636 2024-09-12T16:54:09.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 93847674031712 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8b08ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:09.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8b08ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:09.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8b08ff9640 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8ae8003eb0 con 0x555a9d420db0 2024-09-12T16:54:09.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 93847674031712 notify 146028888117 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8c1003d540 con 0x555a9d420db0 2024-09-12T16:54:09.841 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:09.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8adbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:09.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93847673846064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4588b0 con 0x555a9d420db0 2024-09-12T16:54:09.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93847673846064] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.815+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93847673825808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4588b0 con 0x7f8c180da040 2024-09-12T16:54:09.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.819+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93847673825808] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.819+0000 7f8c278659c0 20 remove_watcher() i=0 2024-09-12T16:54:09.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.819+0000 7f8c278659c0 2 removed watcher, disabling cache 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.819+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93847673829824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4588b0 con 0x555a9d420db0 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.819+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93847673829824] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.819+0000 7f8c278659c0 20 remove_watcher() i=1 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.819+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93847673832496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d42f9c0 con 0x555a9d42a230 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.823+0000 7f8c2536b640 1 -- 172.21.15.151:0/566337327 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93847673832496] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c180f6070 con 0x555a9d42a230 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.823+0000 7f8c278659c0 20 remove_watcher() i=2 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.823+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93847673837200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4588b0 con 0x7f8c180da040 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.823+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93847673837200] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x7f8c180da040 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.823+0000 7f8c278659c0 20 remove_watcher() i=3 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.823+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93847673834704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d431690 con 0x555a9d420db0 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.823+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93847673834704] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a040 con 0x555a9d420db0 2024-09-12T16:54:09.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.827+0000 7f8c278659c0 20 remove_watcher() i=4 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.827+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93847673842880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d430cd0 con 0x555a9d4257b0 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.827+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93847673842880] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.827+0000 7f8c278659c0 20 remove_watcher() i=5 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.827+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93847673845008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d431690 con 0x555a9d4257b0 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93847673845008] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 20 remove_watcher() i=6 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93847673848784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a9d4339c0 con 0x555a9d4257b0 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c25b6c640 1 -- 172.21.15.151:0/566337327 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93847673848784] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c2002a070 con 0x555a9d4257b0 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 20 remove_watcher() i=7 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d4257b0 msgr2=0x555a9d427ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d4257b0 0x555a9d427ba0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d420db0 msgr2=0x555a9d423270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d420db0 0x555a9d423270 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8c180da040 msgr2=0x7f8c180eb050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f8c180da040 0x7f8c180eb050 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a9d42a230 msgr2=0x555a9d42c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x555a9d42a230 0x555a9d42c660 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8af0039a70 msgr2=0x7f8af003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8af0039a70 0x7f8af003bf30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x555a9d3f3ca0 tx=0x7f8c180e4000 comp rx=0 tx=0).stop 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 msgr2=0x555a9d415c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c24b6a640 1 -- 172.21.15.151:0/566337327 reap_dead start 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d415c90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8c2004f690 tx=0x7f8c200506b0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 shutdown_connections 2024-09-12T16:54:09.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/566337327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d40f860 0x555a9d415c90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 >> 172.21.15.151:0/566337327 conn(0x555a9d40ac20 msgr2=0x555a9d408e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 shutdown_connections 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/566337327 wait complete. 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/4191325794 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8afc039a70 msgr2=0x7f8afc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/4191325794 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8afc039a70 0x7f8afc03bf30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x555a9d3e85a0 tx=0x7f8c18005890 comp rx=0 tx=0).stop 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/4191325794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d401f30 msgr2=0x555a9d402350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/4191325794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d401f30 0x555a9d402350 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x555a9d3e9210 tx=0x7f8c20018830 comp rx=0 tx=0).stop 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/4191325794 shutdown_connections 2024-09-12T16:54:09.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/4191325794 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8afc039a70 0x7f8afc03bf30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/4191325794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d401f30 0x555a9d402350 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/4191325794 >> 172.21.15.151:0/4191325794 conn(0x555a9d3f78e0 msgr2=0x555a9d3f7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/4191325794 shutdown_connections 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/4191325794 wait complete. 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d3f0e00 msgr2=0x555a9d3f31f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d3f0e00 0x555a9d3f31f0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d3ec270 msgr2=0x555a9d3ee660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.831+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d3ec270 0x555a9d3ee660 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b0c039a70 msgr2=0x7f8b0c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b0c039a70 0x7f8b0c03bf30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c10001e60 tx=0x7f8c100013e0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f7030 msgr2=0x555a9d3e71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f7030 0x555a9d3e71b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000c10 tx=0x7f8c180180e0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 shutdown_connections 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x555a9d3f0e00 0x555a9d3f31f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x555a9d3ec270 0x555a9d3ee660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8b0c039a70 0x7f8b0c03bf30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 --2- 172.21.15.151:0/1826261258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a9d2f7030 0x555a9d3e71b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 >> 172.21.15.151:0/1826261258 conn(0x555a9d267a90 msgr2=0x555a9d3da020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 shutdown_connections 2024-09-12T16:54:09.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.835+0000 7f8c278659c0 1 -- 172.21.15.151:0/1826261258 wait complete. 2024-09-12T16:54:09.854 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:09.855 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:09.855 ERROR:root:0 2024-09-12T16:54:09.855 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T16:54:09.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T16:54:09.855 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-12T16:54:09.936 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:09.936 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:09.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe442adc9c0 1 Processor -- start 2024-09-12T16:54:09.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe442adc9c0 1 -- start start 2024-09-12T16:54:09.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe442adc9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56545cbf8210 0x56545cbfa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe442adc9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56545caa69c0 con 0x56545cbf4700 2024-09-12T16:54:09.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe442adc9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x56545caf66d0 con 0x56545cbf8210 2024-09-12T16:54:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe43fde1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56545cbf8210 0x56545cbfa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe43fde1640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x56545cbf8210 0x56545cbfa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52782/0 (socket says 172.21.15.151:52782) 2024-09-12T16:54:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe43fde1640 1 -- 172.21.15.151:0/2822398002 learned_addr learned my addr 172.21.15.151:0/2822398002 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.931+0000 7fe4405e2640 1 --1- 172.21.15.151:0/2822398002 >> v1:172.21.15.122:6789/0 conn(0x56545cbf4700 0x56545cbf6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:49308/0 (socket says 172.21.15.151:49308) 2024-09-12T16:54:09.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe43fde1640 1 -- 172.21.15.151:0/2822398002 >> v1:172.21.15.122:6789/0 conn(0x56545cbf4700 legacy=0x56545cbf6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe43fde1640 1 -- 172.21.15.151:0/2822398002 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545ca9aca0 con 0x56545cbf8210 2024-09-12T16:54:09.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe43fde1640 1 --2- 172.21.15.151:0/2822398002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cbfa600 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe42800a5c0 tx=0x7fe42801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508ba7103edd157d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe43f5e0640 1 -- 172.21.15.151:0/2822398002 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4280a6070 con 0x56545cbf8210 2024-09-12T16:54:09.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe43f5e0640 1 -- 172.21.15.151:0/2822398002 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4280af070 con 0x56545cbf8210 2024-09-12T16:54:09.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe43f5e0640 1 -- 172.21.15.151:0/2822398002 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4280aa5c0 con 0x56545cbf8210 2024-09-12T16:54:09.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2822398002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 msgr2=0x56545cbfa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2822398002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cbfa600 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe42800a5c0 tx=0x7fe42801b340 comp rx=0 tx=0).stop 2024-09-12T16:54:09.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2822398002 shutdown_connections 2024-09-12T16:54:09.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2822398002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cbfa600 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2822398002 >> 172.21.15.151:0/2822398002 conn(0x56545cb67a90 msgr2=0x56545cb67ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2822398002 shutdown_connections 2024-09-12T16:54:09.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.935+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2822398002 wait complete. 2024-09-12T16:54:09.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.951+0000 7fe442adc9c0 1 Processor -- start 2024-09-12T16:54:09.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.951+0000 7fe442adc9c0 1 -- start start 2024-09-12T16:54:09.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.951+0000 7fe442adc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf4700 0x56545ccdf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.951+0000 7fe442adc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56545cafa680 con 0x56545cbf4700 2024-09-12T16:54:09.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.951+0000 7fe4405e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf4700 0x56545ccdf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.951+0000 7fe4405e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf4700 0x56545ccdf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52784/0 (socket says 172.21.15.151:52784) 2024-09-12T16:54:09.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.951+0000 7fe4405e2640 1 -- 172.21.15.151:0/852576938 learned_addr learned my addr 172.21.15.151:0/852576938 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe4405e2640 1 -- 172.21.15.151:0/852576938 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545ca75da0 con 0x56545cbf4700 2024-09-12T16:54:09.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe4405e2640 1 --2- 172.21.15.151:0/852576938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf4700 0x56545ccdf8e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe438001ec0 tx=0x7fe43800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a71a2780afd1def server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe32e60c640 1 -- 172.21.15.151:0/852576938 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43800e5d0 con 0x56545cbf4700 2024-09-12T16:54:09.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe32e60c640 1 -- 172.21.15.151:0/852576938 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43800e770 con 0x56545cbf4700 2024-09-12T16:54:09.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe32e60c640 1 -- 172.21.15.151:0/852576938 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43800ea70 con 0x56545cbf4700 2024-09-12T16:54:09.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- 172.21.15.151:0/852576938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf4700 msgr2=0x56545ccdf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/852576938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf4700 0x56545ccdf8e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe438001ec0 tx=0x7fe43800b6d0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- 172.21.15.151:0/852576938 shutdown_connections 2024-09-12T16:54:09.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/852576938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf4700 0x56545ccdf8e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- 172.21.15.151:0/852576938 >> 172.21.15.151:0/852576938 conn(0x56545cb67a90 msgr2=0x56545ccdb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- 172.21.15.151:0/852576938 shutdown_connections 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- 172.21.15.151:0/852576938 wait complete. 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 Processor -- start 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- start start 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cce7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56545ca9ca50 con 0x56545cbf8210 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe4405e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cce7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe4405e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cce7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52798/0 (socket says 172.21.15.151:52798) 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe4405e2640 1 -- 172.21.15.151:0/2909991446 learned_addr learned my addr 172.21.15.151:0/2909991446 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe4405e2640 1 -- 172.21.15.151:0/2909991446 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545cce77f0 con 0x56545cbf8210 2024-09-12T16:54:09.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe4405e2640 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cce7290 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe43800b710 tx=0x7fe438000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe32ce09640 1 -- 172.21.15.151:0/2909991446 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43801a690 con 0x56545cbf8210 2024-09-12T16:54:09.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe32ce09640 1 -- 172.21.15.151:0/2909991446 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43801a830 con 0x56545cbf8210 2024-09-12T16:54:09.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56545cce7a80 con 0x56545cbf8210 2024-09-12T16:54:09.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe32ce09640 1 -- 172.21.15.151:0/2909991446 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43801ab50 con 0x56545cbf8210 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.955+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545cce8390 con 0x56545cbf8210 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe32ce09640 1 -- 172.21.15.151:0/2909991446 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe438017070 con 0x56545cbf8210 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe32ce09640 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe328039a70 0x7fe32803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe32ce09640 1 -- 172.21.15.151:0/2909991446 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe438015020 con 0x56545cbf8210 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe43fde1640 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe328039a70 0x7fe32803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545ccec350 0x56545ccee740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cceec80 con 0x56545ccec350 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe440de3640 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545ccec350 0x56545ccee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe43fde1640 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe328039a70 0x7fe32803bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe4280ae000 tx=0x7fe4280a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe440de3640 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545ccec350 0x56545ccee740 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe440de3640 1 -- 172.21.15.151:0/2909991446 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe43000a4d0 con 0x56545ccec350 2024-09-12T16:54:09.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545ccef080 con 0x56545ccec350 2024-09-12T16:54:09.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe440de3640 1 -- 172.21.15.151:0/2909991446 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe43000a4d0 con 0x56545ccec350 2024-09-12T16:54:09.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545ccf0e90 0x56545ccf3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545ccf3950 con 0x56545ccf0e90 2024-09-12T16:54:09.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe4405e2640 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545ccf0e90 0x56545ccf3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.959+0000 7fe4405e2640 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545ccf0e90 0x56545ccf3280 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe4405e2640 1 -- 172.21.15.151:0/2909991446 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe43802e070 con 0x56545ccf0e90 2024-09-12T16:54:09.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545ccefd30 con 0x56545ccec350 2024-09-12T16:54:09.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe440de3640 1 -- 172.21.15.151:0/2909991446 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe43000a4d0 con 0x56545ccec350 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545ccf01d0 con 0x56545ccec350 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe440de3640 1 -- 172.21.15.151:0/2909991446 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe43000a4d0 con 0x56545ccec350 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe442adc9c0 1 Processor -- start 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe442adc9c0 1 -- start start 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe442adc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd01fc0 0x56545cd023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe442adc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56545cb07450 con 0x56545cd01fc0 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe440de3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd01fc0 0x56545cd023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe440de3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd01fc0 0x56545cd023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52806/0 (socket says 172.21.15.151:52806) 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe440de3640 1 -- 172.21.15.151:0/3352535776 learned_addr learned my addr 172.21.15.151:0/3352535776 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe440de3640 1 -- 172.21.15.151:0/3352535776 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545cd02a20 con 0x56545cd01fc0 2024-09-12T16:54:09.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe440de3640 1 --2- 172.21.15.151:0/3352535776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd01fc0 0x56545cd023e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x56545cce92b0 tx=0x7fe430018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe325ffb640 1 -- 172.21.15.151:0/3352535776 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe430014450 con 0x56545cd01fc0 2024-09-12T16:54:09.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe325ffb640 1 -- 172.21.15.151:0/3352535776 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4300145f0 con 0x56545cd01fc0 2024-09-12T16:54:09.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe442adc9c0 1 -- 172.21.15.151:0/3352535776 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56545cd03280 con 0x56545cd01fc0 2024-09-12T16:54:09.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe325ffb640 1 -- 172.21.15.151:0/3352535776 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe430028060 con 0x56545cd01fc0 2024-09-12T16:54:09.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.963+0000 7fe442adc9c0 1 -- 172.21.15.151:0/3352535776 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545cd037f0 con 0x56545cd01fc0 2024-09-12T16:54:09.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe325ffb640 1 -- 172.21.15.151:0/3352535776 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe430011040 con 0x56545cd01fc0 2024-09-12T16:54:09.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe325ffb640 1 --2- 172.21.15.151:0/3352535776 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe318039a70 0x7fe31803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe325ffb640 1 -- 172.21.15.151:0/3352535776 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe43001e070 con 0x56545cd01fc0 2024-09-12T16:54:09.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe4405e2640 1 --2- 172.21.15.151:0/3352535776 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe318039a70 0x7fe31803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 Processor -- start 2024-09-12T16:54:09.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 -- start start 2024-09-12T16:54:09.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe4405e2640 1 --2- 172.21.15.151:0/3352535776 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe318039a70 0x7fe31803bf30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x56545cce8680 tx=0x7fe43801ae80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd0fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56545cce0130 con 0x56545cd0f850 2024-09-12T16:54:09.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe440de3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd0fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe440de3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd0fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52820/0 (socket says 172.21.15.151:52820) 2024-09-12T16:54:09.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe440de3640 1 -- 172.21.15.151:0/370300181 learned_addr learned my addr 172.21.15.151:0/370300181 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe440de3640 1 -- 172.21.15.151:0/370300181 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545cd10220 con 0x56545cd0f850 2024-09-12T16:54:09.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe440de3640 1 --2- 172.21.15.151:0/370300181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd0fc30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe430050740 tx=0x7fe43002baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2684f6f92f922c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe31f7fe640 1 -- 172.21.15.151:0/370300181 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe430016440 con 0x56545cd0f850 2024-09-12T16:54:09.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe31f7fe640 1 -- 172.21.15.151:0/370300181 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43004f2a0 con 0x56545cd0f850 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe31f7fe640 1 -- 172.21.15.151:0/370300181 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4300167c0 con 0x56545cd0f850 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 -- 172.21.15.151:0/370300181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 msgr2=0x56545cd0fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/370300181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd0fc30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe430050740 tx=0x7fe43002baa0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 -- 172.21.15.151:0/370300181 shutdown_connections 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/370300181 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd0fc30 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.967+0000 7fe442adc9c0 1 -- 172.21.15.151:0/370300181 >> 172.21.15.151:0/370300181 conn(0x56545cd0ac70 msgr2=0x56545cd08eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 -- 172.21.15.151:0/370300181 shutdown_connections 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 -- 172.21.15.151:0/370300181 wait complete. 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 Processor -- start 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 -- start start 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd15d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56545cd0e7a0 con 0x56545cd0f850 2024-09-12T16:54:09.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe440de3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd15d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe440de3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd15d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:52824/0 (socket says 172.21.15.151:52824) 2024-09-12T16:54:09.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 learned_addr learned my addr 172.21.15.151:0/1659867906 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:09.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545cd16280 con 0x56545cd0f850 2024-09-12T16:54:09.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe440de3640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd15d20 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe43004f6b0 tx=0x7fe4300506d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe31dffb640 1 -- 172.21.15.151:0/1659867906 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe430016b50 con 0x56545cd0f850 2024-09-12T16:54:09.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56545cd16510 con 0x56545cd0f850 2024-09-12T16:54:09.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe31dffb640 1 -- 172.21.15.151:0/1659867906 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe430016440 con 0x56545cd0f850 2024-09-12T16:54:09.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe31dffb640 1 -- 172.21.15.151:0/1659867906 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43003ea60 con 0x56545cd0f850 2024-09-12T16:54:09.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545cd16ec0 con 0x56545cd0f850 2024-09-12T16:54:09.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe31dffb640 1 -- 172.21.15.151:0/1659867906 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe43003ec00 con 0x56545cd0f850 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe31dffb640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe310039a70 0x7fe31003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe31dffb640 1 -- 172.21.15.151:0/1659867906 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe43000e040 con 0x56545cd0f850 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe4405e2640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe310039a70 0x7fe31003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545cd21000 0x56545cd234c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd23c10 con 0x56545cd21000 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.971+0000 7fe43fde1640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545cd21000 0x56545cd234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe4405e2640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe310039a70 0x7fe31003bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe43800ffd0 tx=0x7fe438033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe43fde1640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545cd21000 0x56545cd234c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 realm 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd24040 con 0x56545cd21000 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd24910 con 0x56545cd21000 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:09.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd24cb0 con 0x56545cd21000 2024-09-12T16:54:09.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:09.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:09.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545cd25a10 0x56545cd27e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd28410 con 0x56545cd25a10 2024-09-12T16:54:09.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe440de3640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545cd25a10 0x56545cd27e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe440de3640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545cd25a10 0x56545cd27e00 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 20 searching for the correct realm 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56545cd2a360 0x56545cd2c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd2a360 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe4405e2640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56545cd2a360 0x56545cd2c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.975+0000 7fe4405e2640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56545cd2a360 0x56545cd2c770 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe4405e2640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x56545cbf4700 0x7fe43802f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cbf4700 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x56545cbf4700 0x7fe43802f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x56545cbf4700 0x7fe43802f350 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd25a10 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd21000 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd21000 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd25a10 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd25a10 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cbf4700 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.979+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd2a360 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd21000 2024-09-12T16:54:09.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd25a10 2024-09-12T16:54:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd21000 2024-09-12T16:54:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cbf4700 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2cdf0 con 0x56545cd2a360 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd2a360 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd25a10 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd2a360 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd2a360 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd21000 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.983+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd21000 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd25a10 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd2a360 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cbf4700 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd21000 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd25a10 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd2a360 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd25a10 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cbf4700 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.987+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd2a360 2024-09-12T16:54:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:09.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd25a10 2024-09-12T16:54:09.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:09.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cd21000 2024-09-12T16:54:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe43805c040 con 0x56545cbf4700 2024-09-12T16:54:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd28dd0 con 0x56545cd21000 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd289e0 con 0x56545cd21000 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd296c0 con 0x56545cd21000 2024-09-12T16:54:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 zone default found 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 4 Realm: () 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 zonegroup default 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd296c0 con 0x56545cd25a10 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2f160 con 0x56545cd2a360 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2f520 con 0x56545cd2a360 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 started sync module instance, tier type = 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.991+0000 7fe442adc9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.995+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2e5f0 con 0x56545cbf4700 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.995+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.995+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94920334568176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2e5f0 con 0x56545cbf4700 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.995+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd30050 con 0x56545cd21000 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.995+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94920334568176] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.995+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.995+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94920334572320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd2e5f0 con 0x56545cd21000 2024-09-12T16:54:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.995+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd30a60 con 0x56545cd2a360 2024-09-12T16:54:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.999+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.999+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94920334575024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd31300 con 0x56545cd2a360 2024-09-12T16:54:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.999+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd31cc0 con 0x56545cbf4700 2024-09-12T16:54:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.999+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94920334572320] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.999+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.999+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94920334579728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd31c30 con 0x56545cbf4700 2024-09-12T16:54:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:09.999+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd32a10 con 0x56545cd21000 2024-09-12T16:54:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94920334575024] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94920334579728] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94920334577232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd324d0 con 0x56545cd21000 2024-09-12T16:54:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd32d60 con 0x56545cd25a10 2024-09-12T16:54:10.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94920334577232] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94920334582096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd33150 con 0x56545cd25a10 2024-09-12T16:54:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.003+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd33b10 con 0x56545cd25a10 2024-09-12T16:54:10.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.007+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94920334582096] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.007+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.007+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94920334583216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd33b10 con 0x56545cd25a10 2024-09-12T16:54:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.007+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd344d0 con 0x56545cd25a10 2024-09-12T16:54:10.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94920334583216] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94920334587488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd346b0 con 0x56545cd25a10 2024-09-12T16:54:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 add_watcher() i=0 2024-09-12T16:54:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 add_watcher() i=1 2024-09-12T16:54:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 add_watcher() i=2 2024-09-12T16:54:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 add_watcher() i=3 2024-09-12T16:54:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 add_watcher() i=4 2024-09-12T16:54:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 add_watcher() i=5 2024-09-12T16:54:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 add_watcher() i=6 2024-09-12T16:54:10.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94920334587488] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 add_watcher() i=7 2024-09-12T16:54:10.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:10.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd378f0 con 0x56545cd21000 2024-09-12T16:54:10.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94920334590560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd34b30 con 0x56545cd21000 2024-09-12T16:54:10.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94920334590560] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe2f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:10.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:10.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:10.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe442adc9c0 5 note: GC not initialized 2024-09-12T16:54:10.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.011+0000 7fe2f5fe3640 20 reqs_thread_entry: start 2024-09-12T16:54:10.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:10.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 20 Filter name: none 2024-09-12T16:54:10.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe2eeffd640 20 reqs_thread_entry: start 2024-09-12T16:54:10.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:10.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd5ac20 con 0x56545cd25a10 2024-09-12T16:54:10.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T16:54:10.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:10.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:10.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.015+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd61120 con 0x56545cd25a10 2024-09-12T16:54:10.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe442adc9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe442adc9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe442adc9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94920334773136 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545cd5c810 con 0x56545cd21000 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 94920334577232 notify 146028888118 ret 0) ==== 708+0+0 (crc 0 0 0) 0x56545ca9aca0 con 0x56545cd21000 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 94920334773136 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe31f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888118 cookie 94920334577232 notifier 4900 bl.length()=666 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe31f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:10.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe31f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe31f7fe640 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe304003eb0 con 0x56545cd21000 2024-09-12T16:54:10.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== watch-notify(notify_complete (2) cookie 94920334773136 notify 146028888118 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe4280d8400 con 0x56545cd21000 2024-09-12T16:54:10.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.026 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:10.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe2f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:10.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.019+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94920334590560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cd21000 2024-09-12T16:54:10.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94920334590560] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94920334568176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cbf4700 2024-09-12T16:54:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94920334568176] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe442adc9c0 20 remove_watcher() i=0 2024-09-12T16:54:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe442adc9c0 2 removed watcher, disabling cache 2024-09-12T16:54:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94920334572320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cd21000 2024-09-12T16:54:10.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94920334572320] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe442adc9c0 20 remove_watcher() i=1 2024-09-12T16:54:10.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.023+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94920334575024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cd2a360 2024-09-12T16:54:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.027+0000 7fe4405e2640 1 -- 172.21.15.151:0/1659867906 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94920334575024] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe43802e070 con 0x56545cd2a360 2024-09-12T16:54:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.027+0000 7fe442adc9c0 20 remove_watcher() i=2 2024-09-12T16:54:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.027+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94920334579728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cbf4700 2024-09-12T16:54:10.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.027+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94920334579728] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cbf4700 2024-09-12T16:54:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.027+0000 7fe442adc9c0 20 remove_watcher() i=3 2024-09-12T16:54:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.027+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94920334577232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cd21000 2024-09-12T16:54:10.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.031+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94920334577232] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4280aaa80 con 0x56545cd21000 2024-09-12T16:54:10.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.031+0000 7fe442adc9c0 20 remove_watcher() i=4 2024-09-12T16:54:10.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.031+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94920334582096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cd25a10 2024-09-12T16:54:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.031+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94920334582096] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.031+0000 7fe442adc9c0 20 remove_watcher() i=5 2024-09-12T16:54:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.031+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94920334583216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cd25a10 2024-09-12T16:54:10.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94920334583216] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 20 remove_watcher() i=6 2024-09-12T16:54:10.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94920334587488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545cd58a50 con 0x56545cd25a10 2024-09-12T16:54:10.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe440de3640 1 -- 172.21.15.151:0/1659867906 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94920334587488] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe430033070 con 0x56545cd25a10 2024-09-12T16:54:10.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 20 remove_watcher() i=7 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545cd25a10 msgr2=0x56545cd27e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545cd25a10 0x56545cd27e00 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545cd21000 msgr2=0x56545cd234c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545cd21000 0x56545cd234c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x56545cbf4700 msgr2=0x7fe43802f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x56545cbf4700 0x7fe43802f350 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56545cd2a360 msgr2=0x56545cd2c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x56545cd2a360 0x56545cd2c770 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe310039a70 msgr2=0x7fe31003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe310039a70 0x7fe31003bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe43800ffd0 tx=0x7fe438033000 comp rx=0 tx=0).stop 2024-09-12T16:54:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 msgr2=0x56545cd15d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/1659867906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd0f850 0x56545cd15d20 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe43004f6b0 tx=0x7fe4300506d0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 reap_dead start 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe43fde1640 1 -- 172.21.15.151:0/1659867906 reap_dead start 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 shutdown_connections 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 >> 172.21.15.151:0/1659867906 conn(0x56545cd0ac70 msgr2=0x56545cd08e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 shutdown_connections 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/1659867906 wait complete. 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/3352535776 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe318039a70 msgr2=0x7fe31803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/3352535776 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe318039a70 0x7fe31803bf30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x56545cce8680 tx=0x7fe43801ae80 comp rx=0 tx=0).stop 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/3352535776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd01fc0 msgr2=0x56545cd023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/3352535776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd01fc0 0x56545cd023e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x56545cce92b0 tx=0x7fe430018830 comp rx=0 tx=0).stop 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/3352535776 shutdown_connections 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/3352535776 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe318039a70 0x7fe31803bf30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/3352535776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cd01fc0 0x56545cd023e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.035+0000 7fe442adc9c0 1 -- 172.21.15.151:0/3352535776 >> 172.21.15.151:0/3352535776 conn(0x56545ccf7970 msgr2=0x56545ccf7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/3352535776 shutdown_connections 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/3352535776 wait complete. 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545ccf0e90 msgr2=0x56545ccf3280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545ccf0e90 0x56545ccf3280 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545ccec350 msgr2=0x56545ccee740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545ccec350 0x56545ccee740 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe328039a70 msgr2=0x7fe32803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe328039a70 0x7fe32803bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe4280ae000 tx=0x7fe4280a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 msgr2=0x56545cce7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cce7290 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe43800b710 tx=0x7fe438000bd0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 shutdown_connections 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x56545ccf0e90 0x56545ccf3280 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x56545ccec350 0x56545ccee740 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fe328039a70 0x7fe32803bf30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 --2- 172.21.15.151:0/2909991446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56545cbf8210 0x56545cce7290 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 >> 172.21.15.151:0/2909991446 conn(0x56545cb67a90 msgr2=0x56545ccd9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 shutdown_connections 2024-09-12T16:54:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.039+0000 7fe442adc9c0 1 -- 172.21.15.151:0/2909991446 wait complete. 2024-09-12T16:54:10.054 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:10.054 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:10.054 ERROR:root:0 2024-09-12T16:54:10.055 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.060 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000aec19f759893f8e8-0066e31cb2-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:54:10.060 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T16:54:10.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T16:54:10.061 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-12T16:54:10.137 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:10.138 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.131+0000 7fd3164be9c0 1 Processor -- start 2024-09-12T16:54:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.131+0000 7fd3164be9c0 1 -- start start 2024-09-12T16:54:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3164be9c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e57ec8c300 0x55e57ec8e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3164be9c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e57eb3c9c0 con 0x55e57ebfc230 2024-09-12T16:54:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3164be9c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55e57eb8c6d0 con 0x55e57ec8c300 2024-09-12T16:54:10.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3137c3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e57ec8c300 0x55e57ec8e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3137c3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55e57ec8c300 0x55e57ec8e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33974/0 (socket says 172.21.15.151:33974) 2024-09-12T16:54:10.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3137c3640 1 -- 172.21.15.151:0/1194408702 learned_addr learned my addr 172.21.15.151:0/1194408702 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3137c3640 1 -- 172.21.15.151:0/1194408702 >> v1:172.21.15.122:6789/0 conn(0x55e57ebfc230 legacy=0x55e57ec8abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3137c3640 1 -- 172.21.15.151:0/1194408702 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57eb30ca0 con 0x55e57ec8c300 2024-09-12T16:54:10.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd312fc2640 1 -- 172.21.15.151:0/1194408702 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288441752 0 0) 0x55e57eb3c9c0 con 0x55e57ebfc230 2024-09-12T16:54:10.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd3137c3640 1 --2- 172.21.15.151:0/1194408702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec8c300 0x55e57ec8e6f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd30800a5c0 tx=0x7fd30801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84422a3116b9985f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd312fc2640 1 -- 172.21.15.151:0/1194408702 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3080b1070 con 0x55e57ec8c300 2024-09-12T16:54:10.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd312fc2640 1 -- 172.21.15.151:0/1194408702 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3080a8070 con 0x55e57ec8c300 2024-09-12T16:54:10.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.135+0000 7fd312fc2640 1 -- 172.21.15.151:0/1194408702 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3080ac5b0 con 0x55e57ec8c300 2024-09-12T16:54:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.139+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1194408702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec8c300 msgr2=0x55e57ec8e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.139+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/1194408702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec8c300 0x55e57ec8e6f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd30800a5c0 tx=0x7fd30801b340 comp rx=0 tx=0).stop 2024-09-12T16:54:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.139+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1194408702 shutdown_connections 2024-09-12T16:54:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.139+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/1194408702 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec8c300 0x55e57ec8e6f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.139+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1194408702 >> 172.21.15.151:0/1194408702 conn(0x55e57ec82910 msgr2=0x55e57ec84d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.139+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1194408702 shutdown_connections 2024-09-12T16:54:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.139+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1194408702 wait complete. 2024-09-12T16:54:10.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.151+0000 7fd3164be9c0 1 Processor -- start 2024-09-12T16:54:10.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.151+0000 7fd3164be9c0 1 -- start start 2024-09-12T16:54:10.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed73690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e57eb90680 con 0x55e57ebfc230 2024-09-12T16:54:10.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd313fc4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed73690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd313fc4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed73690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:33990/0 (socket says 172.21.15.151:33990) 2024-09-12T16:54:10.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd313fc4640 1 -- 172.21.15.151:0/755175746 learned_addr learned my addr 172.21.15.151:0/755175746 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd313fc4640 1 -- 172.21.15.151:0/755175746 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57eb0bda0 con 0x55e57ebfc230 2024-09-12T16:54:10.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd313fc4640 1 --2- 172.21.15.151:0/755175746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed73690 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd30400b1d0 tx=0x7fd30400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c988d12444953f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd201e0b640 1 -- 172.21.15.151:0/755175746 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd304016070 con 0x55e57ebfc230 2024-09-12T16:54:10.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd201e0b640 1 -- 172.21.15.151:0/755175746 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30400d610 con 0x55e57ebfc230 2024-09-12T16:54:10.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd201e0b640 1 -- 172.21.15.151:0/755175746 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30400d930 con 0x55e57ebfc230 2024-09-12T16:54:10.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 -- 172.21.15.151:0/755175746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 msgr2=0x55e57ed73690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/755175746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed73690 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd30400b1d0 tx=0x7fd30400b690 comp rx=0 tx=0).stop 2024-09-12T16:54:10.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 -- 172.21.15.151:0/755175746 shutdown_connections 2024-09-12T16:54:10.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/755175746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed73690 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 -- 172.21.15.151:0/755175746 >> 172.21.15.151:0/755175746 conn(0x55e57ec82910 msgr2=0x55e57ed6f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 -- 172.21.15.151:0/755175746 shutdown_connections 2024-09-12T16:54:10.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 -- 172.21.15.151:0/755175746 wait complete. 2024-09-12T16:54:10.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 Processor -- start 2024-09-12T16:54:10.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 -- start start 2024-09-12T16:54:10.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed7ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd3164be9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e57eb32a50 con 0x55e57ebfc230 2024-09-12T16:54:10.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd313fc4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed7ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd313fc4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed7ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34004/0 (socket says 172.21.15.151:34004) 2024-09-12T16:54:10.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.155+0000 7fd313fc4640 1 -- 172.21.15.151:0/674634906 learned_addr learned my addr 172.21.15.151:0/674634906 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd313fc4640 1 -- 172.21.15.151:0/674634906 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57ed7b3a0 con 0x55e57ebfc230 2024-09-12T16:54:10.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd313fc4640 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed7ae40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55e57ed74650 tx=0x7fd304000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd1fbfff640 1 -- 172.21.15.151:0/674634906 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd304016030 con 0x55e57ebfc230 2024-09-12T16:54:10.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd1fbfff640 1 -- 172.21.15.151:0/674634906 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd304017040 con 0x55e57ebfc230 2024-09-12T16:54:10.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd1fbfff640 1 -- 172.21.15.151:0/674634906 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3040107b0 con 0x55e57ebfc230 2024-09-12T16:54:10.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e57ed7b630 con 0x55e57ebfc230 2024-09-12T16:54:10.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e57ed7bfe0 con 0x55e57ebfc230 2024-09-12T16:54:10.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd1fbfff640 1 -- 172.21.15.151:0/674634906 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd304026020 con 0x55e57ebfc230 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd1fbfff640 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1fc039ac0 0x7fd1fc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd1fbfff640 1 -- 172.21.15.151:0/674634906 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd304024020 con 0x55e57ebfc230 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3137c3640 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1fc039ac0 0x7fd1fc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57ec8c300 0x55e57ed81fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57ed824f0 con 0x55e57ec8c300 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3147c5640 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57ec8c300 0x55e57ed81fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3137c3640 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1fc039ac0 0x7fd1fc03bf80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd3080ae000 tx=0x7fd3080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3147c5640 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57ec8c300 0x55e57ed81fb0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3147c5640 1 -- 172.21.15.151:0/674634906 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd30c00a4d0 con 0x55e57ec8c300 2024-09-12T16:54:10.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.159+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57ed7c320 con 0x55e57ec8c300 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3147c5640 1 -- 172.21.15.151:0/674634906 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd30c00a4d0 con 0x55e57ec8c300 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57ed84760 0x55e57ed86b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57ed87240 con 0x55e57ed84760 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd313fc4640 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57ed84760 0x55e57ed86b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd313fc4640 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57ed84760 0x55e57ed86b50 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd313fc4640 1 -- 172.21.15.151:0/674634906 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd304028930 con 0x55e57ed84760 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57ed83600 con 0x55e57ec8c300 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3147c5640 1 -- 172.21.15.151:0/674634906 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd30c00a4d0 con 0x55e57ec8c300 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57ed83aa0 con 0x55e57ec8c300 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3147c5640 1 -- 172.21.15.151:0/674634906 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd30c00a4d0 con 0x55e57ec8c300 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3164be9c0 1 Processor -- start 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3164be9c0 1 -- start start 2024-09-12T16:54:10.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3164be9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ed958d0 0x55e57ed95cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.163+0000 7fd3164be9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e57eb9d450 con 0x55e57ed958d0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3147c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ed958d0 0x55e57ed95cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3147c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ed958d0 0x55e57ed95cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34006/0 (socket says 172.21.15.151:34006) 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3147c5640 1 -- 172.21.15.151:0/441231399 learned_addr learned my addr 172.21.15.151:0/441231399 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3147c5640 1 -- 172.21.15.151:0/441231399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57ed96330 con 0x55e57ed958d0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3147c5640 1 --2- 172.21.15.151:0/441231399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ed958d0 0x55e57ed95cf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55e57ed7c1d0 tx=0x7fd30c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd1f97fa640 1 -- 172.21.15.151:0/441231399 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30c014450 con 0x55e57ed958d0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3164be9c0 1 -- 172.21.15.151:0/441231399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e57ed96b90 con 0x55e57ed958d0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd1f97fa640 1 -- 172.21.15.151:0/441231399 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c014610 con 0x55e57ed958d0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd1f97fa640 1 -- 172.21.15.151:0/441231399 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30c014930 con 0x55e57ed958d0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3164be9c0 1 -- 172.21.15.151:0/441231399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e57ed97100 con 0x55e57ed958d0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd1f97fa640 1 -- 172.21.15.151:0/441231399 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd30c011040 con 0x55e57ed958d0 2024-09-12T16:54:10.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd1f97fa640 1 --2- 172.21.15.151:0/441231399 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1ec039a70 0x7fd1ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd1f97fa640 1 -- 172.21.15.151:0/441231399 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd30c01e070 con 0x55e57ed958d0 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd313fc4640 1 --2- 172.21.15.151:0/441231399 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1ec039a70 0x7fd1ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3164be9c0 1 Processor -- start 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3164be9c0 1 -- start start 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd313fc4640 1 --2- 172.21.15.151:0/441231399 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1ec039a70 0x7fd1ec03bf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55e57ed82900 tx=0x7fd304001a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3164be9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57ec86fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3164be9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e57ed73ee0 con 0x55e57ec86ba0 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3147c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57ec86fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3147c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57ec86fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34010/0 (socket says 172.21.15.151:34010) 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.167+0000 7fd3147c5640 1 -- 172.21.15.151:0/1344182285 learned_addr learned my addr 172.21.15.151:0/1344182285 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3147c5640 1 -- 172.21.15.151:0/1344182285 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57ec87590 con 0x55e57ec86ba0 2024-09-12T16:54:10.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3147c5640 1 --2- 172.21.15.151:0/1344182285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57ec86fa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005a90 tx=0x7fd30c049f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23e49f245dbf028 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd1f2ffd640 1 -- 172.21.15.151:0/1344182285 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30c016940 con 0x55e57ec86ba0 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd1f2ffd640 1 -- 172.21.15.151:0/1344182285 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c014ad0 con 0x55e57ec86ba0 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd1f2ffd640 1 -- 172.21.15.151:0/1344182285 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30c014db0 con 0x55e57ec86ba0 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1344182285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 msgr2=0x55e57ec86fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/1344182285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57ec86fa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005a90 tx=0x7fd30c049f80 comp rx=0 tx=0).stop 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1344182285 shutdown_connections 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/1344182285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57ec86fa0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1344182285 >> 172.21.15.151:0/1344182285 conn(0x55e57ed9e620 msgr2=0x55e57ed9c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1344182285 shutdown_connections 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- 172.21.15.151:0/1344182285 wait complete. 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 Processor -- start 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- start start 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57edab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e57ec87c30 con 0x55e57ec86ba0 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3147c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57edab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3147c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57edab920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34026/0 (socket says 172.21.15.151:34026) 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 learned_addr learned my addr 172.21.15.151:0/2174647280 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57edabe80 con 0x55e57ec86ba0 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3147c5640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57edab920 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0504e0 tx=0x7fd30c050510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd1f17fa640 1 -- 172.21.15.151:0/2174647280 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30c031030 con 0x55e57ec86ba0 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e57edac110 con 0x55e57ec86ba0 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd1f17fa640 1 -- 172.21.15.151:0/2174647280 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c016940 con 0x55e57ec86ba0 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd1f17fa640 1 -- 172.21.15.151:0/2174647280 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30c03e940 con 0x55e57ec86ba0 2024-09-12T16:54:10.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.171+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e57edacac0 con 0x55e57ec86ba0 2024-09-12T16:54:10.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd1f17fa640 1 -- 172.21.15.151:0/2174647280 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd30c034030 con 0x55e57ec86ba0 2024-09-12T16:54:10.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd1f17fa640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1dc039a70 0x7fd1dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd1f17fa640 1 -- 172.21.15.151:0/2174647280 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd30c032070 con 0x55e57ec86ba0 2024-09-12T16:54:10.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd313fc4640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1dc039a70 0x7fd1dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57edb6d30 0x55e57edb91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edb9940 con 0x55e57edb6d30 2024-09-12T16:54:10.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3137c3640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57edb6d30 0x55e57edb91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd313fc4640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1dc039a70 0x7fd1dc03bf30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd30404e2b0 tx=0x7fd304033000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3137c3640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57edb6d30 0x55e57edb91f0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 realm 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edb9d70 con 0x55e57edb6d30 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edba640 con 0x55e57edb6d30 2024-09-12T16:54:10.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edba9e0 con 0x55e57edb6d30 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57edbb740 0x55e57edbdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edbe140 con 0x55e57edbb740 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.175+0000 7fd3147c5640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57edbb740 0x55e57edbdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3147c5640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57edbb740 0x55e57edbdb30 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3164be9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3164be9c0 20 searching for the correct realm 2024-09-12T16:54:10.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e57edc0090 0x55e57edc24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd313fc4640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e57edc0090 0x55e57edc24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd313fc4640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e57edc0090 0x55e57edc24c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd313fc4640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd304010070 0x7fd304027a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x7fd304010070 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3137c3640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd304010070 0x7fd304027a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3137c3640 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd304010070 0x7fd304027a60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edb6d30 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edb6d30 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.179+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x7fd304010070 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edb6d30 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edb6d30 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x7fd304010070 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.183+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edb6d30 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edb6d30 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x7fd304010070 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edb6d30 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.187+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x7fd304010070 2024-09-12T16:54:10.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edc0090 2024-09-12T16:54:10.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edbb740 2024-09-12T16:54:10.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x55e57edb6d30 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc2b40 con 0x7fd304010070 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edbeb00 con 0x55e57edb6d30 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edbe710 con 0x55e57edb6d30 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edbf3f0 con 0x55e57edb6d30 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 zone default found 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 4 Realm: () 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:10.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 zonegroup default 2024-09-12T16:54:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.191+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edbf3f0 con 0x55e57edbb740 2024-09-12T16:54:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc4eb0 con 0x55e57edc0090 2024-09-12T16:54:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc5250 con 0x55e57edc0090 2024-09-12T16:54:10.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 20 started sync module instance, tier type = 2024-09-12T16:54:10.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:10.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc4340 con 0x7fd304010070 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94444164237376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc4340 con 0x7fd304010070 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc5d80 con 0x55e57edb6d30 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.195+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94444164237376] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.199+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.199+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94444164241488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc4340 con 0x55e57edb6d30 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.199+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc6790 con 0x55e57edc0090 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.199+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.199+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94444164244192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc7030 con 0x55e57edc0090 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.199+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc7a30 con 0x7fd304010070 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.199+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94444164241488] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.203+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.203+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94444164234896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc7e20 con 0x7fd304010070 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.203+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc87e0 con 0x55e57edb6d30 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.203+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94444164244192] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.203+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94444164234896] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.203+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.203+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94444164248896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc8330 con 0x55e57edb6d30 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.203+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc8b80 con 0x55e57edbb740 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.207+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94444164248896] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.207+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.207+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94444164252464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc8750 con 0x55e57edbb740 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.207+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc9880 con 0x55e57edbb740 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.207+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.207+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94444164256720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc9d00 con 0x55e57edbb740 2024-09-12T16:54:10.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.207+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edca810 con 0x55e57edbb740 2024-09-12T16:54:10.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.207+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94444164252464] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94444164260544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edca7d0 con 0x55e57edbb740 2024-09-12T16:54:10.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 20 add_watcher() i=0 2024-09-12T16:54:10.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 20 add_watcher() i=1 2024-09-12T16:54:10.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 20 add_watcher() i=2 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 20 add_watcher() i=3 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 20 add_watcher() i=4 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 20 add_watcher() i=5 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94444164256720] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 20 add_watcher() i=6 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94444164260544] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 20 add_watcher() i=7 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edc97f0 con 0x55e57edb6d30 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.211+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94444164257776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edcac70 con 0x55e57edb6d30 2024-09-12T16:54:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94444164257776] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd1c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 5 note: GC not initialized 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd1c8fe1640 20 reqs_thread_entry: start 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 20 Filter name: none 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd1427fc640 20 reqs_thread_entry: start 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edf0960 con 0x55e57edbb740 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T16:54:10.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:10.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:10.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.215+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edf71d0 con 0x55e57edbb740 2024-09-12T16:54:10.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3164be9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:10.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3164be9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3164be9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:10.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94444164443200 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e57edf2920 con 0x55e57edb6d30 2024-09-12T16:54:10.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 94444164248896 notify 146028888119 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fd3080cc040 con 0x55e57edb6d30 2024-09-12T16:54:10.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd1f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888119 cookie 94444164248896 notifier 4907 bl.length()=636 2024-09-12T16:54:10.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd1f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:10.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd1f2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 94444164443200 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd1f2ffd640 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd1d8003eb0 con 0x55e57edb6d30 2024-09-12T16:54:10.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 94444164443200 notify 146028888119 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd3080c0040 con 0x55e57edb6d30 2024-09-12T16:54:10.255 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:10.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd1c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:10.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.219+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94444164257776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x55e57edb6d30 2024-09-12T16:54:10.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.223+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94444164257776] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.223+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94444164237376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x7fd304010070 2024-09-12T16:54:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.223+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94444164237376] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.223+0000 7fd3164be9c0 20 remove_watcher() i=0 2024-09-12T16:54:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.223+0000 7fd3164be9c0 2 removed watcher, disabling cache 2024-09-12T16:54:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.223+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94444164241488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x55e57edb6d30 2024-09-12T16:54:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94444164241488] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd3164be9c0 20 remove_watcher() i=1 2024-09-12T16:54:10.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94444164244192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x55e57edc0090 2024-09-12T16:54:10.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd313fc4640 1 -- 172.21.15.151:0/2174647280 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94444164244192] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304028930 con 0x55e57edc0090 2024-09-12T16:54:10.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd3164be9c0 20 remove_watcher() i=2 2024-09-12T16:54:10.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94444164234896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x7fd304010070 2024-09-12T16:54:10.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94444164234896] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x7fd304010070 2024-09-12T16:54:10.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd3164be9c0 20 remove_watcher() i=3 2024-09-12T16:54:10.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.227+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94444164248896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x55e57edb6d30 2024-09-12T16:54:10.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.231+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94444164248896] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3080b4040 con 0x55e57edb6d30 2024-09-12T16:54:10.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.231+0000 7fd3164be9c0 20 remove_watcher() i=4 2024-09-12T16:54:10.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.231+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94444164252464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x55e57edbb740 2024-09-12T16:54:10.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.231+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94444164252464] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.231+0000 7fd3164be9c0 20 remove_watcher() i=5 2024-09-12T16:54:10.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.231+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94444164256720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x55e57edbb740 2024-09-12T16:54:10.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.235+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94444164256720] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.235+0000 7fd3164be9c0 20 remove_watcher() i=6 2024-09-12T16:54:10.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.235+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94444164260544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e57edee740 con 0x55e57edbb740 2024-09-12T16:54:10.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3147c5640 1 -- 172.21.15.151:0/2174647280 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94444164260544] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30c02a070 con 0x55e57edbb740 2024-09-12T16:54:10.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 20 remove_watcher() i=7 2024-09-12T16:54:10.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57edbb740 msgr2=0x55e57edbdb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57edbb740 0x55e57edbdb30 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57edb6d30 msgr2=0x55e57edb91f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57edb6d30 0x55e57edb91f0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd304010070 msgr2=0x7fd304027a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd304010070 0x7fd304027a60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e57edc0090 msgr2=0x55e57edc24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55e57edc0090 0x55e57edc24c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1dc039a70 msgr2=0x7fd1dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1dc039a70 0x7fd1dc03bf30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd30404e2b0 tx=0x7fd304033000 comp rx=0 tx=0).stop 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 msgr2=0x55e57edab920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3137c3640 1 -- 172.21.15.151:0/2174647280 reap_dead start 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57edab920 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0504e0 tx=0x7fd30c050510 comp rx=0 tx=0).stop 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 shutdown_connections 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/2174647280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ec86ba0 0x55e57edab920 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 >> 172.21.15.151:0/2174647280 conn(0x55e57ed9e620 msgr2=0x55e57ed9c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 shutdown_connections 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/2174647280 wait complete. 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/441231399 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1ec039a70 msgr2=0x7fd1ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/441231399 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1ec039a70 0x7fd1ec03bf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55e57ed82900 tx=0x7fd304001a50 comp rx=0 tx=0).stop 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/441231399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ed958d0 msgr2=0x55e57ed95cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/441231399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ed958d0 0x55e57ed95cf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55e57ed7c1d0 tx=0x7fd30c018830 comp rx=0 tx=0).stop 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/441231399 shutdown_connections 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/441231399 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1ec039a70 0x7fd1ec03bf30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/441231399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ed958d0 0x55e57ed95cf0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/441231399 >> 172.21.15.151:0/441231399 conn(0x55e57ed8b280 msgr2=0x55e57ed8b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/441231399 shutdown_connections 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/441231399 wait complete. 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57ed84760 msgr2=0x55e57ed86b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57ed84760 0x55e57ed86b50 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57ec8c300 msgr2=0x55e57ed81fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57ec8c300 0x55e57ed81fb0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1fc039ac0 msgr2=0x7fd1fc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1fc039ac0 0x7fd1fc03bf80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd3080ae000 tx=0x7fd3080a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 msgr2=0x55e57ed7ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed7ae40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55e57ed74650 tx=0x7fd304000ee0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 shutdown_connections 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55e57ed84760 0x55e57ed86b50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55e57ec8c300 0x55e57ed81fb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd1fc039ac0 0x7fd1fc03bf80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 --2- 172.21.15.151:0/674634906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e57ebfc230 0x55e57ed7ae40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 >> 172.21.15.151:0/674634906 conn(0x55e57ec82910 msgr2=0x55e57ed6dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 shutdown_connections 2024-09-12T16:54:10.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.239+0000 7fd3164be9c0 1 -- 172.21.15.151:0/674634906 wait complete. 2024-09-12T16:54:10.276 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:10.276 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:10.276 ERROR:root:0 2024-09-12T16:54:10.276 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T16:54:10.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T16:54:10.277 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T16:54:10.360 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:10.361 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:10.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1ef12119c0 1 Processor -- start 2024-09-12T16:54:10.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1ef12119c0 1 -- start start 2024-09-12T16:54:10.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1ef12119c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55ab3fa6f340 0x55ab3fa71730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1ef12119c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab3f91d9c0 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1ef12119c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x55ab3f96d6d0 con 0x55ab3fa6f340 2024-09-12T16:54:10.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1eee516640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55ab3fa6f340 0x55ab3fa71730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1eeed17640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x55ab3fa6b1f0 0x55ab3fa6b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:56634/0 (socket says 172.21.15.151:56634) 2024-09-12T16:54:10.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1eee516640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x55ab3fa6f340 0x55ab3fa71730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34032/0 (socket says 172.21.15.151:34032) 2024-09-12T16:54:10.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1eeed17640 1 -- 172.21.15.151:0/3355325086 learned_addr learned my addr 172.21.15.151:0/3355325086 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:10.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.355+0000 7f1eee516640 1 -- 172.21.15.151:0/3355325086 >> v1:172.21.15.122:6789/0 conn(0x55ab3fa6b1f0 legacy=0x55ab3fa6b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1eee516640 1 -- 172.21.15.151:0/3355325086 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab3f911ca0 con 0x55ab3fa6f340 2024-09-12T16:54:10.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1eee516640 1 --2- 172.21.15.151:0/3355325086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6f340 0x55ab3fa71730 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000a480 tx=0x7f1ee001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db78f074d404d26f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1eedd15640 1 -- 172.21.15.151:0/3355325086 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee00aa570 con 0x55ab3fa6f340 2024-09-12T16:54:10.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1eedd15640 1 -- 172.21.15.151:0/3355325086 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee00af070 con 0x55ab3fa6f340 2024-09-12T16:54:10.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1eedd15640 1 -- 172.21.15.151:0/3355325086 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee00aa860 con 0x55ab3fa6f340 2024-09-12T16:54:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3355325086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6f340 msgr2=0x55ab3fa71730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/3355325086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6f340 0x55ab3fa71730 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000a480 tx=0x7f1ee001b310 comp rx=0 tx=0).stop 2024-09-12T16:54:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3355325086 shutdown_connections 2024-09-12T16:54:10.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/3355325086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6f340 0x55ab3fa71730 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3355325086 >> 172.21.15.151:0/3355325086 conn(0x55ab3f9deb00 msgr2=0x55ab3f9def10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3355325086 shutdown_connections 2024-09-12T16:54:10.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.359+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3355325086 wait complete. 2024-09-12T16:54:10.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.375+0000 7f1ef12119c0 1 Processor -- start 2024-09-12T16:54:10.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.375+0000 7f1ef12119c0 1 -- start start 2024-09-12T16:54:10.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb56940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ab3f971680 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1eeed17640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb56940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1eeed17640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb56940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34042/0 (socket says 172.21.15.151:34042) 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1eeed17640 1 -- 172.21.15.151:0/2978281340 learned_addr learned my addr 172.21.15.151:0/2978281340 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1eeed17640 1 -- 172.21.15.151:0/2978281340 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab3f8ecda0 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1eeed17640 1 --2- 172.21.15.151:0/2978281340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb56940 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8001e00 tx=0x7f1ed800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a84c80f7cc41c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ddce09640 1 -- 172.21.15.151:0/2978281340 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed8012020 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ddce09640 1 -- 172.21.15.151:0/2978281340 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed800e690 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ddce09640 1 -- 172.21.15.151:0/2978281340 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed800ea10 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2978281340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 msgr2=0x55ab3fb56940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2978281340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb56940 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8001e00 tx=0x7f1ed800b6d0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2978281340 shutdown_connections 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2978281340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb56940 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2978281340 >> 172.21.15.151:0/2978281340 conn(0x55ab3f9deb00 msgr2=0x55ab3fb52580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2978281340 shutdown_connections 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2978281340 wait complete. 2024-09-12T16:54:10.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 Processor -- start 2024-09-12T16:54:10.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 -- start start 2024-09-12T16:54:10.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb5e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1ef12119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ab3f913a50 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1eeed17640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb5e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1eeed17640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb5e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34054/0 (socket says 172.21.15.151:34054) 2024-09-12T16:54:10.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.379+0000 7f1eeed17640 1 -- 172.21.15.151:0/352349396 learned_addr learned my addr 172.21.15.151:0/352349396 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1eeed17640 1 -- 172.21.15.151:0/352349396 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab3fb5e5c0 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1eeed17640 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb5e060 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x55ab3fb578d0 tx=0x7f1ed8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ddb606640 1 -- 172.21.15.151:0/352349396 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed8012030 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab3fb5e850 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ddb606640 1 -- 172.21.15.151:0/352349396 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed8001460 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ddb606640 1 -- 172.21.15.151:0/352349396 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed801a7a0 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab3fb5f200 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ddb606640 1 -- 172.21.15.151:0/352349396 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1ed8015020 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ddb606640 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dd4039a70 0x7f1dd403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ddb606640 1 -- 172.21.15.151:0/352349396 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1ed8020030 con 0x55ab3fa6b1f0 2024-09-12T16:54:10.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1eee516640 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dd4039a70 0x7f1dd403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fa6f340 0x55ab3fb651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb65710 con 0x55ab3fa6f340 2024-09-12T16:54:10.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1eef518640 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fa6f340 0x55ab3fb651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1eee516640 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dd4039a70 0x7f1dd403bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00ae000 tx=0x7f1ee00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1eef518640 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fa6f340 0x55ab3fb651d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1eef518640 1 -- 172.21.15.151:0/352349396 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ee800a4d0 con 0x55ab3fa6f340 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb5f570 con 0x55ab3fa6f340 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1eef518640 1 -- 172.21.15.151:0/352349396 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ee800a4d0 con 0x55ab3fa6f340 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb67a00 0x55ab3fb69df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.383+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb6a4e0 con 0x55ab3fb67a00 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eeed17640 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb67a00 0x55ab3fb69df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eeed17640 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb67a00 0x55ab3fb69df0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eeed17640 1 -- 172.21.15.151:0/352349396 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ed8008030 con 0x55ab3fb67a00 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb668a0 con 0x55ab3fa6f340 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eef518640 1 -- 172.21.15.151:0/352349396 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ee800a4d0 con 0x55ab3fa6f340 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb66d40 con 0x55ab3fa6f340 2024-09-12T16:54:10.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eef518640 1 -- 172.21.15.151:0/352349396 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ee800a4d0 con 0x55ab3fa6f340 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1ef12119c0 1 Processor -- start 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1ef12119c0 1 -- start start 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1ef12119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb78b70 0x55ab3fb78f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1ef12119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ab3f97e450 con 0x55ab3fb78b70 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eef518640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb78b70 0x55ab3fb78f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eef518640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb78b70 0x55ab3fb78f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34064/0 (socket says 172.21.15.151:34064) 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eef518640 1 -- 172.21.15.151:0/967069487 learned_addr learned my addr 172.21.15.151:0/967069487 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.387+0000 7f1eef518640 1 -- 172.21.15.151:0/967069487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab3fb795d0 con 0x55ab3fb78b70 2024-09-12T16:54:10.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1eef518640 1 --2- 172.21.15.151:0/967069487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb78b70 0x55ab3fb78f90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55ab3fb5f3f0 tx=0x7f1ee8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1dd8e01640 1 -- 172.21.15.151:0/967069487 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee8014450 con 0x55ab3fb78b70 2024-09-12T16:54:10.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1ef12119c0 1 -- 172.21.15.151:0/967069487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab3fb79e30 con 0x55ab3fb78b70 2024-09-12T16:54:10.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1dd8e01640 1 -- 172.21.15.151:0/967069487 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee8014610 con 0x55ab3fb78b70 2024-09-12T16:54:10.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1ef12119c0 1 -- 172.21.15.151:0/967069487 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab3fb7a3a0 con 0x55ab3fb78b70 2024-09-12T16:54:10.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1dd8e01640 1 -- 172.21.15.151:0/967069487 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee8028060 con 0x55ab3fb78b70 2024-09-12T16:54:10.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1dd8e01640 1 -- 172.21.15.151:0/967069487 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1ee8011040 con 0x55ab3fb78b70 2024-09-12T16:54:10.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1dd8e01640 1 --2- 172.21.15.151:0/967069487 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dc8039a20 0x7f1dc803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1dd8e01640 1 -- 172.21.15.151:0/967069487 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1ee801e070 con 0x55ab3fb78b70 2024-09-12T16:54:10.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1eeed17640 1 --2- 172.21.15.151:0/967069487 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dc8039a20 0x7f1dc803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1ef12119c0 1 Processor -- start 2024-09-12T16:54:10.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1ef12119c0 1 -- start start 2024-09-12T16:54:10.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1eeed17640 1 --2- 172.21.15.151:0/967069487 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dc8039a20 0x7f1dc803bee0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55ab3fb65b70 tx=0x7f1ed800c630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1ef12119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb86880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1ef12119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ab3fb57190 con 0x55ab3fb864a0 2024-09-12T16:54:10.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1eef518640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb86880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1eef518640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb86880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34080/0 (socket says 172.21.15.151:34080) 2024-09-12T16:54:10.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.391+0000 7f1eef518640 1 -- 172.21.15.151:0/3192774134 learned_addr learned my addr 172.21.15.151:0/3192774134 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1eef518640 1 -- 172.21.15.151:0/3192774134 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab3fb86e70 con 0x55ab3fb864a0 2024-09-12T16:54:10.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1eef518640 1 --2- 172.21.15.151:0/3192774134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb86880 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8050600 tx=0x7f1ee8016ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516a7fdc88382559 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1dd27fc640 1 -- 172.21.15.151:0/3192774134 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee80167c0 con 0x55ab3fb864a0 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1dd27fc640 1 -- 172.21.15.151:0/3192774134 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee8011330 con 0x55ab3fb864a0 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1dd27fc640 1 -- 172.21.15.151:0/3192774134 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee8016960 con 0x55ab3fb864a0 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3192774134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 msgr2=0x55ab3fb86880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/3192774134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb86880 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8050600 tx=0x7f1ee8016ca0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3192774134 shutdown_connections 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/3192774134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb86880 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3192774134 >> 172.21.15.151:0/3192774134 conn(0x55ab3fb818c0 msgr2=0x55ab3fb7fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3192774134 shutdown_connections 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- 172.21.15.151:0/3192774134 wait complete. 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 Processor -- start 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- start start 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb8c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ab3fb853f0 con 0x55ab3fb864a0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1eef518640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb8c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1eef518640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb8c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34082/0 (socket says 172.21.15.151:34082) 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 learned_addr learned my addr 172.21.15.151:0/2639328076 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab3fb8ce80 con 0x55ab3fb864a0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1eef518640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb8c920 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8016ce0 tx=0x7f1ee8050590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1dd0ff9640 1 -- 172.21.15.151:0/2639328076 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee80147c0 con 0x55ab3fb864a0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab3fb8d110 con 0x55ab3fb864a0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1dd0ff9640 1 -- 172.21.15.151:0/2639328076 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee8014960 con 0x55ab3fb864a0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1dd0ff9640 1 -- 172.21.15.151:0/2639328076 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ee8014c40 con 0x55ab3fb864a0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.395+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab3fb8dac0 con 0x55ab3fb864a0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1dd0ff9640 1 -- 172.21.15.151:0/2639328076 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1ee803e3f0 con 0x55ab3fb864a0 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1dd0ff9640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1db8039a70 0x7f1db803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1dd0ff9640 1 -- 172.21.15.151:0/2639328076 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1ee8048050 con 0x55ab3fb864a0 2024-09-12T16:54:10.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eeed17640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1db8039a70 0x7f1db803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fb97c20 0x55ab3fb9a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb9a830 con 0x55ab3fb97c20 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eee516640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fb97c20 0x55ab3fb9a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eeed17640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1db8039a70 0x7f1db803bf30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55ab3fb6a8e0 tx=0x7f1ed804b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eee516640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fb97c20 0x55ab3fb9a0e0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 realm 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb9ac60 con 0x55ab3fb97c20 2024-09-12T16:54:10.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb9b530 con 0x55ab3fb97c20 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb9b8d0 con 0x55ab3fb97c20 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb9c630 0x55ab3fb9ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb9f030 con 0x55ab3fb9c630 2024-09-12T16:54:10.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.399+0000 7f1eef518640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb9c630 0x55ab3fb9ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eef518640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb9c630 0x55ab3fb9ea20 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1ef12119c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1ef12119c0 20 searching for the correct realm 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ab3fba0f80 0x55ab3fba33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eeed17640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ab3fba0f80 0x55ab3fba33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eeed17640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ab3fba0f80 0x55ab3fba33b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eeed17640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1ed8017050 0x7f1ed800c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x7f1ed8017050 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eee516640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1ed8017050 0x7f1ed800c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eee516640 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1ed8017050 0x7f1ed800c760 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb97c20 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb97c20 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.403+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x7f1ed8017050 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb97c20 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb97c20 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x7f1ed8017050 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.407+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb97c20 2024-09-12T16:54:10.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb97c20 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x7f1ed8017050 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb97c20 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.411+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x7f1ed8017050 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fba0f80 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb9c630 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x55ab3fb97c20 2024-09-12T16:54:10.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3a30 con 0x7f1ed8017050 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb9f9f0 con 0x55ab3fb97c20 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fb9f600 con 0x55ab3fb97c20 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba03a0 con 0x55ab3fb97c20 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 zone default found 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 4 Realm: () 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:10.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 zonegroup default 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.415+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba3eb0 con 0x55ab3fb9c630 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba60f0 con 0x55ab3fba0f80 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba64b0 con 0x55ab3fba0f80 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 20 started sync module instance, tier type = 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba5580 con 0x7f1ed8017050 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94193996946048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba5580 con 0x7f1ed8017050 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba6fb0 con 0x55ab3fb97c20 2024-09-12T16:54:10.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.419+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94193996946048] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.423+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.423+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94193996950144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba5580 con 0x55ab3fb97c20 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.423+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba79c0 con 0x55ab3fba0f80 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.423+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94193996950144] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.423+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.423+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94193996943568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba54f0 con 0x55ab3fba0f80 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.423+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba8710 con 0x7f1ed8017050 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94193996956560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba8fb0 con 0x7f1ed8017050 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba99b0 con 0x55ab3fb97c20 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94193996943568] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94193996956560] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94193996955056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba8a90 con 0x55ab3fb97c20 2024-09-12T16:54:10.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbaa250 con 0x55ab3fb9c630 2024-09-12T16:54:10.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.427+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94193996955056] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.431+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.431+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94193996963232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba8a90 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.431+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbaaaa0 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.431+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94193996963232] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.431+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.431+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94193996960960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbaaaa0 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.431+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbab4a0 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94193996960960] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94193996965360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbab640 con 0x55ab3fb9c630 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 20 add_watcher() i=0 2024-09-12T16:54:10.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 20 add_watcher() i=1 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 20 add_watcher() i=2 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 20 add_watcher() i=3 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 20 add_watcher() i=4 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 20 add_watcher() i=5 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 20 add_watcher() i=6 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94193996965360] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 20 add_watcher() i=7 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbae860 con 0x55ab3fb97c20 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.435+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94193996980688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbab5e0 con 0x55ab3fb97c20 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94193996980688] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1da57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 5 note: GC not initialized 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1d1ffff640 20 reqs_thread_entry: start 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 20 Filter name: none 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1d1dffb640 20 reqs_thread_entry: start 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbd1af0 con 0x55ab3fb9c630 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.439+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbd7fe0 con 0x55ab3fb9c630 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1ef12119c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1ef12119c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1ef12119c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94193997150864 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbd3750 con 0x55ab3fb97c20 2024-09-12T16:54:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 94193996955056 notify 146028888120 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55ab3f911ca0 con 0x55ab3fb97c20 2024-09-12T16:54:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1dd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888120 cookie 94193996955056 notifier 4914 bl.length()=649 2024-09-12T16:54:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1dd27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1dd27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 94193997150864 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1dd27fc640 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1db4003eb0 con 0x55ab3fb97c20 2024-09-12T16:54:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 94193997150864 notify 146028888120 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1ee00d8960 con 0x55ab3fb97c20 2024-09-12T16:54:10.459 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1da57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.443+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94193996980688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbd7370 con 0x55ab3fb97c20 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.447+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94193996980688] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.447+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94193996946048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fbd7370 con 0x7f1ed8017050 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.447+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94193996946048] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.447+0000 7f1ef12119c0 20 remove_watcher() i=0 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.447+0000 7f1ef12119c0 2 removed watcher, disabling cache 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.447+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94193996950144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba5a80 con 0x55ab3fb97c20 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94193996950144] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1ef12119c0 20 remove_watcher() i=1 2024-09-12T16:54:10.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94193996943568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba5a80 con 0x55ab3fba0f80 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1eeed17640 1 -- 172.21.15.151:0/2639328076 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94193996943568] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed8036040 con 0x55ab3fba0f80 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1ef12119c0 20 remove_watcher() i=2 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94193996956560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba5a80 con 0x7f1ed8017050 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94193996956560] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x7f1ed8017050 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1ef12119c0 20 remove_watcher() i=3 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.451+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94193996955056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba5a80 con 0x55ab3fb97c20 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.455+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94193996955056] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee00a8070 con 0x55ab3fb97c20 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.455+0000 7f1ef12119c0 20 remove_watcher() i=4 2024-09-12T16:54:10.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.455+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94193996963232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba7db0 con 0x55ab3fb9c630 2024-09-12T16:54:10.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.455+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94193996963232] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.455+0000 7f1ef12119c0 20 remove_watcher() i=5 2024-09-12T16:54:10.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.459+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94193996960960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba5a80 con 0x55ab3fb9c630 2024-09-12T16:54:10.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.459+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94193996960960] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.459+0000 7f1ef12119c0 20 remove_watcher() i=6 2024-09-12T16:54:10.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.459+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94193996965360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ab3fba94c0 con 0x55ab3fb9c630 2024-09-12T16:54:10.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1eef518640 1 -- 172.21.15.151:0/2639328076 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94193996965360] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee802a070 con 0x55ab3fb9c630 2024-09-12T16:54:10.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 20 remove_watcher() i=7 2024-09-12T16:54:10.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb9c630 msgr2=0x55ab3fb9ea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb9c630 0x55ab3fb9ea20 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fb97c20 msgr2=0x55ab3fb9a0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fb97c20 0x55ab3fb9a0e0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1ed8017050 msgr2=0x7f1ed800c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f1ed8017050 0x7f1ed800c760 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ab3fba0f80 msgr2=0x55ab3fba33b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x55ab3fba0f80 0x55ab3fba33b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1db8039a70 msgr2=0x7f1db803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1db8039a70 0x7f1db803bf30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55ab3fb6a8e0 tx=0x7f1ed804b000 comp rx=0 tx=0).stop 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1eee516640 1 -- 172.21.15.151:0/2639328076 reap_dead start 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 msgr2=0x55ab3fb8c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb8c920 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8016ce0 tx=0x7f1ee8050590 comp rx=0 tx=0).stop 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 shutdown_connections 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/2639328076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb864a0 0x55ab3fb8c920 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 >> 172.21.15.151:0/2639328076 conn(0x55ab3fb818c0 msgr2=0x55ab3fb7fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 shutdown_connections 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/2639328076 wait complete. 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/967069487 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dc8039a20 msgr2=0x7f1dc803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/967069487 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dc8039a20 0x7f1dc803bee0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55ab3fb65b70 tx=0x7f1ed800c630 comp rx=0 tx=0).stop 2024-09-12T16:54:10.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/967069487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb78b70 msgr2=0x55ab3fb78f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/967069487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb78b70 0x55ab3fb78f90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55ab3fb5f3f0 tx=0x7f1ee8018830 comp rx=0 tx=0).stop 2024-09-12T16:54:10.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/967069487 shutdown_connections 2024-09-12T16:54:10.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/967069487 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dc8039a20 0x7f1dc803bee0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/967069487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fb78b70 0x55ab3fb78f90 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/967069487 >> 172.21.15.151:0/967069487 conn(0x55ab3fb6e520 msgr2=0x55ab3fb6e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/967069487 shutdown_connections 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/967069487 wait complete. 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb67a00 msgr2=0x55ab3fb69df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb67a00 0x55ab3fb69df0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fa6f340 msgr2=0x55ab3fb651d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fa6f340 0x55ab3fb651d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dd4039a70 msgr2=0x7f1dd403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dd4039a70 0x7f1dd403bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00ae000 tx=0x7f1ee00a6000 comp rx=0 tx=0).stop 2024-09-12T16:54:10.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 msgr2=0x55ab3fb5e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb5e060 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x55ab3fb578d0 tx=0x7f1ed8000bd0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 shutdown_connections 2024-09-12T16:54:10.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x55ab3fb67a00 0x55ab3fb69df0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55ab3fa6f340 0x55ab3fb651d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f1dd4039a70 0x7f1dd403bf30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 --2- 172.21.15.151:0/352349396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab3fa6b1f0 0x55ab3fb5e060 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 >> 172.21.15.151:0/352349396 conn(0x55ab3f9deb00 msgr2=0x55ab3fb51010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 shutdown_connections 2024-09-12T16:54:10.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.463+0000 7f1ef12119c0 1 -- 172.21.15.151:0/352349396 wait complete. 2024-09-12T16:54:10.481 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:10.481 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:10.481 ERROR:root:0 2024-09-12T16:54:10.481 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T16:54:10.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T16:54:10.481 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T16:54:10.562 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:54:10.562 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73f8119c0 1 Processor -- start 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73f8119c0 1 -- start start 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73f8119c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x5567240715d0 0x556724105750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73f8119c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556723fb19c0 con 0x5567240711f0 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73f8119c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x5567240016d0 con 0x5567240715d0 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73d317640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x5567240711f0 0x556724102020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.151:56650/0 (socket says 172.21.15.151:56650) 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73d317640 1 -- 172.21.15.151:0/1281867895 learned_addr learned my addr 172.21.15.151:0/1281867895 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73cb16640 1 --2- 172.21.15.151:0/1281867895 >> v2:172.21.15.122:3300/0 conn(0x5567240715d0 0x556724105750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd72ffff640 1 -- 172.21.15.151:0/1281867895 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937366352 0 0) 0x556723fb19c0 con 0x5567240711f0 2024-09-12T16:54:10.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd72ffff640 1 -- 172.21.15.151:0/1281867895 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd728001e20 con 0x5567240711f0 2024-09-12T16:54:10.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73cb16640 1 -- 172.21.15.151:0/1281867895 >> v1:172.21.15.122:6789/0 conn(0x5567240711f0 legacy=0x556724102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.559+0000 7fd73cb16640 1 -- 172.21.15.151:0/1281867895 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556723fa5ca0 con 0x5567240715d0 2024-09-12T16:54:10.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd73cb16640 1 --2- 172.21.15.151:0/1281867895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240715d0 0x556724105750 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd73400a480 tx=0x7fd73401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b8d72e658e5e59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd72ffff640 1 -- 172.21.15.151:0/1281867895 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7340b0070 con 0x5567240715d0 2024-09-12T16:54:10.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd72ffff640 1 -- 172.21.15.151:0/1281867895 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7340ab540 con 0x5567240715d0 2024-09-12T16:54:10.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd72ffff640 1 -- 172.21.15.151:0/1281867895 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7340ab840 con 0x5567240715d0 2024-09-12T16:54:10.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd73f8119c0 1 -- 172.21.15.151:0/1281867895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240715d0 msgr2=0x556724105750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/1281867895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240715d0 0x556724105750 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd73400a480 tx=0x7fd73401b280 comp rx=0 tx=0).stop 2024-09-12T16:54:10.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd73f8119c0 1 -- 172.21.15.151:0/1281867895 shutdown_connections 2024-09-12T16:54:10.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/1281867895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240715d0 0x556724105750 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd73f8119c0 1 -- 172.21.15.151:0/1281867895 >> 172.21.15.151:0/1281867895 conn(0x5567240f7910 msgr2=0x5567240f9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd73f8119c0 1 -- 172.21.15.151:0/1281867895 shutdown_connections 2024-09-12T16:54:10.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.563+0000 7fd73f8119c0 1 -- 172.21.15.151:0/1281867895 wait complete. 2024-09-12T16:54:10.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73f8119c0 1 Processor -- start 2024-09-12T16:54:10.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73f8119c0 1 -- start start 2024-09-12T16:54:10.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73f8119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73f8119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556724005680 con 0x5567240711f0 2024-09-12T16:54:10.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73d317640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73d317640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241ea7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34100/0 (socket says 172.21.15.151:34100) 2024-09-12T16:54:10.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73d317640 1 -- 172.21.15.151:0/4273653177 learned_addr learned my addr 172.21.15.151:0/4273653177 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73d317640 1 -- 172.21.15.151:0/4273653177 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556723f80da0 con 0x5567240711f0 2024-09-12T16:54:10.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd73d317640 1 --2- 172.21.15.151:0/4273653177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241ea7a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd730001e40 tx=0x7fd73000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9aef5ea348e78f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd62b606640 1 -- 172.21.15.151:0/4273653177 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730012020 con 0x5567240711f0 2024-09-12T16:54:10.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd62b606640 1 -- 172.21.15.151:0/4273653177 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73000e690 con 0x5567240711f0 2024-09-12T16:54:10.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.579+0000 7fd62b606640 1 -- 172.21.15.151:0/4273653177 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73000e9b0 con 0x5567240711f0 2024-09-12T16:54:10.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- 172.21.15.151:0/4273653177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 msgr2=0x5567241ea7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/4273653177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241ea7a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd730001e40 tx=0x7fd73000b790 comp rx=0 tx=0).stop 2024-09-12T16:54:10.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- 172.21.15.151:0/4273653177 shutdown_connections 2024-09-12T16:54:10.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/4273653177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241ea7a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- 172.21.15.151:0/4273653177 >> 172.21.15.151:0/4273653177 conn(0x5567240f7910 msgr2=0x5567241e63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- 172.21.15.151:0/4273653177 shutdown_connections 2024-09-12T16:54:10.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- 172.21.15.151:0/4273653177 wait complete. 2024-09-12T16:54:10.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 Processor -- start 2024-09-12T16:54:10.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- start start 2024-09-12T16:54:10.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556723fa7a50 con 0x5567240711f0 2024-09-12T16:54:10.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73d317640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73d317640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34112/0 (socket says 172.21.15.151:34112) 2024-09-12T16:54:10.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73d317640 1 -- 172.21.15.151:0/3055509603 learned_addr learned my addr 172.21.15.151:0/3055509603 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73d317640 1 -- 172.21.15.151:0/3055509603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567241f23d0 con 0x5567240711f0 2024-09-12T16:54:10.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73d317640 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241f1e70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x5567241eb730 tx=0x7fd7300040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd629e03640 1 -- 172.21.15.151:0/3055509603 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730012030 con 0x5567240711f0 2024-09-12T16:54:10.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567241f2660 con 0x5567240711f0 2024-09-12T16:54:10.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd629e03640 1 -- 172.21.15.151:0/3055509603 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73001a720 con 0x5567240711f0 2024-09-12T16:54:10.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd629e03640 1 -- 172.21.15.151:0/3055509603 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73001aa60 con 0x5567240711f0 2024-09-12T16:54:10.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567241f3010 con 0x5567240711f0 2024-09-12T16:54:10.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd629e03640 1 -- 172.21.15.151:0/3055509603 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd730015020 con 0x5567240711f0 2024-09-12T16:54:10.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.583+0000 7fd629e03640 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd624039a70 0x7fd62403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd629e03640 1 -- 172.21.15.151:0/3055509603 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd730020070 con 0x5567240711f0 2024-09-12T16:54:10.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73cb16640 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd624039a70 0x7fd62403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5567240715d0 0x5567241f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567241f9520 con 0x5567240715d0 2024-09-12T16:54:10.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73db18640 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5567240715d0 0x5567241f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73cb16640 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd624039a70 0x7fd62403bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ad000 tx=0x7fd7340a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73db18640 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5567240715d0 0x5567241f8fe0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73db18640 1 -- 172.21.15.151:0/3055509603 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd73800a4d0 con 0x5567240715d0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567241f3350 con 0x5567240715d0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73db18640 1 -- 172.21.15.151:0/3055509603 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd73800a4d0 con 0x5567240715d0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5567241fb790 0x5567241fdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567241fe270 con 0x5567241fb790 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73d317640 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5567241fb790 0x5567241fdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73d317640 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5567241fb790 0x5567241fdb80 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73d317640 1 -- 172.21.15.151:0/3055509603 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd730008030 con 0x5567241fb790 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.587+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567241fa600 con 0x5567240715d0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73db18640 1 -- 172.21.15.151:0/3055509603 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd73800a4d0 con 0x5567240715d0 2024-09-12T16:54:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567241faaa0 con 0x5567240715d0 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73db18640 1 -- 172.21.15.151:0/3055509603 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd73800a4d0 con 0x5567240715d0 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73f8119c0 1 Processor -- start 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73f8119c0 1 -- start start 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73f8119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672420c8d0 0x55672420ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73f8119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556724012450 con 0x55672420c8d0 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73db18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672420c8d0 0x55672420ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73db18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672420c8d0 0x55672420ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34128/0 (socket says 172.21.15.151:34128) 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73db18640 1 -- 172.21.15.151:0/2147463232 learned_addr learned my addr 172.21.15.151:0/2147463232 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73db18640 1 -- 172.21.15.151:0/2147463232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672420d330 con 0x55672420c8d0 2024-09-12T16:54:10.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73db18640 1 --2- 172.21.15.151:0/2147463232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672420c8d0 0x55672420ccf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x5567241f3200 tx=0x7fd738018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd622ffd640 1 -- 172.21.15.151:0/2147463232 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738014450 con 0x55672420c8d0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd622ffd640 1 -- 172.21.15.151:0/2147463232 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd738014610 con 0x55672420c8d0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73f8119c0 1 -- 172.21.15.151:0/2147463232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55672420db90 con 0x55672420c8d0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd622ffd640 1 -- 172.21.15.151:0/2147463232 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738014930 con 0x55672420c8d0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd73f8119c0 1 -- 172.21.15.151:0/2147463232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55672420e100 con 0x55672420c8d0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.591+0000 7fd622ffd640 1 -- 172.21.15.151:0/2147463232 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd738011040 con 0x55672420c8d0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd622ffd640 1 --2- 172.21.15.151:0/2147463232 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd614039a70 0x7fd61403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd622ffd640 1 -- 172.21.15.151:0/2147463232 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd73801e070 con 0x55672420c8d0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73d317640 1 --2- 172.21.15.151:0/2147463232 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd614039a70 0x7fd61403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 Processor -- start 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- start start 2024-09-12T16:54:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73d317640 1 --2- 172.21.15.151:0/2147463232 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd614039a70 0x7fd61403bf30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd730022750 tx=0x7fd73000df00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x55672421a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5567241eaff0 con 0x55672421a1e0 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73db18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x55672421a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73db18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x55672421a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34138/0 (socket says 172.21.15.151:34138) 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73db18640 1 -- 172.21.15.151:0/3734201071 learned_addr learned my addr 172.21.15.151:0/3734201071 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73db18640 1 -- 172.21.15.151:0/3734201071 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672421abd0 con 0x55672421a1e0 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73db18640 1 --2- 172.21.15.151:0/3734201071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x55672421a5e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fd73802bfb0 tx=0x7fd738011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0a48a2dc262243 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd620ff9640 1 -- 172.21.15.151:0/3734201071 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738011d50 con 0x55672421a1e0 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd620ff9640 1 -- 172.21.15.151:0/3734201071 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7380167c0 con 0x55672421a1e0 2024-09-12T16:54:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd620ff9640 1 -- 172.21.15.151:0/3734201071 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738011330 con 0x55672421a1e0 2024-09-12T16:54:10.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3734201071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 msgr2=0x55672421a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3734201071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x55672421a5e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fd73802bfb0 tx=0x7fd738011a80 comp rx=0 tx=0).stop 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3734201071 shutdown_connections 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3734201071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x55672421a5e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3734201071 >> 172.21.15.151:0/3734201071 conn(0x556724215600 msgr2=0x556724213840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3734201071 shutdown_connections 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3734201071 wait complete. 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 Processor -- start 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- start start 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x5567242206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73f8119c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556724219130 con 0x55672421a1e0 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73db18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x5567242206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73db18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x5567242206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:34148/0 (socket says 172.21.15.151:34148) 2024-09-12T16:54:10.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.595+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 learned_addr learned my addr 172.21.15.151:0/3162597235 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556724220c00 con 0x55672421a1e0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73db18640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x5567242206a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd738018430 tx=0x7fd738050550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd612ffd640 1 -- 172.21.15.151:0/3162597235 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738031070 con 0x55672421a1e0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556724220e90 con 0x55672421a1e0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd612ffd640 1 -- 172.21.15.151:0/3162597235 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd738011480 con 0x55672421a1e0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd612ffd640 1 -- 172.21.15.151:0/3162597235 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738048040 con 0x55672421a1e0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556724221840 con 0x55672421a1e0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd612ffd640 1 -- 172.21.15.151:0/3162597235 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd738034070 con 0x55672421a1e0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd612ffd640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd608039a70 0x7fd60803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd612ffd640 1 -- 172.21.15.151:0/3162597235 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd73800e040 con 0x55672421a1e0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73d317640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd608039a70 0x7fd60803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55672422bbe0 0x55672422e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672422e7c0 con 0x55672422bbe0 2024-09-12T16:54:10.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73cb16640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55672422bbe0 0x55672422e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73d317640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd608039a70 0x7fd60803bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5567241fe670 tx=0x7fd730045000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73cb16640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55672422bbe0 0x55672422e070 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 20 realm 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.599+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672422eb90 con 0x55672422bbe0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672422f460 con 0x55672422bbe0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672422f800 con 0x55672422bbe0 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556724230560 0x556724232950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556724232f10 con 0x556724230560 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73db18640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556724230560 0x556724232950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73db18640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556724230560 0x556724232950 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 20 searching for the correct realm 2024-09-12T16:54:10.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556724234e60 0x556724237290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73d317640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556724234e60 0x556724237290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73d317640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556724234e60 0x556724237290 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73d317640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd730017050 0x7fd730050050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:54:10.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x7fd730017050 2024-09-12T16:54:10.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.603+0000 7fd73cb16640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd730017050 0x7fd730050050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:54:10.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd730017050 0x7fd730050050 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x55672422bbe0 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x55672422bbe0 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x7fd730017050 2024-09-12T16:54:10.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.607+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x55672422bbe0 2024-09-12T16:54:10.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x55672422bbe0 2024-09-12T16:54:10.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x7fd730017050 2024-09-12T16:54:10.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x55672422bbe0 2024-09-12T16:54:10.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x55672422bbe0 2024-09-12T16:54:10.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.611+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x7fd730017050 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x55672422bbe0 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x7fd730017050 2024-09-12T16:54:10.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.615+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724234e60 2024-09-12T16:54:10.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x556724230560 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x55672422bbe0 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556724237910 con 0x7fd730017050 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:54:10.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567242338d0 con 0x55672422bbe0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556724234170 con 0x55672422bbe0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556724233510 con 0x55672422bbe0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 zone default found 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 4 Realm: () 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 zonegroup default 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556724234170 con 0x556724230560 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556724239c80 con 0x556724234e60 2024-09-12T16:54:10.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.619+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55672423a070 con 0x556724234e60 2024-09-12T16:54:10.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73f8119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:54:10.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73f8119c0 20 started sync module instance, tier type = 2024-09-12T16:54:10.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73f8119c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:54:10.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556724239110 con 0x7fd730017050 2024-09-12T16:54:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93901476304400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556724239110 con 0x7fd730017050 2024-09-12T16:54:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423ab90 con 0x55672422bbe0 2024-09-12T16:54:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93901476304400] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93901476308592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556724239110 con 0x55672422bbe0 2024-09-12T16:54:10.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.623+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423b5a0 con 0x556724234e60 2024-09-12T16:54:10.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.627+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93901476308592] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.627+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.627+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93901476301920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556724239080 con 0x556724234e60 2024-09-12T16:54:10.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.627+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423c2e0 con 0x7fd730017050 2024-09-12T16:54:10.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93901476314608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423cb80 con 0x7fd730017050 2024-09-12T16:54:10.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423d540 con 0x55672422bbe0 2024-09-12T16:54:10.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93901476301920] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93901476314608] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93901476319376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423cae0 con 0x55672422bbe0 2024-09-12T16:54:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423d4b0 con 0x556724230560 2024-09-12T16:54:10.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.631+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93901476319376] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.635+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.635+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93901476316992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423de10 con 0x556724230560 2024-09-12T16:54:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.635+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423e660 con 0x556724230560 2024-09-12T16:54:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.635+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93901476316992] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.635+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.635+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93901476322912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423e730 con 0x556724230560 2024-09-12T16:54:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.635+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423e730 con 0x556724230560 2024-09-12T16:54:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93901476322912] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93901476324240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423f0f0 con 0x556724230560 2024-09-12T16:54:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 20 add_watcher() i=0 2024-09-12T16:54:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 20 add_watcher() i=1 2024-09-12T16:54:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 20 add_watcher() i=2 2024-09-12T16:54:10.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 20 add_watcher() i=3 2024-09-12T16:54:10.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 20 add_watcher() i=4 2024-09-12T16:54:10.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 20 add_watcher() i=5 2024-09-12T16:54:10.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 20 add_watcher() i=6 2024-09-12T16:54:10.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93901476324240] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 20 add_watcher() i=7 2024-09-12T16:54:10.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:54:10.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.639+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556724242520 con 0x55672422bbe0 2024-09-12T16:54:10.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93901476326928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672423f9e0 con 0x55672422bbe0 2024-09-12T16:54:10.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93901476326928] v34'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd5f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:10.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:54:10.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:54:10.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 5 note: GC not initialized 2024-09-12T16:54:10.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd5f27e4640 20 reqs_thread_entry: start 2024-09-12T16:54:10.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 20 init_complete bucket index max shards: 11 2024-09-12T16:54:10.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 20 Filter name: none 2024-09-12T16:54:10.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd563fff640 20 reqs_thread_entry: start 2024-09-12T16:54:10.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T16:54:10.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 20 rados->read ofs=0 len=0 2024-09-12T16:54:10.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567242656e0 con 0x556724230560 2024-09-12T16:54:10.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-12T16:54:10.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T16:54:10.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.643+0000 7fd73f8119c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73f8119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:54:10.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672426bf20 con 0x556724230560 2024-09-12T16:54:10.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73f8119c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:10.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73f8119c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73f8119c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T16:54:10.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93901476510160 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556724267670 con 0x55672422bbe0 2024-09-12T16:54:10.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== watch-notify(notify (1) cookie 93901476319376 notify 146028888121 ret 0) ==== 691+0+0 (crc 0 0 0) 0x556723fa5ca0 con 0x55672422bbe0 2024-09-12T16:54:10.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd620ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888121 cookie 93901476319376 notifier 4921 bl.length()=649 2024-09-12T16:54:10.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd620ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T16:54:10.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd620ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T16:54:10.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(64 notify.4 [notify cookie 93901476510160 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd620ff9640 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd600003eb0 con 0x55672422bbe0 2024-09-12T16:54:10.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.647+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== watch-notify(notify_complete (2) cookie 93901476510160 notify 146028888121 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd7340d9d30 con 0x55672422bbe0 2024-09-12T16:54:10.655 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T16:54:07.916256Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T16:54:07.916241Z","tags":[],"group_ids":[]} 2024-09-12T16:54:10.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.651+0000 7fd5f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:54:10.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.651+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93901476326928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672426b2b0 con 0x55672422bbe0 2024-09-12T16:54:10.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.651+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93901476326928] v34'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.651+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93901476304400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672426b2b0 con 0x7fd730017050 2024-09-12T16:54:10.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.651+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93901476304400] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.651+0000 7fd73f8119c0 20 remove_watcher() i=0 2024-09-12T16:54:10.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.651+0000 7fd73f8119c0 2 removed watcher, disabling cache 2024-09-12T16:54:10.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.651+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93901476308592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672426b2b0 con 0x55672422bbe0 2024-09-12T16:54:10.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.655+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93901476308592] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.655+0000 7fd73f8119c0 20 remove_watcher() i=1 2024-09-12T16:54:10.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.655+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93901476301920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55672426b2b0 con 0x556724234e60 2024-09-12T16:54:10.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.655+0000 7fd73d317640 1 -- 172.21.15.151:0/3162597235 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93901476301920] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd730008030 con 0x556724234e60 2024-09-12T16:54:10.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.655+0000 7fd73f8119c0 20 remove_watcher() i=2 2024-09-12T16:54:10.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.655+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93901476314608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567242634c0 con 0x7fd730017050 2024-09-12T16:54:10.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.659+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93901476314608] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x7fd730017050 2024-09-12T16:54:10.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.659+0000 7fd73f8119c0 20 remove_watcher() i=3 2024-09-12T16:54:10.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.659+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93901476319376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567242634c0 con 0x55672422bbe0 2024-09-12T16:54:10.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.659+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93901476319376] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340b3040 con 0x55672422bbe0 2024-09-12T16:54:10.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.659+0000 7fd73f8119c0 20 remove_watcher() i=4 2024-09-12T16:54:10.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.659+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93901476316992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567242634c0 con 0x556724230560 2024-09-12T16:54:10.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.663+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93901476316992] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.663+0000 7fd73f8119c0 20 remove_watcher() i=5 2024-09-12T16:54:10.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.663+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93901476322912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567242634c0 con 0x556724230560 2024-09-12T16:54:10.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.663+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93901476322912] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.663+0000 7fd73f8119c0 20 remove_watcher() i=6 2024-09-12T16:54:10.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.663+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93901476324240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567242634c0 con 0x556724230560 2024-09-12T16:54:10.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73db18640 1 -- 172.21.15.151:0/3162597235 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93901476324240] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd73803d070 con 0x556724230560 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 20 remove_watcher() i=7 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556724230560 msgr2=0x556724232950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x556724230560 0x556724232950 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55672422bbe0 msgr2=0x55672422e070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x55672422bbe0 0x55672422e070 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd730017050 msgr2=0x7fd730050050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fd730017050 0x7fd730050050 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556724234e60 msgr2=0x556724237290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x556724234e60 0x556724237290 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd608039a70 msgr2=0x7fd60803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd608039a70 0x7fd60803bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5567241fe670 tx=0x7fd730045000 comp rx=0 tx=0).stop 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 msgr2=0x5567242206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3162597235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672421a1e0 0x5567242206a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd738018430 tx=0x7fd738050550 comp rx=0 tx=0).stop 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73cb16640 1 -- 172.21.15.151:0/3162597235 reap_dead start 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 shutdown_connections 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 >> 172.21.15.151:0/3162597235 conn(0x556724215600 msgr2=0x556724213810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 shutdown_connections 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3162597235 wait complete. 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/2147463232 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd614039a70 msgr2=0x7fd61403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/2147463232 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd614039a70 0x7fd61403bf30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd730022750 tx=0x7fd73000df00 comp rx=0 tx=0).stop 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/2147463232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672420c8d0 msgr2=0x55672420ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/2147463232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672420c8d0 0x55672420ccf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x5567241f3200 tx=0x7fd738018830 comp rx=0 tx=0).stop 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/2147463232 shutdown_connections 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/2147463232 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd614039a70 0x7fd61403bf30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/2147463232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55672420c8d0 0x55672420ccf0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/2147463232 >> 172.21.15.151:0/2147463232 conn(0x556724202280 msgr2=0x556724202660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/2147463232 shutdown_connections 2024-09-12T16:54:10.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/2147463232 wait complete. 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5567241fb790 msgr2=0x5567241fdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5567241fb790 0x5567241fdb80 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5567240715d0 msgr2=0x5567241f8fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5567240715d0 0x5567241f8fe0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd624039a70 msgr2=0x7fd62403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd624039a70 0x7fd62403bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ad000 tx=0x7fd7340a5040 comp rx=0 tx=0).stop 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 msgr2=0x5567241f1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241f1e70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x5567241eb730 tx=0x7fd7300040f0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 shutdown_connections 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x5567241fb790 0x5567241fdb80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x5567240715d0 0x5567241f8fe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd624039a70 0x7fd62403bf30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 --2- 172.21.15.151:0/3055509603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5567240711f0 0x5567241f1e70 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:54:10.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 >> 172.21.15.151:0/3055509603 conn(0x5567240f7910 msgr2=0x5567241e4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:54:10.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 shutdown_connections 2024-09-12T16:54:10.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:54:10.667+0000 7fd73f8119c0 1 -- 172.21.15.151:0/3055509603 wait complete. 2024-09-12T16:54:10.684 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:10.684 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T16:54:07.916256Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T16:54:07.916241Z', 'tags': [], 'group_ids': []} 2024-09-12T16:54:10.684 ERROR:root:0 2024-09-12T16:54:10.685 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-12T16:54:10.696 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.696 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.703 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.704 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-12T16:54:10.713 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.713 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.723 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.724 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-12T16:54:10.736 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-12T16:54:10.737 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.764 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.764 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-12T16:54:10.782 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:10.782 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.805 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.806 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-12T16:54:10.845 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-12T16:54:10.845 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.855 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.855 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-12T16:54:10.888 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-12T16:54:10.889 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.904 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.905 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-12T16:54:10.926 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:10.927 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.944 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.945 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-12T16:54:10.962 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:10.963 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.976 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.976 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-12T16:54:10.993 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:10.993 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:54:10.998 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:10.999 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-12T16:54:11.009 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T16:54:11.010 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-12T16:54:11.018 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T16:54:11.047 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-12T16:54:11.056 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-12T16:54:11.056 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T16:54:11.065 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T16:54:11.034344Z', 'creation_time': '2024-09-12T16:54:11.023908Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T16:54:11.066 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-12T16:54:11.078 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T16:54:11.034344Z', 'creation_time': '2024-09-12T16:54:11.023908Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-12T16:54:11.089 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T16:54:11.097 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T16:54:11.034344Z', 'creation_time': '2024-09-12T16:54:11.023908Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T16:54:11.098 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-12T16:54:11.106 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx0000066d11554365bd7fc-0066e31cb3-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:54:11.117 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-12T16:54:11.136 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:11.137 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-12T16:54:11.158 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:54:11.212 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11'} 2024-09-12T16:54:11.234 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:11.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11'} 2024-09-12T16:54:11.272 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:11.273 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-12T16:54:11.296 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:11.314 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-12T16:54:11.328 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:54:11.328 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T16:54:11.337 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2480af9e-559e-4103-b02c-bfde6a0f7fec', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11', 'marker': '1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T16:54:11.257749Z', 'creation_time': '2024-09-12T16:54:11.023908Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-12T16:55:11.458 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-12T16:55:11.492 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:55:11.492 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-12T16:55:11.520 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:55:11.520 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-12T16:55:11.525 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:55:11.526 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-12T16:55:11.531 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:55:11.532 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-12T16:55:11.539 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:55:11.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-12T16:55:11.545 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:55:11.546 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-12T16:55:11.551 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T16:00:00.000000Z', 'epoch': 1726156800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T16:55:11.552 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-12T16:55:11.564 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:55:11.564 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-12T16:55:11.571 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-12T16:55:11.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-12T16:55:11.588 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:55:11.594 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-12T16:55:11.610 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:55:11.988 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-12T16:55:11.995 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000de1aa1f5d497276b-0066e31cef-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.172 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-12T16:55:12.178 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-12T16:55:12.189 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-12T16:55:12.195 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-12T16:55:12.341 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-12T16:55:12.432 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:55:12.433 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-12T16:55:12.442 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-12T16:55:12.442 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-12T16:55:12.452 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T16:55:12.477 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-12T16:55:12.482 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000063577e7bfd05b1fc-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.530 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-12T16:55:12.607 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:55:12.608 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T16:55:12.613 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000008c05200118de1e74-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.613 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-12T16:55:12.617 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '5046056a-17be-43b6-80d1-88da5e3ce49b'}]}} 2024-09-12T16:55:12.617 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-12T16:55:12.640 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T16:55:12.641 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-12T16:55:12.645 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T16:55:12.645 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-12T16:55:12.650 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000a6b309964dab3f89-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.651 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-12T16:55:12.655 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000003730cc016c8078d7-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.681 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-12T16:55:12.687 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T16:55:12.688 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-12T16:55:12.693 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000c37d8da641ca3cfe-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.693 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-12T16:55:12.698 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000f86b099994de23d1-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.698 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-12T16:55:12.704 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T16:55:12.704 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-12T16:55:12.709 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b03abe83007adcd2-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.709 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-12T16:55:12.715 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000599fe7d1bbdadb3b-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.715 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-12T16:55:12.719 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000ae01e8944693b674-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.720 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-12T16:55:12.724 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000009dde36b6d83de35f-0066e31cf0-4229-default', 'HostId': '4229-default-default'} 2024-09-12T16:55:12.724 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-12T16:55:12.744 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:55:12.745 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-12T16:55:12.749 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-12T16:55:12.751 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-12T16:55:12.761 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:55:12.761 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-12T16:55:12.765 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-12T16:55:12.766 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-12T16:55:12.776 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T16:55:12.781 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T16:55:12.796 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T16:55:12.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:55:12.798 INFO:tasks.rgw.client.0.smithi151.stdout:2024-09-12T16:55:12.790+0000 7f5901721640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29395) UID: 0 2024-09-12T16:55:12.798 INFO:tasks.rgw.client.0.smithi151.stdout:2024-09-12T16:55:12.790+0000 7f5904f69a40 -1 shutting down 2024-09-12T16:55:42.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T16:55:43.304 INFO:tasks.rgw.client.0:Stopped 2024-09-12T16:55:43.304 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T16:55:43.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T16:55:43.367 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T16:55:43.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T16:55:43.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T16:55:43.423 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T16:55:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:55:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:55:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686ee689c0 1 Processor -- start 2024-09-12T16:55:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686ee689c0 1 -- start start 2024-09-12T16:55:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686ee689c0 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d885a8200 0x564d885a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686ee689c0 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d8845a9c0 con 0x564d885ab340 2024-09-12T16:55:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686ee689c0 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x564d884aa6d0 con 0x564d885a8200 2024-09-12T16:55:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686c96e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d885a8200 0x564d885a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686c96e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x564d885a8200 0x564d885a85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:59934/0 (socket says 172.21.15.151:59934) 2024-09-12T16:55:43.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686c96e640 1 -- 172.21.15.151:0/3571648005 learned_addr learned my addr 172.21.15.151:0/3571648005 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:55:43.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686c96e640 1 -- 172.21.15.151:0/3571648005 >> v1:172.21.15.122:6789/0 conn(0x564d885ab340 legacy=0x564d885ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.498+0000 7f686c96e640 1 -- 172.21.15.151:0/3571648005 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d8844eca0 con 0x564d885a8200 2024-09-12T16:55:43.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686c96e640 1 --2- 172.21.15.151:0/3571648005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d885a85e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f685c00a4e0 tx=0x7f685c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b865444f231f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686b96c640 1 -- 172.21.15.151:0/3571648005 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f685c0aa540 con 0x564d885a8200 2024-09-12T16:55:43.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686b96c640 1 -- 172.21.15.151:0/3571648005 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c0aa6e0 con 0x564d885a8200 2024-09-12T16:55:43.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686b96c640 1 -- 172.21.15.151:0/3571648005 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f685c0aaa40 con 0x564d885a8200 2024-09-12T16:55:43.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686ee689c0 1 -- 172.21.15.151:0/3571648005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 msgr2=0x564d885a85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3571648005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d885a85e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f685c00a4e0 tx=0x7f685c01b090 comp rx=0 tx=0).stop 2024-09-12T16:55:43.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686ee689c0 1 -- 172.21.15.151:0/3571648005 shutdown_connections 2024-09-12T16:55:43.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3571648005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d885a85e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686ee689c0 1 -- 172.21.15.151:0/3571648005 >> 172.21.15.151:0/3571648005 conn(0x564d8851bb10 msgr2=0x564d8851bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:43.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686ee689c0 1 -- 172.21.15.151:0/3571648005 shutdown_connections 2024-09-12T16:55:43.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.502+0000 7f686ee689c0 1 -- 172.21.15.151:0/3571648005 wait complete. 2024-09-12T16:55:43.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.518+0000 7f686ee689c0 1 Processor -- start 2024-09-12T16:55:43.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.518+0000 7f686ee689c0 1 -- start start 2024-09-12T16:55:43.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.518+0000 7f686ee689c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d88693870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.518+0000 7f686ee689c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d884ae680 con 0x564d885a8200 2024-09-12T16:55:43.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.518+0000 7f686c96e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d88693870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.518+0000 7f686c96e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d88693870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:59940/0 (socket says 172.21.15.151:59940) 2024-09-12T16:55:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.518+0000 7f686c96e640 1 -- 172.21.15.151:0/635731172 learned_addr learned my addr 172.21.15.151:0/635731172 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:55:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686c96e640 1 -- 172.21.15.151:0/635731172 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d88429da0 con 0x564d885a8200 2024-09-12T16:55:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686c96e640 1 --2- 172.21.15.151:0/635731172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d88693870 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f685c017ca0 tx=0x7f685c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b69892b6db55408 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f675ae0d640 1 -- 172.21.15.151:0/635731172 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f685c0b9030 con 0x564d885a8200 2024-09-12T16:55:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f675ae0d640 1 -- 172.21.15.151:0/635731172 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c0aaa80 con 0x564d885a8200 2024-09-12T16:55:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f675ae0d640 1 -- 172.21.15.151:0/635731172 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f685c0aada0 con 0x564d885a8200 2024-09-12T16:55:43.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 -- 172.21.15.151:0/635731172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 msgr2=0x564d88693870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 --2- 172.21.15.151:0/635731172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d88693870 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f685c017ca0 tx=0x7f685c0033b0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 -- 172.21.15.151:0/635731172 shutdown_connections 2024-09-12T16:55:43.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 --2- 172.21.15.151:0/635731172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d88693870 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 -- 172.21.15.151:0/635731172 >> 172.21.15.151:0/635731172 conn(0x564d8851bb10 msgr2=0x564d8868f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:43.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 -- 172.21.15.151:0/635731172 shutdown_connections 2024-09-12T16:55:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 -- 172.21.15.151:0/635731172 wait complete. 2024-09-12T16:55:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 Processor -- start 2024-09-12T16:55:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 -- start start 2024-09-12T16:55:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d8869add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686ee689c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d88450a50 con 0x564d885a8200 2024-09-12T16:55:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686c96e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d8869add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686c96e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d8869add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:59948/0 (socket says 172.21.15.151:59948) 2024-09-12T16:55:43.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686c96e640 1 -- 172.21.15.151:0/3204975177 learned_addr learned my addr 172.21.15.151:0/3204975177 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:55:43.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686c96e640 1 -- 172.21.15.151:0/3204975177 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d8869b330 con 0x564d885a8200 2024-09-12T16:55:43.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f686c96e640 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d8869add0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f685c01b930 tx=0x7f685c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.522+0000 7f675960a640 1 -- 172.21.15.151:0/3204975177 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f685c0b9070 con 0x564d885a8200 2024-09-12T16:55:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f675960a640 1 -- 172.21.15.151:0/3204975177 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c0c3030 con 0x564d885a8200 2024-09-12T16:55:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d8869b5c0 con 0x564d885a8200 2024-09-12T16:55:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f675960a640 1 -- 172.21.15.151:0/3204975177 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f685c0b5c40 con 0x564d885a8200 2024-09-12T16:55:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d8869bf20 con 0x564d885a8200 2024-09-12T16:55:43.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f675960a640 1 -- 172.21.15.151:0/3204975177 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f685c0b3040 con 0x564d885a8200 2024-09-12T16:55:43.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f675960a640 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6754039a70 0x7f675403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f675960a640 1 -- 172.21.15.151:0/3204975177 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f685c0ba070 con 0x564d885a8200 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686c16d640 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6754039a70 0x7f675403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d885ab340 0x564d886a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886a2430 con 0x564d885ab340 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686d16f640 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d885ab340 0x564d886a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686c16d640 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6754039a70 0x7f675403bf30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6854001ec0 tx=0x7f6854001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686d16f640 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d885ab340 0x564d886a1ef0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686d16f640 1 -- 172.21.15.151:0/3204975177 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68640083f0 con 0x564d885ab340 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d8869c280 con 0x564d885ab340 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686d16f640 1 -- 172.21.15.151:0/3204975177 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68640083f0 con 0x564d885ab340 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886a46d0 0x564d886a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:3 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886a7200 con 0x564d886a46d0 2024-09-12T16:55:43.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.526+0000 7f686c96e640 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886a46d0 0x564d886a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686c96e640 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886a46d0 0x564d886a6ac0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686c96e640 1 -- 172.21.15.151:0/3204975177 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(3 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886a46d0 2024-09-12T16:55:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886a3510 con 0x564d885ab340 2024-09-12T16:55:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686d16f640 1 -- 172.21.15.151:0/3204975177 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68640083f0 con 0x564d885ab340 2024-09-12T16:55:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:5 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886a3940 con 0x564d885ab340 2024-09-12T16:55:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686d16f640 1 -- 172.21.15.151:0/3204975177 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(5 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68640083f0 con 0x564d885ab340 2024-09-12T16:55:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686ee689c0 1 Processor -- start 2024-09-12T16:55:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686ee689c0 1 -- start start 2024-09-12T16:55:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686ee689c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886b5830 0x564d886b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686ee689c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d884bb450 con 0x564d886b5830 2024-09-12T16:55:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686d16f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886b5830 0x564d886b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686d16f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886b5830 0x564d886b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:59958/0 (socket says 172.21.15.151:59958) 2024-09-12T16:55:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686d16f640 1 -- 172.21.15.151:0/4198183195 learned_addr learned my addr 172.21.15.151:0/4198183195 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:55:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.530+0000 7f686d16f640 1 -- 172.21.15.151:0/4198183195 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d886b6290 con 0x564d886b5830 2024-09-12T16:55:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686d16f640 1 --2- 172.21.15.151:0/4198183195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886b5830 0x564d886b5c50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x564d8869bdb0 tx=0x7f686400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f67527fc640 1 -- 172.21.15.151:0/4198183195 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6864007d70 con 0x564d886b5830 2024-09-12T16:55:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f67527fc640 1 -- 172.21.15.151:0/4198183195 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686401e020 con 0x564d886b5830 2024-09-12T16:55:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f67527fc640 1 -- 172.21.15.151:0/4198183195 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6864019590 con 0x564d886b5830 2024-09-12T16:55:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686ee689c0 1 -- 172.21.15.151:0/4198183195 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d886b6af0 con 0x564d886b5830 2024-09-12T16:55:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686ee689c0 1 -- 172.21.15.151:0/4198183195 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d886b7060 con 0x564d886b5830 2024-09-12T16:55:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f67527fc640 1 -- 172.21.15.151:0/4198183195 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6864016040 con 0x564d886b5830 2024-09-12T16:55:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f67527fc640 1 --2- 172.21.15.151:0/4198183195 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039ac0 0x7f674403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f67527fc640 1 -- 172.21.15.151:0/4198183195 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f686401f030 con 0x564d886b5830 2024-09-12T16:55:43.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686c96e640 1 --2- 172.21.15.151:0/4198183195 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039ac0 0x7f674403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686ee689c0 1 Processor -- start 2024-09-12T16:55:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686ee689c0 1 -- start start 2024-09-12T16:55:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686c96e640 1 --2- 172.21.15.151:0/4198183195 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039ac0 0x7f674403bf80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f685c01b0d0 tx=0x7f685c0b5ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686ee689c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686ee689c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d88694000 con 0x564d886c3150 2024-09-12T16:55:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686d16f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686d16f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:59970/0 (socket says 172.21.15.151:59970) 2024-09-12T16:55:43.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.534+0000 7f686d16f640 1 -- 172.21.15.151:0/2903488954 learned_addr learned my addr 172.21.15.151:0/2903488954 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:55:43.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686d16f640 1 -- 172.21.15.151:0/2903488954 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d886c3b40 con 0x564d886c3150 2024-09-12T16:55:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686d16f640 1 --2- 172.21.15.151:0/2903488954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c3550 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f68640505d0 tx=0x7f6864016f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16871e3b27878876 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f6743fff640 1 -- 172.21.15.151:0/2903488954 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f686401d070 con 0x564d886c3150 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f6743fff640 1 -- 172.21.15.151:0/2903488954 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6864049de0 con 0x564d886c3150 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f6743fff640 1 -- 172.21.15.151:0/2903488954 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6864043390 con 0x564d886c3150 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- 172.21.15.151:0/2903488954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 msgr2=0x564d886c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2903488954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c3550 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f68640505d0 tx=0x7f6864016f70 comp rx=0 tx=0).stop 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- 172.21.15.151:0/2903488954 shutdown_connections 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2903488954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c3550 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- 172.21.15.151:0/2903488954 >> 172.21.15.151:0/2903488954 conn(0x564d886be570 msgr2=0x564d886bc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- 172.21.15.151:0/2903488954 shutdown_connections 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- 172.21.15.151:0/2903488954 wait complete. 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 Processor -- start 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- start start 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564d886c20a0 con 0x564d886c3150 2024-09-12T16:55:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686d16f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686d16f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.151:59972/0 (socket says 172.21.15.151:59972) 2024-09-12T16:55:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 learned_addr learned my addr 172.21.15.151:0/2144080969 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-12T16:55:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d886c9bc0 con 0x564d886c3150 2024-09-12T16:55:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686d16f640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c9660 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6864014d90 tx=0x7f6864050530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f67427fc640 1 -- 172.21.15.151:0/2144080969 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6864030070 con 0x564d886c3150 2024-09-12T16:55:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d886c9e50 con 0x564d886c3150 2024-09-12T16:55:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d886ca800 con 0x564d886c3150 2024-09-12T16:55:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f67427fc640 1 -- 172.21.15.151:0/2144080969 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6864019b60 con 0x564d886c3150 2024-09-12T16:55:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.538+0000 7f67427fc640 1 -- 172.21.15.151:0/2144080969 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68640174e0 con 0x564d886c3150 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f67427fc640 1 -- 172.21.15.151:0/2144080969 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6864033070 con 0x564d886c3150 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f67427fc640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6738039a70 0x7f673803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f67427fc640 1 -- 172.21.15.151:0/2144080969 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6864036d70 con 0x564d886c3150 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686c96e640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6738039a70 0x7f673803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d886d4780 0x564d886d6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886d7360 con 0x564d886d4780 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686c16d640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d886d4780 0x564d886d6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686c96e640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6738039a70 0x7f673803bf30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f685c0b5690 tx=0x7f685c0d2000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686c16d640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d886d4780 0x564d886d6c10 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f685400d040 con 0x564d886d4780 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 realm 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886d3b90 con 0x564d886d4780 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f685400d040 con 0x564d886d4780 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886d7e60 con 0x564d886d4780 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f685400d040 con 0x564d886d4780 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886d8730 con 0x564d886d4780 2024-09-12T16:55:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f685400d040 con 0x564d886d4780 2024-09-12T16:55:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:55:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886d9150 0x564d886db540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.542+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:5 5.3 5:c76ff746:::zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886dbcb0 con 0x564d886d9150 2024-09-12T16:55:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686d16f640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886d9150 0x564d886db540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686d16f640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886d9150 0x564d886db540 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== osd_op_reply(5 zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686ee689c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686ee689c0 20 searching for the correct realm 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d886ddc00 0x564d886e0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c96e640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d886ddc00 0x564d886e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c96e640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d886ddc00 0x564d886e0030 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c96e640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f685c0e21d0 0x7f685c0e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x7f685c0e21d0 2024-09-12T16:55:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c16d640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f685c0e21d0 0x7f685c0e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:43.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c16d640 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f685c0e21d0 0x7f685c0e9a30 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:43.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685400d040 con 0x7f685c0e21d0 2024-09-12T16:55:43.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.546+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d4780 2024-09-12T16:55:43.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685400d040 con 0x564d886d4780 2024-09-12T16:55:43.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d4780 2024-09-12T16:55:43.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 4 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x7f685c0e21d0 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d4780 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 5 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d4780 2024-09-12T16:55:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x7f685c0e21d0 2024-09-12T16:55:43.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.550+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d4780 2024-09-12T16:55:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d4780 2024-09-12T16:55:43.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.554+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x7f685c0e21d0 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d4780 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=140b] v34'5 uv5 ondisk = 1) ==== 144+0+140 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 9 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x7f685c0e21d0 2024-09-12T16:55:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886ddc00 2024-09-12T16:55:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d9150 2024-09-12T16:55:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 10 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x564d886d4780 2024-09-12T16:55:43.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=178b] v34'4 uv4 ondisk = 1) ==== 144+0+178 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.558+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d886e06b0 con 0x7f685c0e21d0 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 RGWRados::pool_iterate: got period_config.default 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 RGWRados::pool_iterate: got zone_info.1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 RGWRados::pool_iterate: got zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:55:43.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886dc670 con 0x564d886d4780 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886dc280 con 0x564d886d4780 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:40 5.f 5:f3121321:::zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886dcf60 con 0x564d886d4780 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 15 ==== osd_op_reply(40 zonegroup_info.2480af9e-559e-4103-b02c-bfde6a0f7fec [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 zone default found 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 4 Realm: () 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 4 ZoneGroup: default (2480af9e-559e-4103-b02c-bfde6a0f7fec) 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 4 Zone: default (1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87) 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 zonegroup default 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886dcf60 con 0x564d886d9150 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 11 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv5 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886e2a20 con 0x564d886ddc00 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados->read ofs=0 len=0 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886e2ed0 con 0x564d886ddc00 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 started sync module instance, tier type = 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 20 started zone id=1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87 (name=default) with tier type = 2024-09-12T16:55:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.562+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e1eb0 con 0x7f685c0e21d0 2024-09-12T16:55:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.566+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 7 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.566+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94891001390000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e1eb0 con 0x7f685c0e21d0 2024-09-12T16:55:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.566+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e3a00 con 0x564d886d4780 2024-09-12T16:55:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.566+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94891001390000] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.566+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 16 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.566+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94891001394384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e1eb0 con 0x564d886d4780 2024-09-12T16:55:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.566+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e4410 con 0x564d886ddc00 2024-09-12T16:55:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.570+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94891001394384] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.570+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 12 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.570+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94891001387520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e1e20 con 0x564d886ddc00 2024-09-12T16:55:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.570+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e5160 con 0x7f685c0e21d0 2024-09-12T16:55:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.570+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 9 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.570+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94891001400768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e5a00 con 0x7f685c0e21d0 2024-09-12T16:55:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.570+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e63c0 con 0x564d886d4780 2024-09-12T16:55:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.570+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94891001387520] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.574+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94891001400768] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.574+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 18 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.574+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94891001402528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e5f10 con 0x564d886d4780 2024-09-12T16:55:43.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.574+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e6760 con 0x564d886d9150 2024-09-12T16:55:43.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.574+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94891001402528] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.574+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 12 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f686403c070 con 0x564d886d9150 2024-09-12T16:55:43.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.574+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94891001405200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e59f0 con 0x564d886d9150 2024-09-12T16:55:43.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.574+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e7060 con 0x564d886d9150 2024-09-12T16:55:43.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.578+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94891001405200] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.578+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 14 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.578+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94891001408336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e7250 con 0x564d886d9150 2024-09-12T16:55:43.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.578+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e7d70 con 0x564d886d9150 2024-09-12T16:55:43.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94891001408336] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 16 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94891001411648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e7d30 con 0x564d886d9150 2024-09-12T16:55:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 20 add_watcher() i=0 2024-09-12T16:55:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 20 add_watcher() i=1 2024-09-12T16:55:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 20 add_watcher() i=2 2024-09-12T16:55:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 20 add_watcher() i=3 2024-09-12T16:55:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 20 add_watcher() i=4 2024-09-12T16:55:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 20 add_watcher() i=5 2024-09-12T16:55:43.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 20 add_watcher() i=6 2024-09-12T16:55:43.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94891001411648] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 20 add_watcher() i=7 2024-09-12T16:55:43.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:55:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886eb1f0 con 0x564d886d4780 2024-09-12T16:55:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.582+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94891001406256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e8710 con 0x564d886d4780 2024-09-12T16:55:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.586+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94891001406256] v34'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.586+0000 7f67237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:55:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.586+0000 7f686ee689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:55:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.586+0000 7f686ee689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:55:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.586+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f38e0 con 0x564d886d4780 2024-09-12T16:55:43.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.590+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.590+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f3f10 con 0x564d886d9150 2024-09-12T16:55:43.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.590+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.590+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f3ef0 con 0x564d886ddc00 2024-09-12T16:55:43.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.594+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.594+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4950 con 0x564d886d4780 2024-09-12T16:55:43.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.594+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'277 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.594+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f1890 con 0x7f685c0e21d0 2024-09-12T16:55:43.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.598+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.598+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f1890 con 0x564d886ddc00 2024-09-12T16:55:43.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.598+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.598+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f1890 con 0x564d886d4780 2024-09-12T16:55:43.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.602+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'36 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.602+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f19b0 con 0x564d886d9150 2024-09-12T16:55:43.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.602+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.602+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f54c0 con 0x7f685c0e21d0 2024-09-12T16:55:43.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.606+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.606+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f54c0 con 0x564d886ddc00 2024-09-12T16:55:43.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.606+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.606+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f54c0 con 0x7f685c0e21d0 2024-09-12T16:55:43.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.610+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.610+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f54c0 con 0x564d886d9150 2024-09-12T16:55:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.610+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.610+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5380 con 0x7f685c0e21d0 2024-09-12T16:55:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.614+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.614+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5380 con 0x564d886d9150 2024-09-12T16:55:43.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.614+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.614+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5470 con 0x564d886d4780 2024-09-12T16:55:43.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.618+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'278 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.618+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5470 con 0x564d886ddc00 2024-09-12T16:55:43.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.618+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.618+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x7f685c0e21d0 2024-09-12T16:55:43.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.622+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.622+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886ddc00 2024-09-12T16:55:43.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.622+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.622+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886d4780 2024-09-12T16:55:43.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.626+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.626+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886d4780 2024-09-12T16:55:43.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.630+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'279 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.630+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886ddc00 2024-09-12T16:55:43.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.630+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.630+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x7f685c0e21d0 2024-09-12T16:55:43.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.634+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.634+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886ddc00 2024-09-12T16:55:43.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.634+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.634+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886ddc00 2024-09-12T16:55:43.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.638+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.638+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886ddc00 2024-09-12T16:55:43.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.638+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.638+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886ddc00 2024-09-12T16:55:43.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.642+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.642+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886d9150 2024-09-12T16:55:43.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.642+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.642+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886ddc00 2024-09-12T16:55:43.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.646+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.646+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886d9150 2024-09-12T16:55:43.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.646+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.646+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886ddc00 2024-09-12T16:55:43.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.650+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.650+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x564d886d9150 2024-09-12T16:55:43.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.654+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.654+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f5880 con 0x7f685c0e21d0 2024-09-12T16:55:43.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f67227e4640 20 reqs_thread_entry: start 2024-09-12T16:55:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686ee689c0 20 init_complete bucket index max shards: 11 2024-09-12T16:55:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686ee689c0 20 Filter name: none 2024-09-12T16:55:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f671b7fe640 20 reqs_thread_entry: start 2024-09-12T16:55:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T16:55:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:94 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 18 ==== osd_op_reply(94 gc.16 [call] v34'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:95 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 19 ==== osd_op_reply(95 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.658+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:96 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 20 ==== osd_op_reply(96 gc.16 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:97 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 21 ==== osd_op_reply(97 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:98 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 22 ==== osd_op_reply(98 gc.16 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:99 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 23 ==== osd_op_reply(99 gc.16 [call] v34'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T16:55:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:100 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 26 ==== osd_op_reply(100 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.662+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:101 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 27 ==== osd_op_reply(101 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:102 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 28 ==== osd_op_reply(102 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:103 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 29 ==== osd_op_reply(103 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:104 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 30 ==== osd_op_reply(104 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:105 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 31 ==== osd_op_reply(105 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T16:55:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.666+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:106 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 28 ==== osd_op_reply(106 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:107 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 29 ==== osd_op_reply(107 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:108 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 30 ==== osd_op_reply(108 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:109 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 31 ==== osd_op_reply(109 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:110 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 32 ==== osd_op_reply(110 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.670+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:111 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 33 ==== osd_op_reply(111 gc.18 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T16:55:43.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:112 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 34 ==== osd_op_reply(112 gc.19 [call] v34'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:113 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 35 ==== osd_op_reply(113 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:114 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 36 ==== osd_op_reply(114 gc.19 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:115 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 37 ==== osd_op_reply(115 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:116 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.674+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 38 ==== osd_op_reply(116 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:117 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 39 ==== osd_op_reply(117 gc.19 [call] v34'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T16:55:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:118 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 32 ==== osd_op_reply(118 gc.20 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:119 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 33 ==== osd_op_reply(119 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.678+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:120 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 34 ==== osd_op_reply(120 gc.20 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:121 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 35 ==== osd_op_reply(121 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:122 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 36 ==== osd_op_reply(122 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:123 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 37 ==== osd_op_reply(123 gc.20 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T16:55:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.682+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:124 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 24 ==== osd_op_reply(124 gc.21 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:125 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 25 ==== osd_op_reply(125 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:126 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 26 ==== osd_op_reply(126 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:127 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 27 ==== osd_op_reply(127 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:128 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 28 ==== osd_op_reply(128 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:129 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 29 ==== osd_op_reply(129 gc.21 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T16:55:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.686+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:130 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 38 ==== osd_op_reply(130 gc.22 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:131 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 39 ==== osd_op_reply(131 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:132 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 40 ==== osd_op_reply(132 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:133 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 41 ==== osd_op_reply(133 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:134 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 42 ==== osd_op_reply(134 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:135 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 43 ==== osd_op_reply(135 gc.22 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T16:55:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.690+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:136 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 44 ==== osd_op_reply(136 gc.23 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:137 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 45 ==== osd_op_reply(137 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:138 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 46 ==== osd_op_reply(138 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:139 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 47 ==== osd_op_reply(139 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:140 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 48 ==== osd_op_reply(140 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.694+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:141 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 49 ==== osd_op_reply(141 gc.23 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T16:55:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:142 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 50 ==== osd_op_reply(142 gc.24 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:143 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 51 ==== osd_op_reply(143 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:144 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 52 ==== osd_op_reply(144 gc.24 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:145 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 53 ==== osd_op_reply(145 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:146 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 54 ==== osd_op_reply(146 gc.24 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.698+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:147 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 55 ==== osd_op_reply(147 gc.24 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T16:55:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:148 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 56 ==== osd_op_reply(148 gc.25 [call] v34'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:149 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 57 ==== osd_op_reply(149 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:150 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 58 ==== osd_op_reply(150 gc.25 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:151 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 59 ==== osd_op_reply(151 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.702+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:152 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.706+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 60 ==== osd_op_reply(152 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.706+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.706+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:153 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.706+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 61 ==== osd_op_reply(153 gc.25 [call] v34'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.706+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T16:55:43.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.706+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:154 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 25 ==== osd_op_reply(154 gc.26 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:155 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 26 ==== osd_op_reply(155 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:156 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 27 ==== osd_op_reply(156 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:157 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 28 ==== osd_op_reply(157 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:158 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 29 ==== osd_op_reply(158 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.710+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:159 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.714+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 30 ==== osd_op_reply(159 gc.26 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.714+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T16:55:43.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.714+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:160 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.714+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 62 ==== osd_op_reply(160 gc.27 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.714+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:161 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 63 ==== osd_op_reply(161 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:162 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 64 ==== osd_op_reply(162 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:163 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 65 ==== osd_op_reply(163 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:164 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 66 ==== osd_op_reply(164 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:165 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 67 ==== osd_op_reply(165 gc.27 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T16:55:43.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.718+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:166 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 31 ==== osd_op_reply(166 gc.28 [call] v34'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:167 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 32 ==== osd_op_reply(167 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:168 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 33 ==== osd_op_reply(168 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:169 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 34 ==== osd_op_reply(169 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.722+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.726+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:170 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.726+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 35 ==== osd_op_reply(170 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.726+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.726+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:171 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.726+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 36 ==== osd_op_reply(171 gc.28 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.726+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T16:55:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.726+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:172 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 68 ==== osd_op_reply(172 gc.29 [call] v34'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:173 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 69 ==== osd_op_reply(173 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:174 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 70 ==== osd_op_reply(174 gc.29 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:175 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 71 ==== osd_op_reply(175 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:176 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 72 ==== osd_op_reply(176 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.730+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:177 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.734+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 73 ==== osd_op_reply(177 gc.29 [call] v34'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.734+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T16:55:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.734+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:178 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 37 ==== osd_op_reply(178 gc.30 [call] v34'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:179 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 38 ==== osd_op_reply(179 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:180 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 39 ==== osd_op_reply(180 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:181 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 40 ==== osd_op_reply(181 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.738+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:182 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.742+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 41 ==== osd_op_reply(182 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.742+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.742+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:183 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.742+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 42 ==== osd_op_reply(183 gc.30 [call] v34'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.742+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T16:55:43.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.742+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:184 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.746+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 30 ==== osd_op_reply(184 gc.31 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.746+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:185 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.746+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 31 ==== osd_op_reply(185 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.746+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.746+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:186 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.746+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 32 ==== osd_op_reply(186 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.746+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.746+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 33 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.750+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.750+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.750+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 34 ==== osd_op_reply(188 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.750+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.750+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.750+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 35 ==== osd_op_reply(189 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.750+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T16:55:43.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.750+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:190 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 40 ==== osd_op_reply(190 gc.0 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:191 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 41 ==== osd_op_reply(191 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:192 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 42 ==== osd_op_reply(192 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:193 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 43 ==== osd_op_reply(193 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.754+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:194 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.758+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 44 ==== osd_op_reply(194 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.758+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.758+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:195 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.758+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 45 ==== osd_op_reply(195 gc.0 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.758+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T16:55:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.758+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:196 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.762+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 43 ==== osd_op_reply(196 gc.1 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.762+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:197 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.762+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 44 ==== osd_op_reply(197 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.762+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.762+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:198 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.762+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 45 ==== osd_op_reply(198 gc.1 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.762+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:199 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 46 ==== osd_op_reply(199 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:200 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 47 ==== osd_op_reply(200 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:201 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d9150 2024-09-12T16:55:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 48 ==== osd_op_reply(201 gc.1 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T16:55:43.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.766+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:202 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 74 ==== osd_op_reply(202 gc.2 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:203 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 75 ==== osd_op_reply(203 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:204 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 76 ==== osd_op_reply(204 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:205 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 77 ==== osd_op_reply(205 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.770+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:206 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.774+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 78 ==== osd_op_reply(206 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.774+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.774+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:207 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.774+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 79 ==== osd_op_reply(207 gc.2 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.774+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T16:55:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.774+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:208 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 46 ==== osd_op_reply(208 gc.3 [call] v34'282 uv282 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:209 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 47 ==== osd_op_reply(209 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:210 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 48 ==== osd_op_reply(210 gc.3 [call out=24b] v0'0 uv282 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:211 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 49 ==== osd_op_reply(211 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.778+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:212 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.782+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 50 ==== osd_op_reply(212 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.782+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.782+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:213 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.782+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 51 ==== osd_op_reply(213 gc.3 [call] v34'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.782+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T16:55:43.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.782+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:214 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 36 ==== osd_op_reply(214 gc.4 [call] v34'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:215 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 37 ==== osd_op_reply(215 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:216 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 38 ==== osd_op_reply(216 gc.4 [call out=24b] v0'0 uv88 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:217 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 39 ==== osd_op_reply(217 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:218 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 40 ==== osd_op_reply(218 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.786+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:219 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x7f685c0e21d0 2024-09-12T16:55:43.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.790+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 41 ==== osd_op_reply(219 gc.4 [call] v34'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.790+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T16:55:43.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.790+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:220 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.790+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 80 ==== osd_op_reply(220 gc.5 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.790+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:221 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 81 ==== osd_op_reply(221 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:222 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 82 ==== osd_op_reply(222 gc.5 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:223 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 83 ==== osd_op_reply(223 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:224 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 84 ==== osd_op_reply(224 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:225 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886ddc00 2024-09-12T16:55:43.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 85 ==== osd_op_reply(225 gc.5 [call] v34'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T16:55:43.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.794+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:226 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.798+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 52 ==== osd_op_reply(226 gc.6 [call] v34'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.798+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:227 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.798+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 53 ==== osd_op_reply(227 gc.6 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.798+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.798+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:228 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.798+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 54 ==== osd_op_reply(228 gc.6 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.798+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:229 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 55 ==== osd_op_reply(229 gc.6 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:230 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d886f4e50 con 0x564d886d4780 2024-09-12T16:55:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 56 ==== osd_op_reply(230 gc.6 [call out=1716b] v0'0 uv37 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T16:55:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 20 garbage collection: RGWGC::process iterating over entry tag='1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.10227095690317294133', time=2024-09-12T16:55:26.980239+0000, chain.objs.size()=7 2024-09-12T16:55:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_1 2024-09-12T16:55:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:231 3.3as0 3:5fbe8976:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88712400 con 0x7f685c0e21d0 2024-09-12T16:55:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_2 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:232 3.1s0 3:8203dd4f:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88714db0 con 0x564d886d9150 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_3 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:233 3.16s0 3:680c674a:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887176e0 con 0x7f685c0e21d0 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_4 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:234 3.as0 3:51291cdb:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88719f50 con 0x564d886ddc00 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_5 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:235 3.39s0 3:9e6dfb5f:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d8871c7c0 con 0x564d886ddc00 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_6 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:236 3.36s0 3:6da476be:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d8871f030 con 0x7f685c0e21d0 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_7 2024-09-12T16:55:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.802+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:237 3.3as0 3:5fbc41b4:::1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d8871c7c0 con 0x7f685c0e21d0 2024-09-12T16:55:43.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.810+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 86 ==== osd_op_reply(234 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.810+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 42 ==== osd_op_reply(233 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_3 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.810+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 43 ==== osd_op_reply(236 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_6 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.814+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 44 ==== osd_op_reply(231 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_1 [call] v34'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.814+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 49 ==== osd_op_reply(232 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.814+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 87 ==== osd_op_reply(235 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_5 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.818+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 45 ==== osd_op_reply(237 1fe4f7c8-a4bd-48a7-92a8-7d5a10a3df87.4229.11__shadow_.GsfqOS4c701nutx3q_2v-VLsGYgp9Le_7 [call] v34'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.818+0000 7f686ee689c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T16:55:43.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.818+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:238 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88715210 con 0x564d886d4780 2024-09-12T16:55:43.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.822+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 57 ==== osd_op_reply(238 gc.6 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.822+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:239 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88715210 con 0x564d886d4780 2024-09-12T16:55:43.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.822+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 58 ==== osd_op_reply(239 gc.6 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.822+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T16:55:43.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.822+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:240 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886d9150 2024-09-12T16:55:43.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.826+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 50 ==== osd_op_reply(240 gc.7 [call] v34'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.826+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:241 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886d9150 2024-09-12T16:55:43.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.826+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 51 ==== osd_op_reply(241 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.826+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.826+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:242 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887113f0 con 0x564d886d9150 2024-09-12T16:55:43.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.826+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 52 ==== osd_op_reply(242 gc.7 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.826+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:243 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886d9150 2024-09-12T16:55:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.830+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 53 ==== osd_op_reply(243 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.830+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.830+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:244 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886d9150 2024-09-12T16:55:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.830+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 54 ==== osd_op_reply(244 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.830+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.830+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:245 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886d9150 2024-09-12T16:55:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.834+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 55 ==== osd_op_reply(245 gc.7 [call] v34'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.834+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T16:55:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.834+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:246 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x7f685c0e21d0 2024-09-12T16:55:43.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.834+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 46 ==== osd_op_reply(246 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.834+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:247 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x7f685c0e21d0 2024-09-12T16:55:43.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.834+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 47 ==== osd_op_reply(247 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.834+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.834+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:248 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887113f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 48 ==== osd_op_reply(248 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:249 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x7f685c0e21d0 2024-09-12T16:55:43.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 49 ==== osd_op_reply(249 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:250 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x7f685c0e21d0 2024-09-12T16:55:43.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 50 ==== osd_op_reply(250 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:251 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x7f685c0e21d0 2024-09-12T16:55:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 51 ==== osd_op_reply(251 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T16:55:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.838+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:252 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886ddc00 2024-09-12T16:55:43.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.842+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 88 ==== osd_op_reply(252 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.842+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:253 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886ddc00 2024-09-12T16:55:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.842+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 89 ==== osd_op_reply(253 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.842+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.842+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:254 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887113f0 con 0x564d886ddc00 2024-09-12T16:55:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.842+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 90 ==== osd_op_reply(254 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.842+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:255 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886ddc00 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 91 ==== osd_op_reply(255 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:256 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712760 con 0x564d886ddc00 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 92 ==== osd_op_reply(256 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:257 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88712650 con 0x564d886ddc00 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 93 ==== osd_op_reply(257 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T16:55:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.846+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:258 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d88712650 con 0x7f685c0e21d0 2024-09-12T16:55:43.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.850+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 52 ==== osd_op_reply(258 gc.10 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.850+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:259 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d88712650 con 0x7f685c0e21d0 2024-09-12T16:55:43.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.850+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 53 ==== osd_op_reply(259 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.850+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.850+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:260 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.850+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 54 ==== osd_op_reply(260 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.850+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:261 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 55 ==== osd_op_reply(261 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:262 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 56 ==== osd_op_reply(262 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:263 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 57 ==== osd_op_reply(263 gc.10 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T16:55:43.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.854+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:264 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.858+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 56 ==== osd_op_reply(264 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.858+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:265 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.858+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 57 ==== osd_op_reply(265 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.858+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.858+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:266 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887113f0 con 0x564d886d9150 2024-09-12T16:55:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.858+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 58 ==== osd_op_reply(266 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.858+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:267 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.862+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 59 ==== osd_op_reply(267 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.862+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.862+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:268 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.862+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 60 ==== osd_op_reply(268 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.862+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.862+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:269 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.866+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 61 ==== osd_op_reply(269 gc.11 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.866+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T16:55:43.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.866+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:270 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.866+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 58 ==== osd_op_reply(270 gc.12 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.866+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:271 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 59 ==== osd_op_reply(271 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:272 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 60 ==== osd_op_reply(272 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:273 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 61 ==== osd_op_reply(273 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:274 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 62 ==== osd_op_reply(274 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.870+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:275 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x7f685c0e21d0 2024-09-12T16:55:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.874+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 63 ==== osd_op_reply(275 gc.12 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.874+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T16:55:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.874+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:276 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 62 ==== osd_op_reply(276 gc.13 [call] v34'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:277 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 63 ==== osd_op_reply(277 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:278 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 64 ==== osd_op_reply(278 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:279 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 65 ==== osd_op_reply(279 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.878+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:280 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.882+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 66 ==== osd_op_reply(280 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.882+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.882+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:281 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d9150 2024-09-12T16:55:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.882+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 67 ==== osd_op_reply(281 gc.13 [call] v34'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.882+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T16:55:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.882+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:282 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d4780 2024-09-12T16:55:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.886+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 59 ==== osd_op_reply(282 gc.14 [call] v34'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.886+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:283 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d4780 2024-09-12T16:55:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.886+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 60 ==== osd_op_reply(283 gc.14 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.886+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.886+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:284 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d4780 2024-09-12T16:55:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.886+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 61 ==== osd_op_reply(284 gc.14 [call out=24b] v0'0 uv284 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.886+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:285 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d4780 2024-09-12T16:55:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 62 ==== osd_op_reply(285 gc.14 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:286 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d4780 2024-09-12T16:55:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 63 ==== osd_op_reply(286 gc.14 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:287 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886d4780 2024-09-12T16:55:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 64 ==== osd_op_reply(287 gc.14 [call] v34'285 uv285 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686ee689c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T16:55:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.890+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:288 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886ddc00 2024-09-12T16:55:43.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.894+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 94 ==== osd_op_reply(288 gc.15 [call] v34'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.894+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:289 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886ddc00 2024-09-12T16:55:43.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.894+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 95 ==== osd_op_reply(289 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.894+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.894+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:290 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887113f0 con 0x564d886ddc00 2024-09-12T16:55:43.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 96 ==== osd_op_reply(290 gc.15 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:291 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886ddc00 2024-09-12T16:55:43.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 97 ==== osd_op_reply(291 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T16:55:43.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:292 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886ddc00 2024-09-12T16:55:43.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 98 ==== osd_op_reply(292 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686ee689c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T16:55:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:293 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d887125f0 con 0x564d886ddc00 2024-09-12T16:55:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.898+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 99 ==== osd_op_reply(293 gc.15 [call] v34'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.902+0000 7f67237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:55:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.902+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94891001406256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886f0330 con 0x564d886d4780 2024-09-12T16:55:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.906+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94891001406256] v34'286 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.906+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94891001390000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e6330 con 0x7f685c0e21d0 2024-09-12T16:55:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.906+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94891001390000] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.906+0000 7f686ee689c0 20 remove_watcher() i=0 2024-09-12T16:55:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.906+0000 7f686ee689c0 2 removed watcher, disabling cache 2024-09-12T16:55:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.906+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94891001394384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e23b0 con 0x564d886d4780 2024-09-12T16:55:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.910+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94891001394384] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.910+0000 7f686ee689c0 20 remove_watcher() i=1 2024-09-12T16:55:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.910+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94891001387520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e34d0 con 0x564d886ddc00 2024-09-12T16:55:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.910+0000 7f686c96e640 1 -- 172.21.15.151:0/2144080969 <== osd.3 v2:172.21.15.151:6808/987175333 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94891001387520] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685c0cf070 con 0x564d886ddc00 2024-09-12T16:55:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.910+0000 7f686ee689c0 20 remove_watcher() i=2 2024-09-12T16:55:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.910+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94891001400768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e1a00 con 0x7f685c0e21d0 2024-09-12T16:55:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.914+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.2 v2:172.21.15.151:6800/1197700885 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94891001400768] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x7f685c0e21d0 2024-09-12T16:55:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.914+0000 7f686ee689c0 20 remove_watcher() i=3 2024-09-12T16:55:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.914+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94891001402528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e1a00 con 0x564d886d4780 2024-09-12T16:55:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.918+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 <== osd.1 v2:172.21.15.151:6816/883447514 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94891001402528] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f685402a040 con 0x564d886d4780 2024-09-12T16:55:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.918+0000 7f686ee689c0 20 remove_watcher() i=4 2024-09-12T16:55:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.918+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94891001405200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e54a0 con 0x564d886d9150 2024-09-12T16:55:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.918+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94891001405200] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.918+0000 7f686ee689c0 20 remove_watcher() i=5 2024-09-12T16:55:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.918+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94891001408336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e63c0 con 0x564d886d9150 2024-09-12T16:55:43.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.922+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94891001408336] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.922+0000 7f686ee689c0 20 remove_watcher() i=6 2024-09-12T16:55:43.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.922+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94891001411648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d886e63c0 con 0x564d886d9150 2024-09-12T16:55:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686d16f640 1 -- 172.21.15.151:0/2144080969 <== osd.0 v2:172.21.15.122:6800/3868153603 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94891001411648] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6864065040 con 0x564d886d9150 2024-09-12T16:55:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 20 remove_watcher() i=7 2024-09-12T16:55:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886d9150 msgr2=0x564d886db540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886d9150 0x564d886db540 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d886d4780 msgr2=0x564d886d6c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d886d4780 0x564d886d6c10 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f685c0e21d0 msgr2=0x7f685c0e9a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7f685c0e21d0 0x7f685c0e9a30 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d886ddc00 msgr2=0x564d886e0030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x564d886ddc00 0x564d886e0030 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6738039a70 msgr2=0x7f673803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6738039a70 0x7f673803bf30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f685c0b5690 tx=0x7f685c0d2000 comp rx=0 tx=0).stop 2024-09-12T16:55:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 msgr2=0x564d886c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c9660 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6864014d90 tx=0x7f6864050530 comp rx=0 tx=0).stop 2024-09-12T16:55:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686c16d640 1 -- 172.21.15.151:0/2144080969 reap_dead start 2024-09-12T16:55:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 shutdown_connections 2024-09-12T16:55:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/2144080969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886c3150 0x564d886c9660 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 >> 172.21.15.151:0/2144080969 conn(0x564d886be570 msgr2=0x564d886bc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 shutdown_connections 2024-09-12T16:55:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/2144080969 wait complete. 2024-09-12T16:55:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/4198183195 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039ac0 msgr2=0x7f674403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/4198183195 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039ac0 0x7f674403bf80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f685c01b0d0 tx=0x7f685c0b5ed0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/4198183195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886b5830 msgr2=0x564d886b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/4198183195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886b5830 0x564d886b5c50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x564d8869bdb0 tx=0x7f686400af40 comp rx=0 tx=0).stop 2024-09-12T16:55:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/4198183195 shutdown_connections 2024-09-12T16:55:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/4198183195 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6744039ac0 0x7f674403bf80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/4198183195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d886b5830 0x564d886b5c50 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/4198183195 >> 172.21.15.151:0/4198183195 conn(0x564d886ab1e0 msgr2=0x564d886ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/4198183195 shutdown_connections 2024-09-12T16:55:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/4198183195 wait complete. 2024-09-12T16:55:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886a46d0 msgr2=0x564d886a6ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886a46d0 0x564d886a6ac0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d885ab340 msgr2=0x564d886a1ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d885ab340 0x564d886a1ef0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6754039a70 msgr2=0x7f675403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6754039a70 0x7f675403bf30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6854001ec0 tx=0x7f6854001440 comp rx=0 tx=0).stop 2024-09-12T16:55:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 msgr2=0x564d8869add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d8869add0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f685c01b930 tx=0x7f685c017e30 comp rx=0 tx=0).stop 2024-09-12T16:55:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 shutdown_connections 2024-09-12T16:55:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x564d886a46d0 0x564d886a6ac0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x564d885ab340 0x564d886a1ef0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6754039a70 0x7f675403bf30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 --2- 172.21.15.151:0/3204975177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d885a8200 0x564d8869add0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 >> 172.21.15.151:0/3204975177 conn(0x564d8851bb10 msgr2=0x564d8868dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 shutdown_connections 2024-09-12T16:55:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-12T16:55:43.926+0000 7f686ee689c0 1 -- 172.21.15.151:0/3204975177 wait complete. 2024-09-12T16:55:43.951 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T16:55:43.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T16:55:43.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:55:44.101 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf8a32640 1 Processor -- start 2024-09-12T16:55:44.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf8a32640 1 -- start start 2024-09-12T16:55:44.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf8a32640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8cf412aee0 0x7f8cf412b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf8a32640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf40008e0 con 0x7f8cf412f110 2024-09-12T16:55:44.105 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf8a32640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf4071e70 con 0x7f8cf412aee0 2024-09-12T16:55:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf259c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8cf412aee0 0x7f8cf412b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.109 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf259c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8cf412aee0 0x7f8cf412b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58758/0 (socket says 172.21.15.122:58758) 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf259c640 1 -- 172.21.15.122:0/2680676783 learned_addr learned my addr 172.21.15.122:0/2680676783 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf259c640 1 -- 172.21.15.122:0/2680676783 >> v1:172.21.15.122:6789/0 conn(0x7f8cf412f110 legacy=0x7f8cf412f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf259c640 1 -- 172.21.15.122:0/2680676783 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf40a30b0 con 0x7f8cf412aee0 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf159a640 1 -- 172.21.15.122:0/2680676783 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37102613 0 0) 0x7f8cf40008e0 con 0x7f8cf412f110 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.097+0000 7f8cf259c640 1 --2- 172.21.15.122:0/2680676783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf412b2c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009e50 tx=0x7f8ce401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a77990699e1904c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf159a640 1 -- 172.21.15.122:0/2680676783 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce4009200 con 0x7f8cf412aee0 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf159a640 1 -- 172.21.15.122:0/2680676783 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce40a57e0 con 0x7f8cf412aee0 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf159a640 1 -- 172.21.15.122:0/2680676783 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce40a5ae0 con 0x7f8cf412aee0 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- 172.21.15.122:0/2680676783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 msgr2=0x7f8cf412b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 --2- 172.21.15.122:0/2680676783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf412b2c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009e50 tx=0x7f8ce401c980 comp rx=0 tx=0).stop 2024-09-12T16:55:44.110 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- 172.21.15.122:0/2680676783 shutdown_connections 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 --2- 172.21.15.122:0/2680676783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf412b2c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- 172.21.15.122:0/2680676783 >> 172.21.15.122:0/2680676783 conn(0x7f8cf40a0a60 msgr2=0x7f8cf406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- 172.21.15.122:0/2680676783 shutdown_connections 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- 172.21.15.122:0/2680676783 wait complete. 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 Processor -- start 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- start start 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf4129710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf412b980 con 0x7f8cf412aee0 2024-09-12T16:55:44.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf4129710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf4129710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58764/0 (socket says 172.21.15.122:58764) 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf259c640 1 -- 172.21.15.122:0/1602406467 learned_addr learned my addr 172.21.15.122:0/1602406467 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf259c640 1 -- 172.21.15.122:0/1602406467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf4073a80 con 0x7f8cf412aee0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf259c640 1 --2- 172.21.15.122:0/1602406467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf4129710 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8ce401a5b0 tx=0x7f8ce4019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8ce2ffd640 1 -- 172.21.15.122:0/1602406467 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce40bc020 con 0x7f8cf412aee0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8ce2ffd640 1 -- 172.21.15.122:0/1602406467 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce40b87b0 con 0x7f8cf412aee0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf411c550 con 0x7f8cf412aee0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8ce2ffd640 1 -- 172.21.15.122:0/1602406467 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce40b8a90 con 0x7f8cf412aee0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.101+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf4129e20 con 0x7f8cf412aee0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.105+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf412b2c0 con 0x7f8cf412aee0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.105+0000 7f8ce2ffd640 1 -- 172.21.15.122:0/1602406467 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ce40bf020 con 0x7f8cf412aee0 2024-09-12T16:55:44.112 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.105+0000 7f8ce2ffd640 1 --2- 172.21.15.122:0/1602406467 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8cd403b1d0 0x7f8cd403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.105+0000 7f8ce2ffd640 1 -- 172.21.15.122:0/1602406467 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8ce40eab10 con 0x7f8cf412aee0 2024-09-12T16:55:44.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.105+0000 7f8cf1d9b640 1 --2- 172.21.15.122:0/1602406467 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8cd403b1d0 0x7f8cd403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.105+0000 7f8cf1d9b640 1 --2- 172.21.15.122:0/1602406467 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8cd403b1d0 0x7f8cd403d690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8000f70 tx=0x7f8ce80078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.113 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.109+0000 7f8ce2ffd640 1 -- 172.21.15.122:0/1602406467 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8ce40c6030 con 0x7f8cf412aee0 2024-09-12T16:55:44.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.277+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cf411bf90 con 0x7f8cd403b1d0 2024-09-12T16:55:44.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.309+0000 7f8ce2ffd640 1 -- 172.21.15.122:0/1602406467 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666050 (secure 0 0 0) 0x7f8cf411bf90 con 0x7f8cd403b1d0 2024-09-12T16:55:44.321 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:55:44.331 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:55:44.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8cd403b1d0 msgr2=0x7f8cd403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 --2- 172.21.15.122:0/1602406467 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8cd403b1d0 0x7f8cd403d690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8000f70 tx=0x7f8ce80078f0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 msgr2=0x7f8cf4129710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 --2- 172.21.15.122:0/1602406467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf4129710 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8ce401a5b0 tx=0x7f8ce4019720 comp rx=0 tx=0).stop 2024-09-12T16:55:44.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 shutdown_connections 2024-09-12T16:55:44.333 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 --2- 172.21.15.122:0/1602406467 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f8cd403b1d0 0x7f8cd403d690 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 --2- 172.21.15.122:0/1602406467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cf412aee0 0x7f8cf4129710 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 >> 172.21.15.122:0/1602406467 conn(0x7f8cf40a0a60 msgr2=0x7f8cf40a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:44.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 shutdown_connections 2024-09-12T16:55:44.334 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.317+0000 7f8cf8a32640 1 -- 172.21.15.122:0/1602406467 wait complete. 2024-09-12T16:55:44.341 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-12T16:55:44.044651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22226705,"num_objects":228,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":4969,"num_read_kb":4550,"num_write":2065,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4466,"ondisk_log_size":4466,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190392,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377296968,"statfs":{"total":386547056640,"available":386352095232,"internally_reserved":0,"allocated":37412864,"data_stored":36211778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4190208,"num_objects":-1,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":47,"num_read_kb":46,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006774"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.089853+0000","last_change":"2024-09-12T16:51:56.151833+0000","last_active":"2024-09-12T16:52:41.089853+0000","last_peered":"2024-09-12T16:52:41.089853+0000","last_clean":"2024-09-12T16:52:41.089853+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:52:41.089853+0000","last_undegraded":"2024-09-12T16:52:41.089853+0000","last_fullsized":"2024-09-12T16:52:41.089853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:07.556912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559689+0000","last_change":"2024-09-12T16:51:58.150328+0000","last_active":"2024-09-12T16:55:12.559689+0000","last_peered":"2024-09-12T16:55:12.559689+0000","last_clean":"2024-09-12T16:55:12.559689+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:55:12.559689+0000","last_undegraded":"2024-09-12T16:55:12.559689+0000","last_fullsized":"2024-09-12T16:55:12.559689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:31.991784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026353+0000","last_change":"2024-09-12T16:51:56.161722+0000","last_active":"2024-09-12T16:52:35.026353+0000","last_peered":"2024-09-12T16:52:35.026353+0000","last_clean":"2024-09-12T16:52:35.026353+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:52:35.026353+0000","last_undegraded":"2024-09-12T16:52:35.026353+0000","last_fullsized":"2024-09-12T16:52:35.026353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:40.529043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.493995+0000","last_change":"2024-09-12T16:51:58.166339+0000","last_active":"2024-09-12T16:55:12.493995+0000","last_peered":"2024-09-12T16:55:12.493995+0000","last_clean":"2024-09-12T16:55:12.493995+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:55:12.493995+0000","last_undegraded":"2024-09-12T16:55:12.493995+0000","last_fullsized":"2024-09-12T16:55:12.493995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.116016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048410+0000","last_change":"2024-09-12T16:51:56.164645+0000","last_active":"2024-09-12T16:52:35.048410+0000","last_peered":"2024-09-12T16:52:35.048410+0000","last_clean":"2024-09-12T16:52:35.048410+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:52:35.048410+0000","last_undegraded":"2024-09-12T16:52:35.048410+0000","last_fullsized":"2024-09-12T16:52:35.048410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:14.665769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.425082+0000","last_change":"2024-09-12T16:51:58.163269+0000","last_active":"2024-09-12T16:55:12.425082+0000","last_peered":"2024-09-12T16:55:12.425082+0000","last_clean":"2024-09-12T16:55:12.425082+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:55:12.425082+0000","last_undegraded":"2024-09-12T16:55:12.425082+0000","last_fullsized":"2024-09-12T16:55:12.425082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:17.060923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.018273+0000","last_change":"2024-09-12T16:51:56.150421+0000","last_active":"2024-09-12T16:52:35.018273+0000","last_peered":"2024-09-12T16:52:35.018273+0000","last_clean":"2024-09-12T16:52:35.018273+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:52:35.018273+0000","last_undegraded":"2024-09-12T16:52:35.018273+0000","last_fullsized":"2024-09-12T16:52:35.018273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:08.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559316+0000","last_change":"2024-09-12T16:51:58.165836+0000","last_active":"2024-09-12T16:55:12.559316+0000","last_peered":"2024-09-12T16:55:12.559316+0000","last_clean":"2024-09-12T16:55:12.559316+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:55:12.559316+0000","last_undegraded":"2024-09-12T16:55:12.559316+0000","last_fullsized":"2024-09-12T16:55:12.559316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.786300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038726+0000","last_change":"2024-09-12T16:51:56.155368+0000","last_active":"2024-09-12T16:52:35.038726+0000","last_peered":"2024-09-12T16:52:35.038726+0000","last_clean":"2024-09-12T16:52:35.038726+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:52:35.038726+0000","last_undegraded":"2024-09-12T16:52:35.038726+0000","last_fullsized":"2024-09-12T16:52:35.038726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:23.509728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.310094+0000","last_change":"2024-09-12T16:51:58.148537+0000","last_active":"2024-09-12T16:52:43.310094+0000","last_peered":"2024-09-12T16:52:43.310094+0000","last_clean":"2024-09-12T16:52:43.310094+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:52:43.310094+0000","last_undegraded":"2024-09-12T16:52:43.310094+0000","last_fullsized":"2024-09-12T16:52:43.310094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:36.641527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.812642+0000","last_change":"2024-09-12T16:51:56.149239+0000","last_active":"2024-09-12T16:55:11.812642+0000","last_peered":"2024-09-12T16:55:11.812642+0000","last_clean":"2024-09-12T16:55:11.812642+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:55:11.812642+0000","last_undegraded":"2024-09-12T16:55:11.812642+0000","last_fullsized":"2024-09-12T16:55:11.812642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:48.008590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":12,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.756687+0000","last_change":"2024-09-12T16:51:58.165599+0000","last_active":"2024-09-12T16:54:06.756687+0000","last_peered":"2024-09-12T16:54:06.756687+0000","last_clean":"2024-09-12T16:54:06.756687+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:54:06.756687+0000","last_undegraded":"2024-09-12T16:54:06.756687+0000","last_fullsized":"2024-09-12T16:54:06.756687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:30.151277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.027975+0000","last_change":"2024-09-12T16:51:56.154655+0000","last_active":"2024-09-12T16:54:26.027975+0000","last_peered":"2024-09-12T16:54:26.027975+0000","last_clean":"2024-09-12T16:54:26.027975+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:54:26.027975+0000","last_undegraded":"2024-09-12T16:54:26.027975+0000","last_fullsized":"2024-09-12T16:54:26.027975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:52.651580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491266+0000","last_change":"2024-09-12T16:51:58.156872+0000","last_active":"2024-09-12T16:55:12.491266+0000","last_peered":"2024-09-12T16:55:12.491266+0000","last_clean":"2024-09-12T16:55:12.491266+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:55:12.491266+0000","last_undegraded":"2024-09-12T16:55:12.491266+0000","last_fullsized":"2024-09-12T16:55:12.491266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:17.848281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.095549+0000","last_change":"2024-09-12T16:51:56.161773+0000","last_active":"2024-09-12T16:53:26.095549+0000","last_peered":"2024-09-12T16:53:26.095549+0000","last_clean":"2024-09-12T16:53:26.095549+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:53:26.095549+0000","last_undegraded":"2024-09-12T16:53:26.095549+0000","last_fullsized":"2024-09-12T16:53:26.095549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:05.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.490892+0000","last_change":"2024-09-12T16:52:35.060238+0000","last_active":"2024-09-12T16:55:12.490892+0000","last_peered":"2024-09-12T16:55:12.490892+0000","last_clean":"2024-09-12T16:55:12.490892+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:55:12.490892+0000","last_undegraded":"2024-09-12T16:55:12.490892+0000","last_fullsized":"2024-09-12T16:55:12.490892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:18.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'5","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508887+0000","last_change":"2024-09-12T16:51:58.152595+0000","last_active":"2024-09-12T16:55:12.508887+0000","last_peered":"2024-09-12T16:55:12.508887+0000","last_clean":"2024-09-12T16:55:12.508887+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:55:12.508887+0000","last_undegraded":"2024-09-12T16:55:12.508887+0000","last_fullsized":"2024-09-12T16:55:12.508887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:06.175184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047444+0000","last_change":"2024-09-12T16:51:56.158348+0000","last_active":"2024-09-12T16:52:35.047444+0000","last_peered":"2024-09-12T16:52:35.047444+0000","last_clean":"2024-09-12T16:52:35.047444+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:52:35.047444+0000","last_undegraded":"2024-09-12T16:52:35.047444+0000","last_fullsized":"2024-09-12T16:52:35.047444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:16.323536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.082244+0000","last_change":"2024-09-12T16:51:58.145539+0000","last_active":"2024-09-12T16:55:12.082244+0000","last_peered":"2024-09-12T16:55:12.082244+0000","last_clean":"2024-09-12T16:55:12.082244+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:55:12.082244+0000","last_undegraded":"2024-09-12T16:55:12.082244+0000","last_fullsized":"2024-09-12T16:55:12.082244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:58.380885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:25.018199+0000","last_change":"2024-09-12T16:51:56.150522+0000","last_active":"2024-09-12T16:54:25.018199+0000","last_peered":"2024-09-12T16:54:25.018199+0000","last_clean":"2024-09-12T16:54:25.018199+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:54:25.018199+0000","last_undegraded":"2024-09-12T16:54:25.018199+0000","last_fullsized":"2024-09-12T16:54:25.018199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:47.138309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450880+0000","last_change":"2024-09-12T16:51:58.147371+0000","last_active":"2024-09-12T16:54:11.450880+0000","last_peered":"2024-09-12T16:54:11.450880+0000","last_clean":"2024-09-12T16:54:11.450880+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:54:11.450880+0000","last_undegraded":"2024-09-12T16:54:11.450880+0000","last_fullsized":"2024-09-12T16:54:11.450880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.439266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044749+0000","last_change":"2024-09-12T16:51:56.164502+0000","last_active":"2024-09-12T16:52:35.044749+0000","last_peered":"2024-09-12T16:52:35.044749+0000","last_clean":"2024-09-12T16:52:35.044749+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:52:35.044749+0000","last_undegraded":"2024-09-12T16:52:35.044749+0000","last_fullsized":"2024-09-12T16:52:35.044749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:23.020353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.578829+0000","last_change":"2024-09-12T16:51:58.171720+0000","last_active":"2024-09-12T16:55:12.578829+0000","last_peered":"2024-09-12T16:55:12.578829+0000","last_clean":"2024-09-12T16:55:12.578829+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:55:12.578829+0000","last_undegraded":"2024-09-12T16:55:12.578829+0000","last_fullsized":"2024-09-12T16:55:12.578829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:43.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.042838+0000","last_change":"2024-09-12T16:51:56.164560+0000","last_active":"2024-09-12T16:52:35.042838+0000","last_peered":"2024-09-12T16:52:35.042838+0000","last_clean":"2024-09-12T16:52:35.042838+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:52:35.042838+0000","last_undegraded":"2024-09-12T16:52:35.042838+0000","last_fullsized":"2024-09-12T16:52:35.042838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:34.588010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.170393+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:20.778233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029650+0000","last_change":"2024-09-12T16:51:56.172466+0000","last_active":"2024-09-12T16:52:35.029650+0000","last_peered":"2024-09-12T16:52:35.029650+0000","last_clean":"2024-09-12T16:52:35.029650+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:52:35.029650+0000","last_undegraded":"2024-09-12T16:52:35.029650+0000","last_fullsized":"2024-09-12T16:52:35.029650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:16.998562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.024343+0000","last_change":"2024-09-12T16:51:58.154333+0000","last_active":"2024-09-12T16:54:26.024343+0000","last_peered":"2024-09-12T16:54:26.024343+0000","last_clean":"2024-09-12T16:54:26.024343+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:54:26.024343+0000","last_undegraded":"2024-09-12T16:54:26.024343+0000","last_fullsized":"2024-09-12T16:54:26.024343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:31.351742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.747323+0000","last_change":"2024-09-12T16:51:56.150214+0000","last_active":"2024-09-12T16:53:25.747323+0000","last_peered":"2024-09-12T16:53:25.747323+0000","last_clean":"2024-09-12T16:53:25.747323+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:53:25.747323+0000","last_undegraded":"2024-09-12T16:53:25.747323+0000","last_fullsized":"2024-09-12T16:53:25.747323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.360856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.449818+0000","last_change":"2024-09-12T16:52:06.228645+0000","last_active":"2024-09-12T16:55:12.449818+0000","last_peered":"2024-09-12T16:55:12.449818+0000","last_clean":"2024-09-12T16:55:12.449818+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:55:12.449818+0000","last_undegraded":"2024-09-12T16:55:12.449818+0000","last_fullsized":"2024-09-12T16:55:12.449818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.027430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559921+0000","last_change":"2024-09-12T16:51:58.158921+0000","last_active":"2024-09-12T16:55:12.559921+0000","last_peered":"2024-09-12T16:55:12.559921+0000","last_clean":"2024-09-12T16:55:12.559921+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:55:12.559921+0000","last_undegraded":"2024-09-12T16:55:12.559921+0000","last_fullsized":"2024-09-12T16:55:12.559921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:53.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.583779+0000","last_change":"2024-09-12T16:51:56.164082+0000","last_active":"2024-09-12T16:52:42.583779+0000","last_peered":"2024-09-12T16:52:42.583779+0000","last_clean":"2024-09-12T16:52:42.583779+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:52:42.583779+0000","last_undegraded":"2024-09-12T16:52:42.583779+0000","last_fullsized":"2024-09-12T16:52:42.583779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:02.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047258+0000","last_change":"2024-09-12T16:52:00.186679+0000","last_active":"2024-09-12T16:52:35.047258+0000","last_peered":"2024-09-12T16:52:35.047258+0000","last_clean":"2024-09-12T16:52:35.047258+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:52:35.047258+0000","last_undegraded":"2024-09-12T16:52:35.047258+0000","last_fullsized":"2024-09-12T16:52:35.047258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:56.774446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.998524+0000","last_change":"2024-09-12T16:52:02.211041+0000","last_active":"2024-09-12T16:54:08.998524+0000","last_peered":"2024-09-12T16:54:08.998524+0000","last_clean":"2024-09-12T16:54:08.998524+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:54:08.998524+0000","last_undegraded":"2024-09-12T16:54:08.998524+0000","last_fullsized":"2024-09-12T16:54:08.998524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:56.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046823+0000","last_change":"2024-09-12T16:52:04.216014+0000","last_active":"2024-09-12T16:52:35.046823+0000","last_peered":"2024-09-12T16:52:35.046823+0000","last_clean":"2024-09-12T16:52:35.046823+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:52:35.046823+0000","last_undegraded":"2024-09-12T16:52:35.046823+0000","last_fullsized":"2024-09-12T16:52:35.046823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.121629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.770372+0000","last_change":"2024-09-12T16:52:06.220823+0000","last_active":"2024-09-12T16:53:25.770372+0000","last_peered":"2024-09-12T16:53:25.770372+0000","last_clean":"2024-09-12T16:53:25.770372+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:53:25.770372+0000","last_undegraded":"2024-09-12T16:53:25.770372+0000","last_fullsized":"2024-09-12T16:53:25.770372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.834594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.769302+0000","last_change":"2024-09-12T16:51:58.172491+0000","last_active":"2024-09-12T16:54:06.769302+0000","last_peered":"2024-09-12T16:54:06.769302+0000","last_clean":"2024-09-12T16:54:06.769302+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:54:06.769302+0000","last_undegraded":"2024-09-12T16:54:06.769302+0000","last_fullsized":"2024-09-12T16:54:06.769302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:13.859827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.015475+0000","last_change":"2024-09-12T16:51:56.148926+0000","last_active":"2024-09-12T16:55:12.015475+0000","last_peered":"2024-09-12T16:55:12.015475+0000","last_clean":"2024-09-12T16:55:12.015475+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:12.015475+0000","last_undegraded":"2024-09-12T16:55:12.015475+0000","last_fullsized":"2024-09-12T16:55:12.015475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:08.525437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022624+0000","last_change":"2024-09-12T16:52:00.173177+0000","last_active":"2024-09-12T16:52:35.022624+0000","last_peered":"2024-09-12T16:52:35.022624+0000","last_clean":"2024-09-12T16:52:35.022624+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:52:35.022624+0000","last_undegraded":"2024-09-12T16:52:35.022624+0000","last_fullsized":"2024-09-12T16:52:35.022624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:29.445195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.045539+0000","last_change":"2024-09-12T16:52:02.183370+0000","last_active":"2024-09-12T16:52:35.045539+0000","last_peered":"2024-09-12T16:52:35.045539+0000","last_clean":"2024-09-12T16:52:35.045539+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:52:35.045539+0000","last_undegraded":"2024-09-12T16:52:35.045539+0000","last_fullsized":"2024-09-12T16:52:35.045539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.193774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044904+0000","last_change":"2024-09-12T16:52:04.210985+0000","last_active":"2024-09-12T16:52:35.044904+0000","last_peered":"2024-09-12T16:52:35.044904+0000","last_clean":"2024-09-12T16:52:35.044904+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:52:35.044904+0000","last_undegraded":"2024-09-12T16:52:35.044904+0000","last_fullsized":"2024-09-12T16:52:35.044904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:41.017144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021248+0000","last_change":"2024-09-12T16:52:06.224899+0000","last_active":"2024-09-12T16:52:35.021248+0000","last_peered":"2024-09-12T16:52:35.021248+0000","last_clean":"2024-09-12T16:52:35.021248+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:52:35.021248+0000","last_undegraded":"2024-09-12T16:52:35.021248+0000","last_fullsized":"2024-09-12T16:52:35.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:27.788906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559983+0000","last_change":"2024-09-12T16:51:58.165985+0000","last_active":"2024-09-12T16:55:12.559983+0000","last_peered":"2024-09-12T16:55:12.559983+0000","last_clean":"2024-09-12T16:55:12.559983+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:55:12.559983+0000","last_undegraded":"2024-09-12T16:55:12.559983+0000","last_fullsized":"2024-09-12T16:55:12.559983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.791071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023098+0000","last_change":"2024-09-12T16:51:56.153288+0000","last_active":"2024-09-12T16:52:35.023098+0000","last_peered":"2024-09-12T16:52:35.023098+0000","last_clean":"2024-09-12T16:52:35.023098+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:52:35.023098+0000","last_undegraded":"2024-09-12T16:52:35.023098+0000","last_fullsized":"2024-09-12T16:52:35.023098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:56.830974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029954+0000","last_change":"2024-09-12T16:52:00.166221+0000","last_active":"2024-09-12T16:52:35.029954+0000","last_peered":"2024-09-12T16:52:35.029954+0000","last_clean":"2024-09-12T16:52:35.029954+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:52:35.029954+0000","last_undegraded":"2024-09-12T16:52:35.029954+0000","last_fullsized":"2024-09-12T16:52:35.029954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:47.637135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017313+0000","last_change":"2024-09-12T16:52:02.202447+0000","last_active":"2024-09-12T16:52:35.017313+0000","last_peered":"2024-09-12T16:52:35.017313+0000","last_clean":"2024-09-12T16:52:35.017313+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:52:35.017313+0000","last_undegraded":"2024-09-12T16:52:35.017313+0000","last_fullsized":"2024-09-12T16:52:35.017313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:48.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419319+0000","last_change":"2024-09-12T16:52:04.214865+0000","last_active":"2024-09-12T16:55:10.419319+0000","last_peered":"2024-09-12T16:55:10.419319+0000","last_clean":"2024-09-12T16:55:10.419319+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:55:10.419319+0000","last_undegraded":"2024-09-12T16:55:10.419319+0000","last_fullsized":"2024-09-12T16:55:10.419319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:36.658689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016249+0000","last_change":"2024-09-12T16:52:06.233885+0000","last_active":"2024-09-12T16:52:35.016249+0000","last_peered":"2024-09-12T16:52:35.016249+0000","last_clean":"2024-09-12T16:52:35.016249+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:52:35.016249+0000","last_undegraded":"2024-09-12T16:52:35.016249+0000","last_fullsized":"2024-09-12T16:52:35.016249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:05.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762116+0000","last_change":"2024-09-12T16:51:58.157856+0000","last_active":"2024-09-12T16:53:25.762116+0000","last_peered":"2024-09-12T16:53:25.762116+0000","last_clean":"2024-09-12T16:53:25.762116+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:53:25.762116+0000","last_undegraded":"2024-09-12T16:53:25.762116+0000","last_fullsized":"2024-09-12T16:53:25.762116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.575311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024635+0000","last_change":"2024-09-12T16:51:56.158840+0000","last_active":"2024-09-12T16:52:35.024635+0000","last_peered":"2024-09-12T16:52:35.024635+0000","last_clean":"2024-09-12T16:52:35.024635+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:52:35.024635+0000","last_undegraded":"2024-09-12T16:52:35.024635+0000","last_fullsized":"2024-09-12T16:52:35.024635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.795717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047933+0000","last_change":"2024-09-12T16:52:00.186758+0000","last_active":"2024-09-12T16:52:35.047933+0000","last_peered":"2024-09-12T16:52:35.047933+0000","last_clean":"2024-09-12T16:52:35.047933+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:52:35.047933+0000","last_undegraded":"2024-09-12T16:52:35.047933+0000","last_fullsized":"2024-09-12T16:52:35.047933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:11.029898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.990711+0000","last_change":"2024-09-12T16:52:02.201456+0000","last_active":"2024-09-12T16:54:08.990711+0000","last_peered":"2024-09-12T16:54:08.990711+0000","last_clean":"2024-09-12T16:54:08.990711+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:54:08.990711+0000","last_undegraded":"2024-09-12T16:54:08.990711+0000","last_fullsized":"2024-09-12T16:54:08.990711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:04.994969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.586516+0000","last_change":"2024-09-12T16:52:04.220126+0000","last_active":"2024-09-12T16:55:43.586516+0000","last_peered":"2024-09-12T16:55:43.586516+0000","last_clean":"2024-09-12T16:55:43.586516+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:55:43.586516+0000","last_undegraded":"2024-09-12T16:55:43.586516+0000","last_fullsized":"2024-09-12T16:55:43.586516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:41.797262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024505+0000","last_change":"2024-09-12T16:51:58.166638+0000","last_active":"2024-09-12T16:52:35.024505+0000","last_peered":"2024-09-12T16:52:35.024505+0000","last_clean":"2024-09-12T16:52:35.024505+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:52:35.024505+0000","last_undegraded":"2024-09-12T16:52:35.024505+0000","last_fullsized":"2024-09-12T16:52:35.024505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:09.865305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022574+0000","last_change":"2024-09-12T16:51:56.152053+0000","last_active":"2024-09-12T16:52:35.022574+0000","last_peered":"2024-09-12T16:52:35.022574+0000","last_clean":"2024-09-12T16:52:35.022574+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:52:35.022574+0000","last_undegraded":"2024-09-12T16:52:35.022574+0000","last_fullsized":"2024-09-12T16:52:35.022574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:05.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025774+0000","last_change":"2024-09-12T16:52:00.158540+0000","last_active":"2024-09-12T16:52:35.025774+0000","last_peered":"2024-09-12T16:52:35.025774+0000","last_clean":"2024-09-12T16:52:35.025774+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:52:35.025774+0000","last_undegraded":"2024-09-12T16:52:35.025774+0000","last_fullsized":"2024-09-12T16:52:35.025774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.058273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015338+0000","last_change":"2024-09-12T16:52:02.185249+0000","last_active":"2024-09-12T16:54:15.015338+0000","last_peered":"2024-09-12T16:54:15.015338+0000","last_clean":"2024-09-12T16:54:15.015338+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:54:15.015338+0000","last_undegraded":"2024-09-12T16:54:15.015338+0000","last_fullsized":"2024-09-12T16:54:15.015338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:09.660762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029067+0000","last_change":"2024-09-12T16:52:04.216055+0000","last_active":"2024-09-12T16:52:35.029067+0000","last_peered":"2024-09-12T16:52:35.029067+0000","last_clean":"2024-09-12T16:52:35.029067+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:52:35.029067+0000","last_undegraded":"2024-09-12T16:52:35.029067+0000","last_fullsized":"2024-09-12T16:52:35.029067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:19.593146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.773290+0000","last_change":"2024-09-12T16:52:06.226575+0000","last_active":"2024-09-12T16:53:25.773290+0000","last_peered":"2024-09-12T16:53:25.773290+0000","last_clean":"2024-09-12T16:53:25.773290+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:53:25.773290+0000","last_undegraded":"2024-09-12T16:53:25.773290+0000","last_fullsized":"2024-09-12T16:53:25.773290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:47.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.059583+0000","last_change":"2024-09-12T16:51:58.154586+0000","last_active":"2024-09-12T16:55:12.059583+0000","last_peered":"2024-09-12T16:55:12.059583+0000","last_clean":"2024-09-12T16:55:12.059583+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:55:12.059583+0000","last_undegraded":"2024-09-12T16:55:12.059583+0000","last_fullsized":"2024-09-12T16:55:12.059583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:21.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.211592+0000","last_change":"2024-09-12T16:51:56.152647+0000","last_active":"2024-09-12T16:54:11.211592+0000","last_peered":"2024-09-12T16:54:11.211592+0000","last_clean":"2024-09-12T16:54:11.211592+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:54:11.211592+0000","last_undegraded":"2024-09-12T16:54:11.211592+0000","last_fullsized":"2024-09-12T16:54:11.211592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023417+0000","last_change":"2024-09-12T16:52:00.156973+0000","last_active":"2024-09-12T16:52:35.023417+0000","last_peered":"2024-09-12T16:52:35.023417+0000","last_clean":"2024-09-12T16:52:35.023417+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:52:35.023417+0000","last_undegraded":"2024-09-12T16:52:35.023417+0000","last_fullsized":"2024-09-12T16:52:35.023417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:53.962016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.974774+0000","last_change":"2024-09-12T16:52:02.209890+0000","last_active":"2024-09-12T16:54:08.974774+0000","last_peered":"2024-09-12T16:54:08.974774+0000","last_clean":"2024-09-12T16:54:08.974774+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:54:08.974774+0000","last_undegraded":"2024-09-12T16:54:08.974774+0000","last_fullsized":"2024-09-12T16:54:08.974774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:04.988153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023620+0000","last_change":"2024-09-12T16:52:04.194679+0000","last_active":"2024-09-12T16:52:35.023620+0000","last_peered":"2024-09-12T16:52:35.023620+0000","last_clean":"2024-09-12T16:52:35.023620+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:52:35.023620+0000","last_undegraded":"2024-09-12T16:52:35.023620+0000","last_fullsized":"2024-09-12T16:52:35.023620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:43.311077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:20.069130+0000","last_change":"2024-09-12T16:52:06.231060+0000","last_active":"2024-09-12T16:53:20.069130+0000","last_peered":"2024-09-12T16:53:20.069130+0000","last_clean":"2024-09-12T16:53:20.069130+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:53:20.069130+0000","last_undegraded":"2024-09-12T16:53:20.069130+0000","last_fullsized":"2024-09-12T16:53:20.069130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:38.753641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019518+0000","last_change":"2024-09-12T16:51:58.170102+0000","last_active":"2024-09-12T16:52:35.019518+0000","last_peered":"2024-09-12T16:52:35.019518+0000","last_clean":"2024-09-12T16:52:35.019518+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:52:35.019518+0000","last_undegraded":"2024-09-12T16:52:35.019518+0000","last_fullsized":"2024-09-12T16:52:35.019518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:03.745874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048163+0000","last_change":"2024-09-12T16:51:56.171021+0000","last_active":"2024-09-12T16:52:35.048163+0000","last_peered":"2024-09-12T16:52:35.048163+0000","last_clean":"2024-09-12T16:52:35.048163+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:52:35.048163+0000","last_undegraded":"2024-09-12T16:52:35.048163+0000","last_fullsized":"2024-09-12T16:52:35.048163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:34.631184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026093+0000","last_change":"2024-09-12T16:52:00.155974+0000","last_active":"2024-09-12T16:52:35.026093+0000","last_peered":"2024-09-12T16:52:35.026093+0000","last_clean":"2024-09-12T16:52:35.026093+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:52:35.026093+0000","last_undegraded":"2024-09-12T16:52:35.026093+0000","last_fullsized":"2024-09-12T16:52:35.026093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:53.769301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:16.024675+0000","last_change":"2024-09-12T16:52:02.203207+0000","last_active":"2024-09-12T16:54:16.024675+0000","last_peered":"2024-09-12T16:54:16.024675+0000","last_clean":"2024-09-12T16:54:16.024675+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:54:16.024675+0000","last_undegraded":"2024-09-12T16:54:16.024675+0000","last_fullsized":"2024-09-12T16:54:16.024675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:18.022593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.589627+0000","last_change":"2024-09-12T16:52:04.194703+0000","last_active":"2024-09-12T16:55:43.589627+0000","last_peered":"2024-09-12T16:55:43.589627+0000","last_clean":"2024-09-12T16:55:43.589627+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:55:43.589627+0000","last_undegraded":"2024-09-12T16:55:43.589627+0000","last_fullsized":"2024-09-12T16:55:43.589627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:45.145668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024038+0000","last_change":"2024-09-12T16:52:06.236389+0000","last_active":"2024-09-12T16:52:35.024038+0000","last_peered":"2024-09-12T16:52:35.024038+0000","last_clean":"2024-09-12T16:52:35.024038+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:52:35.024038+0000","last_undegraded":"2024-09-12T16:52:35.024038+0000","last_fullsized":"2024-09-12T16:52:35.024038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:42.125079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015430+0000","last_change":"2024-09-12T16:51:58.141456+0000","last_active":"2024-09-12T16:54:15.015430+0000","last_peered":"2024-09-12T16:54:15.015430+0000","last_clean":"2024-09-12T16:54:15.015430+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:54:15.015430+0000","last_undegraded":"2024-09-12T16:54:15.015430+0000","last_fullsized":"2024-09-12T16:54:15.015430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.544687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044239+0000","last_change":"2024-09-12T16:51:56.169441+0000","last_active":"2024-09-12T16:52:35.044239+0000","last_peered":"2024-09-12T16:52:35.044239+0000","last_clean":"2024-09-12T16:52:35.044239+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:52:35.044239+0000","last_undegraded":"2024-09-12T16:52:35.044239+0000","last_fullsized":"2024-09-12T16:52:35.044239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:56.370543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022426+0000","last_change":"2024-09-12T16:52:00.178084+0000","last_active":"2024-09-12T16:52:35.022426+0000","last_peered":"2024-09-12T16:52:35.022426+0000","last_clean":"2024-09-12T16:52:35.022426+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:52:35.022426+0000","last_undegraded":"2024-09-12T16:52:35.022426+0000","last_fullsized":"2024-09-12T16:52:35.022426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.597984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.009905+0000","last_change":"2024-09-12T16:52:02.201612+0000","last_active":"2024-09-12T16:54:09.009905+0000","last_peered":"2024-09-12T16:54:09.009905+0000","last_clean":"2024-09-12T16:54:09.009905+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:54:09.009905+0000","last_undegraded":"2024-09-12T16:54:09.009905+0000","last_fullsized":"2024-09-12T16:54:09.009905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:42.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021841+0000","last_change":"2024-09-12T16:52:04.198835+0000","last_active":"2024-09-12T16:52:35.021841+0000","last_peered":"2024-09-12T16:52:35.021841+0000","last_clean":"2024-09-12T16:52:35.021841+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:52:35.021841+0000","last_undegraded":"2024-09-12T16:52:35.021841+0000","last_fullsized":"2024-09-12T16:52:35.021841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.503485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.731668+0000","last_change":"2024-09-12T16:52:06.212053+0000","last_active":"2024-09-12T16:55:12.731668+0000","last_peered":"2024-09-12T16:55:12.731668+0000","last_clean":"2024-09-12T16:55:12.731668+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:55:12.731668+0000","last_undegraded":"2024-09-12T16:55:12.731668+0000","last_fullsized":"2024-09-12T16:55:12.731668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:15.749904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.060440+0000","last_change":"2024-09-12T16:51:58.171124+0000","last_active":"2024-09-12T16:55:12.060440+0000","last_peered":"2024-09-12T16:55:12.060440+0000","last_clean":"2024-09-12T16:55:12.060440+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:55:12.060440+0000","last_undegraded":"2024-09-12T16:55:12.060440+0000","last_fullsized":"2024-09-12T16:55:12.060440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:39.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026631+0000","last_change":"2024-09-12T16:51:56.169756+0000","last_active":"2024-09-12T16:52:35.026631+0000","last_peered":"2024-09-12T16:52:35.026631+0000","last_clean":"2024-09-12T16:52:35.026631+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:52:35.026631+0000","last_undegraded":"2024-09-12T16:52:35.026631+0000","last_fullsized":"2024-09-12T16:52:35.026631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:43.389321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027418+0000","last_change":"2024-09-12T16:52:00.186996+0000","last_active":"2024-09-12T16:52:35.027418+0000","last_peered":"2024-09-12T16:52:35.027418+0000","last_clean":"2024-09-12T16:52:35.027418+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:52:35.027418+0000","last_undegraded":"2024-09-12T16:52:35.027418+0000","last_fullsized":"2024-09-12T16:52:35.027418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:55.614591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.023058+0000","last_change":"2024-09-12T16:52:02.181402+0000","last_active":"2024-09-12T16:54:21.023058+0000","last_peered":"2024-09-12T16:54:21.023058+0000","last_clean":"2024-09-12T16:54:21.023058+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:54:21.023058+0000","last_undegraded":"2024-09-12T16:54:21.023058+0000","last_fullsized":"2024-09-12T16:54:21.023058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:57.545973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048724+0000","last_change":"2024-09-12T16:52:04.214150+0000","last_active":"2024-09-12T16:52:35.048724+0000","last_peered":"2024-09-12T16:52:35.048724+0000","last_clean":"2024-09-12T16:52:35.048724+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:52:35.048724+0000","last_undegraded":"2024-09-12T16:52:35.048724+0000","last_fullsized":"2024-09-12T16:52:35.048724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:04.618846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.605539+0000","last_change":"2024-09-12T16:52:06.231706+0000","last_active":"2024-09-12T16:54:08.605539+0000","last_peered":"2024-09-12T16:54:08.605539+0000","last_clean":"2024-09-12T16:54:08.605539+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:54:08.605539+0000","last_undegraded":"2024-09-12T16:54:08.605539+0000","last_fullsized":"2024-09-12T16:54:08.605539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:20.026659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'9","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.579477+0000","last_change":"2024-09-12T16:51:58.173915+0000","last_active":"2024-09-12T16:55:12.579477+0000","last_peered":"2024-09-12T16:55:12.579477+0000","last_clean":"2024-09-12T16:55:12.579477+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:55:12.579477+0000","last_undegraded":"2024-09-12T16:55:12.579477+0000","last_fullsized":"2024-09-12T16:55:12.579477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:53.515263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.021863+0000","last_change":"2024-09-12T16:51:56.159835+0000","last_active":"2024-09-12T16:54:06.021863+0000","last_peered":"2024-09-12T16:54:06.021863+0000","last_clean":"2024-09-12T16:54:06.021863+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:54:06.021863+0000","last_undegraded":"2024-09-12T16:54:06.021863+0000","last_fullsized":"2024-09-12T16:54:06.021863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:50.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022853+0000","last_change":"2024-09-12T16:52:00.167730+0000","last_active":"2024-09-12T16:52:35.022853+0000","last_peered":"2024-09-12T16:52:35.022853+0000","last_clean":"2024-09-12T16:52:35.022853+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:52:35.022853+0000","last_undegraded":"2024-09-12T16:52:35.022853+0000","last_fullsized":"2024-09-12T16:52:35.022853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:18.641624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.021811+0000","last_change":"2024-09-12T16:52:02.181396+0000","last_active":"2024-09-12T16:54:09.021811+0000","last_peered":"2024-09-12T16:54:09.021811+0000","last_clean":"2024-09-12T16:54:09.021811+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:54:09.021811+0000","last_undegraded":"2024-09-12T16:54:09.021811+0000","last_fullsized":"2024-09-12T16:54:09.021811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:02.688531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":405,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.743611+0000","last_change":"2024-09-12T16:52:04.202044+0000","last_active":"2024-09-12T16:55:12.743611+0000","last_peered":"2024-09-12T16:55:12.743611+0000","last_clean":"2024-09-12T16:55:12.743611+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:55:12.743611+0000","last_undegraded":"2024-09-12T16:55:12.743611+0000","last_fullsized":"2024-09-12T16:55:12.743611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:00.863167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'20","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.680761+0000","last_change":"2024-09-12T16:52:06.219575+0000","last_active":"2024-09-12T16:55:12.680761+0000","last_peered":"2024-09-12T16:55:12.680761+0000","last_clean":"2024-09-12T16:55:12.680761+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:55:12.680761+0000","last_undegraded":"2024-09-12T16:55:12.680761+0000","last_fullsized":"2024-09-12T16:55:12.680761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.073730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.245387+0000","last_change":"2024-09-12T16:51:58.168850+0000","last_active":"2024-09-12T16:52:42.245387+0000","last_peered":"2024-09-12T16:52:42.245387+0000","last_clean":"2024-09-12T16:52:42.245387+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:52:42.245387+0000","last_undegraded":"2024-09-12T16:52:42.245387+0000","last_fullsized":"2024-09-12T16:52:42.245387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:38.519723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030545+0000","last_change":"2024-09-12T16:51:56.163883+0000","last_active":"2024-09-12T16:52:35.030545+0000","last_peered":"2024-09-12T16:52:35.030545+0000","last_clean":"2024-09-12T16:52:35.030545+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:52:35.030545+0000","last_undegraded":"2024-09-12T16:52:35.030545+0000","last_fullsized":"2024-09-12T16:52:35.030545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:19.316288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":617,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.624735+0000","last_change":"2024-09-12T16:52:35.065861+0000","last_active":"2024-09-12T16:54:10.624735+0000","last_peered":"2024-09-12T16:54:10.624735+0000","last_clean":"2024-09-12T16:54:10.624735+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:54:10.624735+0000","last_undegraded":"2024-09-12T16:54:10.624735+0000","last_fullsized":"2024-09-12T16:54:10.624735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.323930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":663,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.454242+0000","last_change":"2024-09-12T16:52:02.209870+0000","last_active":"2024-09-12T16:54:11.454242+0000","last_peered":"2024-09-12T16:54:11.454242+0000","last_clean":"2024-09-12T16:54:11.454242+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:54:11.454242+0000","last_undegraded":"2024-09-12T16:54:11.454242+0000","last_fullsized":"2024-09-12T16:54:11.454242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.846097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":512,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.677065+0000","last_change":"2024-09-12T16:52:04.200303+0000","last_active":"2024-09-12T16:55:12.677065+0000","last_peered":"2024-09-12T16:55:12.677065+0000","last_clean":"2024-09-12T16:55:12.677065+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:55:12.677065+0000","last_undegraded":"2024-09-12T16:55:12.677065+0000","last_fullsized":"2024-09-12T16:55:12.677065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:06.974814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.990445+0000","last_change":"2024-09-12T16:52:06.226319+0000","last_active":"2024-09-12T16:54:10.990445+0000","last_peered":"2024-09-12T16:54:10.990445+0000","last_clean":"2024-09-12T16:54:10.990445+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:54:10.990445+0000","last_undegraded":"2024-09-12T16:54:10.990445+0000","last_fullsized":"2024-09-12T16:54:10.990445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:19.104184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204872+0000","last_change":"2024-09-12T16:51:58.172403+0000","last_active":"2024-09-12T16:55:12.204872+0000","last_peered":"2024-09-12T16:55:12.204872+0000","last_clean":"2024-09-12T16:55:12.204872+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.204872+0000","last_undegraded":"2024-09-12T16:55:12.204872+0000","last_fullsized":"2024-09-12T16:55:12.204872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:17.725825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023537+0000","last_change":"2024-09-12T16:51:56.164438+0000","last_active":"2024-09-12T16:52:35.023537+0000","last_peered":"2024-09-12T16:52:35.023537+0000","last_clean":"2024-09-12T16:52:35.023537+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:52:35.023537+0000","last_undegraded":"2024-09-12T16:52:35.023537+0000","last_fullsized":"2024-09-12T16:52:35.023537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:34.280592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048178+0000","last_change":"2024-09-12T16:52:00.189183+0000","last_active":"2024-09-12T16:52:35.048178+0000","last_peered":"2024-09-12T16:52:35.048178+0000","last_clean":"2024-09-12T16:52:35.048178+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:52:35.048178+0000","last_undegraded":"2024-09-12T16:52:35.048178+0000","last_fullsized":"2024-09-12T16:52:35.048178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:50.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.000581+0000","last_change":"2024-09-12T16:52:02.179426+0000","last_active":"2024-09-12T16:54:09.000581+0000","last_peered":"2024-09-12T16:54:09.000581+0000","last_clean":"2024-09-12T16:54:09.000581+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:54:09.000581+0000","last_undegraded":"2024-09-12T16:54:09.000581+0000","last_fullsized":"2024-09-12T16:54:09.000581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:17.890537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017029+0000","last_change":"2024-09-12T16:52:04.212757+0000","last_active":"2024-09-12T16:52:35.017029+0000","last_peered":"2024-09-12T16:52:35.017029+0000","last_clean":"2024-09-12T16:52:35.017029+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:52:35.017029+0000","last_undegraded":"2024-09-12T16:52:35.017029+0000","last_fullsized":"2024-09-12T16:52:35.017029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.808954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.633190+0000","last_change":"2024-09-12T16:52:06.227780+0000","last_active":"2024-09-12T16:55:12.633190+0000","last_peered":"2024-09-12T16:55:12.633190+0000","last_clean":"2024-09-12T16:55:12.633190+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:55:12.633190+0000","last_undegraded":"2024-09-12T16:55:12.633190+0000","last_fullsized":"2024-09-12T16:55:12.633190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:23.705849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.222251+0000","last_change":"2024-09-12T16:51:58.173604+0000","last_active":"2024-09-12T16:55:12.222251+0000","last_peered":"2024-09-12T16:55:12.222251+0000","last_clean":"2024-09-12T16:55:12.222251+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:55:12.222251+0000","last_undegraded":"2024-09-12T16:55:12.222251+0000","last_fullsized":"2024-09-12T16:55:12.222251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:03.163064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:41.013055+0000","last_change":"2024-09-12T16:51:41.681357+0000","last_active":"2024-09-12T16:53:41.013055+0000","last_peered":"2024-09-12T16:53:41.013055+0000","last_clean":"2024-09-12T16:53:41.013055+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:53:41.013055+0000","last_undegraded":"2024-09-12T16:53:41.013055+0000","last_fullsized":"2024-09-12T16:53:41.013055+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_clean_scrub_stamp":"2024-09-12T16:51:40.347390+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:18.394696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039279+0000","last_change":"2024-09-12T16:51:48.400219+0000","last_active":"2024-09-12T16:52:35.039279+0000","last_peered":"2024-09-12T16:52:35.039279+0000","last_clean":"2024-09-12T16:52:35.039279+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:52:35.039279+0000","last_undegraded":"2024-09-12T16:52:35.039279+0000","last_fullsized":"2024-09-12T16:52:35.039279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.307866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033268+0000","last_change":"2024-09-12T16:51:56.168803+0000","last_active":"2024-09-12T16:52:35.033268+0000","last_peered":"2024-09-12T16:52:35.033268+0000","last_clean":"2024-09-12T16:52:35.033268+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:52:35.033268+0000","last_undegraded":"2024-09-12T16:52:35.033268+0000","last_fullsized":"2024-09-12T16:52:35.033268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.625123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044074+0000","last_change":"2024-09-12T16:52:00.165360+0000","last_active":"2024-09-12T16:52:35.044074+0000","last_peered":"2024-09-12T16:52:35.044074+0000","last_clean":"2024-09-12T16:52:35.044074+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:52:35.044074+0000","last_undegraded":"2024-09-12T16:52:35.044074+0000","last_fullsized":"2024-09-12T16:52:35.044074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:19.218108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.017912+0000","last_change":"2024-09-12T16:52:02.208795+0000","last_active":"2024-09-12T16:54:09.017912+0000","last_peered":"2024-09-12T16:54:09.017912+0000","last_clean":"2024-09-12T16:54:09.017912+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:54:09.017912+0000","last_undegraded":"2024-09-12T16:54:09.017912+0000","last_fullsized":"2024-09-12T16:54:09.017912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:33.220579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024326+0000","last_change":"2024-09-12T16:52:04.190511+0000","last_active":"2024-09-12T16:52:35.024326+0000","last_peered":"2024-09-12T16:52:35.024326+0000","last_clean":"2024-09-12T16:52:35.024326+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:52:35.024326+0000","last_undegraded":"2024-09-12T16:52:35.024326+0000","last_fullsized":"2024-09-12T16:52:35.024326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:34.575751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.588965+0000","last_change":"2024-09-12T16:52:06.216437+0000","last_active":"2024-09-12T16:55:12.588965+0000","last_peered":"2024-09-12T16:55:12.588965+0000","last_clean":"2024-09-12T16:55:12.588965+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:55:12.588965+0000","last_undegraded":"2024-09-12T16:55:12.588965+0000","last_fullsized":"2024-09-12T16:55:12.588965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:11.640533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.560070+0000","last_change":"2024-09-12T16:51:58.165681+0000","last_active":"2024-09-12T16:55:12.560070+0000","last_peered":"2024-09-12T16:55:12.560070+0000","last_clean":"2024-09-12T16:55:12.560070+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:55:12.560070+0000","last_undegraded":"2024-09-12T16:55:12.560070+0000","last_fullsized":"2024-09-12T16:55:12.560070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.848528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022287+0000","last_change":"2024-09-12T16:51:48.399639+0000","last_active":"2024-09-12T16:52:35.022287+0000","last_peered":"2024-09-12T16:52:35.022287+0000","last_clean":"2024-09-12T16:52:35.022287+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:52:35.022287+0000","last_undegraded":"2024-09-12T16:52:35.022287+0000","last_fullsized":"2024-09-12T16:52:35.022287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.533236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.846991+0000","last_change":"2024-09-12T16:51:56.170610+0000","last_active":"2024-09-12T16:55:11.846991+0000","last_peered":"2024-09-12T16:55:11.846991+0000","last_clean":"2024-09-12T16:55:11.846991+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:11.846991+0000","last_undegraded":"2024-09-12T16:55:11.846991+0000","last_fullsized":"2024-09-12T16:55:11.846991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:37.340264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043040+0000","last_change":"2024-09-12T16:52:35.040769+0000","last_active":"2024-09-12T16:52:35.043040+0000","last_peered":"2024-09-12T16:52:35.043040+0000","last_clean":"2024-09-12T16:52:35.043040+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:52:35.043040+0000","last_undegraded":"2024-09-12T16:52:35.043040+0000","last_fullsized":"2024-09-12T16:52:35.043040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'275","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419542+0000","last_change":"2024-09-12T16:52:02.206307+0000","last_active":"2024-09-12T16:55:10.419542+0000","last_peered":"2024-09-12T16:55:10.419542+0000","last_clean":"2024-09-12T16:55:10.419542+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:55:10.419542+0000","last_undegraded":"2024-09-12T16:55:10.419542+0000","last_fullsized":"2024-09-12T16:55:10.419542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:35.817009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":363,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046840+0000","last_change":"2024-09-12T16:52:04.209015+0000","last_active":"2024-09-12T16:52:35.046840+0000","last_peered":"2024-09-12T16:52:35.046840+0000","last_clean":"2024-09-12T16:52:35.046840+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:52:35.046840+0000","last_undegraded":"2024-09-12T16:52:35.046840+0000","last_fullsized":"2024-09-12T16:52:35.046840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.156119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.766970+0000","last_change":"2024-09-12T16:52:06.227599+0000","last_active":"2024-09-12T16:53:25.766970+0000","last_peered":"2024-09-12T16:53:25.766970+0000","last_clean":"2024-09-12T16:53:25.766970+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:53:25.766970+0000","last_undegraded":"2024-09-12T16:53:25.766970+0000","last_fullsized":"2024-09-12T16:53:25.766970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:02.281631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508885+0000","last_change":"2024-09-12T16:51:58.158281+0000","last_active":"2024-09-12T16:55:12.508885+0000","last_peered":"2024-09-12T16:55:12.508885+0000","last_clean":"2024-09-12T16:55:12.508885+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:55:12.508885+0000","last_undegraded":"2024-09-12T16:55:12.508885+0000","last_fullsized":"2024-09-12T16:55:12.508885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:35.307006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.018288+0000","last_change":"2024-09-12T16:51:48.565817+0000","last_active":"2024-09-12T16:52:35.018288+0000","last_peered":"2024-09-12T16:52:35.018288+0000","last_clean":"2024-09-12T16:52:35.018288+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:52:35.018288+0000","last_undegraded":"2024-09-12T16:52:35.018288+0000","last_fullsized":"2024-09-12T16:52:35.018288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:05.344141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021089+0000","last_change":"2024-09-12T16:51:56.167557+0000","last_active":"2024-09-12T16:52:35.021089+0000","last_peered":"2024-09-12T16:52:35.021089+0000","last_clean":"2024-09-12T16:52:35.021089+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:52:35.021089+0000","last_undegraded":"2024-09-12T16:52:35.021089+0000","last_fullsized":"2024-09-12T16:52:35.021089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.057420+0000","last_change":"2024-09-12T16:52:35.055925+0000","last_active":"2024-09-12T16:52:35.057420+0000","last_peered":"2024-09-12T16:52:35.057420+0000","last_clean":"2024-09-12T16:52:35.057420+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:52:35.057420+0000","last_undegraded":"2024-09-12T16:52:35.057420+0000","last_fullsized":"2024-09-12T16:52:35.057420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:39.278393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419519+0000","last_change":"2024-09-12T16:52:02.183372+0000","last_active":"2024-09-12T16:55:10.419519+0000","last_peered":"2024-09-12T16:55:10.419519+0000","last_clean":"2024-09-12T16:55:10.419519+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:55:10.419519+0000","last_undegraded":"2024-09-12T16:55:10.419519+0000","last_fullsized":"2024-09-12T16:55:10.419519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:17.150188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023454+0000","last_change":"2024-09-12T16:52:04.189985+0000","last_active":"2024-09-12T16:52:35.023454+0000","last_peered":"2024-09-12T16:52:35.023454+0000","last_clean":"2024-09-12T16:52:35.023454+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:52:35.023454+0000","last_undegraded":"2024-09-12T16:52:35.023454+0000","last_fullsized":"2024-09-12T16:52:35.023454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:57.543211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032944+0000","last_change":"2024-09-12T16:52:06.229164+0000","last_active":"2024-09-12T16:52:35.032944+0000","last_peered":"2024-09-12T16:52:35.032944+0000","last_clean":"2024-09-12T16:52:35.032944+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:52:35.032944+0000","last_undegraded":"2024-09-12T16:52:35.032944+0000","last_fullsized":"2024-09-12T16:52:35.032944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:53.711707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.430239+0000","last_change":"2024-09-12T16:51:58.152002+0000","last_active":"2024-09-12T16:54:11.430239+0000","last_peered":"2024-09-12T16:54:11.430239+0000","last_clean":"2024-09-12T16:54:11.430239+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:54:11.430239+0000","last_undegraded":"2024-09-12T16:54:11.430239+0000","last_fullsized":"2024-09-12T16:54:11.430239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:09.830533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032753+0000","last_change":"2024-09-12T16:51:48.400929+0000","last_active":"2024-09-12T16:52:35.032753+0000","last_peered":"2024-09-12T16:52:35.032753+0000","last_clean":"2024-09-12T16:52:35.032753+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:52:35.032753+0000","last_undegraded":"2024-09-12T16:52:35.032753+0000","last_fullsized":"2024-09-12T16:52:35.032753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:21.707361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017052+0000","last_change":"2024-09-12T16:51:56.148951+0000","last_active":"2024-09-12T16:52:35.017052+0000","last_peered":"2024-09-12T16:52:35.017052+0000","last_clean":"2024-09-12T16:52:35.017052+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:52:35.017052+0000","last_undegraded":"2024-09-12T16:52:35.017052+0000","last_fullsized":"2024-09-12T16:52:35.017052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:03.940011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024125+0000","last_change":"2024-09-12T16:52:00.189223+0000","last_active":"2024-09-12T16:52:35.024125+0000","last_peered":"2024-09-12T16:52:35.024125+0000","last_clean":"2024-09-12T16:52:35.024125+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:52:35.024125+0000","last_undegraded":"2024-09-12T16:52:35.024125+0000","last_fullsized":"2024-09-12T16:52:35.024125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:19.787530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.470351+0000","last_change":"2024-09-12T16:52:02.207152+0000","last_active":"2024-09-12T16:55:11.470351+0000","last_peered":"2024-09-12T16:55:11.470351+0000","last_clean":"2024-09-12T16:55:11.470351+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:55:11.470351+0000","last_undegraded":"2024-09-12T16:55:11.470351+0000","last_fullsized":"2024-09-12T16:55:11.470351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:18.373274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049115+0000","last_change":"2024-09-12T16:52:04.214830+0000","last_active":"2024-09-12T16:52:35.049115+0000","last_peered":"2024-09-12T16:52:35.049115+0000","last_clean":"2024-09-12T16:52:35.049115+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:52:35.049115+0000","last_undegraded":"2024-09-12T16:52:35.049115+0000","last_fullsized":"2024-09-12T16:52:35.049115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:43.821701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.923598+0000","last_change":"2024-09-12T16:52:06.229880+0000","last_active":"2024-09-12T16:54:10.923598+0000","last_peered":"2024-09-12T16:54:10.923598+0000","last_clean":"2024-09-12T16:54:10.923598+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:54:10.923598+0000","last_undegraded":"2024-09-12T16:54:10.923598+0000","last_fullsized":"2024-09-12T16:54:10.923598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:22.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.035350+0000","last_change":"2024-09-12T16:51:58.173047+0000","last_active":"2024-09-12T16:52:35.035350+0000","last_peered":"2024-09-12T16:52:35.035350+0000","last_clean":"2024-09-12T16:52:35.035350+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:52:35.035350+0000","last_undegraded":"2024-09-12T16:52:35.035350+0000","last_fullsized":"2024-09-12T16:52:35.035350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.635466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.379858+0000","last_change":"2024-09-12T16:51:56.147322+0000","last_active":"2024-09-12T16:54:11.379858+0000","last_peered":"2024-09-12T16:54:11.379858+0000","last_clean":"2024-09-12T16:54:11.379858+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:54:11.379858+0000","last_undegraded":"2024-09-12T16:54:11.379858+0000","last_fullsized":"2024-09-12T16:54:11.379858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:37.340264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023414+0000","last_change":"2024-09-12T16:51:48.406183+0000","last_active":"2024-09-12T16:52:35.023414+0000","last_peered":"2024-09-12T16:52:35.023414+0000","last_clean":"2024-09-12T16:52:35.023414+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:52:35.023414+0000","last_undegraded":"2024-09-12T16:52:35.023414+0000","last_fullsized":"2024-09-12T16:52:35.023414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:06.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'5","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.551692+0000","last_change":"2024-09-12T16:52:00.160190+0000","last_active":"2024-09-12T16:55:43.551692+0000","last_peered":"2024-09-12T16:55:43.551692+0000","last_clean":"2024-09-12T16:55:43.551692+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:55:43.551692+0000","last_undegraded":"2024-09-12T16:55:43.551692+0000","last_fullsized":"2024-09-12T16:55:43.551692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:37.197687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.886587+0000","last_change":"2024-09-12T16:52:02.175160+0000","last_active":"2024-09-12T16:55:43.886587+0000","last_peered":"2024-09-12T16:55:43.886587+0000","last_clean":"2024-09-12T16:55:43.886587+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:55:43.886587+0000","last_undegraded":"2024-09-12T16:55:43.886587+0000","last_fullsized":"2024-09-12T16:55:43.886587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.322350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015201+0000","last_change":"2024-09-12T16:52:04.202004+0000","last_active":"2024-09-12T16:52:35.015201+0000","last_peered":"2024-09-12T16:52:35.015201+0000","last_clean":"2024-09-12T16:52:35.015201+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:52:35.015201+0000","last_undegraded":"2024-09-12T16:52:35.015201+0000","last_fullsized":"2024-09-12T16:52:35.015201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:53.277560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.293385+0000","last_change":"2024-09-12T16:52:06.230268+0000","last_active":"2024-09-12T16:54:11.293385+0000","last_peered":"2024-09-12T16:54:11.293385+0000","last_clean":"2024-09-12T16:54:11.293385+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:54:11.293385+0000","last_undegraded":"2024-09-12T16:54:11.293385+0000","last_fullsized":"2024-09-12T16:54:11.293385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:11.635227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204797+0000","last_change":"2024-09-12T16:51:58.171396+0000","last_active":"2024-09-12T16:55:12.204797+0000","last_peered":"2024-09-12T16:55:12.204797+0000","last_clean":"2024-09-12T16:55:12.204797+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:55:12.204797+0000","last_undegraded":"2024-09-12T16:55:12.204797+0000","last_fullsized":"2024-09-12T16:55:12.204797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:39.687440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.392759+0000","last_change":"2024-09-12T16:51:56.161919+0000","last_active":"2024-09-12T16:55:12.392759+0000","last_peered":"2024-09-12T16:55:12.392759+0000","last_clean":"2024-09-12T16:55:12.392759+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:12.392759+0000","last_undegraded":"2024-09-12T16:55:12.392759+0000","last_fullsized":"2024-09-12T16:55:12.392759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:31.068717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047661+0000","last_change":"2024-09-12T16:51:48.399706+0000","last_active":"2024-09-12T16:52:35.047661+0000","last_peered":"2024-09-12T16:52:35.047661+0000","last_clean":"2024-09-12T16:52:35.047661+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:52:35.047661+0000","last_undegraded":"2024-09-12T16:52:35.047661+0000","last_fullsized":"2024-09-12T16:52:35.047661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.814087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031695+0000","last_change":"2024-09-12T16:52:00.173390+0000","last_active":"2024-09-12T16:52:35.031695+0000","last_peered":"2024-09-12T16:52:35.031695+0000","last_clean":"2024-09-12T16:52:35.031695+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:52:35.031695+0000","last_undegraded":"2024-09-12T16:52:35.031695+0000","last_fullsized":"2024-09-12T16:52:35.031695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:45.833748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027310+0000","last_change":"2024-09-12T16:52:02.194130+0000","last_active":"2024-09-12T16:52:35.027310+0000","last_peered":"2024-09-12T16:52:35.027310+0000","last_clean":"2024-09-12T16:52:35.027310+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:52:35.027310+0000","last_undegraded":"2024-09-12T16:52:35.027310+0000","last_fullsized":"2024-09-12T16:52:35.027310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:27.141664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419252+0000","last_change":"2024-09-12T16:52:04.193182+0000","last_active":"2024-09-12T16:55:10.419252+0000","last_peered":"2024-09-12T16:55:10.419252+0000","last_clean":"2024-09-12T16:55:10.419252+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:55:10.419252+0000","last_undegraded":"2024-09-12T16:55:10.419252+0000","last_fullsized":"2024-09-12T16:55:10.419252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:36.765558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047985+0000","last_change":"2024-09-12T16:52:06.215010+0000","last_active":"2024-09-12T16:52:35.047985+0000","last_peered":"2024-09-12T16:52:35.047985+0000","last_clean":"2024-09-12T16:52:35.047985+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:52:35.047985+0000","last_undegraded":"2024-09-12T16:52:35.047985+0000","last_fullsized":"2024-09-12T16:52:35.047985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:54.128906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.112528+0000","last_change":"2024-09-12T16:52:35.039684+0000","last_active":"2024-09-12T16:53:26.112528+0000","last_peered":"2024-09-12T16:53:26.112528+0000","last_clean":"2024-09-12T16:53:26.112528+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:53:26.112528+0000","last_undegraded":"2024-09-12T16:53:26.112528+0000","last_fullsized":"2024-09-12T16:53:26.112528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.545874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.050083+0000","last_change":"2024-09-12T16:51:56.169511+0000","last_active":"2024-09-12T16:52:35.050083+0000","last_peered":"2024-09-12T16:52:35.050083+0000","last_clean":"2024-09-12T16:52:35.050083+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:52:35.050083+0000","last_undegraded":"2024-09-12T16:52:35.050083+0000","last_fullsized":"2024-09-12T16:52:35.050083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:37.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025906+0000","last_change":"2024-09-12T16:51:48.405954+0000","last_active":"2024-09-12T16:52:35.025906+0000","last_peered":"2024-09-12T16:52:35.025906+0000","last_clean":"2024-09-12T16:52:35.025906+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:52:35.025906+0000","last_undegraded":"2024-09-12T16:52:35.025906+0000","last_fullsized":"2024-09-12T16:52:35.025906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022871+0000","last_change":"2024-09-12T16:52:00.171577+0000","last_active":"2024-09-12T16:52:35.022871+0000","last_peered":"2024-09-12T16:52:35.022871+0000","last_clean":"2024-09-12T16:52:35.022871+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:52:35.022871+0000","last_undegraded":"2024-09-12T16:52:35.022871+0000","last_fullsized":"2024-09-12T16:52:35.022871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.429060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034668+0000","last_change":"2024-09-12T16:52:02.213748+0000","last_active":"2024-09-12T16:52:35.034668+0000","last_peered":"2024-09-12T16:52:35.034668+0000","last_clean":"2024-09-12T16:52:35.034668+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:52:35.034668+0000","last_undegraded":"2024-09-12T16:52:35.034668+0000","last_fullsized":"2024-09-12T16:52:35.034668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:45.880129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.584131+0000","last_change":"2024-09-12T16:52:04.213686+0000","last_active":"2024-09-12T16:55:43.584131+0000","last_peered":"2024-09-12T16:55:43.584131+0000","last_clean":"2024-09-12T16:55:43.584131+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:55:43.584131+0000","last_undegraded":"2024-09-12T16:55:43.584131+0000","last_fullsized":"2024-09-12T16:55:43.584131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:03.491921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.104813+0000","last_change":"2024-09-12T16:52:06.223608+0000","last_active":"2024-09-12T16:55:12.104813+0000","last_peered":"2024-09-12T16:55:12.104813+0000","last_clean":"2024-09-12T16:55:12.104813+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:55:12.104813+0000","last_undegraded":"2024-09-12T16:55:12.104813+0000","last_fullsized":"2024-09-12T16:55:12.104813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:45.915952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405963+0000","last_change":"2024-09-12T16:51:58.169710+0000","last_active":"2024-09-12T16:55:12.405963+0000","last_peered":"2024-09-12T16:55:12.405963+0000","last_clean":"2024-09-12T16:55:12.405963+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:55:12.405963+0000","last_undegraded":"2024-09-12T16:55:12.405963+0000","last_fullsized":"2024-09-12T16:55:12.405963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:19.057567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.384261+0000","last_change":"2024-09-12T16:51:56.158532+0000","last_active":"2024-09-12T16:55:12.384261+0000","last_peered":"2024-09-12T16:55:12.384261+0000","last_clean":"2024-09-12T16:55:12.384261+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:12.384261+0000","last_undegraded":"2024-09-12T16:55:12.384261+0000","last_fullsized":"2024-09-12T16:55:12.384261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:54.713058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049659+0000","last_change":"2024-09-12T16:51:48.400908+0000","last_active":"2024-09-12T16:52:35.049659+0000","last_peered":"2024-09-12T16:52:35.049659+0000","last_clean":"2024-09-12T16:52:35.049659+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:52:35.049659+0000","last_undegraded":"2024-09-12T16:52:35.049659+0000","last_fullsized":"2024-09-12T16:52:35.049659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.059679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021940+0000","last_change":"2024-09-12T16:52:00.177682+0000","last_active":"2024-09-12T16:52:35.021940+0000","last_peered":"2024-09-12T16:52:35.021940+0000","last_clean":"2024-09-12T16:52:35.021940+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:52:35.021940+0000","last_undegraded":"2024-09-12T16:52:35.021940+0000","last_fullsized":"2024-09-12T16:52:35.021940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:07.415377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.997319+0000","last_change":"2024-09-12T16:52:02.187458+0000","last_active":"2024-09-12T16:54:08.997319+0000","last_peered":"2024-09-12T16:54:08.997319+0000","last_clean":"2024-09-12T16:54:08.997319+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:54:08.997319+0000","last_undegraded":"2024-09-12T16:54:08.997319+0000","last_fullsized":"2024-09-12T16:54:08.997319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:39.799750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021656+0000","last_change":"2024-09-12T16:52:04.205957+0000","last_active":"2024-09-12T16:52:35.021656+0000","last_peered":"2024-09-12T16:52:35.021656+0000","last_clean":"2024-09-12T16:52:35.021656+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:52:35.021656+0000","last_undegraded":"2024-09-12T16:52:35.021656+0000","last_fullsized":"2024-09-12T16:52:35.021656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:09.625513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027967+0000","last_change":"2024-09-12T16:52:06.226131+0000","last_active":"2024-09-12T16:52:35.027967+0000","last_peered":"2024-09-12T16:52:35.027967+0000","last_clean":"2024-09-12T16:52:35.027967+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:52:35.027967+0000","last_undegraded":"2024-09-12T16:52:35.027967+0000","last_fullsized":"2024-09-12T16:52:35.027967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:27.891759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.467476+0000","last_change":"2024-09-12T16:52:06.233870+0000","last_active":"2024-09-12T16:55:12.467476+0000","last_peered":"2024-09-12T16:55:12.467476+0000","last_clean":"2024-09-12T16:55:12.467476+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:55:12.467476+0000","last_undegraded":"2024-09-12T16:55:12.467476+0000","last_fullsized":"2024-09-12T16:55:12.467476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:37.518504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.761344+0000","last_change":"2024-09-12T16:51:58.170146+0000","last_active":"2024-09-12T16:53:25.761344+0000","last_peered":"2024-09-12T16:53:25.761344+0000","last_clean":"2024-09-12T16:53:25.761344+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:53:25.761344+0000","last_undegraded":"2024-09-12T16:53:25.761344+0000","last_fullsized":"2024-09-12T16:53:25.761344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:48.025016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.357950+0000","last_change":"2024-09-12T16:51:56.163750+0000","last_active":"2024-09-12T16:55:12.357950+0000","last_peered":"2024-09-12T16:55:12.357950+0000","last_clean":"2024-09-12T16:55:12.357950+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:55:12.357950+0000","last_undegraded":"2024-09-12T16:55:12.357950+0000","last_fullsized":"2024-09-12T16:55:12.357950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:47.582510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032193+0000","last_change":"2024-09-12T16:52:00.176219+0000","last_active":"2024-09-12T16:52:35.032193+0000","last_peered":"2024-09-12T16:52:35.032193+0000","last_clean":"2024-09-12T16:52:35.032193+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:52:35.032193+0000","last_undegraded":"2024-09-12T16:52:35.032193+0000","last_fullsized":"2024-09-12T16:52:35.032193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:21.686238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.006359+0000","last_change":"2024-09-12T16:52:02.194377+0000","last_active":"2024-09-12T16:54:09.006359+0000","last_peered":"2024-09-12T16:54:09.006359+0000","last_clean":"2024-09-12T16:54:09.006359+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:54:09.006359+0000","last_undegraded":"2024-09-12T16:54:09.006359+0000","last_fullsized":"2024-09-12T16:54:09.006359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:35.662292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024735+0000","last_change":"2024-09-12T16:52:04.215450+0000","last_active":"2024-09-12T16:52:35.024735+0000","last_peered":"2024-09-12T16:52:35.024735+0000","last_clean":"2024-09-12T16:52:35.024735+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:52:35.024735+0000","last_undegraded":"2024-09-12T16:52:35.024735+0000","last_fullsized":"2024-09-12T16:52:35.024735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.120052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.497182+0000","last_change":"2024-09-12T16:52:06.212418+0000","last_active":"2024-09-12T16:55:12.497182+0000","last_peered":"2024-09-12T16:55:12.497182+0000","last_clean":"2024-09-12T16:55:12.497182+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:55:12.497182+0000","last_undegraded":"2024-09-12T16:55:12.497182+0000","last_fullsized":"2024-09-12T16:55:12.497182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:57.649089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'27","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.424657+0000","last_change":"2024-09-12T16:51:58.172876+0000","last_active":"2024-09-12T16:55:12.424657+0000","last_peered":"2024-09-12T16:55:12.424657+0000","last_clean":"2024-09-12T16:55:12.424657+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.424657+0000","last_undegraded":"2024-09-12T16:55:12.424657+0000","last_fullsized":"2024-09-12T16:55:12.424657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:16.676112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020927+0000","last_change":"2024-09-12T16:51:56.152311+0000","last_active":"2024-09-12T16:52:35.020927+0000","last_peered":"2024-09-12T16:52:35.020927+0000","last_clean":"2024-09-12T16:52:35.020927+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:52:35.020927+0000","last_undegraded":"2024-09-12T16:52:35.020927+0000","last_fullsized":"2024-09-12T16:52:35.020927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:31.068717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034344+0000","last_change":"2024-09-12T16:52:00.183813+0000","last_active":"2024-09-12T16:52:35.034344+0000","last_peered":"2024-09-12T16:52:35.034344+0000","last_clean":"2024-09-12T16:52:35.034344+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:52:35.034344+0000","last_undegraded":"2024-09-12T16:52:35.034344+0000","last_fullsized":"2024-09-12T16:52:35.034344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.454514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.479969+0000","last_change":"2024-09-12T16:52:02.184368+0000","last_active":"2024-09-12T16:55:11.479969+0000","last_peered":"2024-09-12T16:55:11.479969+0000","last_clean":"2024-09-12T16:55:11.479969+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:55:11.479969+0000","last_undegraded":"2024-09-12T16:55:11.479969+0000","last_fullsized":"2024-09-12T16:55:11.479969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:55.116071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017383+0000","last_change":"2024-09-12T16:52:04.216686+0000","last_active":"2024-09-12T16:52:35.017383+0000","last_peered":"2024-09-12T16:52:35.017383+0000","last_clean":"2024-09-12T16:52:35.017383+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:52:35.017383+0000","last_undegraded":"2024-09-12T16:52:35.017383+0000","last_fullsized":"2024-09-12T16:52:35.017383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.665774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022183+0000","last_change":"2024-09-12T16:52:06.225236+0000","last_active":"2024-09-12T16:52:35.022183+0000","last_peered":"2024-09-12T16:52:35.022183+0000","last_clean":"2024-09-12T16:52:35.022183+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:52:35.022183+0000","last_undegraded":"2024-09-12T16:52:35.022183+0000","last_fullsized":"2024-09-12T16:52:35.022183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.292498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559427+0000","last_change":"2024-09-12T16:51:58.171912+0000","last_active":"2024-09-12T16:55:12.559427+0000","last_peered":"2024-09-12T16:55:12.559427+0000","last_clean":"2024-09-12T16:55:12.559427+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:55:12.559427+0000","last_undegraded":"2024-09-12T16:55:12.559427+0000","last_fullsized":"2024-09-12T16:55:12.559427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:33.118187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:25.018159+0000","last_change":"2024-09-12T16:51:56.153340+0000","last_active":"2024-09-12T16:54:25.018159+0000","last_peered":"2024-09-12T16:54:25.018159+0000","last_clean":"2024-09-12T16:54:25.018159+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:54:25.018159+0000","last_undegraded":"2024-09-12T16:54:25.018159+0000","last_fullsized":"2024-09-12T16:54:25.018159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:43.389321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017569+0000","last_change":"2024-09-12T16:52:00.163603+0000","last_active":"2024-09-12T16:52:35.017569+0000","last_peered":"2024-09-12T16:52:35.017569+0000","last_clean":"2024-09-12T16:52:35.017569+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:52:35.017569+0000","last_undegraded":"2024-09-12T16:52:35.017569+0000","last_fullsized":"2024-09-12T16:52:35.017569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:17.118266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.868200+0000","last_change":"2024-09-12T16:52:02.180694+0000","last_active":"2024-09-12T16:55:43.868200+0000","last_peered":"2024-09-12T16:55:43.868200+0000","last_clean":"2024-09-12T16:55:43.868200+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:55:43.868200+0000","last_undegraded":"2024-09-12T16:55:43.868200+0000","last_fullsized":"2024-09-12T16:55:43.868200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.028291+0000","last_change":"2024-09-12T16:52:04.200667+0000","last_active":"2024-09-12T16:52:35.028291+0000","last_peered":"2024-09-12T16:52:35.028291+0000","last_clean":"2024-09-12T16:52:35.028291+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:52:35.028291+0000","last_undegraded":"2024-09-12T16:52:35.028291+0000","last_fullsized":"2024-09-12T16:52:35.028291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.487906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039574+0000","last_change":"2024-09-12T16:52:06.236861+0000","last_active":"2024-09-12T16:52:35.039574+0000","last_peered":"2024-09-12T16:52:35.039574+0000","last_clean":"2024-09-12T16:52:35.039574+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:52:35.039574+0000","last_undegraded":"2024-09-12T16:52:35.039574+0000","last_fullsized":"2024-09-12T16:52:35.039574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:29.568087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114298+0000","last_change":"2024-09-12T16:51:58.168169+0000","last_active":"2024-09-12T16:53:26.114298+0000","last_peered":"2024-09-12T16:53:26.114298+0000","last_clean":"2024-09-12T16:53:26.114298+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:53:26.114298+0000","last_undegraded":"2024-09-12T16:53:26.114298+0000","last_fullsized":"2024-09-12T16:53:26.114298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:56.585276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046409+0000","last_change":"2024-09-12T16:51:56.158362+0000","last_active":"2024-09-12T16:52:35.046409+0000","last_peered":"2024-09-12T16:52:35.046409+0000","last_clean":"2024-09-12T16:52:35.046409+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:52:35.046409+0000","last_undegraded":"2024-09-12T16:52:35.046409+0000","last_fullsized":"2024-09-12T16:52:35.046409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:58.692768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022824+0000","last_change":"2024-09-12T16:52:00.181358+0000","last_active":"2024-09-12T16:52:35.022824+0000","last_peered":"2024-09-12T16:52:35.022824+0000","last_clean":"2024-09-12T16:52:35.022824+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:52:35.022824+0000","last_undegraded":"2024-09-12T16:52:35.022824+0000","last_fullsized":"2024-09-12T16:52:35.022824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:32.384807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.984883+0000","last_change":"2024-09-12T16:52:02.181716+0000","last_active":"2024-09-12T16:54:08.984883+0000","last_peered":"2024-09-12T16:54:08.984883+0000","last_clean":"2024-09-12T16:54:08.984883+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:54:08.984883+0000","last_undegraded":"2024-09-12T16:54:08.984883+0000","last_fullsized":"2024-09-12T16:54:08.984883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.238474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016494+0000","last_change":"2024-09-12T16:52:04.211716+0000","last_active":"2024-09-12T16:52:35.016494+0000","last_peered":"2024-09-12T16:52:35.016494+0000","last_clean":"2024-09-12T16:52:35.016494+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:52:35.016494+0000","last_undegraded":"2024-09-12T16:52:35.016494+0000","last_fullsized":"2024-09-12T16:52:35.016494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.708673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406316+0000","last_change":"2024-09-12T16:51:58.158927+0000","last_active":"2024-09-12T16:55:12.406316+0000","last_peered":"2024-09-12T16:55:12.406316+0000","last_clean":"2024-09-12T16:55:12.406316+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:55:12.406316+0000","last_undegraded":"2024-09-12T16:55:12.406316+0000","last_fullsized":"2024-09-12T16:55:12.406316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:52.129370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022527+0000","last_change":"2024-09-12T16:51:56.157350+0000","last_active":"2024-09-12T16:52:35.022527+0000","last_peered":"2024-09-12T16:52:35.022527+0000","last_clean":"2024-09-12T16:52:35.022527+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:52:35.022527+0000","last_undegraded":"2024-09-12T16:52:35.022527+0000","last_fullsized":"2024-09-12T16:52:35.022527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:35.055723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025762+0000","last_change":"2024-09-12T16:52:00.159525+0000","last_active":"2024-09-12T16:52:35.025762+0000","last_peered":"2024-09-12T16:52:35.025762+0000","last_clean":"2024-09-12T16:52:35.025762+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:52:35.025762+0000","last_undegraded":"2024-09-12T16:52:35.025762+0000","last_fullsized":"2024-09-12T16:52:35.025762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:04.399510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.835655+0000","last_change":"2024-09-12T16:52:02.184114+0000","last_active":"2024-09-12T16:55:43.835655+0000","last_peered":"2024-09-12T16:55:43.835655+0000","last_clean":"2024-09-12T16:55:43.835655+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:55:43.835655+0000","last_undegraded":"2024-09-12T16:55:43.835655+0000","last_fullsized":"2024-09-12T16:55:43.835655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:51.260998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016853+0000","last_change":"2024-09-12T16:52:04.212854+0000","last_active":"2024-09-12T16:52:35.016853+0000","last_peered":"2024-09-12T16:52:35.016853+0000","last_clean":"2024-09-12T16:52:35.016853+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:52:35.016853+0000","last_undegraded":"2024-09-12T16:52:35.016853+0000","last_fullsized":"2024-09-12T16:52:35.016853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:31.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.284031+0000","last_change":"2024-09-12T16:52:06.224912+0000","last_active":"2024-09-12T16:54:11.284031+0000","last_peered":"2024-09-12T16:54:11.284031+0000","last_clean":"2024-09-12T16:54:11.284031+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:54:11.284031+0000","last_undegraded":"2024-09-12T16:54:11.284031+0000","last_fullsized":"2024-09-12T16:54:11.284031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:53.469591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762074+0000","last_change":"2024-09-12T16:51:58.157261+0000","last_active":"2024-09-12T16:53:25.762074+0000","last_peered":"2024-09-12T16:53:25.762074+0000","last_clean":"2024-09-12T16:53:25.762074+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:53:25.762074+0000","last_undegraded":"2024-09-12T16:53:25.762074+0000","last_fullsized":"2024-09-12T16:53:25.762074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:49.731949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.546723+0000","last_change":"2024-09-12T16:51:56.145141+0000","last_active":"2024-09-12T16:55:12.546723+0000","last_peered":"2024-09-12T16:55:12.546723+0000","last_clean":"2024-09-12T16:55:12.546723+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:12.546723+0000","last_undegraded":"2024-09-12T16:55:12.546723+0000","last_fullsized":"2024-09-12T16:55:12.546723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:56.176046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026467+0000","last_change":"2024-09-12T16:52:00.164196+0000","last_active":"2024-09-12T16:52:35.026467+0000","last_peered":"2024-09-12T16:52:35.026467+0000","last_clean":"2024-09-12T16:52:35.026467+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:52:35.026467+0000","last_undegraded":"2024-09-12T16:52:35.026467+0000","last_fullsized":"2024-09-12T16:52:35.026467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:24.903329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.986087+0000","last_change":"2024-09-12T16:52:02.212469+0000","last_active":"2024-09-12T16:54:08.986087+0000","last_peered":"2024-09-12T16:54:08.986087+0000","last_clean":"2024-09-12T16:54:08.986087+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:54:08.986087+0000","last_undegraded":"2024-09-12T16:54:08.986087+0000","last_fullsized":"2024-09-12T16:54:08.986087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043455+0000","last_change":"2024-09-12T16:52:04.211092+0000","last_active":"2024-09-12T16:52:35.043455+0000","last_peered":"2024-09-12T16:52:35.043455+0000","last_clean":"2024-09-12T16:52:35.043455+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:52:35.043455+0000","last_undegraded":"2024-09-12T16:52:35.043455+0000","last_fullsized":"2024-09-12T16:52:35.043455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:37.948154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031153+0000","last_change":"2024-09-12T16:52:06.224892+0000","last_active":"2024-09-12T16:52:35.031153+0000","last_peered":"2024-09-12T16:52:35.031153+0000","last_clean":"2024-09-12T16:52:35.031153+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:52:35.031153+0000","last_undegraded":"2024-09-12T16:52:35.031153+0000","last_fullsized":"2024-09-12T16:52:35.031153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:23.862554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406528+0000","last_change":"2024-09-12T16:51:58.175046+0000","last_active":"2024-09-12T16:55:12.406528+0000","last_peered":"2024-09-12T16:55:12.406528+0000","last_clean":"2024-09-12T16:55:12.406528+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:55:12.406528+0000","last_undegraded":"2024-09-12T16:55:12.406528+0000","last_fullsized":"2024-09-12T16:55:12.406528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:23.110954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032546+0000","last_change":"2024-09-12T16:51:56.166124+0000","last_active":"2024-09-12T16:52:35.032546+0000","last_peered":"2024-09-12T16:52:35.032546+0000","last_clean":"2024-09-12T16:52:35.032546+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:52:35.032546+0000","last_undegraded":"2024-09-12T16:52:35.032546+0000","last_fullsized":"2024-09-12T16:52:35.032546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:37.152636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019381+0000","last_change":"2024-09-12T16:52:00.168294+0000","last_active":"2024-09-12T16:52:35.019381+0000","last_peered":"2024-09-12T16:52:35.019381+0000","last_clean":"2024-09-12T16:52:35.019381+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:52:35.019381+0000","last_undegraded":"2024-09-12T16:52:35.019381+0000","last_fullsized":"2024-09-12T16:52:35.019381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:51.062344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.717682+0000","last_change":"2024-09-12T16:52:02.196172+0000","last_active":"2024-09-12T16:55:43.717682+0000","last_peered":"2024-09-12T16:55:43.717682+0000","last_clean":"2024-09-12T16:55:43.717682+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:55:43.717682+0000","last_undegraded":"2024-09-12T16:55:43.717682+0000","last_fullsized":"2024-09-12T16:55:43.717682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:02.649211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024118+0000","last_change":"2024-09-12T16:52:04.215112+0000","last_active":"2024-09-12T16:52:35.024118+0000","last_peered":"2024-09-12T16:52:35.024118+0000","last_clean":"2024-09-12T16:52:35.024118+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:52:35.024118+0000","last_undegraded":"2024-09-12T16:52:35.024118+0000","last_fullsized":"2024-09-12T16:52:35.024118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:24.385068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.437862+0000","last_change":"2024-09-12T16:52:06.234025+0000","last_active":"2024-09-12T16:54:11.437862+0000","last_peered":"2024-09-12T16:54:11.437862+0000","last_clean":"2024-09-12T16:54:11.437862+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:54:11.437862+0000","last_undegraded":"2024-09-12T16:54:11.437862+0000","last_fullsized":"2024-09-12T16:54:11.437862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:23.554247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491550+0000","last_change":"2024-09-12T16:51:58.153302+0000","last_active":"2024-09-12T16:55:12.491550+0000","last_peered":"2024-09-12T16:55:12.491550+0000","last_clean":"2024-09-12T16:55:12.491550+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:55:12.491550+0000","last_undegraded":"2024-09-12T16:55:12.491550+0000","last_fullsized":"2024-09-12T16:55:12.491550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:40.425831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.374105+0000","last_change":"2024-09-12T16:51:56.163659+0000","last_active":"2024-09-12T16:55:12.374105+0000","last_peered":"2024-09-12T16:55:12.374105+0000","last_clean":"2024-09-12T16:55:12.374105+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:55:12.374105+0000","last_undegraded":"2024-09-12T16:55:12.374105+0000","last_fullsized":"2024-09-12T16:55:12.374105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:06.765327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043977+0000","last_change":"2024-09-12T16:52:00.162650+0000","last_active":"2024-09-12T16:52:35.043977+0000","last_peered":"2024-09-12T16:52:35.043977+0000","last_clean":"2024-09-12T16:52:35.043977+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:52:35.043977+0000","last_undegraded":"2024-09-12T16:52:35.043977+0000","last_fullsized":"2024-09-12T16:52:35.043977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.597418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.050080+0000","last_change":"2024-09-12T16:52:02.216308+0000","last_active":"2024-09-12T16:52:35.050080+0000","last_peered":"2024-09-12T16:52:35.050080+0000","last_clean":"2024-09-12T16:52:35.050080+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:52:35.050080+0000","last_undegraded":"2024-09-12T16:52:35.050080+0000","last_fullsized":"2024-09-12T16:52:35.050080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:12.930560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419678+0000","last_change":"2024-09-12T16:52:04.219251+0000","last_active":"2024-09-12T16:55:10.419678+0000","last_peered":"2024-09-12T16:55:10.419678+0000","last_clean":"2024-09-12T16:55:10.419678+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:55:10.419678+0000","last_undegraded":"2024-09-12T16:55:10.419678+0000","last_fullsized":"2024-09-12T16:55:10.419678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.043443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020791+0000","last_change":"2024-09-12T16:52:06.232237+0000","last_active":"2024-09-12T16:52:35.020791+0000","last_peered":"2024-09-12T16:52:35.020791+0000","last_clean":"2024-09-12T16:52:35.020791+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:52:35.020791+0000","last_undegraded":"2024-09-12T16:52:35.020791+0000","last_fullsized":"2024-09-12T16:52:35.020791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:08.018725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.407369+0000","last_change":"2024-09-12T16:51:58.142849+0000","last_active":"2024-09-12T16:55:12.407369+0000","last_peered":"2024-09-12T16:55:12.407369+0000","last_clean":"2024-09-12T16:55:12.407369+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:55:12.407369+0000","last_undegraded":"2024-09-12T16:55:12.407369+0000","last_fullsized":"2024-09-12T16:55:12.407369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.603060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043118+0000","last_change":"2024-09-12T16:51:56.145893+0000","last_active":"2024-09-12T16:52:35.043118+0000","last_peered":"2024-09-12T16:52:35.043118+0000","last_clean":"2024-09-12T16:52:35.043118+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:52:35.043118+0000","last_undegraded":"2024-09-12T16:52:35.043118+0000","last_fullsized":"2024-09-12T16:52:35.043118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:01.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031597+0000","last_change":"2024-09-12T16:52:00.179417+0000","last_active":"2024-09-12T16:52:35.031597+0000","last_peered":"2024-09-12T16:52:35.031597+0000","last_clean":"2024-09-12T16:52:35.031597+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:52:35.031597+0000","last_undegraded":"2024-09-12T16:52:35.031597+0000","last_fullsized":"2024-09-12T16:52:35.031597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:39.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.971611+0000","last_change":"2024-09-12T16:52:02.182087+0000","last_active":"2024-09-12T16:54:08.971611+0000","last_peered":"2024-09-12T16:54:08.971611+0000","last_clean":"2024-09-12T16:54:08.971611+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:54:08.971611+0000","last_undegraded":"2024-09-12T16:54:08.971611+0000","last_fullsized":"2024-09-12T16:54:08.971611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:10.821781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021023+0000","last_change":"2024-09-12T16:52:04.206758+0000","last_active":"2024-09-12T16:52:35.021023+0000","last_peered":"2024-09-12T16:52:35.021023+0000","last_clean":"2024-09-12T16:52:35.021023+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:52:35.021023+0000","last_undegraded":"2024-09-12T16:52:35.021023+0000","last_fullsized":"2024-09-12T16:52:35.021023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.089165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047680+0000","last_change":"2024-09-12T16:52:06.224320+0000","last_active":"2024-09-12T16:52:35.047680+0000","last_peered":"2024-09-12T16:52:35.047680+0000","last_clean":"2024-09-12T16:52:35.047680+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:52:35.047680+0000","last_undegraded":"2024-09-12T16:52:35.047680+0000","last_fullsized":"2024-09-12T16:52:35.047680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:34.785095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.062896+0000","last_change":"2024-09-12T16:51:58.141944+0000","last_active":"2024-09-12T16:55:12.062896+0000","last_peered":"2024-09-12T16:55:12.062896+0000","last_clean":"2024-09-12T16:55:12.062896+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:55:12.062896+0000","last_undegraded":"2024-09-12T16:55:12.062896+0000","last_fullsized":"2024-09-12T16:55:12.062896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047893+0000","last_change":"2024-09-12T16:51:56.169511+0000","last_active":"2024-09-12T16:52:35.047893+0000","last_peered":"2024-09-12T16:52:35.047893+0000","last_clean":"2024-09-12T16:52:35.047893+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:52:35.047893+0000","last_undegraded":"2024-09-12T16:52:35.047893+0000","last_fullsized":"2024-09-12T16:52:35.047893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:28.067613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020018+0000","last_change":"2024-09-12T16:52:00.183375+0000","last_active":"2024-09-12T16:52:35.020018+0000","last_peered":"2024-09-12T16:52:35.020018+0000","last_clean":"2024-09-12T16:52:35.020018+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:52:35.020018+0000","last_undegraded":"2024-09-12T16:52:35.020018+0000","last_fullsized":"2024-09-12T16:52:35.020018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.969978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.771290+0000","last_change":"2024-09-12T16:52:02.175268+0000","last_active":"2024-09-12T16:55:43.771290+0000","last_peered":"2024-09-12T16:55:43.771290+0000","last_clean":"2024-09-12T16:55:43.771290+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:55:43.771290+0000","last_undegraded":"2024-09-12T16:55:43.771290+0000","last_fullsized":"2024-09-12T16:55:43.771290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:54.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022138+0000","last_change":"2024-09-12T16:52:04.209135+0000","last_active":"2024-09-12T16:52:35.022138+0000","last_peered":"2024-09-12T16:52:35.022138+0000","last_clean":"2024-09-12T16:52:35.022138+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:52:35.022138+0000","last_undegraded":"2024-09-12T16:52:35.022138+0000","last_fullsized":"2024-09-12T16:52:35.022138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:49.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.442179+0000","last_change":"2024-09-12T16:52:06.237385+0000","last_active":"2024-09-12T16:54:11.442179+0000","last_peered":"2024-09-12T16:54:11.442179+0000","last_clean":"2024-09-12T16:54:11.442179+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:54:11.442179+0000","last_undegraded":"2024-09-12T16:54:11.442179+0000","last_fullsized":"2024-09-12T16:54:11.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:58.165732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406440+0000","last_change":"2024-09-12T16:51:58.168050+0000","last_active":"2024-09-12T16:55:12.406440+0000","last_peered":"2024-09-12T16:55:12.406440+0000","last_clean":"2024-09-12T16:55:12.406440+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:55:12.406440+0000","last_undegraded":"2024-09-12T16:55:12.406440+0000","last_fullsized":"2024-09-12T16:55:12.406440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:30.432926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.563604+0000","last_change":"2024-09-12T16:51:56.158228+0000","last_active":"2024-09-12T16:52:42.563604+0000","last_peered":"2024-09-12T16:52:42.563604+0000","last_clean":"2024-09-12T16:52:42.563604+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:52:42.563604+0000","last_undegraded":"2024-09-12T16:52:42.563604+0000","last_fullsized":"2024-09-12T16:52:42.563604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:35.587454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022978+0000","last_change":"2024-09-12T16:52:00.162253+0000","last_active":"2024-09-12T16:52:35.022978+0000","last_peered":"2024-09-12T16:52:35.022978+0000","last_clean":"2024-09-12T16:52:35.022978+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:52:35.022978+0000","last_undegraded":"2024-09-12T16:52:35.022978+0000","last_fullsized":"2024-09-12T16:52:35.022978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:02.417426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'27","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:36.031143+0000","last_change":"2024-09-12T16:52:02.212684+0000","last_active":"2024-09-12T16:54:36.031143+0000","last_peered":"2024-09-12T16:54:36.031143+0000","last_clean":"2024-09-12T16:54:36.031143+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:54:36.031143+0000","last_undegraded":"2024-09-12T16:54:36.031143+0000","last_fullsized":"2024-09-12T16:54:36.031143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:00.299441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032673+0000","last_change":"2024-09-12T16:52:04.209557+0000","last_active":"2024-09-12T16:52:35.032673+0000","last_peered":"2024-09-12T16:52:35.032673+0000","last_clean":"2024-09-12T16:52:35.032673+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:52:35.032673+0000","last_undegraded":"2024-09-12T16:52:35.032673+0000","last_fullsized":"2024-09-12T16:52:35.032673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:33.026740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.024814+0000","last_change":"2024-09-12T16:52:06.234752+0000","last_active":"2024-09-12T16:54:09.024814+0000","last_peered":"2024-09-12T16:54:09.024814+0000","last_clean":"2024-09-12T16:54:09.024814+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:54:09.024814+0000","last_undegraded":"2024-09-12T16:54:09.024814+0000","last_fullsized":"2024-09-12T16:54:09.024814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.433924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406497+0000","last_change":"2024-09-12T16:51:58.141857+0000","last_active":"2024-09-12T16:55:12.406497+0000","last_peered":"2024-09-12T16:55:12.406497+0000","last_clean":"2024-09-12T16:55:12.406497+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:55:12.406497+0000","last_undegraded":"2024-09-12T16:55:12.406497+0000","last_fullsized":"2024-09-12T16:55:12.406497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:34.368226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.365932+0000","last_change":"2024-09-12T16:51:56.157950+0000","last_active":"2024-09-12T16:55:12.365932+0000","last_peered":"2024-09-12T16:55:12.365932+0000","last_clean":"2024-09-12T16:55:12.365932+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:12.365932+0000","last_undegraded":"2024-09-12T16:55:12.365932+0000","last_fullsized":"2024-09-12T16:55:12.365932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:44.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:07.263520+0000","last_change":"2024-09-12T16:52:00.163609+0000","last_active":"2024-09-12T16:54:07.263520+0000","last_peered":"2024-09-12T16:54:07.263520+0000","last_clean":"2024-09-12T16:54:07.263520+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:54:07.263520+0000","last_undegraded":"2024-09-12T16:54:07.263520+0000","last_fullsized":"2024-09-12T16:54:07.263520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:40.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.481851+0000","last_change":"2024-09-12T16:52:02.212039+0000","last_active":"2024-09-12T16:55:11.481851+0000","last_peered":"2024-09-12T16:55:11.481851+0000","last_clean":"2024-09-12T16:55:11.481851+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:55:11.481851+0000","last_undegraded":"2024-09-12T16:55:11.481851+0000","last_fullsized":"2024-09-12T16:55:11.481851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:30.940482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022180+0000","last_change":"2024-09-12T16:52:04.194659+0000","last_active":"2024-09-12T16:52:35.022180+0000","last_peered":"2024-09-12T16:52:35.022180+0000","last_clean":"2024-09-12T16:52:35.022180+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:52:35.022180+0000","last_undegraded":"2024-09-12T16:52:35.022180+0000","last_fullsized":"2024-09-12T16:52:35.022180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:10.799769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.029336+0000","last_change":"2024-09-12T16:52:06.237422+0000","last_active":"2024-09-12T16:54:09.029336+0000","last_peered":"2024-09-12T16:54:09.029336+0000","last_clean":"2024-09-12T16:54:09.029336+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:54:09.029336+0000","last_undegraded":"2024-09-12T16:54:09.029336+0000","last_fullsized":"2024-09-12T16:54:09.029336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:35.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.020472+0000","last_change":"2024-09-12T16:51:58.171119+0000","last_active":"2024-09-12T16:54:11.020472+0000","last_peered":"2024-09-12T16:54:11.020472+0000","last_clean":"2024-09-12T16:54:11.020472+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:54:11.020472+0000","last_undegraded":"2024-09-12T16:54:11.020472+0000","last_fullsized":"2024-09-12T16:54:11.020472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:42.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015512+0000","last_change":"2024-09-12T16:51:56.153106+0000","last_active":"2024-09-12T16:52:35.015512+0000","last_peered":"2024-09-12T16:52:35.015512+0000","last_clean":"2024-09-12T16:52:35.015512+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:52:35.015512+0000","last_undegraded":"2024-09-12T16:52:35.015512+0000","last_fullsized":"2024-09-12T16:52:35.015512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:35.393789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'13","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450215+0000","last_change":"2024-09-12T16:51:58.149936+0000","last_active":"2024-09-12T16:54:11.450215+0000","last_peered":"2024-09-12T16:54:11.450215+0000","last_clean":"2024-09-12T16:54:11.450215+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:54:11.450215+0000","last_undegraded":"2024-09-12T16:54:11.450215+0000","last_fullsized":"2024-09-12T16:54:11.450215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:45.542639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.109318+0000","last_change":"2024-09-12T16:51:56.165393+0000","last_active":"2024-09-12T16:54:11.109318+0000","last_peered":"2024-09-12T16:54:11.109318+0000","last_clean":"2024-09-12T16:54:11.109318+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:54:11.109318+0000","last_undegraded":"2024-09-12T16:54:11.109318+0000","last_fullsized":"2024-09-12T16:54:11.109318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:22.213222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559962+0000","last_change":"2024-09-12T16:51:58.172460+0000","last_active":"2024-09-12T16:55:12.559962+0000","last_peered":"2024-09-12T16:55:12.559962+0000","last_clean":"2024-09-12T16:55:12.559962+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:55:12.559962+0000","last_undegraded":"2024-09-12T16:55:12.559962+0000","last_fullsized":"2024-09-12T16:55:12.559962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:11.477678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033006+0000","last_change":"2024-09-12T16:51:56.154964+0000","last_active":"2024-09-12T16:52:35.033006+0000","last_peered":"2024-09-12T16:52:35.033006+0000","last_clean":"2024-09-12T16:52:35.033006+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:52:35.033006+0000","last_undegraded":"2024-09-12T16:52:35.033006+0000","last_fullsized":"2024-09-12T16:52:35.033006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:09.313014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206890+0000","last_change":"2024-09-12T16:51:58.153420+0000","last_active":"2024-09-12T16:55:12.206890+0000","last_peered":"2024-09-12T16:55:12.206890+0000","last_clean":"2024-09-12T16:55:12.206890+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:55:12.206890+0000","last_undegraded":"2024-09-12T16:55:12.206890+0000","last_fullsized":"2024-09-12T16:55:12.206890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:45.866817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.748616+0000","last_change":"2024-09-12T16:51:56.170783+0000","last_active":"2024-09-12T16:54:06.748616+0000","last_peered":"2024-09-12T16:54:06.748616+0000","last_clean":"2024-09-12T16:54:06.748616+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:54:06.748616+0000","last_undegraded":"2024-09-12T16:54:06.748616+0000","last_fullsized":"2024-09-12T16:54:06.748616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:07.556912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.059507+0000","last_change":"2024-09-12T16:52:35.058216+0000","last_active":"2024-09-12T16:52:35.059507+0000","last_peered":"2024-09-12T16:52:35.059507+0000","last_clean":"2024-09-12T16:52:35.059507+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:52:35.059507+0000","last_undegraded":"2024-09-12T16:52:35.059507+0000","last_fullsized":"2024-09-12T16:52:35.059507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:04.174584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024027+0000","last_change":"2024-09-12T16:51:56.159691+0000","last_active":"2024-09-12T16:52:35.024027+0000","last_peered":"2024-09-12T16:52:35.024027+0000","last_clean":"2024-09-12T16:52:35.024027+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:52:35.024027+0000","last_undegraded":"2024-09-12T16:52:35.024027+0000","last_fullsized":"2024-09-12T16:52:35.024027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.592397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038033+0000","last_change":"2024-09-12T16:51:58.173240+0000","last_active":"2024-09-12T16:52:35.038033+0000","last_peered":"2024-09-12T16:52:35.038033+0000","last_clean":"2024-09-12T16:52:35.038033+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:52:35.038033+0000","last_undegraded":"2024-09-12T16:52:35.038033+0000","last_fullsized":"2024-09-12T16:52:35.038033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:49.259251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.573852+0000","last_change":"2024-09-12T16:51:56.165516+0000","last_active":"2024-09-12T16:52:42.573852+0000","last_peered":"2024-09-12T16:52:42.573852+0000","last_clean":"2024-09-12T16:52:42.573852+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:52:42.573852+0000","last_undegraded":"2024-09-12T16:52:42.573852+0000","last_fullsized":"2024-09-12T16:52:42.573852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:35.139651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762612+0000","last_change":"2024-09-12T16:51:58.149306+0000","last_active":"2024-09-12T16:53:25.762612+0000","last_peered":"2024-09-12T16:53:25.762612+0000","last_clean":"2024-09-12T16:53:25.762612+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:53:25.762612+0000","last_undegraded":"2024-09-12T16:53:25.762612+0000","last_fullsized":"2024-09-12T16:53:25.762612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092689+0000","last_change":"2024-09-12T16:51:56.150773+0000","last_active":"2024-09-12T16:52:41.092689+0000","last_peered":"2024-09-12T16:52:41.092689+0000","last_clean":"2024-09-12T16:52:41.092689+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:52:41.092689+0000","last_undegraded":"2024-09-12T16:52:41.092689+0000","last_fullsized":"2024-09-12T16:52:41.092689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:22.213222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.220234+0000","last_change":"2024-09-12T16:51:58.162339+0000","last_active":"2024-09-12T16:55:12.220234+0000","last_peered":"2024-09-12T16:55:12.220234+0000","last_clean":"2024-09-12T16:55:12.220234+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:55:12.220234+0000","last_undegraded":"2024-09-12T16:55:12.220234+0000","last_fullsized":"2024-09-12T16:55:12.220234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:52.597412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092203+0000","last_change":"2024-09-12T16:51:56.158411+0000","last_active":"2024-09-12T16:52:41.092203+0000","last_peered":"2024-09-12T16:52:41.092203+0000","last_clean":"2024-09-12T16:52:41.092203+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:52:41.092203+0000","last_undegraded":"2024-09-12T16:52:41.092203+0000","last_fullsized":"2024-09-12T16:52:41.092203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:45.612366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.159807+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:05.194424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023142+0000","last_change":"2024-09-12T16:51:56.155038+0000","last_active":"2024-09-12T16:52:35.023142+0000","last_peered":"2024-09-12T16:52:35.023142+0000","last_clean":"2024-09-12T16:52:35.023142+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:52:35.023142+0000","last_undegraded":"2024-09-12T16:52:35.023142+0000","last_fullsized":"2024-09-12T16:52:35.023142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:24.208686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491894+0000","last_change":"2024-09-12T16:51:58.159514+0000","last_active":"2024-09-12T16:55:12.491894+0000","last_peered":"2024-09-12T16:55:12.491894+0000","last_clean":"2024-09-12T16:55:12.491894+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:55:12.491894+0000","last_undegraded":"2024-09-12T16:55:12.491894+0000","last_fullsized":"2024-09-12T16:55:12.491894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.364726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021975+0000","last_change":"2024-09-12T16:51:56.167940+0000","last_active":"2024-09-12T16:52:35.021975+0000","last_peered":"2024-09-12T16:52:35.021975+0000","last_clean":"2024-09-12T16:52:35.021975+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:52:35.021975+0000","last_undegraded":"2024-09-12T16:52:35.021975+0000","last_fullsized":"2024-09-12T16:52:35.021975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:08.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405710+0000","last_change":"2024-09-12T16:51:58.176452+0000","last_active":"2024-09-12T16:55:12.405710+0000","last_peered":"2024-09-12T16:55:12.405710+0000","last_clean":"2024-09-12T16:55:12.405710+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:55:12.405710+0000","last_undegraded":"2024-09-12T16:55:12.405710+0000","last_fullsized":"2024-09-12T16:55:12.405710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:45.955514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033519+0000","last_change":"2024-09-12T16:51:56.166412+0000","last_active":"2024-09-12T16:52:35.033519+0000","last_peered":"2024-09-12T16:52:35.033519+0000","last_clean":"2024-09-12T16:52:35.033519+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:52:35.033519+0000","last_undegraded":"2024-09-12T16:52:35.033519+0000","last_fullsized":"2024-09-12T16:52:35.033519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:20.820430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.309364+0000","last_change":"2024-09-12T16:51:58.146572+0000","last_active":"2024-09-12T16:52:43.309364+0000","last_peered":"2024-09-12T16:52:43.309364+0000","last_clean":"2024-09-12T16:52:43.309364+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:52:43.309364+0000","last_undegraded":"2024-09-12T16:52:43.309364+0000","last_fullsized":"2024-09-12T16:52:43.309364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:01.315966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038391+0000","last_change":"2024-09-12T16:51:56.158751+0000","last_active":"2024-09-12T16:52:35.038391+0000","last_peered":"2024-09-12T16:52:35.038391+0000","last_clean":"2024-09-12T16:52:35.038391+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:52:35.038391+0000","last_undegraded":"2024-09-12T16:52:35.038391+0000","last_fullsized":"2024-09-12T16:52:35.038391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:44.033762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114250+0000","last_change":"2024-09-12T16:51:58.172245+0000","last_active":"2024-09-12T16:53:26.114250+0000","last_peered":"2024-09-12T16:53:26.114250+0000","last_clean":"2024-09-12T16:53:26.114250+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:53:26.114250+0000","last_undegraded":"2024-09-12T16:53:26.114250+0000","last_fullsized":"2024-09-12T16:53:26.114250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:30.077956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.087965+0000","last_change":"2024-09-12T16:51:56.153153+0000","last_active":"2024-09-12T16:52:41.087965+0000","last_peered":"2024-09-12T16:52:41.087965+0000","last_clean":"2024-09-12T16:52:41.087965+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:52:41.087965+0000","last_undegraded":"2024-09-12T16:52:41.087965+0000","last_fullsized":"2024-09-12T16:52:41.087965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:50.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204146+0000","last_change":"2024-09-12T16:51:58.148643+0000","last_active":"2024-09-12T16:55:12.204146+0000","last_peered":"2024-09-12T16:55:12.204146+0000","last_clean":"2024-09-12T16:55:12.204146+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:55:12.204146+0000","last_undegraded":"2024-09-12T16:55:12.204146+0000","last_fullsized":"2024-09-12T16:55:12.204146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:32.984633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048111+0000","last_change":"2024-09-12T16:51:56.166599+0000","last_active":"2024-09-12T16:52:35.048111+0000","last_peered":"2024-09-12T16:52:35.048111+0000","last_clean":"2024-09-12T16:52:35.048111+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:52:35.048111+0000","last_undegraded":"2024-09-12T16:52:35.048111+0000","last_fullsized":"2024-09-12T16:52:35.048111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.428924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206978+0000","last_change":"2024-09-12T16:52:35.049949+0000","last_active":"2024-09-12T16:55:12.206978+0000","last_peered":"2024-09-12T16:55:12.206978+0000","last_clean":"2024-09-12T16:55:12.206978+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:55:12.206978+0000","last_undegraded":"2024-09-12T16:55:12.206978+0000","last_fullsized":"2024-09-12T16:55:12.206978+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.495939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092683+0000","last_change":"2024-09-12T16:51:56.150301+0000","last_active":"2024-09-12T16:52:41.092683+0000","last_peered":"2024-09-12T16:52:41.092683+0000","last_clean":"2024-09-12T16:52:41.092683+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:52:41.092683+0000","last_undegraded":"2024-09-12T16:52:41.092683+0000","last_fullsized":"2024-09-12T16:52:41.092683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.592397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.434439+0000","last_change":"2024-09-12T16:51:58.159251+0000","last_active":"2024-09-12T16:54:11.434439+0000","last_peered":"2024-09-12T16:54:11.434439+0000","last_clean":"2024-09-12T16:54:11.434439+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:54:11.434439+0000","last_undegraded":"2024-09-12T16:54:11.434439+0000","last_fullsized":"2024-09-12T16:54:11.434439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:33.404970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.094347+0000","last_change":"2024-09-12T16:51:56.169106+0000","last_active":"2024-09-12T16:52:41.094347+0000","last_peered":"2024-09-12T16:52:41.094347+0000","last_clean":"2024-09-12T16:52:41.094347+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:52:41.094347+0000","last_undegraded":"2024-09-12T16:52:41.094347+0000","last_fullsized":"2024-09-12T16:52:41.094347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:11.710348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.567566+0000","last_change":"2024-09-12T16:51:56.155830+0000","last_active":"2024-09-12T16:52:42.567566+0000","last_peered":"2024-09-12T16:52:42.567566+0000","last_clean":"2024-09-12T16:52:42.567566+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:52:42.567566+0000","last_undegraded":"2024-09-12T16:52:42.567566+0000","last_fullsized":"2024-09-12T16:52:42.567566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.219841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030048+0000","last_change":"2024-09-12T16:51:58.164418+0000","last_active":"2024-09-12T16:52:35.030048+0000","last_peered":"2024-09-12T16:52:35.030048+0000","last_clean":"2024-09-12T16:52:35.030048+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:52:35.030048+0000","last_undegraded":"2024-09-12T16:52:35.030048+0000","last_fullsized":"2024-09-12T16:52:35.030048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:15.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025775+0000","last_change":"2024-09-12T16:51:56.171869+0000","last_active":"2024-09-12T16:52:35.025775+0000","last_peered":"2024-09-12T16:52:35.025775+0000","last_clean":"2024-09-12T16:52:35.025775+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:52:35.025775+0000","last_undegraded":"2024-09-12T16:52:35.025775+0000","last_fullsized":"2024-09-12T16:52:35.025775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:08.525437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.246329+0000","last_change":"2024-09-12T16:51:58.173368+0000","last_active":"2024-09-12T16:52:42.246329+0000","last_peered":"2024-09-12T16:52:42.246329+0000","last_clean":"2024-09-12T16:52:42.246329+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:52:42.246329+0000","last_undegraded":"2024-09-12T16:52:42.246329+0000","last_fullsized":"2024-09-12T16:52:42.246329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:45.341574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21619584,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":87,"num_write":310,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25817088,"data_stored":25817088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640307,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8758283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640308,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44764,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327076,"statfs":{"total":96636764160,"available":96590925824,"internally_reserved":0,"allocated":9646080,"data_stored":9347905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48904,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322936,"statfs":{"total":96636764160,"available":96586686464,"internally_reserved":0,"allocated":9625600,"data_stored":9346317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48344,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323496,"statfs":{"total":96636764160,"available":96587259904,"internally_reserved":0,"allocated":9052160,"data_stored":8759273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:55:44.353 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:55:44.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f468197e640 1 Processor -- start 2024-09-12T16:55:44.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f468197e640 1 -- start start 2024-09-12T16:55:44.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f468197e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f467c110da0 0x7f467c111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f468197e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467c073a90 con 0x7f467c1116c0 2024-09-12T16:55:44.514 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f468197e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f467c0696e0 con 0x7f467c110da0 2024-09-12T16:55:44.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f467affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f467c110da0 0x7f467c111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f467a7fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f467c1116c0 0x7f467c1231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36710/0 (socket says 172.21.15.122:36710) 2024-09-12T16:55:44.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f467a7fc640 1 -- 172.21.15.122:0/3465865327 learned_addr learned my addr 172.21.15.122:0/3465865327 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:44.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f467affd640 1 -- 172.21.15.122:0/3465865327 >> v1:172.21.15.122:6789/0 conn(0x7f467c1116c0 legacy=0x7f467c1231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f4679ffb640 1 -- 172.21.15.122:0/3465865327 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102870246 0 0) 0x7f467c073a90 con 0x7f467c1116c0 2024-09-12T16:55:44.515 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f467affd640 1 -- 172.21.15.122:0/3465865327 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c06dd50 con 0x7f467c110da0 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f467affd640 1 --2- 172.21.15.122:0/3465865327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c111180 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4674009740 tx=0x7f467401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e01ae62a8bc130 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f4679ffb640 1 -- 172.21.15.122:0/3465865327 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46740b0070 con 0x7f467c110da0 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f4679ffb640 1 -- 172.21.15.122:0/3465865327 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46740ab530 con 0x7f467c110da0 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.509+0000 7f4679ffb640 1 -- 172.21.15.122:0/3465865327 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46740ab830 con 0x7f467c110da0 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- 172.21.15.122:0/3465865327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 msgr2=0x7f467c111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 --2- 172.21.15.122:0/3465865327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c111180 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4674009740 tx=0x7f467401c370 comp rx=0 tx=0).stop 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- 172.21.15.122:0/3465865327 shutdown_connections 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 --2- 172.21.15.122:0/3465865327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c111180 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- 172.21.15.122:0/3465865327 >> 172.21.15.122:0/3465865327 conn(0x7f467c070900 msgr2=0x7f467c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- 172.21.15.122:0/3465865327 shutdown_connections 2024-09-12T16:55:44.518 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- 172.21.15.122:0/3465865327 wait complete. 2024-09-12T16:55:44.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 Processor -- start 2024-09-12T16:55:44.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- start start 2024-09-12T16:55:44.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c1226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f467c135470 con 0x7f467c110da0 2024-09-12T16:55:44.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f467affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c1226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f467affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c1226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58782/0 (socket says 172.21.15.122:58782) 2024-09-12T16:55:44.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f467affd640 1 -- 172.21.15.122:0/2297824481 learned_addr learned my addr 172.21.15.122:0/2297824481 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:44.519 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f467affd640 1 -- 172.21.15.122:0/2297824481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c130730 con 0x7f467c110da0 2024-09-12T16:55:44.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f467affd640 1 --2- 172.21.15.122:0/2297824481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c1226b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4674019fa0 tx=0x7f467401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f4673fff640 1 -- 172.21.15.122:0/2297824481 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46740b0050 con 0x7f467c110da0 2024-09-12T16:55:44.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f4673fff640 1 -- 172.21.15.122:0/2297824481 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46740b1040 con 0x7f467c110da0 2024-09-12T16:55:44.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467c130da0 con 0x7f467c110da0 2024-09-12T16:55:44.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f4673fff640 1 -- 172.21.15.122:0/2297824481 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46740042a0 con 0x7f467c110da0 2024-09-12T16:55:44.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467c122dc0 con 0x7f467c110da0 2024-09-12T16:55:44.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467c111180 con 0x7f467c110da0 2024-09-12T16:55:44.521 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f4673fff640 1 -- 172.21.15.122:0/2297824481 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f46740be060 con 0x7f467c110da0 2024-09-12T16:55:44.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f4673fff640 1 --2- 172.21.15.122:0/2297824481 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f465c03b200 0x7f465c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.513+0000 7f4673fff640 1 -- 172.21.15.122:0/2297824481 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f46740e9550 con 0x7f467c110da0 2024-09-12T16:55:44.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.517+0000 7f467a7fc640 1 --2- 172.21.15.122:0/2297824481 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f465c03b200 0x7f465c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.522 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.517+0000 7f467a7fc640 1 --2- 172.21.15.122:0/2297824481 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f465c03b200 0x7f465c03d6c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f466c000f90 tx=0x7f466c007c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.521+0000 7f4673fff640 1 -- 172.21.15.122:0/2297824481 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4674015ff0 con 0x7f467c110da0 2024-09-12T16:55:44.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.685+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f467c1140c0 con 0x7f465c03b200 2024-09-12T16:55:44.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.713+0000 7f4673fff640 1 -- 172.21.15.122:0/2297824481 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666050 (secure 0 0 0) 0x7f467c1140c0 con 0x7f465c03b200 2024-09-12T16:55:44.726 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:55:44.732 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:55:44.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f465c03b200 msgr2=0x7f465c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 --2- 172.21.15.122:0/2297824481 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f465c03b200 0x7f465c03d6c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f466c000f90 tx=0x7f466c007c60 comp rx=0 tx=0).stop 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 msgr2=0x7f467c1226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 --2- 172.21.15.122:0/2297824481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c1226b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4674019fa0 tx=0x7f467401abb0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 shutdown_connections 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 --2- 172.21.15.122:0/2297824481 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f465c03b200 0x7f465c03d6c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 --2- 172.21.15.122:0/2297824481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f467c110da0 0x7f467c1226b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 >> 172.21.15.122:0/2297824481 conn(0x7f467c070900 msgr2=0x7f467c071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 shutdown_connections 2024-09-12T16:55:44.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.721+0000 7f468197e640 1 -- 172.21.15.122:0/2297824481 wait complete. 2024-09-12T16:55:44.743 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-12T16:55:44.044651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22226705,"num_objects":228,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":4969,"num_read_kb":4550,"num_write":2065,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4466,"ondisk_log_size":4466,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190392,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377296968,"statfs":{"total":386547056640,"available":386352095232,"internally_reserved":0,"allocated":37412864,"data_stored":36211778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4190208,"num_objects":-1,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":47,"num_read_kb":46,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006774"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.089853+0000","last_change":"2024-09-12T16:51:56.151833+0000","last_active":"2024-09-12T16:52:41.089853+0000","last_peered":"2024-09-12T16:52:41.089853+0000","last_clean":"2024-09-12T16:52:41.089853+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:52:41.089853+0000","last_undegraded":"2024-09-12T16:52:41.089853+0000","last_fullsized":"2024-09-12T16:52:41.089853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:07.556912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559689+0000","last_change":"2024-09-12T16:51:58.150328+0000","last_active":"2024-09-12T16:55:12.559689+0000","last_peered":"2024-09-12T16:55:12.559689+0000","last_clean":"2024-09-12T16:55:12.559689+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:55:12.559689+0000","last_undegraded":"2024-09-12T16:55:12.559689+0000","last_fullsized":"2024-09-12T16:55:12.559689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:31.991784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026353+0000","last_change":"2024-09-12T16:51:56.161722+0000","last_active":"2024-09-12T16:52:35.026353+0000","last_peered":"2024-09-12T16:52:35.026353+0000","last_clean":"2024-09-12T16:52:35.026353+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:52:35.026353+0000","last_undegraded":"2024-09-12T16:52:35.026353+0000","last_fullsized":"2024-09-12T16:52:35.026353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:40.529043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.493995+0000","last_change":"2024-09-12T16:51:58.166339+0000","last_active":"2024-09-12T16:55:12.493995+0000","last_peered":"2024-09-12T16:55:12.493995+0000","last_clean":"2024-09-12T16:55:12.493995+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:55:12.493995+0000","last_undegraded":"2024-09-12T16:55:12.493995+0000","last_fullsized":"2024-09-12T16:55:12.493995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.116016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048410+0000","last_change":"2024-09-12T16:51:56.164645+0000","last_active":"2024-09-12T16:52:35.048410+0000","last_peered":"2024-09-12T16:52:35.048410+0000","last_clean":"2024-09-12T16:52:35.048410+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:52:35.048410+0000","last_undegraded":"2024-09-12T16:52:35.048410+0000","last_fullsized":"2024-09-12T16:52:35.048410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:14.665769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.425082+0000","last_change":"2024-09-12T16:51:58.163269+0000","last_active":"2024-09-12T16:55:12.425082+0000","last_peered":"2024-09-12T16:55:12.425082+0000","last_clean":"2024-09-12T16:55:12.425082+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:55:12.425082+0000","last_undegraded":"2024-09-12T16:55:12.425082+0000","last_fullsized":"2024-09-12T16:55:12.425082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:17.060923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.018273+0000","last_change":"2024-09-12T16:51:56.150421+0000","last_active":"2024-09-12T16:52:35.018273+0000","last_peered":"2024-09-12T16:52:35.018273+0000","last_clean":"2024-09-12T16:52:35.018273+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:52:35.018273+0000","last_undegraded":"2024-09-12T16:52:35.018273+0000","last_fullsized":"2024-09-12T16:52:35.018273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:08.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559316+0000","last_change":"2024-09-12T16:51:58.165836+0000","last_active":"2024-09-12T16:55:12.559316+0000","last_peered":"2024-09-12T16:55:12.559316+0000","last_clean":"2024-09-12T16:55:12.559316+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:55:12.559316+0000","last_undegraded":"2024-09-12T16:55:12.559316+0000","last_fullsized":"2024-09-12T16:55:12.559316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.786300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038726+0000","last_change":"2024-09-12T16:51:56.155368+0000","last_active":"2024-09-12T16:52:35.038726+0000","last_peered":"2024-09-12T16:52:35.038726+0000","last_clean":"2024-09-12T16:52:35.038726+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:52:35.038726+0000","last_undegraded":"2024-09-12T16:52:35.038726+0000","last_fullsized":"2024-09-12T16:52:35.038726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:23.509728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.310094+0000","last_change":"2024-09-12T16:51:58.148537+0000","last_active":"2024-09-12T16:52:43.310094+0000","last_peered":"2024-09-12T16:52:43.310094+0000","last_clean":"2024-09-12T16:52:43.310094+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:52:43.310094+0000","last_undegraded":"2024-09-12T16:52:43.310094+0000","last_fullsized":"2024-09-12T16:52:43.310094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:36.641527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.812642+0000","last_change":"2024-09-12T16:51:56.149239+0000","last_active":"2024-09-12T16:55:11.812642+0000","last_peered":"2024-09-12T16:55:11.812642+0000","last_clean":"2024-09-12T16:55:11.812642+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:55:11.812642+0000","last_undegraded":"2024-09-12T16:55:11.812642+0000","last_fullsized":"2024-09-12T16:55:11.812642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:48.008590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":12,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.756687+0000","last_change":"2024-09-12T16:51:58.165599+0000","last_active":"2024-09-12T16:54:06.756687+0000","last_peered":"2024-09-12T16:54:06.756687+0000","last_clean":"2024-09-12T16:54:06.756687+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:54:06.756687+0000","last_undegraded":"2024-09-12T16:54:06.756687+0000","last_fullsized":"2024-09-12T16:54:06.756687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:30.151277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.027975+0000","last_change":"2024-09-12T16:51:56.154655+0000","last_active":"2024-09-12T16:54:26.027975+0000","last_peered":"2024-09-12T16:54:26.027975+0000","last_clean":"2024-09-12T16:54:26.027975+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:54:26.027975+0000","last_undegraded":"2024-09-12T16:54:26.027975+0000","last_fullsized":"2024-09-12T16:54:26.027975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:52.651580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491266+0000","last_change":"2024-09-12T16:51:58.156872+0000","last_active":"2024-09-12T16:55:12.491266+0000","last_peered":"2024-09-12T16:55:12.491266+0000","last_clean":"2024-09-12T16:55:12.491266+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:55:12.491266+0000","last_undegraded":"2024-09-12T16:55:12.491266+0000","last_fullsized":"2024-09-12T16:55:12.491266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:17.848281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.095549+0000","last_change":"2024-09-12T16:51:56.161773+0000","last_active":"2024-09-12T16:53:26.095549+0000","last_peered":"2024-09-12T16:53:26.095549+0000","last_clean":"2024-09-12T16:53:26.095549+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:53:26.095549+0000","last_undegraded":"2024-09-12T16:53:26.095549+0000","last_fullsized":"2024-09-12T16:53:26.095549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:05.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.490892+0000","last_change":"2024-09-12T16:52:35.060238+0000","last_active":"2024-09-12T16:55:12.490892+0000","last_peered":"2024-09-12T16:55:12.490892+0000","last_clean":"2024-09-12T16:55:12.490892+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:55:12.490892+0000","last_undegraded":"2024-09-12T16:55:12.490892+0000","last_fullsized":"2024-09-12T16:55:12.490892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:18.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'5","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508887+0000","last_change":"2024-09-12T16:51:58.152595+0000","last_active":"2024-09-12T16:55:12.508887+0000","last_peered":"2024-09-12T16:55:12.508887+0000","last_clean":"2024-09-12T16:55:12.508887+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:55:12.508887+0000","last_undegraded":"2024-09-12T16:55:12.508887+0000","last_fullsized":"2024-09-12T16:55:12.508887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:06.175184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047444+0000","last_change":"2024-09-12T16:51:56.158348+0000","last_active":"2024-09-12T16:52:35.047444+0000","last_peered":"2024-09-12T16:52:35.047444+0000","last_clean":"2024-09-12T16:52:35.047444+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:52:35.047444+0000","last_undegraded":"2024-09-12T16:52:35.047444+0000","last_fullsized":"2024-09-12T16:52:35.047444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:16.323536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.082244+0000","last_change":"2024-09-12T16:51:58.145539+0000","last_active":"2024-09-12T16:55:12.082244+0000","last_peered":"2024-09-12T16:55:12.082244+0000","last_clean":"2024-09-12T16:55:12.082244+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:55:12.082244+0000","last_undegraded":"2024-09-12T16:55:12.082244+0000","last_fullsized":"2024-09-12T16:55:12.082244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:58.380885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:25.018199+0000","last_change":"2024-09-12T16:51:56.150522+0000","last_active":"2024-09-12T16:54:25.018199+0000","last_peered":"2024-09-12T16:54:25.018199+0000","last_clean":"2024-09-12T16:54:25.018199+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:54:25.018199+0000","last_undegraded":"2024-09-12T16:54:25.018199+0000","last_fullsized":"2024-09-12T16:54:25.018199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:47.138309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450880+0000","last_change":"2024-09-12T16:51:58.147371+0000","last_active":"2024-09-12T16:54:11.450880+0000","last_peered":"2024-09-12T16:54:11.450880+0000","last_clean":"2024-09-12T16:54:11.450880+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:54:11.450880+0000","last_undegraded":"2024-09-12T16:54:11.450880+0000","last_fullsized":"2024-09-12T16:54:11.450880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.439266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044749+0000","last_change":"2024-09-12T16:51:56.164502+0000","last_active":"2024-09-12T16:52:35.044749+0000","last_peered":"2024-09-12T16:52:35.044749+0000","last_clean":"2024-09-12T16:52:35.044749+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:52:35.044749+0000","last_undegraded":"2024-09-12T16:52:35.044749+0000","last_fullsized":"2024-09-12T16:52:35.044749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:23.020353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.578829+0000","last_change":"2024-09-12T16:51:58.171720+0000","last_active":"2024-09-12T16:55:12.578829+0000","last_peered":"2024-09-12T16:55:12.578829+0000","last_clean":"2024-09-12T16:55:12.578829+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:55:12.578829+0000","last_undegraded":"2024-09-12T16:55:12.578829+0000","last_fullsized":"2024-09-12T16:55:12.578829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:43.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.042838+0000","last_change":"2024-09-12T16:51:56.164560+0000","last_active":"2024-09-12T16:52:35.042838+0000","last_peered":"2024-09-12T16:52:35.042838+0000","last_clean":"2024-09-12T16:52:35.042838+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:52:35.042838+0000","last_undegraded":"2024-09-12T16:52:35.042838+0000","last_fullsized":"2024-09-12T16:52:35.042838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:34.588010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.170393+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:20.778233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029650+0000","last_change":"2024-09-12T16:51:56.172466+0000","last_active":"2024-09-12T16:52:35.029650+0000","last_peered":"2024-09-12T16:52:35.029650+0000","last_clean":"2024-09-12T16:52:35.029650+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:52:35.029650+0000","last_undegraded":"2024-09-12T16:52:35.029650+0000","last_fullsized":"2024-09-12T16:52:35.029650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:16.998562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.024343+0000","last_change":"2024-09-12T16:51:58.154333+0000","last_active":"2024-09-12T16:54:26.024343+0000","last_peered":"2024-09-12T16:54:26.024343+0000","last_clean":"2024-09-12T16:54:26.024343+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:54:26.024343+0000","last_undegraded":"2024-09-12T16:54:26.024343+0000","last_fullsized":"2024-09-12T16:54:26.024343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:31.351742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.747323+0000","last_change":"2024-09-12T16:51:56.150214+0000","last_active":"2024-09-12T16:53:25.747323+0000","last_peered":"2024-09-12T16:53:25.747323+0000","last_clean":"2024-09-12T16:53:25.747323+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:53:25.747323+0000","last_undegraded":"2024-09-12T16:53:25.747323+0000","last_fullsized":"2024-09-12T16:53:25.747323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.360856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.449818+0000","last_change":"2024-09-12T16:52:06.228645+0000","last_active":"2024-09-12T16:55:12.449818+0000","last_peered":"2024-09-12T16:55:12.449818+0000","last_clean":"2024-09-12T16:55:12.449818+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:55:12.449818+0000","last_undegraded":"2024-09-12T16:55:12.449818+0000","last_fullsized":"2024-09-12T16:55:12.449818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.027430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559921+0000","last_change":"2024-09-12T16:51:58.158921+0000","last_active":"2024-09-12T16:55:12.559921+0000","last_peered":"2024-09-12T16:55:12.559921+0000","last_clean":"2024-09-12T16:55:12.559921+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:55:12.559921+0000","last_undegraded":"2024-09-12T16:55:12.559921+0000","last_fullsized":"2024-09-12T16:55:12.559921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:53.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.583779+0000","last_change":"2024-09-12T16:51:56.164082+0000","last_active":"2024-09-12T16:52:42.583779+0000","last_peered":"2024-09-12T16:52:42.583779+0000","last_clean":"2024-09-12T16:52:42.583779+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:52:42.583779+0000","last_undegraded":"2024-09-12T16:52:42.583779+0000","last_fullsized":"2024-09-12T16:52:42.583779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:02.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047258+0000","last_change":"2024-09-12T16:52:00.186679+0000","last_active":"2024-09-12T16:52:35.047258+0000","last_peered":"2024-09-12T16:52:35.047258+0000","last_clean":"2024-09-12T16:52:35.047258+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:52:35.047258+0000","last_undegraded":"2024-09-12T16:52:35.047258+0000","last_fullsized":"2024-09-12T16:52:35.047258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:56.774446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.998524+0000","last_change":"2024-09-12T16:52:02.211041+0000","last_active":"2024-09-12T16:54:08.998524+0000","last_peered":"2024-09-12T16:54:08.998524+0000","last_clean":"2024-09-12T16:54:08.998524+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:54:08.998524+0000","last_undegraded":"2024-09-12T16:54:08.998524+0000","last_fullsized":"2024-09-12T16:54:08.998524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:56.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046823+0000","last_change":"2024-09-12T16:52:04.216014+0000","last_active":"2024-09-12T16:52:35.046823+0000","last_peered":"2024-09-12T16:52:35.046823+0000","last_clean":"2024-09-12T16:52:35.046823+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:52:35.046823+0000","last_undegraded":"2024-09-12T16:52:35.046823+0000","last_fullsized":"2024-09-12T16:52:35.046823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.121629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.770372+0000","last_change":"2024-09-12T16:52:06.220823+0000","last_active":"2024-09-12T16:53:25.770372+0000","last_peered":"2024-09-12T16:53:25.770372+0000","last_clean":"2024-09-12T16:53:25.770372+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:53:25.770372+0000","last_undegraded":"2024-09-12T16:53:25.770372+0000","last_fullsized":"2024-09-12T16:53:25.770372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.834594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.769302+0000","last_change":"2024-09-12T16:51:58.172491+0000","last_active":"2024-09-12T16:54:06.769302+0000","last_peered":"2024-09-12T16:54:06.769302+0000","last_clean":"2024-09-12T16:54:06.769302+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:54:06.769302+0000","last_undegraded":"2024-09-12T16:54:06.769302+0000","last_fullsized":"2024-09-12T16:54:06.769302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:13.859827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.015475+0000","last_change":"2024-09-12T16:51:56.148926+0000","last_active":"2024-09-12T16:55:12.015475+0000","last_peered":"2024-09-12T16:55:12.015475+0000","last_clean":"2024-09-12T16:55:12.015475+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:12.015475+0000","last_undegraded":"2024-09-12T16:55:12.015475+0000","last_fullsized":"2024-09-12T16:55:12.015475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:08.525437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022624+0000","last_change":"2024-09-12T16:52:00.173177+0000","last_active":"2024-09-12T16:52:35.022624+0000","last_peered":"2024-09-12T16:52:35.022624+0000","last_clean":"2024-09-12T16:52:35.022624+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:52:35.022624+0000","last_undegraded":"2024-09-12T16:52:35.022624+0000","last_fullsized":"2024-09-12T16:52:35.022624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:29.445195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.045539+0000","last_change":"2024-09-12T16:52:02.183370+0000","last_active":"2024-09-12T16:52:35.045539+0000","last_peered":"2024-09-12T16:52:35.045539+0000","last_clean":"2024-09-12T16:52:35.045539+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:52:35.045539+0000","last_undegraded":"2024-09-12T16:52:35.045539+0000","last_fullsized":"2024-09-12T16:52:35.045539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.193774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044904+0000","last_change":"2024-09-12T16:52:04.210985+0000","last_active":"2024-09-12T16:52:35.044904+0000","last_peered":"2024-09-12T16:52:35.044904+0000","last_clean":"2024-09-12T16:52:35.044904+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:52:35.044904+0000","last_undegraded":"2024-09-12T16:52:35.044904+0000","last_fullsized":"2024-09-12T16:52:35.044904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:41.017144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021248+0000","last_change":"2024-09-12T16:52:06.224899+0000","last_active":"2024-09-12T16:52:35.021248+0000","last_peered":"2024-09-12T16:52:35.021248+0000","last_clean":"2024-09-12T16:52:35.021248+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:52:35.021248+0000","last_undegraded":"2024-09-12T16:52:35.021248+0000","last_fullsized":"2024-09-12T16:52:35.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:27.788906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559983+0000","last_change":"2024-09-12T16:51:58.165985+0000","last_active":"2024-09-12T16:55:12.559983+0000","last_peered":"2024-09-12T16:55:12.559983+0000","last_clean":"2024-09-12T16:55:12.559983+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:55:12.559983+0000","last_undegraded":"2024-09-12T16:55:12.559983+0000","last_fullsized":"2024-09-12T16:55:12.559983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.791071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023098+0000","last_change":"2024-09-12T16:51:56.153288+0000","last_active":"2024-09-12T16:52:35.023098+0000","last_peered":"2024-09-12T16:52:35.023098+0000","last_clean":"2024-09-12T16:52:35.023098+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:52:35.023098+0000","last_undegraded":"2024-09-12T16:52:35.023098+0000","last_fullsized":"2024-09-12T16:52:35.023098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:56.830974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029954+0000","last_change":"2024-09-12T16:52:00.166221+0000","last_active":"2024-09-12T16:52:35.029954+0000","last_peered":"2024-09-12T16:52:35.029954+0000","last_clean":"2024-09-12T16:52:35.029954+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:52:35.029954+0000","last_undegraded":"2024-09-12T16:52:35.029954+0000","last_fullsized":"2024-09-12T16:52:35.029954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:47.637135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017313+0000","last_change":"2024-09-12T16:52:02.202447+0000","last_active":"2024-09-12T16:52:35.017313+0000","last_peered":"2024-09-12T16:52:35.017313+0000","last_clean":"2024-09-12T16:52:35.017313+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:52:35.017313+0000","last_undegraded":"2024-09-12T16:52:35.017313+0000","last_fullsized":"2024-09-12T16:52:35.017313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:48.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419319+0000","last_change":"2024-09-12T16:52:04.214865+0000","last_active":"2024-09-12T16:55:10.419319+0000","last_peered":"2024-09-12T16:55:10.419319+0000","last_clean":"2024-09-12T16:55:10.419319+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:55:10.419319+0000","last_undegraded":"2024-09-12T16:55:10.419319+0000","last_fullsized":"2024-09-12T16:55:10.419319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:36.658689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016249+0000","last_change":"2024-09-12T16:52:06.233885+0000","last_active":"2024-09-12T16:52:35.016249+0000","last_peered":"2024-09-12T16:52:35.016249+0000","last_clean":"2024-09-12T16:52:35.016249+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:52:35.016249+0000","last_undegraded":"2024-09-12T16:52:35.016249+0000","last_fullsized":"2024-09-12T16:52:35.016249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:05.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762116+0000","last_change":"2024-09-12T16:51:58.157856+0000","last_active":"2024-09-12T16:53:25.762116+0000","last_peered":"2024-09-12T16:53:25.762116+0000","last_clean":"2024-09-12T16:53:25.762116+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:53:25.762116+0000","last_undegraded":"2024-09-12T16:53:25.762116+0000","last_fullsized":"2024-09-12T16:53:25.762116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.575311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024635+0000","last_change":"2024-09-12T16:51:56.158840+0000","last_active":"2024-09-12T16:52:35.024635+0000","last_peered":"2024-09-12T16:52:35.024635+0000","last_clean":"2024-09-12T16:52:35.024635+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:52:35.024635+0000","last_undegraded":"2024-09-12T16:52:35.024635+0000","last_fullsized":"2024-09-12T16:52:35.024635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.795717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047933+0000","last_change":"2024-09-12T16:52:00.186758+0000","last_active":"2024-09-12T16:52:35.047933+0000","last_peered":"2024-09-12T16:52:35.047933+0000","last_clean":"2024-09-12T16:52:35.047933+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:52:35.047933+0000","last_undegraded":"2024-09-12T16:52:35.047933+0000","last_fullsized":"2024-09-12T16:52:35.047933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:11.029898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.990711+0000","last_change":"2024-09-12T16:52:02.201456+0000","last_active":"2024-09-12T16:54:08.990711+0000","last_peered":"2024-09-12T16:54:08.990711+0000","last_clean":"2024-09-12T16:54:08.990711+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:54:08.990711+0000","last_undegraded":"2024-09-12T16:54:08.990711+0000","last_fullsized":"2024-09-12T16:54:08.990711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:04.994969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.586516+0000","last_change":"2024-09-12T16:52:04.220126+0000","last_active":"2024-09-12T16:55:43.586516+0000","last_peered":"2024-09-12T16:55:43.586516+0000","last_clean":"2024-09-12T16:55:43.586516+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:55:43.586516+0000","last_undegraded":"2024-09-12T16:55:43.586516+0000","last_fullsized":"2024-09-12T16:55:43.586516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:41.797262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024505+0000","last_change":"2024-09-12T16:51:58.166638+0000","last_active":"2024-09-12T16:52:35.024505+0000","last_peered":"2024-09-12T16:52:35.024505+0000","last_clean":"2024-09-12T16:52:35.024505+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:52:35.024505+0000","last_undegraded":"2024-09-12T16:52:35.024505+0000","last_fullsized":"2024-09-12T16:52:35.024505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:09.865305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022574+0000","last_change":"2024-09-12T16:51:56.152053+0000","last_active":"2024-09-12T16:52:35.022574+0000","last_peered":"2024-09-12T16:52:35.022574+0000","last_clean":"2024-09-12T16:52:35.022574+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:52:35.022574+0000","last_undegraded":"2024-09-12T16:52:35.022574+0000","last_fullsized":"2024-09-12T16:52:35.022574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:05.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025774+0000","last_change":"2024-09-12T16:52:00.158540+0000","last_active":"2024-09-12T16:52:35.025774+0000","last_peered":"2024-09-12T16:52:35.025774+0000","last_clean":"2024-09-12T16:52:35.025774+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:52:35.025774+0000","last_undegraded":"2024-09-12T16:52:35.025774+0000","last_fullsized":"2024-09-12T16:52:35.025774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.058273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015338+0000","last_change":"2024-09-12T16:52:02.185249+0000","last_active":"2024-09-12T16:54:15.015338+0000","last_peered":"2024-09-12T16:54:15.015338+0000","last_clean":"2024-09-12T16:54:15.015338+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:54:15.015338+0000","last_undegraded":"2024-09-12T16:54:15.015338+0000","last_fullsized":"2024-09-12T16:54:15.015338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:09.660762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029067+0000","last_change":"2024-09-12T16:52:04.216055+0000","last_active":"2024-09-12T16:52:35.029067+0000","last_peered":"2024-09-12T16:52:35.029067+0000","last_clean":"2024-09-12T16:52:35.029067+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:52:35.029067+0000","last_undegraded":"2024-09-12T16:52:35.029067+0000","last_fullsized":"2024-09-12T16:52:35.029067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:19.593146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.773290+0000","last_change":"2024-09-12T16:52:06.226575+0000","last_active":"2024-09-12T16:53:25.773290+0000","last_peered":"2024-09-12T16:53:25.773290+0000","last_clean":"2024-09-12T16:53:25.773290+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:53:25.773290+0000","last_undegraded":"2024-09-12T16:53:25.773290+0000","last_fullsized":"2024-09-12T16:53:25.773290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:47.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.059583+0000","last_change":"2024-09-12T16:51:58.154586+0000","last_active":"2024-09-12T16:55:12.059583+0000","last_peered":"2024-09-12T16:55:12.059583+0000","last_clean":"2024-09-12T16:55:12.059583+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:55:12.059583+0000","last_undegraded":"2024-09-12T16:55:12.059583+0000","last_fullsized":"2024-09-12T16:55:12.059583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:21.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.211592+0000","last_change":"2024-09-12T16:51:56.152647+0000","last_active":"2024-09-12T16:54:11.211592+0000","last_peered":"2024-09-12T16:54:11.211592+0000","last_clean":"2024-09-12T16:54:11.211592+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:54:11.211592+0000","last_undegraded":"2024-09-12T16:54:11.211592+0000","last_fullsized":"2024-09-12T16:54:11.211592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023417+0000","last_change":"2024-09-12T16:52:00.156973+0000","last_active":"2024-09-12T16:52:35.023417+0000","last_peered":"2024-09-12T16:52:35.023417+0000","last_clean":"2024-09-12T16:52:35.023417+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:52:35.023417+0000","last_undegraded":"2024-09-12T16:52:35.023417+0000","last_fullsized":"2024-09-12T16:52:35.023417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:53.962016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.974774+0000","last_change":"2024-09-12T16:52:02.209890+0000","last_active":"2024-09-12T16:54:08.974774+0000","last_peered":"2024-09-12T16:54:08.974774+0000","last_clean":"2024-09-12T16:54:08.974774+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:54:08.974774+0000","last_undegraded":"2024-09-12T16:54:08.974774+0000","last_fullsized":"2024-09-12T16:54:08.974774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:04.988153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023620+0000","last_change":"2024-09-12T16:52:04.194679+0000","last_active":"2024-09-12T16:52:35.023620+0000","last_peered":"2024-09-12T16:52:35.023620+0000","last_clean":"2024-09-12T16:52:35.023620+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:52:35.023620+0000","last_undegraded":"2024-09-12T16:52:35.023620+0000","last_fullsized":"2024-09-12T16:52:35.023620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:43.311077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:20.069130+0000","last_change":"2024-09-12T16:52:06.231060+0000","last_active":"2024-09-12T16:53:20.069130+0000","last_peered":"2024-09-12T16:53:20.069130+0000","last_clean":"2024-09-12T16:53:20.069130+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:53:20.069130+0000","last_undegraded":"2024-09-12T16:53:20.069130+0000","last_fullsized":"2024-09-12T16:53:20.069130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:38.753641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019518+0000","last_change":"2024-09-12T16:51:58.170102+0000","last_active":"2024-09-12T16:52:35.019518+0000","last_peered":"2024-09-12T16:52:35.019518+0000","last_clean":"2024-09-12T16:52:35.019518+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:52:35.019518+0000","last_undegraded":"2024-09-12T16:52:35.019518+0000","last_fullsized":"2024-09-12T16:52:35.019518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:03.745874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048163+0000","last_change":"2024-09-12T16:51:56.171021+0000","last_active":"2024-09-12T16:52:35.048163+0000","last_peered":"2024-09-12T16:52:35.048163+0000","last_clean":"2024-09-12T16:52:35.048163+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:52:35.048163+0000","last_undegraded":"2024-09-12T16:52:35.048163+0000","last_fullsized":"2024-09-12T16:52:35.048163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:34.631184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026093+0000","last_change":"2024-09-12T16:52:00.155974+0000","last_active":"2024-09-12T16:52:35.026093+0000","last_peered":"2024-09-12T16:52:35.026093+0000","last_clean":"2024-09-12T16:52:35.026093+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:52:35.026093+0000","last_undegraded":"2024-09-12T16:52:35.026093+0000","last_fullsized":"2024-09-12T16:52:35.026093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:53.769301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:16.024675+0000","last_change":"2024-09-12T16:52:02.203207+0000","last_active":"2024-09-12T16:54:16.024675+0000","last_peered":"2024-09-12T16:54:16.024675+0000","last_clean":"2024-09-12T16:54:16.024675+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:54:16.024675+0000","last_undegraded":"2024-09-12T16:54:16.024675+0000","last_fullsized":"2024-09-12T16:54:16.024675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:18.022593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.589627+0000","last_change":"2024-09-12T16:52:04.194703+0000","last_active":"2024-09-12T16:55:43.589627+0000","last_peered":"2024-09-12T16:55:43.589627+0000","last_clean":"2024-09-12T16:55:43.589627+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:55:43.589627+0000","last_undegraded":"2024-09-12T16:55:43.589627+0000","last_fullsized":"2024-09-12T16:55:43.589627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:45.145668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024038+0000","last_change":"2024-09-12T16:52:06.236389+0000","last_active":"2024-09-12T16:52:35.024038+0000","last_peered":"2024-09-12T16:52:35.024038+0000","last_clean":"2024-09-12T16:52:35.024038+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:52:35.024038+0000","last_undegraded":"2024-09-12T16:52:35.024038+0000","last_fullsized":"2024-09-12T16:52:35.024038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:42.125079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015430+0000","last_change":"2024-09-12T16:51:58.141456+0000","last_active":"2024-09-12T16:54:15.015430+0000","last_peered":"2024-09-12T16:54:15.015430+0000","last_clean":"2024-09-12T16:54:15.015430+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:54:15.015430+0000","last_undegraded":"2024-09-12T16:54:15.015430+0000","last_fullsized":"2024-09-12T16:54:15.015430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.544687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044239+0000","last_change":"2024-09-12T16:51:56.169441+0000","last_active":"2024-09-12T16:52:35.044239+0000","last_peered":"2024-09-12T16:52:35.044239+0000","last_clean":"2024-09-12T16:52:35.044239+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:52:35.044239+0000","last_undegraded":"2024-09-12T16:52:35.044239+0000","last_fullsized":"2024-09-12T16:52:35.044239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:56.370543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022426+0000","last_change":"2024-09-12T16:52:00.178084+0000","last_active":"2024-09-12T16:52:35.022426+0000","last_peered":"2024-09-12T16:52:35.022426+0000","last_clean":"2024-09-12T16:52:35.022426+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:52:35.022426+0000","last_undegraded":"2024-09-12T16:52:35.022426+0000","last_fullsized":"2024-09-12T16:52:35.022426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.597984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.009905+0000","last_change":"2024-09-12T16:52:02.201612+0000","last_active":"2024-09-12T16:54:09.009905+0000","last_peered":"2024-09-12T16:54:09.009905+0000","last_clean":"2024-09-12T16:54:09.009905+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:54:09.009905+0000","last_undegraded":"2024-09-12T16:54:09.009905+0000","last_fullsized":"2024-09-12T16:54:09.009905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:42.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021841+0000","last_change":"2024-09-12T16:52:04.198835+0000","last_active":"2024-09-12T16:52:35.021841+0000","last_peered":"2024-09-12T16:52:35.021841+0000","last_clean":"2024-09-12T16:52:35.021841+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:52:35.021841+0000","last_undegraded":"2024-09-12T16:52:35.021841+0000","last_fullsized":"2024-09-12T16:52:35.021841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.503485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.731668+0000","last_change":"2024-09-12T16:52:06.212053+0000","last_active":"2024-09-12T16:55:12.731668+0000","last_peered":"2024-09-12T16:55:12.731668+0000","last_clean":"2024-09-12T16:55:12.731668+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:55:12.731668+0000","last_undegraded":"2024-09-12T16:55:12.731668+0000","last_fullsized":"2024-09-12T16:55:12.731668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:15.749904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.060440+0000","last_change":"2024-09-12T16:51:58.171124+0000","last_active":"2024-09-12T16:55:12.060440+0000","last_peered":"2024-09-12T16:55:12.060440+0000","last_clean":"2024-09-12T16:55:12.060440+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:55:12.060440+0000","last_undegraded":"2024-09-12T16:55:12.060440+0000","last_fullsized":"2024-09-12T16:55:12.060440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:39.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026631+0000","last_change":"2024-09-12T16:51:56.169756+0000","last_active":"2024-09-12T16:52:35.026631+0000","last_peered":"2024-09-12T16:52:35.026631+0000","last_clean":"2024-09-12T16:52:35.026631+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:52:35.026631+0000","last_undegraded":"2024-09-12T16:52:35.026631+0000","last_fullsized":"2024-09-12T16:52:35.026631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:43.389321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027418+0000","last_change":"2024-09-12T16:52:00.186996+0000","last_active":"2024-09-12T16:52:35.027418+0000","last_peered":"2024-09-12T16:52:35.027418+0000","last_clean":"2024-09-12T16:52:35.027418+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:52:35.027418+0000","last_undegraded":"2024-09-12T16:52:35.027418+0000","last_fullsized":"2024-09-12T16:52:35.027418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:55.614591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.023058+0000","last_change":"2024-09-12T16:52:02.181402+0000","last_active":"2024-09-12T16:54:21.023058+0000","last_peered":"2024-09-12T16:54:21.023058+0000","last_clean":"2024-09-12T16:54:21.023058+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:54:21.023058+0000","last_undegraded":"2024-09-12T16:54:21.023058+0000","last_fullsized":"2024-09-12T16:54:21.023058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:57.545973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048724+0000","last_change":"2024-09-12T16:52:04.214150+0000","last_active":"2024-09-12T16:52:35.048724+0000","last_peered":"2024-09-12T16:52:35.048724+0000","last_clean":"2024-09-12T16:52:35.048724+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:52:35.048724+0000","last_undegraded":"2024-09-12T16:52:35.048724+0000","last_fullsized":"2024-09-12T16:52:35.048724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:04.618846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.605539+0000","last_change":"2024-09-12T16:52:06.231706+0000","last_active":"2024-09-12T16:54:08.605539+0000","last_peered":"2024-09-12T16:54:08.605539+0000","last_clean":"2024-09-12T16:54:08.605539+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:54:08.605539+0000","last_undegraded":"2024-09-12T16:54:08.605539+0000","last_fullsized":"2024-09-12T16:54:08.605539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:20.026659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'9","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.579477+0000","last_change":"2024-09-12T16:51:58.173915+0000","last_active":"2024-09-12T16:55:12.579477+0000","last_peered":"2024-09-12T16:55:12.579477+0000","last_clean":"2024-09-12T16:55:12.579477+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:55:12.579477+0000","last_undegraded":"2024-09-12T16:55:12.579477+0000","last_fullsized":"2024-09-12T16:55:12.579477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:53.515263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.021863+0000","last_change":"2024-09-12T16:51:56.159835+0000","last_active":"2024-09-12T16:54:06.021863+0000","last_peered":"2024-09-12T16:54:06.021863+0000","last_clean":"2024-09-12T16:54:06.021863+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:54:06.021863+0000","last_undegraded":"2024-09-12T16:54:06.021863+0000","last_fullsized":"2024-09-12T16:54:06.021863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:50.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022853+0000","last_change":"2024-09-12T16:52:00.167730+0000","last_active":"2024-09-12T16:52:35.022853+0000","last_peered":"2024-09-12T16:52:35.022853+0000","last_clean":"2024-09-12T16:52:35.022853+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:52:35.022853+0000","last_undegraded":"2024-09-12T16:52:35.022853+0000","last_fullsized":"2024-09-12T16:52:35.022853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:18.641624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.021811+0000","last_change":"2024-09-12T16:52:02.181396+0000","last_active":"2024-09-12T16:54:09.021811+0000","last_peered":"2024-09-12T16:54:09.021811+0000","last_clean":"2024-09-12T16:54:09.021811+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:54:09.021811+0000","last_undegraded":"2024-09-12T16:54:09.021811+0000","last_fullsized":"2024-09-12T16:54:09.021811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:02.688531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":405,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.743611+0000","last_change":"2024-09-12T16:52:04.202044+0000","last_active":"2024-09-12T16:55:12.743611+0000","last_peered":"2024-09-12T16:55:12.743611+0000","last_clean":"2024-09-12T16:55:12.743611+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:55:12.743611+0000","last_undegraded":"2024-09-12T16:55:12.743611+0000","last_fullsized":"2024-09-12T16:55:12.743611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:00.863167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'20","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.680761+0000","last_change":"2024-09-12T16:52:06.219575+0000","last_active":"2024-09-12T16:55:12.680761+0000","last_peered":"2024-09-12T16:55:12.680761+0000","last_clean":"2024-09-12T16:55:12.680761+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:55:12.680761+0000","last_undegraded":"2024-09-12T16:55:12.680761+0000","last_fullsized":"2024-09-12T16:55:12.680761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.073730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.245387+0000","last_change":"2024-09-12T16:51:58.168850+0000","last_active":"2024-09-12T16:52:42.245387+0000","last_peered":"2024-09-12T16:52:42.245387+0000","last_clean":"2024-09-12T16:52:42.245387+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:52:42.245387+0000","last_undegraded":"2024-09-12T16:52:42.245387+0000","last_fullsized":"2024-09-12T16:52:42.245387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:38.519723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030545+0000","last_change":"2024-09-12T16:51:56.163883+0000","last_active":"2024-09-12T16:52:35.030545+0000","last_peered":"2024-09-12T16:52:35.030545+0000","last_clean":"2024-09-12T16:52:35.030545+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:52:35.030545+0000","last_undegraded":"2024-09-12T16:52:35.030545+0000","last_fullsized":"2024-09-12T16:52:35.030545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:19.316288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":617,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.624735+0000","last_change":"2024-09-12T16:52:35.065861+0000","last_active":"2024-09-12T16:54:10.624735+0000","last_peered":"2024-09-12T16:54:10.624735+0000","last_clean":"2024-09-12T16:54:10.624735+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:54:10.624735+0000","last_undegraded":"2024-09-12T16:54:10.624735+0000","last_fullsized":"2024-09-12T16:54:10.624735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.323930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":663,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.454242+0000","last_change":"2024-09-12T16:52:02.209870+0000","last_active":"2024-09-12T16:54:11.454242+0000","last_peered":"2024-09-12T16:54:11.454242+0000","last_clean":"2024-09-12T16:54:11.454242+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:54:11.454242+0000","last_undegraded":"2024-09-12T16:54:11.454242+0000","last_fullsized":"2024-09-12T16:54:11.454242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.846097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":512,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.677065+0000","last_change":"2024-09-12T16:52:04.200303+0000","last_active":"2024-09-12T16:55:12.677065+0000","last_peered":"2024-09-12T16:55:12.677065+0000","last_clean":"2024-09-12T16:55:12.677065+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:55:12.677065+0000","last_undegraded":"2024-09-12T16:55:12.677065+0000","last_fullsized":"2024-09-12T16:55:12.677065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:06.974814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.990445+0000","last_change":"2024-09-12T16:52:06.226319+0000","last_active":"2024-09-12T16:54:10.990445+0000","last_peered":"2024-09-12T16:54:10.990445+0000","last_clean":"2024-09-12T16:54:10.990445+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:54:10.990445+0000","last_undegraded":"2024-09-12T16:54:10.990445+0000","last_fullsized":"2024-09-12T16:54:10.990445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:19.104184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204872+0000","last_change":"2024-09-12T16:51:58.172403+0000","last_active":"2024-09-12T16:55:12.204872+0000","last_peered":"2024-09-12T16:55:12.204872+0000","last_clean":"2024-09-12T16:55:12.204872+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.204872+0000","last_undegraded":"2024-09-12T16:55:12.204872+0000","last_fullsized":"2024-09-12T16:55:12.204872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:17.725825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023537+0000","last_change":"2024-09-12T16:51:56.164438+0000","last_active":"2024-09-12T16:52:35.023537+0000","last_peered":"2024-09-12T16:52:35.023537+0000","last_clean":"2024-09-12T16:52:35.023537+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:52:35.023537+0000","last_undegraded":"2024-09-12T16:52:35.023537+0000","last_fullsized":"2024-09-12T16:52:35.023537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:34.280592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048178+0000","last_change":"2024-09-12T16:52:00.189183+0000","last_active":"2024-09-12T16:52:35.048178+0000","last_peered":"2024-09-12T16:52:35.048178+0000","last_clean":"2024-09-12T16:52:35.048178+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:52:35.048178+0000","last_undegraded":"2024-09-12T16:52:35.048178+0000","last_fullsized":"2024-09-12T16:52:35.048178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:50.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.000581+0000","last_change":"2024-09-12T16:52:02.179426+0000","last_active":"2024-09-12T16:54:09.000581+0000","last_peered":"2024-09-12T16:54:09.000581+0000","last_clean":"2024-09-12T16:54:09.000581+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:54:09.000581+0000","last_undegraded":"2024-09-12T16:54:09.000581+0000","last_fullsized":"2024-09-12T16:54:09.000581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:17.890537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017029+0000","last_change":"2024-09-12T16:52:04.212757+0000","last_active":"2024-09-12T16:52:35.017029+0000","last_peered":"2024-09-12T16:52:35.017029+0000","last_clean":"2024-09-12T16:52:35.017029+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:52:35.017029+0000","last_undegraded":"2024-09-12T16:52:35.017029+0000","last_fullsized":"2024-09-12T16:52:35.017029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.808954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.633190+0000","last_change":"2024-09-12T16:52:06.227780+0000","last_active":"2024-09-12T16:55:12.633190+0000","last_peered":"2024-09-12T16:55:12.633190+0000","last_clean":"2024-09-12T16:55:12.633190+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:55:12.633190+0000","last_undegraded":"2024-09-12T16:55:12.633190+0000","last_fullsized":"2024-09-12T16:55:12.633190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:23.705849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.222251+0000","last_change":"2024-09-12T16:51:58.173604+0000","last_active":"2024-09-12T16:55:12.222251+0000","last_peered":"2024-09-12T16:55:12.222251+0000","last_clean":"2024-09-12T16:55:12.222251+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:55:12.222251+0000","last_undegraded":"2024-09-12T16:55:12.222251+0000","last_fullsized":"2024-09-12T16:55:12.222251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:03.163064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:41.013055+0000","last_change":"2024-09-12T16:51:41.681357+0000","last_active":"2024-09-12T16:53:41.013055+0000","last_peered":"2024-09-12T16:53:41.013055+0000","last_clean":"2024-09-12T16:53:41.013055+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:53:41.013055+0000","last_undegraded":"2024-09-12T16:53:41.013055+0000","last_fullsized":"2024-09-12T16:53:41.013055+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_clean_scrub_stamp":"2024-09-12T16:51:40.347390+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:18.394696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039279+0000","last_change":"2024-09-12T16:51:48.400219+0000","last_active":"2024-09-12T16:52:35.039279+0000","last_peered":"2024-09-12T16:52:35.039279+0000","last_clean":"2024-09-12T16:52:35.039279+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:52:35.039279+0000","last_undegraded":"2024-09-12T16:52:35.039279+0000","last_fullsized":"2024-09-12T16:52:35.039279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.307866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033268+0000","last_change":"2024-09-12T16:51:56.168803+0000","last_active":"2024-09-12T16:52:35.033268+0000","last_peered":"2024-09-12T16:52:35.033268+0000","last_clean":"2024-09-12T16:52:35.033268+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:52:35.033268+0000","last_undegraded":"2024-09-12T16:52:35.033268+0000","last_fullsized":"2024-09-12T16:52:35.033268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.625123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044074+0000","last_change":"2024-09-12T16:52:00.165360+0000","last_active":"2024-09-12T16:52:35.044074+0000","last_peered":"2024-09-12T16:52:35.044074+0000","last_clean":"2024-09-12T16:52:35.044074+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:52:35.044074+0000","last_undegraded":"2024-09-12T16:52:35.044074+0000","last_fullsized":"2024-09-12T16:52:35.044074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:19.218108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.017912+0000","last_change":"2024-09-12T16:52:02.208795+0000","last_active":"2024-09-12T16:54:09.017912+0000","last_peered":"2024-09-12T16:54:09.017912+0000","last_clean":"2024-09-12T16:54:09.017912+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:54:09.017912+0000","last_undegraded":"2024-09-12T16:54:09.017912+0000","last_fullsized":"2024-09-12T16:54:09.017912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:33.220579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024326+0000","last_change":"2024-09-12T16:52:04.190511+0000","last_active":"2024-09-12T16:52:35.024326+0000","last_peered":"2024-09-12T16:52:35.024326+0000","last_clean":"2024-09-12T16:52:35.024326+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:52:35.024326+0000","last_undegraded":"2024-09-12T16:52:35.024326+0000","last_fullsized":"2024-09-12T16:52:35.024326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:34.575751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.588965+0000","last_change":"2024-09-12T16:52:06.216437+0000","last_active":"2024-09-12T16:55:12.588965+0000","last_peered":"2024-09-12T16:55:12.588965+0000","last_clean":"2024-09-12T16:55:12.588965+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:55:12.588965+0000","last_undegraded":"2024-09-12T16:55:12.588965+0000","last_fullsized":"2024-09-12T16:55:12.588965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:11.640533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.560070+0000","last_change":"2024-09-12T16:51:58.165681+0000","last_active":"2024-09-12T16:55:12.560070+0000","last_peered":"2024-09-12T16:55:12.560070+0000","last_clean":"2024-09-12T16:55:12.560070+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:55:12.560070+0000","last_undegraded":"2024-09-12T16:55:12.560070+0000","last_fullsized":"2024-09-12T16:55:12.560070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.848528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022287+0000","last_change":"2024-09-12T16:51:48.399639+0000","last_active":"2024-09-12T16:52:35.022287+0000","last_peered":"2024-09-12T16:52:35.022287+0000","last_clean":"2024-09-12T16:52:35.022287+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:52:35.022287+0000","last_undegraded":"2024-09-12T16:52:35.022287+0000","last_fullsized":"2024-09-12T16:52:35.022287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.533236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.846991+0000","last_change":"2024-09-12T16:51:56.170610+0000","last_active":"2024-09-12T16:55:11.846991+0000","last_peered":"2024-09-12T16:55:11.846991+0000","last_clean":"2024-09-12T16:55:11.846991+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:11.846991+0000","last_undegraded":"2024-09-12T16:55:11.846991+0000","last_fullsized":"2024-09-12T16:55:11.846991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:37.340264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043040+0000","last_change":"2024-09-12T16:52:35.040769+0000","last_active":"2024-09-12T16:52:35.043040+0000","last_peered":"2024-09-12T16:52:35.043040+0000","last_clean":"2024-09-12T16:52:35.043040+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:52:35.043040+0000","last_undegraded":"2024-09-12T16:52:35.043040+0000","last_fullsized":"2024-09-12T16:52:35.043040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'275","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419542+0000","last_change":"2024-09-12T16:52:02.206307+0000","last_active":"2024-09-12T16:55:10.419542+0000","last_peered":"2024-09-12T16:55:10.419542+0000","last_clean":"2024-09-12T16:55:10.419542+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:55:10.419542+0000","last_undegraded":"2024-09-12T16:55:10.419542+0000","last_fullsized":"2024-09-12T16:55:10.419542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:35.817009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":363,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046840+0000","last_change":"2024-09-12T16:52:04.209015+0000","last_active":"2024-09-12T16:52:35.046840+0000","last_peered":"2024-09-12T16:52:35.046840+0000","last_clean":"2024-09-12T16:52:35.046840+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:52:35.046840+0000","last_undegraded":"2024-09-12T16:52:35.046840+0000","last_fullsized":"2024-09-12T16:52:35.046840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.156119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.766970+0000","last_change":"2024-09-12T16:52:06.227599+0000","last_active":"2024-09-12T16:53:25.766970+0000","last_peered":"2024-09-12T16:53:25.766970+0000","last_clean":"2024-09-12T16:53:25.766970+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:53:25.766970+0000","last_undegraded":"2024-09-12T16:53:25.766970+0000","last_fullsized":"2024-09-12T16:53:25.766970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:02.281631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508885+0000","last_change":"2024-09-12T16:51:58.158281+0000","last_active":"2024-09-12T16:55:12.508885+0000","last_peered":"2024-09-12T16:55:12.508885+0000","last_clean":"2024-09-12T16:55:12.508885+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:55:12.508885+0000","last_undegraded":"2024-09-12T16:55:12.508885+0000","last_fullsized":"2024-09-12T16:55:12.508885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:35.307006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.018288+0000","last_change":"2024-09-12T16:51:48.565817+0000","last_active":"2024-09-12T16:52:35.018288+0000","last_peered":"2024-09-12T16:52:35.018288+0000","last_clean":"2024-09-12T16:52:35.018288+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:52:35.018288+0000","last_undegraded":"2024-09-12T16:52:35.018288+0000","last_fullsized":"2024-09-12T16:52:35.018288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:05.344141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021089+0000","last_change":"2024-09-12T16:51:56.167557+0000","last_active":"2024-09-12T16:52:35.021089+0000","last_peered":"2024-09-12T16:52:35.021089+0000","last_clean":"2024-09-12T16:52:35.021089+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:52:35.021089+0000","last_undegraded":"2024-09-12T16:52:35.021089+0000","last_fullsized":"2024-09-12T16:52:35.021089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.057420+0000","last_change":"2024-09-12T16:52:35.055925+0000","last_active":"2024-09-12T16:52:35.057420+0000","last_peered":"2024-09-12T16:52:35.057420+0000","last_clean":"2024-09-12T16:52:35.057420+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:52:35.057420+0000","last_undegraded":"2024-09-12T16:52:35.057420+0000","last_fullsized":"2024-09-12T16:52:35.057420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:39.278393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419519+0000","last_change":"2024-09-12T16:52:02.183372+0000","last_active":"2024-09-12T16:55:10.419519+0000","last_peered":"2024-09-12T16:55:10.419519+0000","last_clean":"2024-09-12T16:55:10.419519+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:55:10.419519+0000","last_undegraded":"2024-09-12T16:55:10.419519+0000","last_fullsized":"2024-09-12T16:55:10.419519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:17.150188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023454+0000","last_change":"2024-09-12T16:52:04.189985+0000","last_active":"2024-09-12T16:52:35.023454+0000","last_peered":"2024-09-12T16:52:35.023454+0000","last_clean":"2024-09-12T16:52:35.023454+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:52:35.023454+0000","last_undegraded":"2024-09-12T16:52:35.023454+0000","last_fullsized":"2024-09-12T16:52:35.023454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:57.543211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032944+0000","last_change":"2024-09-12T16:52:06.229164+0000","last_active":"2024-09-12T16:52:35.032944+0000","last_peered":"2024-09-12T16:52:35.032944+0000","last_clean":"2024-09-12T16:52:35.032944+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:52:35.032944+0000","last_undegraded":"2024-09-12T16:52:35.032944+0000","last_fullsized":"2024-09-12T16:52:35.032944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:53.711707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.430239+0000","last_change":"2024-09-12T16:51:58.152002+0000","last_active":"2024-09-12T16:54:11.430239+0000","last_peered":"2024-09-12T16:54:11.430239+0000","last_clean":"2024-09-12T16:54:11.430239+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:54:11.430239+0000","last_undegraded":"2024-09-12T16:54:11.430239+0000","last_fullsized":"2024-09-12T16:54:11.430239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:09.830533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032753+0000","last_change":"2024-09-12T16:51:48.400929+0000","last_active":"2024-09-12T16:52:35.032753+0000","last_peered":"2024-09-12T16:52:35.032753+0000","last_clean":"2024-09-12T16:52:35.032753+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:52:35.032753+0000","last_undegraded":"2024-09-12T16:52:35.032753+0000","last_fullsized":"2024-09-12T16:52:35.032753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:21.707361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017052+0000","last_change":"2024-09-12T16:51:56.148951+0000","last_active":"2024-09-12T16:52:35.017052+0000","last_peered":"2024-09-12T16:52:35.017052+0000","last_clean":"2024-09-12T16:52:35.017052+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:52:35.017052+0000","last_undegraded":"2024-09-12T16:52:35.017052+0000","last_fullsized":"2024-09-12T16:52:35.017052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:03.940011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024125+0000","last_change":"2024-09-12T16:52:00.189223+0000","last_active":"2024-09-12T16:52:35.024125+0000","last_peered":"2024-09-12T16:52:35.024125+0000","last_clean":"2024-09-12T16:52:35.024125+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:52:35.024125+0000","last_undegraded":"2024-09-12T16:52:35.024125+0000","last_fullsized":"2024-09-12T16:52:35.024125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:19.787530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.470351+0000","last_change":"2024-09-12T16:52:02.207152+0000","last_active":"2024-09-12T16:55:11.470351+0000","last_peered":"2024-09-12T16:55:11.470351+0000","last_clean":"2024-09-12T16:55:11.470351+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:55:11.470351+0000","last_undegraded":"2024-09-12T16:55:11.470351+0000","last_fullsized":"2024-09-12T16:55:11.470351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:18.373274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049115+0000","last_change":"2024-09-12T16:52:04.214830+0000","last_active":"2024-09-12T16:52:35.049115+0000","last_peered":"2024-09-12T16:52:35.049115+0000","last_clean":"2024-09-12T16:52:35.049115+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:52:35.049115+0000","last_undegraded":"2024-09-12T16:52:35.049115+0000","last_fullsized":"2024-09-12T16:52:35.049115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:43.821701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.923598+0000","last_change":"2024-09-12T16:52:06.229880+0000","last_active":"2024-09-12T16:54:10.923598+0000","last_peered":"2024-09-12T16:54:10.923598+0000","last_clean":"2024-09-12T16:54:10.923598+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:54:10.923598+0000","last_undegraded":"2024-09-12T16:54:10.923598+0000","last_fullsized":"2024-09-12T16:54:10.923598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:22.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.035350+0000","last_change":"2024-09-12T16:51:58.173047+0000","last_active":"2024-09-12T16:52:35.035350+0000","last_peered":"2024-09-12T16:52:35.035350+0000","last_clean":"2024-09-12T16:52:35.035350+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:52:35.035350+0000","last_undegraded":"2024-09-12T16:52:35.035350+0000","last_fullsized":"2024-09-12T16:52:35.035350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.635466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.379858+0000","last_change":"2024-09-12T16:51:56.147322+0000","last_active":"2024-09-12T16:54:11.379858+0000","last_peered":"2024-09-12T16:54:11.379858+0000","last_clean":"2024-09-12T16:54:11.379858+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:54:11.379858+0000","last_undegraded":"2024-09-12T16:54:11.379858+0000","last_fullsized":"2024-09-12T16:54:11.379858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:37.340264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023414+0000","last_change":"2024-09-12T16:51:48.406183+0000","last_active":"2024-09-12T16:52:35.023414+0000","last_peered":"2024-09-12T16:52:35.023414+0000","last_clean":"2024-09-12T16:52:35.023414+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:52:35.023414+0000","last_undegraded":"2024-09-12T16:52:35.023414+0000","last_fullsized":"2024-09-12T16:52:35.023414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:06.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'5","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.551692+0000","last_change":"2024-09-12T16:52:00.160190+0000","last_active":"2024-09-12T16:55:43.551692+0000","last_peered":"2024-09-12T16:55:43.551692+0000","last_clean":"2024-09-12T16:55:43.551692+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:55:43.551692+0000","last_undegraded":"2024-09-12T16:55:43.551692+0000","last_fullsized":"2024-09-12T16:55:43.551692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:37.197687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.886587+0000","last_change":"2024-09-12T16:52:02.175160+0000","last_active":"2024-09-12T16:55:43.886587+0000","last_peered":"2024-09-12T16:55:43.886587+0000","last_clean":"2024-09-12T16:55:43.886587+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:55:43.886587+0000","last_undegraded":"2024-09-12T16:55:43.886587+0000","last_fullsized":"2024-09-12T16:55:43.886587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.322350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015201+0000","last_change":"2024-09-12T16:52:04.202004+0000","last_active":"2024-09-12T16:52:35.015201+0000","last_peered":"2024-09-12T16:52:35.015201+0000","last_clean":"2024-09-12T16:52:35.015201+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:52:35.015201+0000","last_undegraded":"2024-09-12T16:52:35.015201+0000","last_fullsized":"2024-09-12T16:52:35.015201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:53.277560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.293385+0000","last_change":"2024-09-12T16:52:06.230268+0000","last_active":"2024-09-12T16:54:11.293385+0000","last_peered":"2024-09-12T16:54:11.293385+0000","last_clean":"2024-09-12T16:54:11.293385+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:54:11.293385+0000","last_undegraded":"2024-09-12T16:54:11.293385+0000","last_fullsized":"2024-09-12T16:54:11.293385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:11.635227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204797+0000","last_change":"2024-09-12T16:51:58.171396+0000","last_active":"2024-09-12T16:55:12.204797+0000","last_peered":"2024-09-12T16:55:12.204797+0000","last_clean":"2024-09-12T16:55:12.204797+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:55:12.204797+0000","last_undegraded":"2024-09-12T16:55:12.204797+0000","last_fullsized":"2024-09-12T16:55:12.204797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:39.687440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.392759+0000","last_change":"2024-09-12T16:51:56.161919+0000","last_active":"2024-09-12T16:55:12.392759+0000","last_peered":"2024-09-12T16:55:12.392759+0000","last_clean":"2024-09-12T16:55:12.392759+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:12.392759+0000","last_undegraded":"2024-09-12T16:55:12.392759+0000","last_fullsized":"2024-09-12T16:55:12.392759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:31.068717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047661+0000","last_change":"2024-09-12T16:51:48.399706+0000","last_active":"2024-09-12T16:52:35.047661+0000","last_peered":"2024-09-12T16:52:35.047661+0000","last_clean":"2024-09-12T16:52:35.047661+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:52:35.047661+0000","last_undegraded":"2024-09-12T16:52:35.047661+0000","last_fullsized":"2024-09-12T16:52:35.047661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.814087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031695+0000","last_change":"2024-09-12T16:52:00.173390+0000","last_active":"2024-09-12T16:52:35.031695+0000","last_peered":"2024-09-12T16:52:35.031695+0000","last_clean":"2024-09-12T16:52:35.031695+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:52:35.031695+0000","last_undegraded":"2024-09-12T16:52:35.031695+0000","last_fullsized":"2024-09-12T16:52:35.031695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:45.833748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027310+0000","last_change":"2024-09-12T16:52:02.194130+0000","last_active":"2024-09-12T16:52:35.027310+0000","last_peered":"2024-09-12T16:52:35.027310+0000","last_clean":"2024-09-12T16:52:35.027310+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:52:35.027310+0000","last_undegraded":"2024-09-12T16:52:35.027310+0000","last_fullsized":"2024-09-12T16:52:35.027310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:27.141664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419252+0000","last_change":"2024-09-12T16:52:04.193182+0000","last_active":"2024-09-12T16:55:10.419252+0000","last_peered":"2024-09-12T16:55:10.419252+0000","last_clean":"2024-09-12T16:55:10.419252+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:55:10.419252+0000","last_undegraded":"2024-09-12T16:55:10.419252+0000","last_fullsized":"2024-09-12T16:55:10.419252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:36.765558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047985+0000","last_change":"2024-09-12T16:52:06.215010+0000","last_active":"2024-09-12T16:52:35.047985+0000","last_peered":"2024-09-12T16:52:35.047985+0000","last_clean":"2024-09-12T16:52:35.047985+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:52:35.047985+0000","last_undegraded":"2024-09-12T16:52:35.047985+0000","last_fullsized":"2024-09-12T16:52:35.047985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:54.128906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.112528+0000","last_change":"2024-09-12T16:52:35.039684+0000","last_active":"2024-09-12T16:53:26.112528+0000","last_peered":"2024-09-12T16:53:26.112528+0000","last_clean":"2024-09-12T16:53:26.112528+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:53:26.112528+0000","last_undegraded":"2024-09-12T16:53:26.112528+0000","last_fullsized":"2024-09-12T16:53:26.112528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.545874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.050083+0000","last_change":"2024-09-12T16:51:56.169511+0000","last_active":"2024-09-12T16:52:35.050083+0000","last_peered":"2024-09-12T16:52:35.050083+0000","last_clean":"2024-09-12T16:52:35.050083+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:52:35.050083+0000","last_undegraded":"2024-09-12T16:52:35.050083+0000","last_fullsized":"2024-09-12T16:52:35.050083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:37.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025906+0000","last_change":"2024-09-12T16:51:48.405954+0000","last_active":"2024-09-12T16:52:35.025906+0000","last_peered":"2024-09-12T16:52:35.025906+0000","last_clean":"2024-09-12T16:52:35.025906+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:52:35.025906+0000","last_undegraded":"2024-09-12T16:52:35.025906+0000","last_fullsized":"2024-09-12T16:52:35.025906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022871+0000","last_change":"2024-09-12T16:52:00.171577+0000","last_active":"2024-09-12T16:52:35.022871+0000","last_peered":"2024-09-12T16:52:35.022871+0000","last_clean":"2024-09-12T16:52:35.022871+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:52:35.022871+0000","last_undegraded":"2024-09-12T16:52:35.022871+0000","last_fullsized":"2024-09-12T16:52:35.022871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.429060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034668+0000","last_change":"2024-09-12T16:52:02.213748+0000","last_active":"2024-09-12T16:52:35.034668+0000","last_peered":"2024-09-12T16:52:35.034668+0000","last_clean":"2024-09-12T16:52:35.034668+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:52:35.034668+0000","last_undegraded":"2024-09-12T16:52:35.034668+0000","last_fullsized":"2024-09-12T16:52:35.034668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:45.880129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.584131+0000","last_change":"2024-09-12T16:52:04.213686+0000","last_active":"2024-09-12T16:55:43.584131+0000","last_peered":"2024-09-12T16:55:43.584131+0000","last_clean":"2024-09-12T16:55:43.584131+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:55:43.584131+0000","last_undegraded":"2024-09-12T16:55:43.584131+0000","last_fullsized":"2024-09-12T16:55:43.584131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:03.491921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.104813+0000","last_change":"2024-09-12T16:52:06.223608+0000","last_active":"2024-09-12T16:55:12.104813+0000","last_peered":"2024-09-12T16:55:12.104813+0000","last_clean":"2024-09-12T16:55:12.104813+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:55:12.104813+0000","last_undegraded":"2024-09-12T16:55:12.104813+0000","last_fullsized":"2024-09-12T16:55:12.104813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:45.915952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405963+0000","last_change":"2024-09-12T16:51:58.169710+0000","last_active":"2024-09-12T16:55:12.405963+0000","last_peered":"2024-09-12T16:55:12.405963+0000","last_clean":"2024-09-12T16:55:12.405963+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:55:12.405963+0000","last_undegraded":"2024-09-12T16:55:12.405963+0000","last_fullsized":"2024-09-12T16:55:12.405963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:19.057567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.384261+0000","last_change":"2024-09-12T16:51:56.158532+0000","last_active":"2024-09-12T16:55:12.384261+0000","last_peered":"2024-09-12T16:55:12.384261+0000","last_clean":"2024-09-12T16:55:12.384261+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:12.384261+0000","last_undegraded":"2024-09-12T16:55:12.384261+0000","last_fullsized":"2024-09-12T16:55:12.384261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:54.713058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049659+0000","last_change":"2024-09-12T16:51:48.400908+0000","last_active":"2024-09-12T16:52:35.049659+0000","last_peered":"2024-09-12T16:52:35.049659+0000","last_clean":"2024-09-12T16:52:35.049659+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:52:35.049659+0000","last_undegraded":"2024-09-12T16:52:35.049659+0000","last_fullsized":"2024-09-12T16:52:35.049659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.059679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021940+0000","last_change":"2024-09-12T16:52:00.177682+0000","last_active":"2024-09-12T16:52:35.021940+0000","last_peered":"2024-09-12T16:52:35.021940+0000","last_clean":"2024-09-12T16:52:35.021940+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:52:35.021940+0000","last_undegraded":"2024-09-12T16:52:35.021940+0000","last_fullsized":"2024-09-12T16:52:35.021940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:07.415377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.997319+0000","last_change":"2024-09-12T16:52:02.187458+0000","last_active":"2024-09-12T16:54:08.997319+0000","last_peered":"2024-09-12T16:54:08.997319+0000","last_clean":"2024-09-12T16:54:08.997319+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:54:08.997319+0000","last_undegraded":"2024-09-12T16:54:08.997319+0000","last_fullsized":"2024-09-12T16:54:08.997319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:39.799750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021656+0000","last_change":"2024-09-12T16:52:04.205957+0000","last_active":"2024-09-12T16:52:35.021656+0000","last_peered":"2024-09-12T16:52:35.021656+0000","last_clean":"2024-09-12T16:52:35.021656+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:52:35.021656+0000","last_undegraded":"2024-09-12T16:52:35.021656+0000","last_fullsized":"2024-09-12T16:52:35.021656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:09.625513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027967+0000","last_change":"2024-09-12T16:52:06.226131+0000","last_active":"2024-09-12T16:52:35.027967+0000","last_peered":"2024-09-12T16:52:35.027967+0000","last_clean":"2024-09-12T16:52:35.027967+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:52:35.027967+0000","last_undegraded":"2024-09-12T16:52:35.027967+0000","last_fullsized":"2024-09-12T16:52:35.027967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:27.891759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.467476+0000","last_change":"2024-09-12T16:52:06.233870+0000","last_active":"2024-09-12T16:55:12.467476+0000","last_peered":"2024-09-12T16:55:12.467476+0000","last_clean":"2024-09-12T16:55:12.467476+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:55:12.467476+0000","last_undegraded":"2024-09-12T16:55:12.467476+0000","last_fullsized":"2024-09-12T16:55:12.467476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:37.518504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.761344+0000","last_change":"2024-09-12T16:51:58.170146+0000","last_active":"2024-09-12T16:53:25.761344+0000","last_peered":"2024-09-12T16:53:25.761344+0000","last_clean":"2024-09-12T16:53:25.761344+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:53:25.761344+0000","last_undegraded":"2024-09-12T16:53:25.761344+0000","last_fullsized":"2024-09-12T16:53:25.761344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:48.025016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.357950+0000","last_change":"2024-09-12T16:51:56.163750+0000","last_active":"2024-09-12T16:55:12.357950+0000","last_peered":"2024-09-12T16:55:12.357950+0000","last_clean":"2024-09-12T16:55:12.357950+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:55:12.357950+0000","last_undegraded":"2024-09-12T16:55:12.357950+0000","last_fullsized":"2024-09-12T16:55:12.357950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:47.582510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032193+0000","last_change":"2024-09-12T16:52:00.176219+0000","last_active":"2024-09-12T16:52:35.032193+0000","last_peered":"2024-09-12T16:52:35.032193+0000","last_clean":"2024-09-12T16:52:35.032193+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:52:35.032193+0000","last_undegraded":"2024-09-12T16:52:35.032193+0000","last_fullsized":"2024-09-12T16:52:35.032193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:21.686238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.006359+0000","last_change":"2024-09-12T16:52:02.194377+0000","last_active":"2024-09-12T16:54:09.006359+0000","last_peered":"2024-09-12T16:54:09.006359+0000","last_clean":"2024-09-12T16:54:09.006359+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:54:09.006359+0000","last_undegraded":"2024-09-12T16:54:09.006359+0000","last_fullsized":"2024-09-12T16:54:09.006359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:35.662292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024735+0000","last_change":"2024-09-12T16:52:04.215450+0000","last_active":"2024-09-12T16:52:35.024735+0000","last_peered":"2024-09-12T16:52:35.024735+0000","last_clean":"2024-09-12T16:52:35.024735+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:52:35.024735+0000","last_undegraded":"2024-09-12T16:52:35.024735+0000","last_fullsized":"2024-09-12T16:52:35.024735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.120052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.497182+0000","last_change":"2024-09-12T16:52:06.212418+0000","last_active":"2024-09-12T16:55:12.497182+0000","last_peered":"2024-09-12T16:55:12.497182+0000","last_clean":"2024-09-12T16:55:12.497182+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:55:12.497182+0000","last_undegraded":"2024-09-12T16:55:12.497182+0000","last_fullsized":"2024-09-12T16:55:12.497182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:57.649089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'27","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.424657+0000","last_change":"2024-09-12T16:51:58.172876+0000","last_active":"2024-09-12T16:55:12.424657+0000","last_peered":"2024-09-12T16:55:12.424657+0000","last_clean":"2024-09-12T16:55:12.424657+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.424657+0000","last_undegraded":"2024-09-12T16:55:12.424657+0000","last_fullsized":"2024-09-12T16:55:12.424657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:16.676112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020927+0000","last_change":"2024-09-12T16:51:56.152311+0000","last_active":"2024-09-12T16:52:35.020927+0000","last_peered":"2024-09-12T16:52:35.020927+0000","last_clean":"2024-09-12T16:52:35.020927+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:52:35.020927+0000","last_undegraded":"2024-09-12T16:52:35.020927+0000","last_fullsized":"2024-09-12T16:52:35.020927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:31.068717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034344+0000","last_change":"2024-09-12T16:52:00.183813+0000","last_active":"2024-09-12T16:52:35.034344+0000","last_peered":"2024-09-12T16:52:35.034344+0000","last_clean":"2024-09-12T16:52:35.034344+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:52:35.034344+0000","last_undegraded":"2024-09-12T16:52:35.034344+0000","last_fullsized":"2024-09-12T16:52:35.034344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.454514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.479969+0000","last_change":"2024-09-12T16:52:02.184368+0000","last_active":"2024-09-12T16:55:11.479969+0000","last_peered":"2024-09-12T16:55:11.479969+0000","last_clean":"2024-09-12T16:55:11.479969+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:55:11.479969+0000","last_undegraded":"2024-09-12T16:55:11.479969+0000","last_fullsized":"2024-09-12T16:55:11.479969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:55.116071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017383+0000","last_change":"2024-09-12T16:52:04.216686+0000","last_active":"2024-09-12T16:52:35.017383+0000","last_peered":"2024-09-12T16:52:35.017383+0000","last_clean":"2024-09-12T16:52:35.017383+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:52:35.017383+0000","last_undegraded":"2024-09-12T16:52:35.017383+0000","last_fullsized":"2024-09-12T16:52:35.017383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.665774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022183+0000","last_change":"2024-09-12T16:52:06.225236+0000","last_active":"2024-09-12T16:52:35.022183+0000","last_peered":"2024-09-12T16:52:35.022183+0000","last_clean":"2024-09-12T16:52:35.022183+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:52:35.022183+0000","last_undegraded":"2024-09-12T16:52:35.022183+0000","last_fullsized":"2024-09-12T16:52:35.022183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.292498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559427+0000","last_change":"2024-09-12T16:51:58.171912+0000","last_active":"2024-09-12T16:55:12.559427+0000","last_peered":"2024-09-12T16:55:12.559427+0000","last_clean":"2024-09-12T16:55:12.559427+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:55:12.559427+0000","last_undegraded":"2024-09-12T16:55:12.559427+0000","last_fullsized":"2024-09-12T16:55:12.559427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:33.118187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:25.018159+0000","last_change":"2024-09-12T16:51:56.153340+0000","last_active":"2024-09-12T16:54:25.018159+0000","last_peered":"2024-09-12T16:54:25.018159+0000","last_clean":"2024-09-12T16:54:25.018159+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:54:25.018159+0000","last_undegraded":"2024-09-12T16:54:25.018159+0000","last_fullsized":"2024-09-12T16:54:25.018159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:43.389321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017569+0000","last_change":"2024-09-12T16:52:00.163603+0000","last_active":"2024-09-12T16:52:35.017569+0000","last_peered":"2024-09-12T16:52:35.017569+0000","last_clean":"2024-09-12T16:52:35.017569+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:52:35.017569+0000","last_undegraded":"2024-09-12T16:52:35.017569+0000","last_fullsized":"2024-09-12T16:52:35.017569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:17.118266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.868200+0000","last_change":"2024-09-12T16:52:02.180694+0000","last_active":"2024-09-12T16:55:43.868200+0000","last_peered":"2024-09-12T16:55:43.868200+0000","last_clean":"2024-09-12T16:55:43.868200+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:55:43.868200+0000","last_undegraded":"2024-09-12T16:55:43.868200+0000","last_fullsized":"2024-09-12T16:55:43.868200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.028291+0000","last_change":"2024-09-12T16:52:04.200667+0000","last_active":"2024-09-12T16:52:35.028291+0000","last_peered":"2024-09-12T16:52:35.028291+0000","last_clean":"2024-09-12T16:52:35.028291+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:52:35.028291+0000","last_undegraded":"2024-09-12T16:52:35.028291+0000","last_fullsized":"2024-09-12T16:52:35.028291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.487906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039574+0000","last_change":"2024-09-12T16:52:06.236861+0000","last_active":"2024-09-12T16:52:35.039574+0000","last_peered":"2024-09-12T16:52:35.039574+0000","last_clean":"2024-09-12T16:52:35.039574+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:52:35.039574+0000","last_undegraded":"2024-09-12T16:52:35.039574+0000","last_fullsized":"2024-09-12T16:52:35.039574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:29.568087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114298+0000","last_change":"2024-09-12T16:51:58.168169+0000","last_active":"2024-09-12T16:53:26.114298+0000","last_peered":"2024-09-12T16:53:26.114298+0000","last_clean":"2024-09-12T16:53:26.114298+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:53:26.114298+0000","last_undegraded":"2024-09-12T16:53:26.114298+0000","last_fullsized":"2024-09-12T16:53:26.114298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:56.585276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046409+0000","last_change":"2024-09-12T16:51:56.158362+0000","last_active":"2024-09-12T16:52:35.046409+0000","last_peered":"2024-09-12T16:52:35.046409+0000","last_clean":"2024-09-12T16:52:35.046409+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:52:35.046409+0000","last_undegraded":"2024-09-12T16:52:35.046409+0000","last_fullsized":"2024-09-12T16:52:35.046409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:58.692768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022824+0000","last_change":"2024-09-12T16:52:00.181358+0000","last_active":"2024-09-12T16:52:35.022824+0000","last_peered":"2024-09-12T16:52:35.022824+0000","last_clean":"2024-09-12T16:52:35.022824+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:52:35.022824+0000","last_undegraded":"2024-09-12T16:52:35.022824+0000","last_fullsized":"2024-09-12T16:52:35.022824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:32.384807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.984883+0000","last_change":"2024-09-12T16:52:02.181716+0000","last_active":"2024-09-12T16:54:08.984883+0000","last_peered":"2024-09-12T16:54:08.984883+0000","last_clean":"2024-09-12T16:54:08.984883+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:54:08.984883+0000","last_undegraded":"2024-09-12T16:54:08.984883+0000","last_fullsized":"2024-09-12T16:54:08.984883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.238474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016494+0000","last_change":"2024-09-12T16:52:04.211716+0000","last_active":"2024-09-12T16:52:35.016494+0000","last_peered":"2024-09-12T16:52:35.016494+0000","last_clean":"2024-09-12T16:52:35.016494+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:52:35.016494+0000","last_undegraded":"2024-09-12T16:52:35.016494+0000","last_fullsized":"2024-09-12T16:52:35.016494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.708673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406316+0000","last_change":"2024-09-12T16:51:58.158927+0000","last_active":"2024-09-12T16:55:12.406316+0000","last_peered":"2024-09-12T16:55:12.406316+0000","last_clean":"2024-09-12T16:55:12.406316+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:55:12.406316+0000","last_undegraded":"2024-09-12T16:55:12.406316+0000","last_fullsized":"2024-09-12T16:55:12.406316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:52.129370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022527+0000","last_change":"2024-09-12T16:51:56.157350+0000","last_active":"2024-09-12T16:52:35.022527+0000","last_peered":"2024-09-12T16:52:35.022527+0000","last_clean":"2024-09-12T16:52:35.022527+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:52:35.022527+0000","last_undegraded":"2024-09-12T16:52:35.022527+0000","last_fullsized":"2024-09-12T16:52:35.022527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:35.055723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025762+0000","last_change":"2024-09-12T16:52:00.159525+0000","last_active":"2024-09-12T16:52:35.025762+0000","last_peered":"2024-09-12T16:52:35.025762+0000","last_clean":"2024-09-12T16:52:35.025762+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:52:35.025762+0000","last_undegraded":"2024-09-12T16:52:35.025762+0000","last_fullsized":"2024-09-12T16:52:35.025762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:04.399510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.835655+0000","last_change":"2024-09-12T16:52:02.184114+0000","last_active":"2024-09-12T16:55:43.835655+0000","last_peered":"2024-09-12T16:55:43.835655+0000","last_clean":"2024-09-12T16:55:43.835655+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:55:43.835655+0000","last_undegraded":"2024-09-12T16:55:43.835655+0000","last_fullsized":"2024-09-12T16:55:43.835655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:51.260998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016853+0000","last_change":"2024-09-12T16:52:04.212854+0000","last_active":"2024-09-12T16:52:35.016853+0000","last_peered":"2024-09-12T16:52:35.016853+0000","last_clean":"2024-09-12T16:52:35.016853+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:52:35.016853+0000","last_undegraded":"2024-09-12T16:52:35.016853+0000","last_fullsized":"2024-09-12T16:52:35.016853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:31.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.284031+0000","last_change":"2024-09-12T16:52:06.224912+0000","last_active":"2024-09-12T16:54:11.284031+0000","last_peered":"2024-09-12T16:54:11.284031+0000","last_clean":"2024-09-12T16:54:11.284031+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:54:11.284031+0000","last_undegraded":"2024-09-12T16:54:11.284031+0000","last_fullsized":"2024-09-12T16:54:11.284031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:53.469591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762074+0000","last_change":"2024-09-12T16:51:58.157261+0000","last_active":"2024-09-12T16:53:25.762074+0000","last_peered":"2024-09-12T16:53:25.762074+0000","last_clean":"2024-09-12T16:53:25.762074+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:53:25.762074+0000","last_undegraded":"2024-09-12T16:53:25.762074+0000","last_fullsized":"2024-09-12T16:53:25.762074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:49.731949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.546723+0000","last_change":"2024-09-12T16:51:56.145141+0000","last_active":"2024-09-12T16:55:12.546723+0000","last_peered":"2024-09-12T16:55:12.546723+0000","last_clean":"2024-09-12T16:55:12.546723+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:12.546723+0000","last_undegraded":"2024-09-12T16:55:12.546723+0000","last_fullsized":"2024-09-12T16:55:12.546723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:56.176046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026467+0000","last_change":"2024-09-12T16:52:00.164196+0000","last_active":"2024-09-12T16:52:35.026467+0000","last_peered":"2024-09-12T16:52:35.026467+0000","last_clean":"2024-09-12T16:52:35.026467+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:52:35.026467+0000","last_undegraded":"2024-09-12T16:52:35.026467+0000","last_fullsized":"2024-09-12T16:52:35.026467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:24.903329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.986087+0000","last_change":"2024-09-12T16:52:02.212469+0000","last_active":"2024-09-12T16:54:08.986087+0000","last_peered":"2024-09-12T16:54:08.986087+0000","last_clean":"2024-09-12T16:54:08.986087+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:54:08.986087+0000","last_undegraded":"2024-09-12T16:54:08.986087+0000","last_fullsized":"2024-09-12T16:54:08.986087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043455+0000","last_change":"2024-09-12T16:52:04.211092+0000","last_active":"2024-09-12T16:52:35.043455+0000","last_peered":"2024-09-12T16:52:35.043455+0000","last_clean":"2024-09-12T16:52:35.043455+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:52:35.043455+0000","last_undegraded":"2024-09-12T16:52:35.043455+0000","last_fullsized":"2024-09-12T16:52:35.043455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:37.948154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031153+0000","last_change":"2024-09-12T16:52:06.224892+0000","last_active":"2024-09-12T16:52:35.031153+0000","last_peered":"2024-09-12T16:52:35.031153+0000","last_clean":"2024-09-12T16:52:35.031153+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:52:35.031153+0000","last_undegraded":"2024-09-12T16:52:35.031153+0000","last_fullsized":"2024-09-12T16:52:35.031153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:23.862554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406528+0000","last_change":"2024-09-12T16:51:58.175046+0000","last_active":"2024-09-12T16:55:12.406528+0000","last_peered":"2024-09-12T16:55:12.406528+0000","last_clean":"2024-09-12T16:55:12.406528+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:55:12.406528+0000","last_undegraded":"2024-09-12T16:55:12.406528+0000","last_fullsized":"2024-09-12T16:55:12.406528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:23.110954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032546+0000","last_change":"2024-09-12T16:51:56.166124+0000","last_active":"2024-09-12T16:52:35.032546+0000","last_peered":"2024-09-12T16:52:35.032546+0000","last_clean":"2024-09-12T16:52:35.032546+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:52:35.032546+0000","last_undegraded":"2024-09-12T16:52:35.032546+0000","last_fullsized":"2024-09-12T16:52:35.032546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:37.152636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019381+0000","last_change":"2024-09-12T16:52:00.168294+0000","last_active":"2024-09-12T16:52:35.019381+0000","last_peered":"2024-09-12T16:52:35.019381+0000","last_clean":"2024-09-12T16:52:35.019381+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:52:35.019381+0000","last_undegraded":"2024-09-12T16:52:35.019381+0000","last_fullsized":"2024-09-12T16:52:35.019381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:51.062344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.717682+0000","last_change":"2024-09-12T16:52:02.196172+0000","last_active":"2024-09-12T16:55:43.717682+0000","last_peered":"2024-09-12T16:55:43.717682+0000","last_clean":"2024-09-12T16:55:43.717682+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:55:43.717682+0000","last_undegraded":"2024-09-12T16:55:43.717682+0000","last_fullsized":"2024-09-12T16:55:43.717682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:02.649211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024118+0000","last_change":"2024-09-12T16:52:04.215112+0000","last_active":"2024-09-12T16:52:35.024118+0000","last_peered":"2024-09-12T16:52:35.024118+0000","last_clean":"2024-09-12T16:52:35.024118+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:52:35.024118+0000","last_undegraded":"2024-09-12T16:52:35.024118+0000","last_fullsized":"2024-09-12T16:52:35.024118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:24.385068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.437862+0000","last_change":"2024-09-12T16:52:06.234025+0000","last_active":"2024-09-12T16:54:11.437862+0000","last_peered":"2024-09-12T16:54:11.437862+0000","last_clean":"2024-09-12T16:54:11.437862+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:54:11.437862+0000","last_undegraded":"2024-09-12T16:54:11.437862+0000","last_fullsized":"2024-09-12T16:54:11.437862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:23.554247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491550+0000","last_change":"2024-09-12T16:51:58.153302+0000","last_active":"2024-09-12T16:55:12.491550+0000","last_peered":"2024-09-12T16:55:12.491550+0000","last_clean":"2024-09-12T16:55:12.491550+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:55:12.491550+0000","last_undegraded":"2024-09-12T16:55:12.491550+0000","last_fullsized":"2024-09-12T16:55:12.491550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:40.425831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.374105+0000","last_change":"2024-09-12T16:51:56.163659+0000","last_active":"2024-09-12T16:55:12.374105+0000","last_peered":"2024-09-12T16:55:12.374105+0000","last_clean":"2024-09-12T16:55:12.374105+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:55:12.374105+0000","last_undegraded":"2024-09-12T16:55:12.374105+0000","last_fullsized":"2024-09-12T16:55:12.374105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:06.765327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043977+0000","last_change":"2024-09-12T16:52:00.162650+0000","last_active":"2024-09-12T16:52:35.043977+0000","last_peered":"2024-09-12T16:52:35.043977+0000","last_clean":"2024-09-12T16:52:35.043977+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:52:35.043977+0000","last_undegraded":"2024-09-12T16:52:35.043977+0000","last_fullsized":"2024-09-12T16:52:35.043977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.597418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.050080+0000","last_change":"2024-09-12T16:52:02.216308+0000","last_active":"2024-09-12T16:52:35.050080+0000","last_peered":"2024-09-12T16:52:35.050080+0000","last_clean":"2024-09-12T16:52:35.050080+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:52:35.050080+0000","last_undegraded":"2024-09-12T16:52:35.050080+0000","last_fullsized":"2024-09-12T16:52:35.050080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:12.930560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419678+0000","last_change":"2024-09-12T16:52:04.219251+0000","last_active":"2024-09-12T16:55:10.419678+0000","last_peered":"2024-09-12T16:55:10.419678+0000","last_clean":"2024-09-12T16:55:10.419678+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:55:10.419678+0000","last_undegraded":"2024-09-12T16:55:10.419678+0000","last_fullsized":"2024-09-12T16:55:10.419678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.043443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020791+0000","last_change":"2024-09-12T16:52:06.232237+0000","last_active":"2024-09-12T16:52:35.020791+0000","last_peered":"2024-09-12T16:52:35.020791+0000","last_clean":"2024-09-12T16:52:35.020791+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:52:35.020791+0000","last_undegraded":"2024-09-12T16:52:35.020791+0000","last_fullsized":"2024-09-12T16:52:35.020791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:08.018725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.407369+0000","last_change":"2024-09-12T16:51:58.142849+0000","last_active":"2024-09-12T16:55:12.407369+0000","last_peered":"2024-09-12T16:55:12.407369+0000","last_clean":"2024-09-12T16:55:12.407369+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:55:12.407369+0000","last_undegraded":"2024-09-12T16:55:12.407369+0000","last_fullsized":"2024-09-12T16:55:12.407369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.603060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043118+0000","last_change":"2024-09-12T16:51:56.145893+0000","last_active":"2024-09-12T16:52:35.043118+0000","last_peered":"2024-09-12T16:52:35.043118+0000","last_clean":"2024-09-12T16:52:35.043118+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:52:35.043118+0000","last_undegraded":"2024-09-12T16:52:35.043118+0000","last_fullsized":"2024-09-12T16:52:35.043118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:01.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031597+0000","last_change":"2024-09-12T16:52:00.179417+0000","last_active":"2024-09-12T16:52:35.031597+0000","last_peered":"2024-09-12T16:52:35.031597+0000","last_clean":"2024-09-12T16:52:35.031597+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:52:35.031597+0000","last_undegraded":"2024-09-12T16:52:35.031597+0000","last_fullsized":"2024-09-12T16:52:35.031597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:39.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.971611+0000","last_change":"2024-09-12T16:52:02.182087+0000","last_active":"2024-09-12T16:54:08.971611+0000","last_peered":"2024-09-12T16:54:08.971611+0000","last_clean":"2024-09-12T16:54:08.971611+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:54:08.971611+0000","last_undegraded":"2024-09-12T16:54:08.971611+0000","last_fullsized":"2024-09-12T16:54:08.971611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:10.821781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021023+0000","last_change":"2024-09-12T16:52:04.206758+0000","last_active":"2024-09-12T16:52:35.021023+0000","last_peered":"2024-09-12T16:52:35.021023+0000","last_clean":"2024-09-12T16:52:35.021023+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:52:35.021023+0000","last_undegraded":"2024-09-12T16:52:35.021023+0000","last_fullsized":"2024-09-12T16:52:35.021023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.089165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047680+0000","last_change":"2024-09-12T16:52:06.224320+0000","last_active":"2024-09-12T16:52:35.047680+0000","last_peered":"2024-09-12T16:52:35.047680+0000","last_clean":"2024-09-12T16:52:35.047680+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:52:35.047680+0000","last_undegraded":"2024-09-12T16:52:35.047680+0000","last_fullsized":"2024-09-12T16:52:35.047680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:34.785095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.062896+0000","last_change":"2024-09-12T16:51:58.141944+0000","last_active":"2024-09-12T16:55:12.062896+0000","last_peered":"2024-09-12T16:55:12.062896+0000","last_clean":"2024-09-12T16:55:12.062896+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:55:12.062896+0000","last_undegraded":"2024-09-12T16:55:12.062896+0000","last_fullsized":"2024-09-12T16:55:12.062896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047893+0000","last_change":"2024-09-12T16:51:56.169511+0000","last_active":"2024-09-12T16:52:35.047893+0000","last_peered":"2024-09-12T16:52:35.047893+0000","last_clean":"2024-09-12T16:52:35.047893+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:52:35.047893+0000","last_undegraded":"2024-09-12T16:52:35.047893+0000","last_fullsized":"2024-09-12T16:52:35.047893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:28.067613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020018+0000","last_change":"2024-09-12T16:52:00.183375+0000","last_active":"2024-09-12T16:52:35.020018+0000","last_peered":"2024-09-12T16:52:35.020018+0000","last_clean":"2024-09-12T16:52:35.020018+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:52:35.020018+0000","last_undegraded":"2024-09-12T16:52:35.020018+0000","last_fullsized":"2024-09-12T16:52:35.020018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.969978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.771290+0000","last_change":"2024-09-12T16:52:02.175268+0000","last_active":"2024-09-12T16:55:43.771290+0000","last_peered":"2024-09-12T16:55:43.771290+0000","last_clean":"2024-09-12T16:55:43.771290+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:55:43.771290+0000","last_undegraded":"2024-09-12T16:55:43.771290+0000","last_fullsized":"2024-09-12T16:55:43.771290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:54.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022138+0000","last_change":"2024-09-12T16:52:04.209135+0000","last_active":"2024-09-12T16:52:35.022138+0000","last_peered":"2024-09-12T16:52:35.022138+0000","last_clean":"2024-09-12T16:52:35.022138+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:52:35.022138+0000","last_undegraded":"2024-09-12T16:52:35.022138+0000","last_fullsized":"2024-09-12T16:52:35.022138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:49.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.442179+0000","last_change":"2024-09-12T16:52:06.237385+0000","last_active":"2024-09-12T16:54:11.442179+0000","last_peered":"2024-09-12T16:54:11.442179+0000","last_clean":"2024-09-12T16:54:11.442179+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:54:11.442179+0000","last_undegraded":"2024-09-12T16:54:11.442179+0000","last_fullsized":"2024-09-12T16:54:11.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:58.165732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406440+0000","last_change":"2024-09-12T16:51:58.168050+0000","last_active":"2024-09-12T16:55:12.406440+0000","last_peered":"2024-09-12T16:55:12.406440+0000","last_clean":"2024-09-12T16:55:12.406440+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:55:12.406440+0000","last_undegraded":"2024-09-12T16:55:12.406440+0000","last_fullsized":"2024-09-12T16:55:12.406440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:30.432926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.563604+0000","last_change":"2024-09-12T16:51:56.158228+0000","last_active":"2024-09-12T16:52:42.563604+0000","last_peered":"2024-09-12T16:52:42.563604+0000","last_clean":"2024-09-12T16:52:42.563604+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:52:42.563604+0000","last_undegraded":"2024-09-12T16:52:42.563604+0000","last_fullsized":"2024-09-12T16:52:42.563604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:35.587454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022978+0000","last_change":"2024-09-12T16:52:00.162253+0000","last_active":"2024-09-12T16:52:35.022978+0000","last_peered":"2024-09-12T16:52:35.022978+0000","last_clean":"2024-09-12T16:52:35.022978+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:52:35.022978+0000","last_undegraded":"2024-09-12T16:52:35.022978+0000","last_fullsized":"2024-09-12T16:52:35.022978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:02.417426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'27","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:36.031143+0000","last_change":"2024-09-12T16:52:02.212684+0000","last_active":"2024-09-12T16:54:36.031143+0000","last_peered":"2024-09-12T16:54:36.031143+0000","last_clean":"2024-09-12T16:54:36.031143+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:54:36.031143+0000","last_undegraded":"2024-09-12T16:54:36.031143+0000","last_fullsized":"2024-09-12T16:54:36.031143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:00.299441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032673+0000","last_change":"2024-09-12T16:52:04.209557+0000","last_active":"2024-09-12T16:52:35.032673+0000","last_peered":"2024-09-12T16:52:35.032673+0000","last_clean":"2024-09-12T16:52:35.032673+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:52:35.032673+0000","last_undegraded":"2024-09-12T16:52:35.032673+0000","last_fullsized":"2024-09-12T16:52:35.032673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:33.026740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.024814+0000","last_change":"2024-09-12T16:52:06.234752+0000","last_active":"2024-09-12T16:54:09.024814+0000","last_peered":"2024-09-12T16:54:09.024814+0000","last_clean":"2024-09-12T16:54:09.024814+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:54:09.024814+0000","last_undegraded":"2024-09-12T16:54:09.024814+0000","last_fullsized":"2024-09-12T16:54:09.024814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.433924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406497+0000","last_change":"2024-09-12T16:51:58.141857+0000","last_active":"2024-09-12T16:55:12.406497+0000","last_peered":"2024-09-12T16:55:12.406497+0000","last_clean":"2024-09-12T16:55:12.406497+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:55:12.406497+0000","last_undegraded":"2024-09-12T16:55:12.406497+0000","last_fullsized":"2024-09-12T16:55:12.406497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:34.368226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.365932+0000","last_change":"2024-09-12T16:51:56.157950+0000","last_active":"2024-09-12T16:55:12.365932+0000","last_peered":"2024-09-12T16:55:12.365932+0000","last_clean":"2024-09-12T16:55:12.365932+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:12.365932+0000","last_undegraded":"2024-09-12T16:55:12.365932+0000","last_fullsized":"2024-09-12T16:55:12.365932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:44.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:07.263520+0000","last_change":"2024-09-12T16:52:00.163609+0000","last_active":"2024-09-12T16:54:07.263520+0000","last_peered":"2024-09-12T16:54:07.263520+0000","last_clean":"2024-09-12T16:54:07.263520+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:54:07.263520+0000","last_undegraded":"2024-09-12T16:54:07.263520+0000","last_fullsized":"2024-09-12T16:54:07.263520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:40.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.481851+0000","last_change":"2024-09-12T16:52:02.212039+0000","last_active":"2024-09-12T16:55:11.481851+0000","last_peered":"2024-09-12T16:55:11.481851+0000","last_clean":"2024-09-12T16:55:11.481851+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:55:11.481851+0000","last_undegraded":"2024-09-12T16:55:11.481851+0000","last_fullsized":"2024-09-12T16:55:11.481851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:30.940482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022180+0000","last_change":"2024-09-12T16:52:04.194659+0000","last_active":"2024-09-12T16:52:35.022180+0000","last_peered":"2024-09-12T16:52:35.022180+0000","last_clean":"2024-09-12T16:52:35.022180+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:52:35.022180+0000","last_undegraded":"2024-09-12T16:52:35.022180+0000","last_fullsized":"2024-09-12T16:52:35.022180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:10.799769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.029336+0000","last_change":"2024-09-12T16:52:06.237422+0000","last_active":"2024-09-12T16:54:09.029336+0000","last_peered":"2024-09-12T16:54:09.029336+0000","last_clean":"2024-09-12T16:54:09.029336+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:54:09.029336+0000","last_undegraded":"2024-09-12T16:54:09.029336+0000","last_fullsized":"2024-09-12T16:54:09.029336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:35.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.020472+0000","last_change":"2024-09-12T16:51:58.171119+0000","last_active":"2024-09-12T16:54:11.020472+0000","last_peered":"2024-09-12T16:54:11.020472+0000","last_clean":"2024-09-12T16:54:11.020472+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:54:11.020472+0000","last_undegraded":"2024-09-12T16:54:11.020472+0000","last_fullsized":"2024-09-12T16:54:11.020472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:42.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015512+0000","last_change":"2024-09-12T16:51:56.153106+0000","last_active":"2024-09-12T16:52:35.015512+0000","last_peered":"2024-09-12T16:52:35.015512+0000","last_clean":"2024-09-12T16:52:35.015512+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:52:35.015512+0000","last_undegraded":"2024-09-12T16:52:35.015512+0000","last_fullsized":"2024-09-12T16:52:35.015512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:35.393789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'13","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450215+0000","last_change":"2024-09-12T16:51:58.149936+0000","last_active":"2024-09-12T16:54:11.450215+0000","last_peered":"2024-09-12T16:54:11.450215+0000","last_clean":"2024-09-12T16:54:11.450215+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:54:11.450215+0000","last_undegraded":"2024-09-12T16:54:11.450215+0000","last_fullsized":"2024-09-12T16:54:11.450215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:45.542639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.109318+0000","last_change":"2024-09-12T16:51:56.165393+0000","last_active":"2024-09-12T16:54:11.109318+0000","last_peered":"2024-09-12T16:54:11.109318+0000","last_clean":"2024-09-12T16:54:11.109318+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:54:11.109318+0000","last_undegraded":"2024-09-12T16:54:11.109318+0000","last_fullsized":"2024-09-12T16:54:11.109318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:22.213222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559962+0000","last_change":"2024-09-12T16:51:58.172460+0000","last_active":"2024-09-12T16:55:12.559962+0000","last_peered":"2024-09-12T16:55:12.559962+0000","last_clean":"2024-09-12T16:55:12.559962+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:55:12.559962+0000","last_undegraded":"2024-09-12T16:55:12.559962+0000","last_fullsized":"2024-09-12T16:55:12.559962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:11.477678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033006+0000","last_change":"2024-09-12T16:51:56.154964+0000","last_active":"2024-09-12T16:52:35.033006+0000","last_peered":"2024-09-12T16:52:35.033006+0000","last_clean":"2024-09-12T16:52:35.033006+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:52:35.033006+0000","last_undegraded":"2024-09-12T16:52:35.033006+0000","last_fullsized":"2024-09-12T16:52:35.033006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:09.313014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206890+0000","last_change":"2024-09-12T16:51:58.153420+0000","last_active":"2024-09-12T16:55:12.206890+0000","last_peered":"2024-09-12T16:55:12.206890+0000","last_clean":"2024-09-12T16:55:12.206890+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:55:12.206890+0000","last_undegraded":"2024-09-12T16:55:12.206890+0000","last_fullsized":"2024-09-12T16:55:12.206890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:45.866817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.748616+0000","last_change":"2024-09-12T16:51:56.170783+0000","last_active":"2024-09-12T16:54:06.748616+0000","last_peered":"2024-09-12T16:54:06.748616+0000","last_clean":"2024-09-12T16:54:06.748616+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:54:06.748616+0000","last_undegraded":"2024-09-12T16:54:06.748616+0000","last_fullsized":"2024-09-12T16:54:06.748616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:07.556912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.059507+0000","last_change":"2024-09-12T16:52:35.058216+0000","last_active":"2024-09-12T16:52:35.059507+0000","last_peered":"2024-09-12T16:52:35.059507+0000","last_clean":"2024-09-12T16:52:35.059507+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:52:35.059507+0000","last_undegraded":"2024-09-12T16:52:35.059507+0000","last_fullsized":"2024-09-12T16:52:35.059507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:04.174584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024027+0000","last_change":"2024-09-12T16:51:56.159691+0000","last_active":"2024-09-12T16:52:35.024027+0000","last_peered":"2024-09-12T16:52:35.024027+0000","last_clean":"2024-09-12T16:52:35.024027+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:52:35.024027+0000","last_undegraded":"2024-09-12T16:52:35.024027+0000","last_fullsized":"2024-09-12T16:52:35.024027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.592397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038033+0000","last_change":"2024-09-12T16:51:58.173240+0000","last_active":"2024-09-12T16:52:35.038033+0000","last_peered":"2024-09-12T16:52:35.038033+0000","last_clean":"2024-09-12T16:52:35.038033+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:52:35.038033+0000","last_undegraded":"2024-09-12T16:52:35.038033+0000","last_fullsized":"2024-09-12T16:52:35.038033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:49.259251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.573852+0000","last_change":"2024-09-12T16:51:56.165516+0000","last_active":"2024-09-12T16:52:42.573852+0000","last_peered":"2024-09-12T16:52:42.573852+0000","last_clean":"2024-09-12T16:52:42.573852+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:52:42.573852+0000","last_undegraded":"2024-09-12T16:52:42.573852+0000","last_fullsized":"2024-09-12T16:52:42.573852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:35.139651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762612+0000","last_change":"2024-09-12T16:51:58.149306+0000","last_active":"2024-09-12T16:53:25.762612+0000","last_peered":"2024-09-12T16:53:25.762612+0000","last_clean":"2024-09-12T16:53:25.762612+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:53:25.762612+0000","last_undegraded":"2024-09-12T16:53:25.762612+0000","last_fullsized":"2024-09-12T16:53:25.762612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092689+0000","last_change":"2024-09-12T16:51:56.150773+0000","last_active":"2024-09-12T16:52:41.092689+0000","last_peered":"2024-09-12T16:52:41.092689+0000","last_clean":"2024-09-12T16:52:41.092689+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:52:41.092689+0000","last_undegraded":"2024-09-12T16:52:41.092689+0000","last_fullsized":"2024-09-12T16:52:41.092689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:22.213222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.220234+0000","last_change":"2024-09-12T16:51:58.162339+0000","last_active":"2024-09-12T16:55:12.220234+0000","last_peered":"2024-09-12T16:55:12.220234+0000","last_clean":"2024-09-12T16:55:12.220234+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:55:12.220234+0000","last_undegraded":"2024-09-12T16:55:12.220234+0000","last_fullsized":"2024-09-12T16:55:12.220234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:52.597412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092203+0000","last_change":"2024-09-12T16:51:56.158411+0000","last_active":"2024-09-12T16:52:41.092203+0000","last_peered":"2024-09-12T16:52:41.092203+0000","last_clean":"2024-09-12T16:52:41.092203+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:52:41.092203+0000","last_undegraded":"2024-09-12T16:52:41.092203+0000","last_fullsized":"2024-09-12T16:52:41.092203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:45.612366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.159807+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:05.194424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023142+0000","last_change":"2024-09-12T16:51:56.155038+0000","last_active":"2024-09-12T16:52:35.023142+0000","last_peered":"2024-09-12T16:52:35.023142+0000","last_clean":"2024-09-12T16:52:35.023142+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:52:35.023142+0000","last_undegraded":"2024-09-12T16:52:35.023142+0000","last_fullsized":"2024-09-12T16:52:35.023142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:24.208686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491894+0000","last_change":"2024-09-12T16:51:58.159514+0000","last_active":"2024-09-12T16:55:12.491894+0000","last_peered":"2024-09-12T16:55:12.491894+0000","last_clean":"2024-09-12T16:55:12.491894+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:55:12.491894+0000","last_undegraded":"2024-09-12T16:55:12.491894+0000","last_fullsized":"2024-09-12T16:55:12.491894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.364726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021975+0000","last_change":"2024-09-12T16:51:56.167940+0000","last_active":"2024-09-12T16:52:35.021975+0000","last_peered":"2024-09-12T16:52:35.021975+0000","last_clean":"2024-09-12T16:52:35.021975+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:52:35.021975+0000","last_undegraded":"2024-09-12T16:52:35.021975+0000","last_fullsized":"2024-09-12T16:52:35.021975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:08.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405710+0000","last_change":"2024-09-12T16:51:58.176452+0000","last_active":"2024-09-12T16:55:12.405710+0000","last_peered":"2024-09-12T16:55:12.405710+0000","last_clean":"2024-09-12T16:55:12.405710+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:55:12.405710+0000","last_undegraded":"2024-09-12T16:55:12.405710+0000","last_fullsized":"2024-09-12T16:55:12.405710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:45.955514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033519+0000","last_change":"2024-09-12T16:51:56.166412+0000","last_active":"2024-09-12T16:52:35.033519+0000","last_peered":"2024-09-12T16:52:35.033519+0000","last_clean":"2024-09-12T16:52:35.033519+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:52:35.033519+0000","last_undegraded":"2024-09-12T16:52:35.033519+0000","last_fullsized":"2024-09-12T16:52:35.033519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:20.820430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.309364+0000","last_change":"2024-09-12T16:51:58.146572+0000","last_active":"2024-09-12T16:52:43.309364+0000","last_peered":"2024-09-12T16:52:43.309364+0000","last_clean":"2024-09-12T16:52:43.309364+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:52:43.309364+0000","last_undegraded":"2024-09-12T16:52:43.309364+0000","last_fullsized":"2024-09-12T16:52:43.309364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:01.315966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038391+0000","last_change":"2024-09-12T16:51:56.158751+0000","last_active":"2024-09-12T16:52:35.038391+0000","last_peered":"2024-09-12T16:52:35.038391+0000","last_clean":"2024-09-12T16:52:35.038391+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:52:35.038391+0000","last_undegraded":"2024-09-12T16:52:35.038391+0000","last_fullsized":"2024-09-12T16:52:35.038391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:44.033762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114250+0000","last_change":"2024-09-12T16:51:58.172245+0000","last_active":"2024-09-12T16:53:26.114250+0000","last_peered":"2024-09-12T16:53:26.114250+0000","last_clean":"2024-09-12T16:53:26.114250+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:53:26.114250+0000","last_undegraded":"2024-09-12T16:53:26.114250+0000","last_fullsized":"2024-09-12T16:53:26.114250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:30.077956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.087965+0000","last_change":"2024-09-12T16:51:56.153153+0000","last_active":"2024-09-12T16:52:41.087965+0000","last_peered":"2024-09-12T16:52:41.087965+0000","last_clean":"2024-09-12T16:52:41.087965+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:52:41.087965+0000","last_undegraded":"2024-09-12T16:52:41.087965+0000","last_fullsized":"2024-09-12T16:52:41.087965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:50.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204146+0000","last_change":"2024-09-12T16:51:58.148643+0000","last_active":"2024-09-12T16:55:12.204146+0000","last_peered":"2024-09-12T16:55:12.204146+0000","last_clean":"2024-09-12T16:55:12.204146+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:55:12.204146+0000","last_undegraded":"2024-09-12T16:55:12.204146+0000","last_fullsized":"2024-09-12T16:55:12.204146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:32.984633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048111+0000","last_change":"2024-09-12T16:51:56.166599+0000","last_active":"2024-09-12T16:52:35.048111+0000","last_peered":"2024-09-12T16:52:35.048111+0000","last_clean":"2024-09-12T16:52:35.048111+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:52:35.048111+0000","last_undegraded":"2024-09-12T16:52:35.048111+0000","last_fullsized":"2024-09-12T16:52:35.048111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.428924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206978+0000","last_change":"2024-09-12T16:52:35.049949+0000","last_active":"2024-09-12T16:55:12.206978+0000","last_peered":"2024-09-12T16:55:12.206978+0000","last_clean":"2024-09-12T16:55:12.206978+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:55:12.206978+0000","last_undegraded":"2024-09-12T16:55:12.206978+0000","last_fullsized":"2024-09-12T16:55:12.206978+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.495939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092683+0000","last_change":"2024-09-12T16:51:56.150301+0000","last_active":"2024-09-12T16:52:41.092683+0000","last_peered":"2024-09-12T16:52:41.092683+0000","last_clean":"2024-09-12T16:52:41.092683+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:52:41.092683+0000","last_undegraded":"2024-09-12T16:52:41.092683+0000","last_fullsized":"2024-09-12T16:52:41.092683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.592397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.434439+0000","last_change":"2024-09-12T16:51:58.159251+0000","last_active":"2024-09-12T16:54:11.434439+0000","last_peered":"2024-09-12T16:54:11.434439+0000","last_clean":"2024-09-12T16:54:11.434439+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:54:11.434439+0000","last_undegraded":"2024-09-12T16:54:11.434439+0000","last_fullsized":"2024-09-12T16:54:11.434439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:33.404970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.094347+0000","last_change":"2024-09-12T16:51:56.169106+0000","last_active":"2024-09-12T16:52:41.094347+0000","last_peered":"2024-09-12T16:52:41.094347+0000","last_clean":"2024-09-12T16:52:41.094347+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:52:41.094347+0000","last_undegraded":"2024-09-12T16:52:41.094347+0000","last_fullsized":"2024-09-12T16:52:41.094347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:11.710348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.567566+0000","last_change":"2024-09-12T16:51:56.155830+0000","last_active":"2024-09-12T16:52:42.567566+0000","last_peered":"2024-09-12T16:52:42.567566+0000","last_clean":"2024-09-12T16:52:42.567566+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:52:42.567566+0000","last_undegraded":"2024-09-12T16:52:42.567566+0000","last_fullsized":"2024-09-12T16:52:42.567566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.219841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030048+0000","last_change":"2024-09-12T16:51:58.164418+0000","last_active":"2024-09-12T16:52:35.030048+0000","last_peered":"2024-09-12T16:52:35.030048+0000","last_clean":"2024-09-12T16:52:35.030048+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:52:35.030048+0000","last_undegraded":"2024-09-12T16:52:35.030048+0000","last_fullsized":"2024-09-12T16:52:35.030048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:15.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025775+0000","last_change":"2024-09-12T16:51:56.171869+0000","last_active":"2024-09-12T16:52:35.025775+0000","last_peered":"2024-09-12T16:52:35.025775+0000","last_clean":"2024-09-12T16:52:35.025775+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:52:35.025775+0000","last_undegraded":"2024-09-12T16:52:35.025775+0000","last_fullsized":"2024-09-12T16:52:35.025775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:08.525437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.246329+0000","last_change":"2024-09-12T16:51:58.173368+0000","last_active":"2024-09-12T16:52:42.246329+0000","last_peered":"2024-09-12T16:52:42.246329+0000","last_clean":"2024-09-12T16:52:42.246329+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:52:42.246329+0000","last_undegraded":"2024-09-12T16:52:42.246329+0000","last_fullsized":"2024-09-12T16:52:42.246329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:45.341574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21619584,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":87,"num_write":310,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25817088,"data_stored":25817088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640307,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8758283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640308,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44764,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327076,"statfs":{"total":96636764160,"available":96590925824,"internally_reserved":0,"allocated":9646080,"data_stored":9347905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48904,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322936,"statfs":{"total":96636764160,"available":96586686464,"internally_reserved":0,"allocated":9625600,"data_stored":9346317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48344,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323496,"statfs":{"total":96636764160,"available":96587259904,"internally_reserved":0,"allocated":9052160,"data_stored":8759273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:55:44.752 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T16:55:44.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:55:44.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.897+0000 7f2345246640 1 Processor -- start 2024-09-12T16:55:44.903 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.897+0000 7f2345246640 1 -- start start 2024-09-12T16:55:44.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.897+0000 7f2345246640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2340111890 0x7f2340132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.904 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.897+0000 7f2345246640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2340073a90 con 0x7f2340110da0 2024-09-12T16:55:44.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.897+0000 7f2345246640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f23400696e0 con 0x7f2340111890 2024-09-12T16:55:44.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233e59c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2340111890 0x7f2340132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233ed9d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f2340110da0 0x7f2340111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36716/0 (socket says 172.21.15.122:36716) 2024-09-12T16:55:44.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233ed9d640 1 -- 172.21.15.122:0/469399217 learned_addr learned my addr 172.21.15.122:0/469399217 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:44.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233e59c640 1 -- 172.21.15.122:0/469399217 >> v1:172.21.15.122:6789/0 conn(0x7f2340110da0 legacy=0x7f2340111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.905 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233e59c640 1 -- 172.21.15.122:0/469399217 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234006dd50 con 0x7f2340111890 2024-09-12T16:55:44.906 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233e59c640 1 --2- 172.21.15.122:0/469399217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340111890 0x7f2340132450 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2328009740 tx=0x7f232801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bac15822ec4467 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233dd9b640 1 -- 172.21.15.122:0/469399217 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23280b0070 con 0x7f2340111890 2024-09-12T16:55:44.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233dd9b640 1 -- 172.21.15.122:0/469399217 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23280ab530 con 0x7f2340111890 2024-09-12T16:55:44.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f233dd9b640 1 -- 172.21.15.122:0/469399217 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23280ab830 con 0x7f2340111890 2024-09-12T16:55:44.907 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f2345246640 1 -- 172.21.15.122:0/469399217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340111890 msgr2=0x7f2340132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:44.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f2345246640 1 --2- 172.21.15.122:0/469399217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340111890 0x7f2340132450 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2328009740 tx=0x7f232801c370 comp rx=0 tx=0).stop 2024-09-12T16:55:44.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f2345246640 1 -- 172.21.15.122:0/469399217 shutdown_connections 2024-09-12T16:55:44.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f2345246640 1 --2- 172.21.15.122:0/469399217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340111890 0x7f2340132450 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:44.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f2345246640 1 -- 172.21.15.122:0/469399217 >> 172.21.15.122:0/469399217 conn(0x7f2340070900 msgr2=0x7f2340072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:44.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f2345246640 1 -- 172.21.15.122:0/469399217 shutdown_connections 2024-09-12T16:55:44.908 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.901+0000 7f2345246640 1 -- 172.21.15.122:0/469399217 wait complete. 2024-09-12T16:55:44.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f2345246640 1 Processor -- start 2024-09-12T16:55:44.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f2345246640 1 -- start start 2024-09-12T16:55:44.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f2345246640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340110da0 0x7f2340122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.909 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f2345246640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2340135330 con 0x7f2340110da0 2024-09-12T16:55:44.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f233ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340110da0 0x7f2340122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f233ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340110da0 0x7f2340122a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58802/0 (socket says 172.21.15.122:58802) 2024-09-12T16:55:44.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f233ed9d640 1 -- 172.21.15.122:0/4054281448 learned_addr learned my addr 172.21.15.122:0/4054281448 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:44.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f233ed9d640 1 -- 172.21.15.122:0/4054281448 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2340131dd0 con 0x7f2340110da0 2024-09-12T16:55:44.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f233ed9d640 1 --2- 172.21.15.122:0/4054281448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340110da0 0x7f2340122a50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f233000cbd0 tx=0x7f233000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f23377fe640 1 -- 172.21.15.122:0/4054281448 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2330017070 con 0x7f2340110da0 2024-09-12T16:55:44.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f23377fe640 1 -- 172.21.15.122:0/4054281448 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f233000abc0 con 0x7f2340110da0 2024-09-12T16:55:44.910 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f23377fe640 1 -- 172.21.15.122:0/4054281448 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2330012400 con 0x7f2340110da0 2024-09-12T16:55:44.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234012fee0 con 0x7f2340110da0 2024-09-12T16:55:44.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2340130f70 con 0x7f2340110da0 2024-09-12T16:55:44.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2340111180 con 0x7f2340110da0 2024-09-12T16:55:44.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f23377fe640 1 -- 172.21.15.122:0/4054281448 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f233001a070 con 0x7f2340110da0 2024-09-12T16:55:44.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f23377fe640 1 --2- 172.21.15.122:0/4054281448 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f232003b1d0 0x7f232003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:44.911 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f23377fe640 1 -- 172.21.15.122:0/4054281448 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f233004f6f0 con 0x7f2340110da0 2024-09-12T16:55:44.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.905+0000 7f233e59c640 1 --2- 172.21.15.122:0/4054281448 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f232003b1d0 0x7f232003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:44.912 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.909+0000 7f233e59c640 1 --2- 172.21.15.122:0/4054281448 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f232003b1d0 0x7f232003d690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23280ad000 tx=0x7f23280a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:44.916 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:44.909+0000 7f23377fe640 1 -- 172.21.15.122:0/4054281448 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f23300078c0 con 0x7f2340110da0 2024-09-12T16:55:45.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.073+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2340122f90 con 0x7f232003b1d0 2024-09-12T16:55:45.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.097+0000 7f23377fe640 1 -- 172.21.15.122:0/4054281448 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666050 (secure 0 0 0) 0x7f23280ab500 con 0x7f232003b1d0 2024-09-12T16:55:45.109 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:55:45.115 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:55:45.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f232003b1d0 msgr2=0x7f232003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:45.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 --2- 172.21.15.122:0/4054281448 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f232003b1d0 0x7f232003d690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23280ad000 tx=0x7f23280a6000 comp rx=0 tx=0).stop 2024-09-12T16:55:45.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340110da0 msgr2=0x7f2340122a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:45.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 --2- 172.21.15.122:0/4054281448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340110da0 0x7f2340122a50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f233000cbd0 tx=0x7f233000a430 comp rx=0 tx=0).stop 2024-09-12T16:55:45.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 shutdown_connections 2024-09-12T16:55:45.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 --2- 172.21.15.122:0/4054281448 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f232003b1d0 0x7f232003d690 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:45.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 --2- 172.21.15.122:0/4054281448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340110da0 0x7f2340122a50 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:45.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 >> 172.21.15.122:0/4054281448 conn(0x7f2340070900 msgr2=0x7f2340071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:45.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 shutdown_connections 2024-09-12T16:55:45.118 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.105+0000 7f2345246640 1 -- 172.21.15.122:0/4054281448 wait complete. 2024-09-12T16:55:45.125 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-12T16:55:44.044651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22226705,"num_objects":228,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":4969,"num_read_kb":4550,"num_write":2065,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4466,"ondisk_log_size":4466,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190392,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377296968,"statfs":{"total":386547056640,"available":386352095232,"internally_reserved":0,"allocated":37412864,"data_stored":36211778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4190208,"num_objects":-1,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":47,"num_read_kb":46,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006774"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.089853+0000","last_change":"2024-09-12T16:51:56.151833+0000","last_active":"2024-09-12T16:52:41.089853+0000","last_peered":"2024-09-12T16:52:41.089853+0000","last_clean":"2024-09-12T16:52:41.089853+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:52:41.089853+0000","last_undegraded":"2024-09-12T16:52:41.089853+0000","last_fullsized":"2024-09-12T16:52:41.089853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:07.556912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559689+0000","last_change":"2024-09-12T16:51:58.150328+0000","last_active":"2024-09-12T16:55:12.559689+0000","last_peered":"2024-09-12T16:55:12.559689+0000","last_clean":"2024-09-12T16:55:12.559689+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:55:12.559689+0000","last_undegraded":"2024-09-12T16:55:12.559689+0000","last_fullsized":"2024-09-12T16:55:12.559689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:31.991784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026353+0000","last_change":"2024-09-12T16:51:56.161722+0000","last_active":"2024-09-12T16:52:35.026353+0000","last_peered":"2024-09-12T16:52:35.026353+0000","last_clean":"2024-09-12T16:52:35.026353+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:52:35.026353+0000","last_undegraded":"2024-09-12T16:52:35.026353+0000","last_fullsized":"2024-09-12T16:52:35.026353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:40.529043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.493995+0000","last_change":"2024-09-12T16:51:58.166339+0000","last_active":"2024-09-12T16:55:12.493995+0000","last_peered":"2024-09-12T16:55:12.493995+0000","last_clean":"2024-09-12T16:55:12.493995+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:55:12.493995+0000","last_undegraded":"2024-09-12T16:55:12.493995+0000","last_fullsized":"2024-09-12T16:55:12.493995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.116016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048410+0000","last_change":"2024-09-12T16:51:56.164645+0000","last_active":"2024-09-12T16:52:35.048410+0000","last_peered":"2024-09-12T16:52:35.048410+0000","last_clean":"2024-09-12T16:52:35.048410+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:52:35.048410+0000","last_undegraded":"2024-09-12T16:52:35.048410+0000","last_fullsized":"2024-09-12T16:52:35.048410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:14.665769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.425082+0000","last_change":"2024-09-12T16:51:58.163269+0000","last_active":"2024-09-12T16:55:12.425082+0000","last_peered":"2024-09-12T16:55:12.425082+0000","last_clean":"2024-09-12T16:55:12.425082+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:55:12.425082+0000","last_undegraded":"2024-09-12T16:55:12.425082+0000","last_fullsized":"2024-09-12T16:55:12.425082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:17.060923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.018273+0000","last_change":"2024-09-12T16:51:56.150421+0000","last_active":"2024-09-12T16:52:35.018273+0000","last_peered":"2024-09-12T16:52:35.018273+0000","last_clean":"2024-09-12T16:52:35.018273+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:52:35.018273+0000","last_undegraded":"2024-09-12T16:52:35.018273+0000","last_fullsized":"2024-09-12T16:52:35.018273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:08.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559316+0000","last_change":"2024-09-12T16:51:58.165836+0000","last_active":"2024-09-12T16:55:12.559316+0000","last_peered":"2024-09-12T16:55:12.559316+0000","last_clean":"2024-09-12T16:55:12.559316+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:55:12.559316+0000","last_undegraded":"2024-09-12T16:55:12.559316+0000","last_fullsized":"2024-09-12T16:55:12.559316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.786300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038726+0000","last_change":"2024-09-12T16:51:56.155368+0000","last_active":"2024-09-12T16:52:35.038726+0000","last_peered":"2024-09-12T16:52:35.038726+0000","last_clean":"2024-09-12T16:52:35.038726+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:52:35.038726+0000","last_undegraded":"2024-09-12T16:52:35.038726+0000","last_fullsized":"2024-09-12T16:52:35.038726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:23.509728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.310094+0000","last_change":"2024-09-12T16:51:58.148537+0000","last_active":"2024-09-12T16:52:43.310094+0000","last_peered":"2024-09-12T16:52:43.310094+0000","last_clean":"2024-09-12T16:52:43.310094+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:52:43.310094+0000","last_undegraded":"2024-09-12T16:52:43.310094+0000","last_fullsized":"2024-09-12T16:52:43.310094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:36.641527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.812642+0000","last_change":"2024-09-12T16:51:56.149239+0000","last_active":"2024-09-12T16:55:11.812642+0000","last_peered":"2024-09-12T16:55:11.812642+0000","last_clean":"2024-09-12T16:55:11.812642+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:55:11.812642+0000","last_undegraded":"2024-09-12T16:55:11.812642+0000","last_fullsized":"2024-09-12T16:55:11.812642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:48.008590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":12,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.756687+0000","last_change":"2024-09-12T16:51:58.165599+0000","last_active":"2024-09-12T16:54:06.756687+0000","last_peered":"2024-09-12T16:54:06.756687+0000","last_clean":"2024-09-12T16:54:06.756687+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:54:06.756687+0000","last_undegraded":"2024-09-12T16:54:06.756687+0000","last_fullsized":"2024-09-12T16:54:06.756687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:30.151277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.027975+0000","last_change":"2024-09-12T16:51:56.154655+0000","last_active":"2024-09-12T16:54:26.027975+0000","last_peered":"2024-09-12T16:54:26.027975+0000","last_clean":"2024-09-12T16:54:26.027975+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:54:26.027975+0000","last_undegraded":"2024-09-12T16:54:26.027975+0000","last_fullsized":"2024-09-12T16:54:26.027975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:52.651580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491266+0000","last_change":"2024-09-12T16:51:58.156872+0000","last_active":"2024-09-12T16:55:12.491266+0000","last_peered":"2024-09-12T16:55:12.491266+0000","last_clean":"2024-09-12T16:55:12.491266+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:55:12.491266+0000","last_undegraded":"2024-09-12T16:55:12.491266+0000","last_fullsized":"2024-09-12T16:55:12.491266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:17.848281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.095549+0000","last_change":"2024-09-12T16:51:56.161773+0000","last_active":"2024-09-12T16:53:26.095549+0000","last_peered":"2024-09-12T16:53:26.095549+0000","last_clean":"2024-09-12T16:53:26.095549+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:53:26.095549+0000","last_undegraded":"2024-09-12T16:53:26.095549+0000","last_fullsized":"2024-09-12T16:53:26.095549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:05.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.490892+0000","last_change":"2024-09-12T16:52:35.060238+0000","last_active":"2024-09-12T16:55:12.490892+0000","last_peered":"2024-09-12T16:55:12.490892+0000","last_clean":"2024-09-12T16:55:12.490892+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:55:12.490892+0000","last_undegraded":"2024-09-12T16:55:12.490892+0000","last_fullsized":"2024-09-12T16:55:12.490892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:18.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'5","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508887+0000","last_change":"2024-09-12T16:51:58.152595+0000","last_active":"2024-09-12T16:55:12.508887+0000","last_peered":"2024-09-12T16:55:12.508887+0000","last_clean":"2024-09-12T16:55:12.508887+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:55:12.508887+0000","last_undegraded":"2024-09-12T16:55:12.508887+0000","last_fullsized":"2024-09-12T16:55:12.508887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:06.175184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047444+0000","last_change":"2024-09-12T16:51:56.158348+0000","last_active":"2024-09-12T16:52:35.047444+0000","last_peered":"2024-09-12T16:52:35.047444+0000","last_clean":"2024-09-12T16:52:35.047444+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:52:35.047444+0000","last_undegraded":"2024-09-12T16:52:35.047444+0000","last_fullsized":"2024-09-12T16:52:35.047444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:16.323536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.082244+0000","last_change":"2024-09-12T16:51:58.145539+0000","last_active":"2024-09-12T16:55:12.082244+0000","last_peered":"2024-09-12T16:55:12.082244+0000","last_clean":"2024-09-12T16:55:12.082244+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:55:12.082244+0000","last_undegraded":"2024-09-12T16:55:12.082244+0000","last_fullsized":"2024-09-12T16:55:12.082244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:58.380885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:25.018199+0000","last_change":"2024-09-12T16:51:56.150522+0000","last_active":"2024-09-12T16:54:25.018199+0000","last_peered":"2024-09-12T16:54:25.018199+0000","last_clean":"2024-09-12T16:54:25.018199+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:54:25.018199+0000","last_undegraded":"2024-09-12T16:54:25.018199+0000","last_fullsized":"2024-09-12T16:54:25.018199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:47.138309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450880+0000","last_change":"2024-09-12T16:51:58.147371+0000","last_active":"2024-09-12T16:54:11.450880+0000","last_peered":"2024-09-12T16:54:11.450880+0000","last_clean":"2024-09-12T16:54:11.450880+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:54:11.450880+0000","last_undegraded":"2024-09-12T16:54:11.450880+0000","last_fullsized":"2024-09-12T16:54:11.450880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.439266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044749+0000","last_change":"2024-09-12T16:51:56.164502+0000","last_active":"2024-09-12T16:52:35.044749+0000","last_peered":"2024-09-12T16:52:35.044749+0000","last_clean":"2024-09-12T16:52:35.044749+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:52:35.044749+0000","last_undegraded":"2024-09-12T16:52:35.044749+0000","last_fullsized":"2024-09-12T16:52:35.044749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:23.020353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.578829+0000","last_change":"2024-09-12T16:51:58.171720+0000","last_active":"2024-09-12T16:55:12.578829+0000","last_peered":"2024-09-12T16:55:12.578829+0000","last_clean":"2024-09-12T16:55:12.578829+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:55:12.578829+0000","last_undegraded":"2024-09-12T16:55:12.578829+0000","last_fullsized":"2024-09-12T16:55:12.578829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:43.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.042838+0000","last_change":"2024-09-12T16:51:56.164560+0000","last_active":"2024-09-12T16:52:35.042838+0000","last_peered":"2024-09-12T16:52:35.042838+0000","last_clean":"2024-09-12T16:52:35.042838+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:52:35.042838+0000","last_undegraded":"2024-09-12T16:52:35.042838+0000","last_fullsized":"2024-09-12T16:52:35.042838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:34.588010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.170393+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:20.778233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029650+0000","last_change":"2024-09-12T16:51:56.172466+0000","last_active":"2024-09-12T16:52:35.029650+0000","last_peered":"2024-09-12T16:52:35.029650+0000","last_clean":"2024-09-12T16:52:35.029650+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:52:35.029650+0000","last_undegraded":"2024-09-12T16:52:35.029650+0000","last_fullsized":"2024-09-12T16:52:35.029650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:16.998562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.024343+0000","last_change":"2024-09-12T16:51:58.154333+0000","last_active":"2024-09-12T16:54:26.024343+0000","last_peered":"2024-09-12T16:54:26.024343+0000","last_clean":"2024-09-12T16:54:26.024343+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:54:26.024343+0000","last_undegraded":"2024-09-12T16:54:26.024343+0000","last_fullsized":"2024-09-12T16:54:26.024343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:31.351742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.747323+0000","last_change":"2024-09-12T16:51:56.150214+0000","last_active":"2024-09-12T16:53:25.747323+0000","last_peered":"2024-09-12T16:53:25.747323+0000","last_clean":"2024-09-12T16:53:25.747323+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:53:25.747323+0000","last_undegraded":"2024-09-12T16:53:25.747323+0000","last_fullsized":"2024-09-12T16:53:25.747323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.360856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.449818+0000","last_change":"2024-09-12T16:52:06.228645+0000","last_active":"2024-09-12T16:55:12.449818+0000","last_peered":"2024-09-12T16:55:12.449818+0000","last_clean":"2024-09-12T16:55:12.449818+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:55:12.449818+0000","last_undegraded":"2024-09-12T16:55:12.449818+0000","last_fullsized":"2024-09-12T16:55:12.449818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.027430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559921+0000","last_change":"2024-09-12T16:51:58.158921+0000","last_active":"2024-09-12T16:55:12.559921+0000","last_peered":"2024-09-12T16:55:12.559921+0000","last_clean":"2024-09-12T16:55:12.559921+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:55:12.559921+0000","last_undegraded":"2024-09-12T16:55:12.559921+0000","last_fullsized":"2024-09-12T16:55:12.559921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:53.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.583779+0000","last_change":"2024-09-12T16:51:56.164082+0000","last_active":"2024-09-12T16:52:42.583779+0000","last_peered":"2024-09-12T16:52:42.583779+0000","last_clean":"2024-09-12T16:52:42.583779+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:52:42.583779+0000","last_undegraded":"2024-09-12T16:52:42.583779+0000","last_fullsized":"2024-09-12T16:52:42.583779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:02.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047258+0000","last_change":"2024-09-12T16:52:00.186679+0000","last_active":"2024-09-12T16:52:35.047258+0000","last_peered":"2024-09-12T16:52:35.047258+0000","last_clean":"2024-09-12T16:52:35.047258+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:52:35.047258+0000","last_undegraded":"2024-09-12T16:52:35.047258+0000","last_fullsized":"2024-09-12T16:52:35.047258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:56.774446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.998524+0000","last_change":"2024-09-12T16:52:02.211041+0000","last_active":"2024-09-12T16:54:08.998524+0000","last_peered":"2024-09-12T16:54:08.998524+0000","last_clean":"2024-09-12T16:54:08.998524+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:54:08.998524+0000","last_undegraded":"2024-09-12T16:54:08.998524+0000","last_fullsized":"2024-09-12T16:54:08.998524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:56.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046823+0000","last_change":"2024-09-12T16:52:04.216014+0000","last_active":"2024-09-12T16:52:35.046823+0000","last_peered":"2024-09-12T16:52:35.046823+0000","last_clean":"2024-09-12T16:52:35.046823+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:52:35.046823+0000","last_undegraded":"2024-09-12T16:52:35.046823+0000","last_fullsized":"2024-09-12T16:52:35.046823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.121629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.770372+0000","last_change":"2024-09-12T16:52:06.220823+0000","last_active":"2024-09-12T16:53:25.770372+0000","last_peered":"2024-09-12T16:53:25.770372+0000","last_clean":"2024-09-12T16:53:25.770372+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:53:25.770372+0000","last_undegraded":"2024-09-12T16:53:25.770372+0000","last_fullsized":"2024-09-12T16:53:25.770372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.834594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.769302+0000","last_change":"2024-09-12T16:51:58.172491+0000","last_active":"2024-09-12T16:54:06.769302+0000","last_peered":"2024-09-12T16:54:06.769302+0000","last_clean":"2024-09-12T16:54:06.769302+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:54:06.769302+0000","last_undegraded":"2024-09-12T16:54:06.769302+0000","last_fullsized":"2024-09-12T16:54:06.769302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:13.859827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.015475+0000","last_change":"2024-09-12T16:51:56.148926+0000","last_active":"2024-09-12T16:55:12.015475+0000","last_peered":"2024-09-12T16:55:12.015475+0000","last_clean":"2024-09-12T16:55:12.015475+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:12.015475+0000","last_undegraded":"2024-09-12T16:55:12.015475+0000","last_fullsized":"2024-09-12T16:55:12.015475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:08.525437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022624+0000","last_change":"2024-09-12T16:52:00.173177+0000","last_active":"2024-09-12T16:52:35.022624+0000","last_peered":"2024-09-12T16:52:35.022624+0000","last_clean":"2024-09-12T16:52:35.022624+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:52:35.022624+0000","last_undegraded":"2024-09-12T16:52:35.022624+0000","last_fullsized":"2024-09-12T16:52:35.022624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:29.445195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.045539+0000","last_change":"2024-09-12T16:52:02.183370+0000","last_active":"2024-09-12T16:52:35.045539+0000","last_peered":"2024-09-12T16:52:35.045539+0000","last_clean":"2024-09-12T16:52:35.045539+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:52:35.045539+0000","last_undegraded":"2024-09-12T16:52:35.045539+0000","last_fullsized":"2024-09-12T16:52:35.045539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.193774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044904+0000","last_change":"2024-09-12T16:52:04.210985+0000","last_active":"2024-09-12T16:52:35.044904+0000","last_peered":"2024-09-12T16:52:35.044904+0000","last_clean":"2024-09-12T16:52:35.044904+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:52:35.044904+0000","last_undegraded":"2024-09-12T16:52:35.044904+0000","last_fullsized":"2024-09-12T16:52:35.044904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:41.017144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021248+0000","last_change":"2024-09-12T16:52:06.224899+0000","last_active":"2024-09-12T16:52:35.021248+0000","last_peered":"2024-09-12T16:52:35.021248+0000","last_clean":"2024-09-12T16:52:35.021248+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:52:35.021248+0000","last_undegraded":"2024-09-12T16:52:35.021248+0000","last_fullsized":"2024-09-12T16:52:35.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:27.788906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559983+0000","last_change":"2024-09-12T16:51:58.165985+0000","last_active":"2024-09-12T16:55:12.559983+0000","last_peered":"2024-09-12T16:55:12.559983+0000","last_clean":"2024-09-12T16:55:12.559983+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:55:12.559983+0000","last_undegraded":"2024-09-12T16:55:12.559983+0000","last_fullsized":"2024-09-12T16:55:12.559983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.791071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023098+0000","last_change":"2024-09-12T16:51:56.153288+0000","last_active":"2024-09-12T16:52:35.023098+0000","last_peered":"2024-09-12T16:52:35.023098+0000","last_clean":"2024-09-12T16:52:35.023098+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:52:35.023098+0000","last_undegraded":"2024-09-12T16:52:35.023098+0000","last_fullsized":"2024-09-12T16:52:35.023098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:56.830974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029954+0000","last_change":"2024-09-12T16:52:00.166221+0000","last_active":"2024-09-12T16:52:35.029954+0000","last_peered":"2024-09-12T16:52:35.029954+0000","last_clean":"2024-09-12T16:52:35.029954+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:52:35.029954+0000","last_undegraded":"2024-09-12T16:52:35.029954+0000","last_fullsized":"2024-09-12T16:52:35.029954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:47.637135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017313+0000","last_change":"2024-09-12T16:52:02.202447+0000","last_active":"2024-09-12T16:52:35.017313+0000","last_peered":"2024-09-12T16:52:35.017313+0000","last_clean":"2024-09-12T16:52:35.017313+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:52:35.017313+0000","last_undegraded":"2024-09-12T16:52:35.017313+0000","last_fullsized":"2024-09-12T16:52:35.017313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:48.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419319+0000","last_change":"2024-09-12T16:52:04.214865+0000","last_active":"2024-09-12T16:55:10.419319+0000","last_peered":"2024-09-12T16:55:10.419319+0000","last_clean":"2024-09-12T16:55:10.419319+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:55:10.419319+0000","last_undegraded":"2024-09-12T16:55:10.419319+0000","last_fullsized":"2024-09-12T16:55:10.419319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:36.658689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016249+0000","last_change":"2024-09-12T16:52:06.233885+0000","last_active":"2024-09-12T16:52:35.016249+0000","last_peered":"2024-09-12T16:52:35.016249+0000","last_clean":"2024-09-12T16:52:35.016249+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:52:35.016249+0000","last_undegraded":"2024-09-12T16:52:35.016249+0000","last_fullsized":"2024-09-12T16:52:35.016249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:05.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762116+0000","last_change":"2024-09-12T16:51:58.157856+0000","last_active":"2024-09-12T16:53:25.762116+0000","last_peered":"2024-09-12T16:53:25.762116+0000","last_clean":"2024-09-12T16:53:25.762116+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:53:25.762116+0000","last_undegraded":"2024-09-12T16:53:25.762116+0000","last_fullsized":"2024-09-12T16:53:25.762116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.575311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024635+0000","last_change":"2024-09-12T16:51:56.158840+0000","last_active":"2024-09-12T16:52:35.024635+0000","last_peered":"2024-09-12T16:52:35.024635+0000","last_clean":"2024-09-12T16:52:35.024635+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:52:35.024635+0000","last_undegraded":"2024-09-12T16:52:35.024635+0000","last_fullsized":"2024-09-12T16:52:35.024635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.795717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047933+0000","last_change":"2024-09-12T16:52:00.186758+0000","last_active":"2024-09-12T16:52:35.047933+0000","last_peered":"2024-09-12T16:52:35.047933+0000","last_clean":"2024-09-12T16:52:35.047933+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:52:35.047933+0000","last_undegraded":"2024-09-12T16:52:35.047933+0000","last_fullsized":"2024-09-12T16:52:35.047933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:11.029898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.990711+0000","last_change":"2024-09-12T16:52:02.201456+0000","last_active":"2024-09-12T16:54:08.990711+0000","last_peered":"2024-09-12T16:54:08.990711+0000","last_clean":"2024-09-12T16:54:08.990711+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:54:08.990711+0000","last_undegraded":"2024-09-12T16:54:08.990711+0000","last_fullsized":"2024-09-12T16:54:08.990711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:04.994969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.586516+0000","last_change":"2024-09-12T16:52:04.220126+0000","last_active":"2024-09-12T16:55:43.586516+0000","last_peered":"2024-09-12T16:55:43.586516+0000","last_clean":"2024-09-12T16:55:43.586516+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:55:43.586516+0000","last_undegraded":"2024-09-12T16:55:43.586516+0000","last_fullsized":"2024-09-12T16:55:43.586516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:41.797262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024505+0000","last_change":"2024-09-12T16:51:58.166638+0000","last_active":"2024-09-12T16:52:35.024505+0000","last_peered":"2024-09-12T16:52:35.024505+0000","last_clean":"2024-09-12T16:52:35.024505+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:52:35.024505+0000","last_undegraded":"2024-09-12T16:52:35.024505+0000","last_fullsized":"2024-09-12T16:52:35.024505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:09.865305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022574+0000","last_change":"2024-09-12T16:51:56.152053+0000","last_active":"2024-09-12T16:52:35.022574+0000","last_peered":"2024-09-12T16:52:35.022574+0000","last_clean":"2024-09-12T16:52:35.022574+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:52:35.022574+0000","last_undegraded":"2024-09-12T16:52:35.022574+0000","last_fullsized":"2024-09-12T16:52:35.022574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:05.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025774+0000","last_change":"2024-09-12T16:52:00.158540+0000","last_active":"2024-09-12T16:52:35.025774+0000","last_peered":"2024-09-12T16:52:35.025774+0000","last_clean":"2024-09-12T16:52:35.025774+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:52:35.025774+0000","last_undegraded":"2024-09-12T16:52:35.025774+0000","last_fullsized":"2024-09-12T16:52:35.025774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.058273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015338+0000","last_change":"2024-09-12T16:52:02.185249+0000","last_active":"2024-09-12T16:54:15.015338+0000","last_peered":"2024-09-12T16:54:15.015338+0000","last_clean":"2024-09-12T16:54:15.015338+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:54:15.015338+0000","last_undegraded":"2024-09-12T16:54:15.015338+0000","last_fullsized":"2024-09-12T16:54:15.015338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:09.660762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029067+0000","last_change":"2024-09-12T16:52:04.216055+0000","last_active":"2024-09-12T16:52:35.029067+0000","last_peered":"2024-09-12T16:52:35.029067+0000","last_clean":"2024-09-12T16:52:35.029067+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:52:35.029067+0000","last_undegraded":"2024-09-12T16:52:35.029067+0000","last_fullsized":"2024-09-12T16:52:35.029067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:19.593146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.773290+0000","last_change":"2024-09-12T16:52:06.226575+0000","last_active":"2024-09-12T16:53:25.773290+0000","last_peered":"2024-09-12T16:53:25.773290+0000","last_clean":"2024-09-12T16:53:25.773290+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:53:25.773290+0000","last_undegraded":"2024-09-12T16:53:25.773290+0000","last_fullsized":"2024-09-12T16:53:25.773290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:47.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.059583+0000","last_change":"2024-09-12T16:51:58.154586+0000","last_active":"2024-09-12T16:55:12.059583+0000","last_peered":"2024-09-12T16:55:12.059583+0000","last_clean":"2024-09-12T16:55:12.059583+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:55:12.059583+0000","last_undegraded":"2024-09-12T16:55:12.059583+0000","last_fullsized":"2024-09-12T16:55:12.059583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:21.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.211592+0000","last_change":"2024-09-12T16:51:56.152647+0000","last_active":"2024-09-12T16:54:11.211592+0000","last_peered":"2024-09-12T16:54:11.211592+0000","last_clean":"2024-09-12T16:54:11.211592+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:54:11.211592+0000","last_undegraded":"2024-09-12T16:54:11.211592+0000","last_fullsized":"2024-09-12T16:54:11.211592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023417+0000","last_change":"2024-09-12T16:52:00.156973+0000","last_active":"2024-09-12T16:52:35.023417+0000","last_peered":"2024-09-12T16:52:35.023417+0000","last_clean":"2024-09-12T16:52:35.023417+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:52:35.023417+0000","last_undegraded":"2024-09-12T16:52:35.023417+0000","last_fullsized":"2024-09-12T16:52:35.023417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:53.962016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.974774+0000","last_change":"2024-09-12T16:52:02.209890+0000","last_active":"2024-09-12T16:54:08.974774+0000","last_peered":"2024-09-12T16:54:08.974774+0000","last_clean":"2024-09-12T16:54:08.974774+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:54:08.974774+0000","last_undegraded":"2024-09-12T16:54:08.974774+0000","last_fullsized":"2024-09-12T16:54:08.974774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:04.988153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023620+0000","last_change":"2024-09-12T16:52:04.194679+0000","last_active":"2024-09-12T16:52:35.023620+0000","last_peered":"2024-09-12T16:52:35.023620+0000","last_clean":"2024-09-12T16:52:35.023620+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:52:35.023620+0000","last_undegraded":"2024-09-12T16:52:35.023620+0000","last_fullsized":"2024-09-12T16:52:35.023620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:43.311077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:20.069130+0000","last_change":"2024-09-12T16:52:06.231060+0000","last_active":"2024-09-12T16:53:20.069130+0000","last_peered":"2024-09-12T16:53:20.069130+0000","last_clean":"2024-09-12T16:53:20.069130+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:53:20.069130+0000","last_undegraded":"2024-09-12T16:53:20.069130+0000","last_fullsized":"2024-09-12T16:53:20.069130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:38.753641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019518+0000","last_change":"2024-09-12T16:51:58.170102+0000","last_active":"2024-09-12T16:52:35.019518+0000","last_peered":"2024-09-12T16:52:35.019518+0000","last_clean":"2024-09-12T16:52:35.019518+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:52:35.019518+0000","last_undegraded":"2024-09-12T16:52:35.019518+0000","last_fullsized":"2024-09-12T16:52:35.019518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:03.745874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048163+0000","last_change":"2024-09-12T16:51:56.171021+0000","last_active":"2024-09-12T16:52:35.048163+0000","last_peered":"2024-09-12T16:52:35.048163+0000","last_clean":"2024-09-12T16:52:35.048163+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:52:35.048163+0000","last_undegraded":"2024-09-12T16:52:35.048163+0000","last_fullsized":"2024-09-12T16:52:35.048163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:34.631184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026093+0000","last_change":"2024-09-12T16:52:00.155974+0000","last_active":"2024-09-12T16:52:35.026093+0000","last_peered":"2024-09-12T16:52:35.026093+0000","last_clean":"2024-09-12T16:52:35.026093+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:52:35.026093+0000","last_undegraded":"2024-09-12T16:52:35.026093+0000","last_fullsized":"2024-09-12T16:52:35.026093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:53.769301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:16.024675+0000","last_change":"2024-09-12T16:52:02.203207+0000","last_active":"2024-09-12T16:54:16.024675+0000","last_peered":"2024-09-12T16:54:16.024675+0000","last_clean":"2024-09-12T16:54:16.024675+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:54:16.024675+0000","last_undegraded":"2024-09-12T16:54:16.024675+0000","last_fullsized":"2024-09-12T16:54:16.024675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:18.022593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.589627+0000","last_change":"2024-09-12T16:52:04.194703+0000","last_active":"2024-09-12T16:55:43.589627+0000","last_peered":"2024-09-12T16:55:43.589627+0000","last_clean":"2024-09-12T16:55:43.589627+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:55:43.589627+0000","last_undegraded":"2024-09-12T16:55:43.589627+0000","last_fullsized":"2024-09-12T16:55:43.589627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:45.145668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024038+0000","last_change":"2024-09-12T16:52:06.236389+0000","last_active":"2024-09-12T16:52:35.024038+0000","last_peered":"2024-09-12T16:52:35.024038+0000","last_clean":"2024-09-12T16:52:35.024038+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:52:35.024038+0000","last_undegraded":"2024-09-12T16:52:35.024038+0000","last_fullsized":"2024-09-12T16:52:35.024038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:42.125079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015430+0000","last_change":"2024-09-12T16:51:58.141456+0000","last_active":"2024-09-12T16:54:15.015430+0000","last_peered":"2024-09-12T16:54:15.015430+0000","last_clean":"2024-09-12T16:54:15.015430+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:54:15.015430+0000","last_undegraded":"2024-09-12T16:54:15.015430+0000","last_fullsized":"2024-09-12T16:54:15.015430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.544687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044239+0000","last_change":"2024-09-12T16:51:56.169441+0000","last_active":"2024-09-12T16:52:35.044239+0000","last_peered":"2024-09-12T16:52:35.044239+0000","last_clean":"2024-09-12T16:52:35.044239+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:52:35.044239+0000","last_undegraded":"2024-09-12T16:52:35.044239+0000","last_fullsized":"2024-09-12T16:52:35.044239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:56.370543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022426+0000","last_change":"2024-09-12T16:52:00.178084+0000","last_active":"2024-09-12T16:52:35.022426+0000","last_peered":"2024-09-12T16:52:35.022426+0000","last_clean":"2024-09-12T16:52:35.022426+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:52:35.022426+0000","last_undegraded":"2024-09-12T16:52:35.022426+0000","last_fullsized":"2024-09-12T16:52:35.022426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.597984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.009905+0000","last_change":"2024-09-12T16:52:02.201612+0000","last_active":"2024-09-12T16:54:09.009905+0000","last_peered":"2024-09-12T16:54:09.009905+0000","last_clean":"2024-09-12T16:54:09.009905+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:54:09.009905+0000","last_undegraded":"2024-09-12T16:54:09.009905+0000","last_fullsized":"2024-09-12T16:54:09.009905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:42.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021841+0000","last_change":"2024-09-12T16:52:04.198835+0000","last_active":"2024-09-12T16:52:35.021841+0000","last_peered":"2024-09-12T16:52:35.021841+0000","last_clean":"2024-09-12T16:52:35.021841+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:52:35.021841+0000","last_undegraded":"2024-09-12T16:52:35.021841+0000","last_fullsized":"2024-09-12T16:52:35.021841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.503485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.731668+0000","last_change":"2024-09-12T16:52:06.212053+0000","last_active":"2024-09-12T16:55:12.731668+0000","last_peered":"2024-09-12T16:55:12.731668+0000","last_clean":"2024-09-12T16:55:12.731668+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:55:12.731668+0000","last_undegraded":"2024-09-12T16:55:12.731668+0000","last_fullsized":"2024-09-12T16:55:12.731668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:15.749904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.060440+0000","last_change":"2024-09-12T16:51:58.171124+0000","last_active":"2024-09-12T16:55:12.060440+0000","last_peered":"2024-09-12T16:55:12.060440+0000","last_clean":"2024-09-12T16:55:12.060440+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:55:12.060440+0000","last_undegraded":"2024-09-12T16:55:12.060440+0000","last_fullsized":"2024-09-12T16:55:12.060440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:39.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026631+0000","last_change":"2024-09-12T16:51:56.169756+0000","last_active":"2024-09-12T16:52:35.026631+0000","last_peered":"2024-09-12T16:52:35.026631+0000","last_clean":"2024-09-12T16:52:35.026631+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:52:35.026631+0000","last_undegraded":"2024-09-12T16:52:35.026631+0000","last_fullsized":"2024-09-12T16:52:35.026631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:43.389321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027418+0000","last_change":"2024-09-12T16:52:00.186996+0000","last_active":"2024-09-12T16:52:35.027418+0000","last_peered":"2024-09-12T16:52:35.027418+0000","last_clean":"2024-09-12T16:52:35.027418+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:52:35.027418+0000","last_undegraded":"2024-09-12T16:52:35.027418+0000","last_fullsized":"2024-09-12T16:52:35.027418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:55.614591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.023058+0000","last_change":"2024-09-12T16:52:02.181402+0000","last_active":"2024-09-12T16:54:21.023058+0000","last_peered":"2024-09-12T16:54:21.023058+0000","last_clean":"2024-09-12T16:54:21.023058+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:54:21.023058+0000","last_undegraded":"2024-09-12T16:54:21.023058+0000","last_fullsized":"2024-09-12T16:54:21.023058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:57.545973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048724+0000","last_change":"2024-09-12T16:52:04.214150+0000","last_active":"2024-09-12T16:52:35.048724+0000","last_peered":"2024-09-12T16:52:35.048724+0000","last_clean":"2024-09-12T16:52:35.048724+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:52:35.048724+0000","last_undegraded":"2024-09-12T16:52:35.048724+0000","last_fullsized":"2024-09-12T16:52:35.048724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:04.618846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.605539+0000","last_change":"2024-09-12T16:52:06.231706+0000","last_active":"2024-09-12T16:54:08.605539+0000","last_peered":"2024-09-12T16:54:08.605539+0000","last_clean":"2024-09-12T16:54:08.605539+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:54:08.605539+0000","last_undegraded":"2024-09-12T16:54:08.605539+0000","last_fullsized":"2024-09-12T16:54:08.605539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:20.026659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'9","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.579477+0000","last_change":"2024-09-12T16:51:58.173915+0000","last_active":"2024-09-12T16:55:12.579477+0000","last_peered":"2024-09-12T16:55:12.579477+0000","last_clean":"2024-09-12T16:55:12.579477+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:55:12.579477+0000","last_undegraded":"2024-09-12T16:55:12.579477+0000","last_fullsized":"2024-09-12T16:55:12.579477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:53.515263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.021863+0000","last_change":"2024-09-12T16:51:56.159835+0000","last_active":"2024-09-12T16:54:06.021863+0000","last_peered":"2024-09-12T16:54:06.021863+0000","last_clean":"2024-09-12T16:54:06.021863+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:54:06.021863+0000","last_undegraded":"2024-09-12T16:54:06.021863+0000","last_fullsized":"2024-09-12T16:54:06.021863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:50.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022853+0000","last_change":"2024-09-12T16:52:00.167730+0000","last_active":"2024-09-12T16:52:35.022853+0000","last_peered":"2024-09-12T16:52:35.022853+0000","last_clean":"2024-09-12T16:52:35.022853+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:52:35.022853+0000","last_undegraded":"2024-09-12T16:52:35.022853+0000","last_fullsized":"2024-09-12T16:52:35.022853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:18.641624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.021811+0000","last_change":"2024-09-12T16:52:02.181396+0000","last_active":"2024-09-12T16:54:09.021811+0000","last_peered":"2024-09-12T16:54:09.021811+0000","last_clean":"2024-09-12T16:54:09.021811+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:54:09.021811+0000","last_undegraded":"2024-09-12T16:54:09.021811+0000","last_fullsized":"2024-09-12T16:54:09.021811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:02.688531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":405,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.743611+0000","last_change":"2024-09-12T16:52:04.202044+0000","last_active":"2024-09-12T16:55:12.743611+0000","last_peered":"2024-09-12T16:55:12.743611+0000","last_clean":"2024-09-12T16:55:12.743611+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:55:12.743611+0000","last_undegraded":"2024-09-12T16:55:12.743611+0000","last_fullsized":"2024-09-12T16:55:12.743611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:00.863167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'20","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.680761+0000","last_change":"2024-09-12T16:52:06.219575+0000","last_active":"2024-09-12T16:55:12.680761+0000","last_peered":"2024-09-12T16:55:12.680761+0000","last_clean":"2024-09-12T16:55:12.680761+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:55:12.680761+0000","last_undegraded":"2024-09-12T16:55:12.680761+0000","last_fullsized":"2024-09-12T16:55:12.680761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.073730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.245387+0000","last_change":"2024-09-12T16:51:58.168850+0000","last_active":"2024-09-12T16:52:42.245387+0000","last_peered":"2024-09-12T16:52:42.245387+0000","last_clean":"2024-09-12T16:52:42.245387+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:52:42.245387+0000","last_undegraded":"2024-09-12T16:52:42.245387+0000","last_fullsized":"2024-09-12T16:52:42.245387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:38.519723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030545+0000","last_change":"2024-09-12T16:51:56.163883+0000","last_active":"2024-09-12T16:52:35.030545+0000","last_peered":"2024-09-12T16:52:35.030545+0000","last_clean":"2024-09-12T16:52:35.030545+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:52:35.030545+0000","last_undegraded":"2024-09-12T16:52:35.030545+0000","last_fullsized":"2024-09-12T16:52:35.030545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:19.316288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":617,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.624735+0000","last_change":"2024-09-12T16:52:35.065861+0000","last_active":"2024-09-12T16:54:10.624735+0000","last_peered":"2024-09-12T16:54:10.624735+0000","last_clean":"2024-09-12T16:54:10.624735+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:54:10.624735+0000","last_undegraded":"2024-09-12T16:54:10.624735+0000","last_fullsized":"2024-09-12T16:54:10.624735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.323930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":663,"num_read_kb":663,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.454242+0000","last_change":"2024-09-12T16:52:02.209870+0000","last_active":"2024-09-12T16:54:11.454242+0000","last_peered":"2024-09-12T16:54:11.454242+0000","last_clean":"2024-09-12T16:54:11.454242+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:54:11.454242+0000","last_undegraded":"2024-09-12T16:54:11.454242+0000","last_fullsized":"2024-09-12T16:54:11.454242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.846097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":512,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.677065+0000","last_change":"2024-09-12T16:52:04.200303+0000","last_active":"2024-09-12T16:55:12.677065+0000","last_peered":"2024-09-12T16:55:12.677065+0000","last_clean":"2024-09-12T16:55:12.677065+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:55:12.677065+0000","last_undegraded":"2024-09-12T16:55:12.677065+0000","last_fullsized":"2024-09-12T16:55:12.677065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:06.974814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.990445+0000","last_change":"2024-09-12T16:52:06.226319+0000","last_active":"2024-09-12T16:54:10.990445+0000","last_peered":"2024-09-12T16:54:10.990445+0000","last_clean":"2024-09-12T16:54:10.990445+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:54:10.990445+0000","last_undegraded":"2024-09-12T16:54:10.990445+0000","last_fullsized":"2024-09-12T16:54:10.990445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:19.104184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204872+0000","last_change":"2024-09-12T16:51:58.172403+0000","last_active":"2024-09-12T16:55:12.204872+0000","last_peered":"2024-09-12T16:55:12.204872+0000","last_clean":"2024-09-12T16:55:12.204872+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.204872+0000","last_undegraded":"2024-09-12T16:55:12.204872+0000","last_fullsized":"2024-09-12T16:55:12.204872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:17.725825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023537+0000","last_change":"2024-09-12T16:51:56.164438+0000","last_active":"2024-09-12T16:52:35.023537+0000","last_peered":"2024-09-12T16:52:35.023537+0000","last_clean":"2024-09-12T16:52:35.023537+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:52:35.023537+0000","last_undegraded":"2024-09-12T16:52:35.023537+0000","last_fullsized":"2024-09-12T16:52:35.023537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:34.280592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048178+0000","last_change":"2024-09-12T16:52:00.189183+0000","last_active":"2024-09-12T16:52:35.048178+0000","last_peered":"2024-09-12T16:52:35.048178+0000","last_clean":"2024-09-12T16:52:35.048178+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:52:35.048178+0000","last_undegraded":"2024-09-12T16:52:35.048178+0000","last_fullsized":"2024-09-12T16:52:35.048178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:50.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.000581+0000","last_change":"2024-09-12T16:52:02.179426+0000","last_active":"2024-09-12T16:54:09.000581+0000","last_peered":"2024-09-12T16:54:09.000581+0000","last_clean":"2024-09-12T16:54:09.000581+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:54:09.000581+0000","last_undegraded":"2024-09-12T16:54:09.000581+0000","last_fullsized":"2024-09-12T16:54:09.000581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:17.890537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017029+0000","last_change":"2024-09-12T16:52:04.212757+0000","last_active":"2024-09-12T16:52:35.017029+0000","last_peered":"2024-09-12T16:52:35.017029+0000","last_clean":"2024-09-12T16:52:35.017029+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:52:35.017029+0000","last_undegraded":"2024-09-12T16:52:35.017029+0000","last_fullsized":"2024-09-12T16:52:35.017029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.808954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.633190+0000","last_change":"2024-09-12T16:52:06.227780+0000","last_active":"2024-09-12T16:55:12.633190+0000","last_peered":"2024-09-12T16:55:12.633190+0000","last_clean":"2024-09-12T16:55:12.633190+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:55:12.633190+0000","last_undegraded":"2024-09-12T16:55:12.633190+0000","last_fullsized":"2024-09-12T16:55:12.633190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:23.705849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.222251+0000","last_change":"2024-09-12T16:51:58.173604+0000","last_active":"2024-09-12T16:55:12.222251+0000","last_peered":"2024-09-12T16:55:12.222251+0000","last_clean":"2024-09-12T16:55:12.222251+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:55:12.222251+0000","last_undegraded":"2024-09-12T16:55:12.222251+0000","last_fullsized":"2024-09-12T16:55:12.222251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:03.163064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:41.013055+0000","last_change":"2024-09-12T16:51:41.681357+0000","last_active":"2024-09-12T16:53:41.013055+0000","last_peered":"2024-09-12T16:53:41.013055+0000","last_clean":"2024-09-12T16:53:41.013055+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:53:41.013055+0000","last_undegraded":"2024-09-12T16:53:41.013055+0000","last_fullsized":"2024-09-12T16:53:41.013055+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_clean_scrub_stamp":"2024-09-12T16:51:40.347390+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:18.394696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039279+0000","last_change":"2024-09-12T16:51:48.400219+0000","last_active":"2024-09-12T16:52:35.039279+0000","last_peered":"2024-09-12T16:52:35.039279+0000","last_clean":"2024-09-12T16:52:35.039279+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:52:35.039279+0000","last_undegraded":"2024-09-12T16:52:35.039279+0000","last_fullsized":"2024-09-12T16:52:35.039279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.307866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033268+0000","last_change":"2024-09-12T16:51:56.168803+0000","last_active":"2024-09-12T16:52:35.033268+0000","last_peered":"2024-09-12T16:52:35.033268+0000","last_clean":"2024-09-12T16:52:35.033268+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:52:35.033268+0000","last_undegraded":"2024-09-12T16:52:35.033268+0000","last_fullsized":"2024-09-12T16:52:35.033268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.625123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044074+0000","last_change":"2024-09-12T16:52:00.165360+0000","last_active":"2024-09-12T16:52:35.044074+0000","last_peered":"2024-09-12T16:52:35.044074+0000","last_clean":"2024-09-12T16:52:35.044074+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:52:35.044074+0000","last_undegraded":"2024-09-12T16:52:35.044074+0000","last_fullsized":"2024-09-12T16:52:35.044074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:19.218108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.017912+0000","last_change":"2024-09-12T16:52:02.208795+0000","last_active":"2024-09-12T16:54:09.017912+0000","last_peered":"2024-09-12T16:54:09.017912+0000","last_clean":"2024-09-12T16:54:09.017912+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:54:09.017912+0000","last_undegraded":"2024-09-12T16:54:09.017912+0000","last_fullsized":"2024-09-12T16:54:09.017912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:33.220579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024326+0000","last_change":"2024-09-12T16:52:04.190511+0000","last_active":"2024-09-12T16:52:35.024326+0000","last_peered":"2024-09-12T16:52:35.024326+0000","last_clean":"2024-09-12T16:52:35.024326+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:52:35.024326+0000","last_undegraded":"2024-09-12T16:52:35.024326+0000","last_fullsized":"2024-09-12T16:52:35.024326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:34.575751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.588965+0000","last_change":"2024-09-12T16:52:06.216437+0000","last_active":"2024-09-12T16:55:12.588965+0000","last_peered":"2024-09-12T16:55:12.588965+0000","last_clean":"2024-09-12T16:55:12.588965+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:55:12.588965+0000","last_undegraded":"2024-09-12T16:55:12.588965+0000","last_fullsized":"2024-09-12T16:55:12.588965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:11.640533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.560070+0000","last_change":"2024-09-12T16:51:58.165681+0000","last_active":"2024-09-12T16:55:12.560070+0000","last_peered":"2024-09-12T16:55:12.560070+0000","last_clean":"2024-09-12T16:55:12.560070+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:55:12.560070+0000","last_undegraded":"2024-09-12T16:55:12.560070+0000","last_fullsized":"2024-09-12T16:55:12.560070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.848528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022287+0000","last_change":"2024-09-12T16:51:48.399639+0000","last_active":"2024-09-12T16:52:35.022287+0000","last_peered":"2024-09-12T16:52:35.022287+0000","last_clean":"2024-09-12T16:52:35.022287+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:52:35.022287+0000","last_undegraded":"2024-09-12T16:52:35.022287+0000","last_fullsized":"2024-09-12T16:52:35.022287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.533236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.846991+0000","last_change":"2024-09-12T16:51:56.170610+0000","last_active":"2024-09-12T16:55:11.846991+0000","last_peered":"2024-09-12T16:55:11.846991+0000","last_clean":"2024-09-12T16:55:11.846991+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:11.846991+0000","last_undegraded":"2024-09-12T16:55:11.846991+0000","last_fullsized":"2024-09-12T16:55:11.846991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:37.340264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043040+0000","last_change":"2024-09-12T16:52:35.040769+0000","last_active":"2024-09-12T16:52:35.043040+0000","last_peered":"2024-09-12T16:52:35.043040+0000","last_clean":"2024-09-12T16:52:35.043040+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:52:35.043040+0000","last_undegraded":"2024-09-12T16:52:35.043040+0000","last_fullsized":"2024-09-12T16:52:35.043040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'275","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419542+0000","last_change":"2024-09-12T16:52:02.206307+0000","last_active":"2024-09-12T16:55:10.419542+0000","last_peered":"2024-09-12T16:55:10.419542+0000","last_clean":"2024-09-12T16:55:10.419542+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:55:10.419542+0000","last_undegraded":"2024-09-12T16:55:10.419542+0000","last_fullsized":"2024-09-12T16:55:10.419542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:35.817009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":363,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046840+0000","last_change":"2024-09-12T16:52:04.209015+0000","last_active":"2024-09-12T16:52:35.046840+0000","last_peered":"2024-09-12T16:52:35.046840+0000","last_clean":"2024-09-12T16:52:35.046840+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:52:35.046840+0000","last_undegraded":"2024-09-12T16:52:35.046840+0000","last_fullsized":"2024-09-12T16:52:35.046840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.156119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.766970+0000","last_change":"2024-09-12T16:52:06.227599+0000","last_active":"2024-09-12T16:53:25.766970+0000","last_peered":"2024-09-12T16:53:25.766970+0000","last_clean":"2024-09-12T16:53:25.766970+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:53:25.766970+0000","last_undegraded":"2024-09-12T16:53:25.766970+0000","last_fullsized":"2024-09-12T16:53:25.766970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:02.281631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508885+0000","last_change":"2024-09-12T16:51:58.158281+0000","last_active":"2024-09-12T16:55:12.508885+0000","last_peered":"2024-09-12T16:55:12.508885+0000","last_clean":"2024-09-12T16:55:12.508885+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:55:12.508885+0000","last_undegraded":"2024-09-12T16:55:12.508885+0000","last_fullsized":"2024-09-12T16:55:12.508885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:35.307006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.018288+0000","last_change":"2024-09-12T16:51:48.565817+0000","last_active":"2024-09-12T16:52:35.018288+0000","last_peered":"2024-09-12T16:52:35.018288+0000","last_clean":"2024-09-12T16:52:35.018288+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:52:35.018288+0000","last_undegraded":"2024-09-12T16:52:35.018288+0000","last_fullsized":"2024-09-12T16:52:35.018288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:05.344141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021089+0000","last_change":"2024-09-12T16:51:56.167557+0000","last_active":"2024-09-12T16:52:35.021089+0000","last_peered":"2024-09-12T16:52:35.021089+0000","last_clean":"2024-09-12T16:52:35.021089+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:52:35.021089+0000","last_undegraded":"2024-09-12T16:52:35.021089+0000","last_fullsized":"2024-09-12T16:52:35.021089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.057420+0000","last_change":"2024-09-12T16:52:35.055925+0000","last_active":"2024-09-12T16:52:35.057420+0000","last_peered":"2024-09-12T16:52:35.057420+0000","last_clean":"2024-09-12T16:52:35.057420+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:52:35.057420+0000","last_undegraded":"2024-09-12T16:52:35.057420+0000","last_fullsized":"2024-09-12T16:52:35.057420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:39.278393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419519+0000","last_change":"2024-09-12T16:52:02.183372+0000","last_active":"2024-09-12T16:55:10.419519+0000","last_peered":"2024-09-12T16:55:10.419519+0000","last_clean":"2024-09-12T16:55:10.419519+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:55:10.419519+0000","last_undegraded":"2024-09-12T16:55:10.419519+0000","last_fullsized":"2024-09-12T16:55:10.419519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:17.150188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023454+0000","last_change":"2024-09-12T16:52:04.189985+0000","last_active":"2024-09-12T16:52:35.023454+0000","last_peered":"2024-09-12T16:52:35.023454+0000","last_clean":"2024-09-12T16:52:35.023454+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:52:35.023454+0000","last_undegraded":"2024-09-12T16:52:35.023454+0000","last_fullsized":"2024-09-12T16:52:35.023454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:57.543211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032944+0000","last_change":"2024-09-12T16:52:06.229164+0000","last_active":"2024-09-12T16:52:35.032944+0000","last_peered":"2024-09-12T16:52:35.032944+0000","last_clean":"2024-09-12T16:52:35.032944+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:52:35.032944+0000","last_undegraded":"2024-09-12T16:52:35.032944+0000","last_fullsized":"2024-09-12T16:52:35.032944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:53.711707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.430239+0000","last_change":"2024-09-12T16:51:58.152002+0000","last_active":"2024-09-12T16:54:11.430239+0000","last_peered":"2024-09-12T16:54:11.430239+0000","last_clean":"2024-09-12T16:54:11.430239+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:54:11.430239+0000","last_undegraded":"2024-09-12T16:54:11.430239+0000","last_fullsized":"2024-09-12T16:54:11.430239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:09.830533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032753+0000","last_change":"2024-09-12T16:51:48.400929+0000","last_active":"2024-09-12T16:52:35.032753+0000","last_peered":"2024-09-12T16:52:35.032753+0000","last_clean":"2024-09-12T16:52:35.032753+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:52:35.032753+0000","last_undegraded":"2024-09-12T16:52:35.032753+0000","last_fullsized":"2024-09-12T16:52:35.032753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:21.707361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017052+0000","last_change":"2024-09-12T16:51:56.148951+0000","last_active":"2024-09-12T16:52:35.017052+0000","last_peered":"2024-09-12T16:52:35.017052+0000","last_clean":"2024-09-12T16:52:35.017052+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:52:35.017052+0000","last_undegraded":"2024-09-12T16:52:35.017052+0000","last_fullsized":"2024-09-12T16:52:35.017052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:03.940011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024125+0000","last_change":"2024-09-12T16:52:00.189223+0000","last_active":"2024-09-12T16:52:35.024125+0000","last_peered":"2024-09-12T16:52:35.024125+0000","last_clean":"2024-09-12T16:52:35.024125+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:52:35.024125+0000","last_undegraded":"2024-09-12T16:52:35.024125+0000","last_fullsized":"2024-09-12T16:52:35.024125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:19.787530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.470351+0000","last_change":"2024-09-12T16:52:02.207152+0000","last_active":"2024-09-12T16:55:11.470351+0000","last_peered":"2024-09-12T16:55:11.470351+0000","last_clean":"2024-09-12T16:55:11.470351+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:55:11.470351+0000","last_undegraded":"2024-09-12T16:55:11.470351+0000","last_fullsized":"2024-09-12T16:55:11.470351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:18.373274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049115+0000","last_change":"2024-09-12T16:52:04.214830+0000","last_active":"2024-09-12T16:52:35.049115+0000","last_peered":"2024-09-12T16:52:35.049115+0000","last_clean":"2024-09-12T16:52:35.049115+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:52:35.049115+0000","last_undegraded":"2024-09-12T16:52:35.049115+0000","last_fullsized":"2024-09-12T16:52:35.049115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:43.821701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.923598+0000","last_change":"2024-09-12T16:52:06.229880+0000","last_active":"2024-09-12T16:54:10.923598+0000","last_peered":"2024-09-12T16:54:10.923598+0000","last_clean":"2024-09-12T16:54:10.923598+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:54:10.923598+0000","last_undegraded":"2024-09-12T16:54:10.923598+0000","last_fullsized":"2024-09-12T16:54:10.923598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:22.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.035350+0000","last_change":"2024-09-12T16:51:58.173047+0000","last_active":"2024-09-12T16:52:35.035350+0000","last_peered":"2024-09-12T16:52:35.035350+0000","last_clean":"2024-09-12T16:52:35.035350+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:52:35.035350+0000","last_undegraded":"2024-09-12T16:52:35.035350+0000","last_fullsized":"2024-09-12T16:52:35.035350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.635466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.379858+0000","last_change":"2024-09-12T16:51:56.147322+0000","last_active":"2024-09-12T16:54:11.379858+0000","last_peered":"2024-09-12T16:54:11.379858+0000","last_clean":"2024-09-12T16:54:11.379858+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:54:11.379858+0000","last_undegraded":"2024-09-12T16:54:11.379858+0000","last_fullsized":"2024-09-12T16:54:11.379858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:37.340264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023414+0000","last_change":"2024-09-12T16:51:48.406183+0000","last_active":"2024-09-12T16:52:35.023414+0000","last_peered":"2024-09-12T16:52:35.023414+0000","last_clean":"2024-09-12T16:52:35.023414+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:52:35.023414+0000","last_undegraded":"2024-09-12T16:52:35.023414+0000","last_fullsized":"2024-09-12T16:52:35.023414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:06.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'5","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.551692+0000","last_change":"2024-09-12T16:52:00.160190+0000","last_active":"2024-09-12T16:55:43.551692+0000","last_peered":"2024-09-12T16:55:43.551692+0000","last_clean":"2024-09-12T16:55:43.551692+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:55:43.551692+0000","last_undegraded":"2024-09-12T16:55:43.551692+0000","last_fullsized":"2024-09-12T16:55:43.551692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:37.197687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.886587+0000","last_change":"2024-09-12T16:52:02.175160+0000","last_active":"2024-09-12T16:55:43.886587+0000","last_peered":"2024-09-12T16:55:43.886587+0000","last_clean":"2024-09-12T16:55:43.886587+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:55:43.886587+0000","last_undegraded":"2024-09-12T16:55:43.886587+0000","last_fullsized":"2024-09-12T16:55:43.886587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.322350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015201+0000","last_change":"2024-09-12T16:52:04.202004+0000","last_active":"2024-09-12T16:52:35.015201+0000","last_peered":"2024-09-12T16:52:35.015201+0000","last_clean":"2024-09-12T16:52:35.015201+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:52:35.015201+0000","last_undegraded":"2024-09-12T16:52:35.015201+0000","last_fullsized":"2024-09-12T16:52:35.015201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:53.277560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.293385+0000","last_change":"2024-09-12T16:52:06.230268+0000","last_active":"2024-09-12T16:54:11.293385+0000","last_peered":"2024-09-12T16:54:11.293385+0000","last_clean":"2024-09-12T16:54:11.293385+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:54:11.293385+0000","last_undegraded":"2024-09-12T16:54:11.293385+0000","last_fullsized":"2024-09-12T16:54:11.293385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:11.635227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204797+0000","last_change":"2024-09-12T16:51:58.171396+0000","last_active":"2024-09-12T16:55:12.204797+0000","last_peered":"2024-09-12T16:55:12.204797+0000","last_clean":"2024-09-12T16:55:12.204797+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:55:12.204797+0000","last_undegraded":"2024-09-12T16:55:12.204797+0000","last_fullsized":"2024-09-12T16:55:12.204797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:39.687440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.392759+0000","last_change":"2024-09-12T16:51:56.161919+0000","last_active":"2024-09-12T16:55:12.392759+0000","last_peered":"2024-09-12T16:55:12.392759+0000","last_clean":"2024-09-12T16:55:12.392759+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:12.392759+0000","last_undegraded":"2024-09-12T16:55:12.392759+0000","last_fullsized":"2024-09-12T16:55:12.392759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:31.068717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047661+0000","last_change":"2024-09-12T16:51:48.399706+0000","last_active":"2024-09-12T16:52:35.047661+0000","last_peered":"2024-09-12T16:52:35.047661+0000","last_clean":"2024-09-12T16:52:35.047661+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:52:35.047661+0000","last_undegraded":"2024-09-12T16:52:35.047661+0000","last_fullsized":"2024-09-12T16:52:35.047661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.814087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031695+0000","last_change":"2024-09-12T16:52:00.173390+0000","last_active":"2024-09-12T16:52:35.031695+0000","last_peered":"2024-09-12T16:52:35.031695+0000","last_clean":"2024-09-12T16:52:35.031695+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:52:35.031695+0000","last_undegraded":"2024-09-12T16:52:35.031695+0000","last_fullsized":"2024-09-12T16:52:35.031695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:45.833748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027310+0000","last_change":"2024-09-12T16:52:02.194130+0000","last_active":"2024-09-12T16:52:35.027310+0000","last_peered":"2024-09-12T16:52:35.027310+0000","last_clean":"2024-09-12T16:52:35.027310+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:52:35.027310+0000","last_undegraded":"2024-09-12T16:52:35.027310+0000","last_fullsized":"2024-09-12T16:52:35.027310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:27.141664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419252+0000","last_change":"2024-09-12T16:52:04.193182+0000","last_active":"2024-09-12T16:55:10.419252+0000","last_peered":"2024-09-12T16:55:10.419252+0000","last_clean":"2024-09-12T16:55:10.419252+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:55:10.419252+0000","last_undegraded":"2024-09-12T16:55:10.419252+0000","last_fullsized":"2024-09-12T16:55:10.419252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:36.765558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047985+0000","last_change":"2024-09-12T16:52:06.215010+0000","last_active":"2024-09-12T16:52:35.047985+0000","last_peered":"2024-09-12T16:52:35.047985+0000","last_clean":"2024-09-12T16:52:35.047985+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:52:35.047985+0000","last_undegraded":"2024-09-12T16:52:35.047985+0000","last_fullsized":"2024-09-12T16:52:35.047985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:54.128906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.112528+0000","last_change":"2024-09-12T16:52:35.039684+0000","last_active":"2024-09-12T16:53:26.112528+0000","last_peered":"2024-09-12T16:53:26.112528+0000","last_clean":"2024-09-12T16:53:26.112528+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:53:26.112528+0000","last_undegraded":"2024-09-12T16:53:26.112528+0000","last_fullsized":"2024-09-12T16:53:26.112528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.545874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.050083+0000","last_change":"2024-09-12T16:51:56.169511+0000","last_active":"2024-09-12T16:52:35.050083+0000","last_peered":"2024-09-12T16:52:35.050083+0000","last_clean":"2024-09-12T16:52:35.050083+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:52:35.050083+0000","last_undegraded":"2024-09-12T16:52:35.050083+0000","last_fullsized":"2024-09-12T16:52:35.050083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:37.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025906+0000","last_change":"2024-09-12T16:51:48.405954+0000","last_active":"2024-09-12T16:52:35.025906+0000","last_peered":"2024-09-12T16:52:35.025906+0000","last_clean":"2024-09-12T16:52:35.025906+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:52:35.025906+0000","last_undegraded":"2024-09-12T16:52:35.025906+0000","last_fullsized":"2024-09-12T16:52:35.025906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022871+0000","last_change":"2024-09-12T16:52:00.171577+0000","last_active":"2024-09-12T16:52:35.022871+0000","last_peered":"2024-09-12T16:52:35.022871+0000","last_clean":"2024-09-12T16:52:35.022871+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:52:35.022871+0000","last_undegraded":"2024-09-12T16:52:35.022871+0000","last_fullsized":"2024-09-12T16:52:35.022871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.429060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034668+0000","last_change":"2024-09-12T16:52:02.213748+0000","last_active":"2024-09-12T16:52:35.034668+0000","last_peered":"2024-09-12T16:52:35.034668+0000","last_clean":"2024-09-12T16:52:35.034668+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:52:35.034668+0000","last_undegraded":"2024-09-12T16:52:35.034668+0000","last_fullsized":"2024-09-12T16:52:35.034668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:45.880129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.584131+0000","last_change":"2024-09-12T16:52:04.213686+0000","last_active":"2024-09-12T16:55:43.584131+0000","last_peered":"2024-09-12T16:55:43.584131+0000","last_clean":"2024-09-12T16:55:43.584131+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:55:43.584131+0000","last_undegraded":"2024-09-12T16:55:43.584131+0000","last_fullsized":"2024-09-12T16:55:43.584131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:03.491921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.104813+0000","last_change":"2024-09-12T16:52:06.223608+0000","last_active":"2024-09-12T16:55:12.104813+0000","last_peered":"2024-09-12T16:55:12.104813+0000","last_clean":"2024-09-12T16:55:12.104813+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:55:12.104813+0000","last_undegraded":"2024-09-12T16:55:12.104813+0000","last_fullsized":"2024-09-12T16:55:12.104813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:45.915952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405963+0000","last_change":"2024-09-12T16:51:58.169710+0000","last_active":"2024-09-12T16:55:12.405963+0000","last_peered":"2024-09-12T16:55:12.405963+0000","last_clean":"2024-09-12T16:55:12.405963+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:55:12.405963+0000","last_undegraded":"2024-09-12T16:55:12.405963+0000","last_fullsized":"2024-09-12T16:55:12.405963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:19.057567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.384261+0000","last_change":"2024-09-12T16:51:56.158532+0000","last_active":"2024-09-12T16:55:12.384261+0000","last_peered":"2024-09-12T16:55:12.384261+0000","last_clean":"2024-09-12T16:55:12.384261+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:12.384261+0000","last_undegraded":"2024-09-12T16:55:12.384261+0000","last_fullsized":"2024-09-12T16:55:12.384261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:54.713058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049659+0000","last_change":"2024-09-12T16:51:48.400908+0000","last_active":"2024-09-12T16:52:35.049659+0000","last_peered":"2024-09-12T16:52:35.049659+0000","last_clean":"2024-09-12T16:52:35.049659+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:52:35.049659+0000","last_undegraded":"2024-09-12T16:52:35.049659+0000","last_fullsized":"2024-09-12T16:52:35.049659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.059679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021940+0000","last_change":"2024-09-12T16:52:00.177682+0000","last_active":"2024-09-12T16:52:35.021940+0000","last_peered":"2024-09-12T16:52:35.021940+0000","last_clean":"2024-09-12T16:52:35.021940+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:52:35.021940+0000","last_undegraded":"2024-09-12T16:52:35.021940+0000","last_fullsized":"2024-09-12T16:52:35.021940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:07.415377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.997319+0000","last_change":"2024-09-12T16:52:02.187458+0000","last_active":"2024-09-12T16:54:08.997319+0000","last_peered":"2024-09-12T16:54:08.997319+0000","last_clean":"2024-09-12T16:54:08.997319+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:54:08.997319+0000","last_undegraded":"2024-09-12T16:54:08.997319+0000","last_fullsized":"2024-09-12T16:54:08.997319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:39.799750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021656+0000","last_change":"2024-09-12T16:52:04.205957+0000","last_active":"2024-09-12T16:52:35.021656+0000","last_peered":"2024-09-12T16:52:35.021656+0000","last_clean":"2024-09-12T16:52:35.021656+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:52:35.021656+0000","last_undegraded":"2024-09-12T16:52:35.021656+0000","last_fullsized":"2024-09-12T16:52:35.021656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:09.625513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027967+0000","last_change":"2024-09-12T16:52:06.226131+0000","last_active":"2024-09-12T16:52:35.027967+0000","last_peered":"2024-09-12T16:52:35.027967+0000","last_clean":"2024-09-12T16:52:35.027967+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:52:35.027967+0000","last_undegraded":"2024-09-12T16:52:35.027967+0000","last_fullsized":"2024-09-12T16:52:35.027967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:27.891759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.467476+0000","last_change":"2024-09-12T16:52:06.233870+0000","last_active":"2024-09-12T16:55:12.467476+0000","last_peered":"2024-09-12T16:55:12.467476+0000","last_clean":"2024-09-12T16:55:12.467476+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:55:12.467476+0000","last_undegraded":"2024-09-12T16:55:12.467476+0000","last_fullsized":"2024-09-12T16:55:12.467476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:37.518504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.761344+0000","last_change":"2024-09-12T16:51:58.170146+0000","last_active":"2024-09-12T16:53:25.761344+0000","last_peered":"2024-09-12T16:53:25.761344+0000","last_clean":"2024-09-12T16:53:25.761344+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:53:25.761344+0000","last_undegraded":"2024-09-12T16:53:25.761344+0000","last_fullsized":"2024-09-12T16:53:25.761344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:48.025016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.357950+0000","last_change":"2024-09-12T16:51:56.163750+0000","last_active":"2024-09-12T16:55:12.357950+0000","last_peered":"2024-09-12T16:55:12.357950+0000","last_clean":"2024-09-12T16:55:12.357950+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:55:12.357950+0000","last_undegraded":"2024-09-12T16:55:12.357950+0000","last_fullsized":"2024-09-12T16:55:12.357950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:47.582510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032193+0000","last_change":"2024-09-12T16:52:00.176219+0000","last_active":"2024-09-12T16:52:35.032193+0000","last_peered":"2024-09-12T16:52:35.032193+0000","last_clean":"2024-09-12T16:52:35.032193+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:52:35.032193+0000","last_undegraded":"2024-09-12T16:52:35.032193+0000","last_fullsized":"2024-09-12T16:52:35.032193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:21.686238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.006359+0000","last_change":"2024-09-12T16:52:02.194377+0000","last_active":"2024-09-12T16:54:09.006359+0000","last_peered":"2024-09-12T16:54:09.006359+0000","last_clean":"2024-09-12T16:54:09.006359+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:54:09.006359+0000","last_undegraded":"2024-09-12T16:54:09.006359+0000","last_fullsized":"2024-09-12T16:54:09.006359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:35.662292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024735+0000","last_change":"2024-09-12T16:52:04.215450+0000","last_active":"2024-09-12T16:52:35.024735+0000","last_peered":"2024-09-12T16:52:35.024735+0000","last_clean":"2024-09-12T16:52:35.024735+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:52:35.024735+0000","last_undegraded":"2024-09-12T16:52:35.024735+0000","last_fullsized":"2024-09-12T16:52:35.024735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.120052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.497182+0000","last_change":"2024-09-12T16:52:06.212418+0000","last_active":"2024-09-12T16:55:12.497182+0000","last_peered":"2024-09-12T16:55:12.497182+0000","last_clean":"2024-09-12T16:55:12.497182+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:55:12.497182+0000","last_undegraded":"2024-09-12T16:55:12.497182+0000","last_fullsized":"2024-09-12T16:55:12.497182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:57.649089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'27","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.424657+0000","last_change":"2024-09-12T16:51:58.172876+0000","last_active":"2024-09-12T16:55:12.424657+0000","last_peered":"2024-09-12T16:55:12.424657+0000","last_clean":"2024-09-12T16:55:12.424657+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.424657+0000","last_undegraded":"2024-09-12T16:55:12.424657+0000","last_fullsized":"2024-09-12T16:55:12.424657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:16.676112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020927+0000","last_change":"2024-09-12T16:51:56.152311+0000","last_active":"2024-09-12T16:52:35.020927+0000","last_peered":"2024-09-12T16:52:35.020927+0000","last_clean":"2024-09-12T16:52:35.020927+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:52:35.020927+0000","last_undegraded":"2024-09-12T16:52:35.020927+0000","last_fullsized":"2024-09-12T16:52:35.020927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:31.068717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034344+0000","last_change":"2024-09-12T16:52:00.183813+0000","last_active":"2024-09-12T16:52:35.034344+0000","last_peered":"2024-09-12T16:52:35.034344+0000","last_clean":"2024-09-12T16:52:35.034344+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:52:35.034344+0000","last_undegraded":"2024-09-12T16:52:35.034344+0000","last_fullsized":"2024-09-12T16:52:35.034344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.454514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.479969+0000","last_change":"2024-09-12T16:52:02.184368+0000","last_active":"2024-09-12T16:55:11.479969+0000","last_peered":"2024-09-12T16:55:11.479969+0000","last_clean":"2024-09-12T16:55:11.479969+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:55:11.479969+0000","last_undegraded":"2024-09-12T16:55:11.479969+0000","last_fullsized":"2024-09-12T16:55:11.479969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:55.116071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017383+0000","last_change":"2024-09-12T16:52:04.216686+0000","last_active":"2024-09-12T16:52:35.017383+0000","last_peered":"2024-09-12T16:52:35.017383+0000","last_clean":"2024-09-12T16:52:35.017383+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:52:35.017383+0000","last_undegraded":"2024-09-12T16:52:35.017383+0000","last_fullsized":"2024-09-12T16:52:35.017383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.665774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022183+0000","last_change":"2024-09-12T16:52:06.225236+0000","last_active":"2024-09-12T16:52:35.022183+0000","last_peered":"2024-09-12T16:52:35.022183+0000","last_clean":"2024-09-12T16:52:35.022183+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:52:35.022183+0000","last_undegraded":"2024-09-12T16:52:35.022183+0000","last_fullsized":"2024-09-12T16:52:35.022183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.292498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559427+0000","last_change":"2024-09-12T16:51:58.171912+0000","last_active":"2024-09-12T16:55:12.559427+0000","last_peered":"2024-09-12T16:55:12.559427+0000","last_clean":"2024-09-12T16:55:12.559427+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:55:12.559427+0000","last_undegraded":"2024-09-12T16:55:12.559427+0000","last_fullsized":"2024-09-12T16:55:12.559427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:33.118187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:25.018159+0000","last_change":"2024-09-12T16:51:56.153340+0000","last_active":"2024-09-12T16:54:25.018159+0000","last_peered":"2024-09-12T16:54:25.018159+0000","last_clean":"2024-09-12T16:54:25.018159+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:54:25.018159+0000","last_undegraded":"2024-09-12T16:54:25.018159+0000","last_fullsized":"2024-09-12T16:54:25.018159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:43.389321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017569+0000","last_change":"2024-09-12T16:52:00.163603+0000","last_active":"2024-09-12T16:52:35.017569+0000","last_peered":"2024-09-12T16:52:35.017569+0000","last_clean":"2024-09-12T16:52:35.017569+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:52:35.017569+0000","last_undegraded":"2024-09-12T16:52:35.017569+0000","last_fullsized":"2024-09-12T16:52:35.017569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:17.118266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.868200+0000","last_change":"2024-09-12T16:52:02.180694+0000","last_active":"2024-09-12T16:55:43.868200+0000","last_peered":"2024-09-12T16:55:43.868200+0000","last_clean":"2024-09-12T16:55:43.868200+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:55:43.868200+0000","last_undegraded":"2024-09-12T16:55:43.868200+0000","last_fullsized":"2024-09-12T16:55:43.868200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.028291+0000","last_change":"2024-09-12T16:52:04.200667+0000","last_active":"2024-09-12T16:52:35.028291+0000","last_peered":"2024-09-12T16:52:35.028291+0000","last_clean":"2024-09-12T16:52:35.028291+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:52:35.028291+0000","last_undegraded":"2024-09-12T16:52:35.028291+0000","last_fullsized":"2024-09-12T16:52:35.028291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.487906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039574+0000","last_change":"2024-09-12T16:52:06.236861+0000","last_active":"2024-09-12T16:52:35.039574+0000","last_peered":"2024-09-12T16:52:35.039574+0000","last_clean":"2024-09-12T16:52:35.039574+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:52:35.039574+0000","last_undegraded":"2024-09-12T16:52:35.039574+0000","last_fullsized":"2024-09-12T16:52:35.039574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:29.568087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114298+0000","last_change":"2024-09-12T16:51:58.168169+0000","last_active":"2024-09-12T16:53:26.114298+0000","last_peered":"2024-09-12T16:53:26.114298+0000","last_clean":"2024-09-12T16:53:26.114298+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:53:26.114298+0000","last_undegraded":"2024-09-12T16:53:26.114298+0000","last_fullsized":"2024-09-12T16:53:26.114298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:56.585276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046409+0000","last_change":"2024-09-12T16:51:56.158362+0000","last_active":"2024-09-12T16:52:35.046409+0000","last_peered":"2024-09-12T16:52:35.046409+0000","last_clean":"2024-09-12T16:52:35.046409+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:52:35.046409+0000","last_undegraded":"2024-09-12T16:52:35.046409+0000","last_fullsized":"2024-09-12T16:52:35.046409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:58.692768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022824+0000","last_change":"2024-09-12T16:52:00.181358+0000","last_active":"2024-09-12T16:52:35.022824+0000","last_peered":"2024-09-12T16:52:35.022824+0000","last_clean":"2024-09-12T16:52:35.022824+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:52:35.022824+0000","last_undegraded":"2024-09-12T16:52:35.022824+0000","last_fullsized":"2024-09-12T16:52:35.022824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:32.384807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.984883+0000","last_change":"2024-09-12T16:52:02.181716+0000","last_active":"2024-09-12T16:54:08.984883+0000","last_peered":"2024-09-12T16:54:08.984883+0000","last_clean":"2024-09-12T16:54:08.984883+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:54:08.984883+0000","last_undegraded":"2024-09-12T16:54:08.984883+0000","last_fullsized":"2024-09-12T16:54:08.984883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.238474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016494+0000","last_change":"2024-09-12T16:52:04.211716+0000","last_active":"2024-09-12T16:52:35.016494+0000","last_peered":"2024-09-12T16:52:35.016494+0000","last_clean":"2024-09-12T16:52:35.016494+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:52:35.016494+0000","last_undegraded":"2024-09-12T16:52:35.016494+0000","last_fullsized":"2024-09-12T16:52:35.016494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.708673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406316+0000","last_change":"2024-09-12T16:51:58.158927+0000","last_active":"2024-09-12T16:55:12.406316+0000","last_peered":"2024-09-12T16:55:12.406316+0000","last_clean":"2024-09-12T16:55:12.406316+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:55:12.406316+0000","last_undegraded":"2024-09-12T16:55:12.406316+0000","last_fullsized":"2024-09-12T16:55:12.406316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:52.129370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022527+0000","last_change":"2024-09-12T16:51:56.157350+0000","last_active":"2024-09-12T16:52:35.022527+0000","last_peered":"2024-09-12T16:52:35.022527+0000","last_clean":"2024-09-12T16:52:35.022527+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:52:35.022527+0000","last_undegraded":"2024-09-12T16:52:35.022527+0000","last_fullsized":"2024-09-12T16:52:35.022527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:35.055723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025762+0000","last_change":"2024-09-12T16:52:00.159525+0000","last_active":"2024-09-12T16:52:35.025762+0000","last_peered":"2024-09-12T16:52:35.025762+0000","last_clean":"2024-09-12T16:52:35.025762+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:52:35.025762+0000","last_undegraded":"2024-09-12T16:52:35.025762+0000","last_fullsized":"2024-09-12T16:52:35.025762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:04.399510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.835655+0000","last_change":"2024-09-12T16:52:02.184114+0000","last_active":"2024-09-12T16:55:43.835655+0000","last_peered":"2024-09-12T16:55:43.835655+0000","last_clean":"2024-09-12T16:55:43.835655+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:55:43.835655+0000","last_undegraded":"2024-09-12T16:55:43.835655+0000","last_fullsized":"2024-09-12T16:55:43.835655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:51.260998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016853+0000","last_change":"2024-09-12T16:52:04.212854+0000","last_active":"2024-09-12T16:52:35.016853+0000","last_peered":"2024-09-12T16:52:35.016853+0000","last_clean":"2024-09-12T16:52:35.016853+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:52:35.016853+0000","last_undegraded":"2024-09-12T16:52:35.016853+0000","last_fullsized":"2024-09-12T16:52:35.016853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:31.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.284031+0000","last_change":"2024-09-12T16:52:06.224912+0000","last_active":"2024-09-12T16:54:11.284031+0000","last_peered":"2024-09-12T16:54:11.284031+0000","last_clean":"2024-09-12T16:54:11.284031+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:54:11.284031+0000","last_undegraded":"2024-09-12T16:54:11.284031+0000","last_fullsized":"2024-09-12T16:54:11.284031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:53.469591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762074+0000","last_change":"2024-09-12T16:51:58.157261+0000","last_active":"2024-09-12T16:53:25.762074+0000","last_peered":"2024-09-12T16:53:25.762074+0000","last_clean":"2024-09-12T16:53:25.762074+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:53:25.762074+0000","last_undegraded":"2024-09-12T16:53:25.762074+0000","last_fullsized":"2024-09-12T16:53:25.762074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:49.731949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.546723+0000","last_change":"2024-09-12T16:51:56.145141+0000","last_active":"2024-09-12T16:55:12.546723+0000","last_peered":"2024-09-12T16:55:12.546723+0000","last_clean":"2024-09-12T16:55:12.546723+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:12.546723+0000","last_undegraded":"2024-09-12T16:55:12.546723+0000","last_fullsized":"2024-09-12T16:55:12.546723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:56.176046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026467+0000","last_change":"2024-09-12T16:52:00.164196+0000","last_active":"2024-09-12T16:52:35.026467+0000","last_peered":"2024-09-12T16:52:35.026467+0000","last_clean":"2024-09-12T16:52:35.026467+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:52:35.026467+0000","last_undegraded":"2024-09-12T16:52:35.026467+0000","last_fullsized":"2024-09-12T16:52:35.026467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:24.903329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.986087+0000","last_change":"2024-09-12T16:52:02.212469+0000","last_active":"2024-09-12T16:54:08.986087+0000","last_peered":"2024-09-12T16:54:08.986087+0000","last_clean":"2024-09-12T16:54:08.986087+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:54:08.986087+0000","last_undegraded":"2024-09-12T16:54:08.986087+0000","last_fullsized":"2024-09-12T16:54:08.986087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043455+0000","last_change":"2024-09-12T16:52:04.211092+0000","last_active":"2024-09-12T16:52:35.043455+0000","last_peered":"2024-09-12T16:52:35.043455+0000","last_clean":"2024-09-12T16:52:35.043455+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:52:35.043455+0000","last_undegraded":"2024-09-12T16:52:35.043455+0000","last_fullsized":"2024-09-12T16:52:35.043455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:37.948154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031153+0000","last_change":"2024-09-12T16:52:06.224892+0000","last_active":"2024-09-12T16:52:35.031153+0000","last_peered":"2024-09-12T16:52:35.031153+0000","last_clean":"2024-09-12T16:52:35.031153+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:52:35.031153+0000","last_undegraded":"2024-09-12T16:52:35.031153+0000","last_fullsized":"2024-09-12T16:52:35.031153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:23.862554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406528+0000","last_change":"2024-09-12T16:51:58.175046+0000","last_active":"2024-09-12T16:55:12.406528+0000","last_peered":"2024-09-12T16:55:12.406528+0000","last_clean":"2024-09-12T16:55:12.406528+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:55:12.406528+0000","last_undegraded":"2024-09-12T16:55:12.406528+0000","last_fullsized":"2024-09-12T16:55:12.406528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:23.110954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032546+0000","last_change":"2024-09-12T16:51:56.166124+0000","last_active":"2024-09-12T16:52:35.032546+0000","last_peered":"2024-09-12T16:52:35.032546+0000","last_clean":"2024-09-12T16:52:35.032546+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:52:35.032546+0000","last_undegraded":"2024-09-12T16:52:35.032546+0000","last_fullsized":"2024-09-12T16:52:35.032546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:37.152636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019381+0000","last_change":"2024-09-12T16:52:00.168294+0000","last_active":"2024-09-12T16:52:35.019381+0000","last_peered":"2024-09-12T16:52:35.019381+0000","last_clean":"2024-09-12T16:52:35.019381+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:52:35.019381+0000","last_undegraded":"2024-09-12T16:52:35.019381+0000","last_fullsized":"2024-09-12T16:52:35.019381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:51.062344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.717682+0000","last_change":"2024-09-12T16:52:02.196172+0000","last_active":"2024-09-12T16:55:43.717682+0000","last_peered":"2024-09-12T16:55:43.717682+0000","last_clean":"2024-09-12T16:55:43.717682+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:55:43.717682+0000","last_undegraded":"2024-09-12T16:55:43.717682+0000","last_fullsized":"2024-09-12T16:55:43.717682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:02.649211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024118+0000","last_change":"2024-09-12T16:52:04.215112+0000","last_active":"2024-09-12T16:52:35.024118+0000","last_peered":"2024-09-12T16:52:35.024118+0000","last_clean":"2024-09-12T16:52:35.024118+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:52:35.024118+0000","last_undegraded":"2024-09-12T16:52:35.024118+0000","last_fullsized":"2024-09-12T16:52:35.024118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:24.385068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.437862+0000","last_change":"2024-09-12T16:52:06.234025+0000","last_active":"2024-09-12T16:54:11.437862+0000","last_peered":"2024-09-12T16:54:11.437862+0000","last_clean":"2024-09-12T16:54:11.437862+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:54:11.437862+0000","last_undegraded":"2024-09-12T16:54:11.437862+0000","last_fullsized":"2024-09-12T16:54:11.437862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:23.554247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491550+0000","last_change":"2024-09-12T16:51:58.153302+0000","last_active":"2024-09-12T16:55:12.491550+0000","last_peered":"2024-09-12T16:55:12.491550+0000","last_clean":"2024-09-12T16:55:12.491550+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:55:12.491550+0000","last_undegraded":"2024-09-12T16:55:12.491550+0000","last_fullsized":"2024-09-12T16:55:12.491550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:40.425831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.374105+0000","last_change":"2024-09-12T16:51:56.163659+0000","last_active":"2024-09-12T16:55:12.374105+0000","last_peered":"2024-09-12T16:55:12.374105+0000","last_clean":"2024-09-12T16:55:12.374105+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:55:12.374105+0000","last_undegraded":"2024-09-12T16:55:12.374105+0000","last_fullsized":"2024-09-12T16:55:12.374105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:06.765327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043977+0000","last_change":"2024-09-12T16:52:00.162650+0000","last_active":"2024-09-12T16:52:35.043977+0000","last_peered":"2024-09-12T16:52:35.043977+0000","last_clean":"2024-09-12T16:52:35.043977+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:52:35.043977+0000","last_undegraded":"2024-09-12T16:52:35.043977+0000","last_fullsized":"2024-09-12T16:52:35.043977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.597418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.050080+0000","last_change":"2024-09-12T16:52:02.216308+0000","last_active":"2024-09-12T16:52:35.050080+0000","last_peered":"2024-09-12T16:52:35.050080+0000","last_clean":"2024-09-12T16:52:35.050080+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:52:35.050080+0000","last_undegraded":"2024-09-12T16:52:35.050080+0000","last_fullsized":"2024-09-12T16:52:35.050080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:12.930560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419678+0000","last_change":"2024-09-12T16:52:04.219251+0000","last_active":"2024-09-12T16:55:10.419678+0000","last_peered":"2024-09-12T16:55:10.419678+0000","last_clean":"2024-09-12T16:55:10.419678+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:55:10.419678+0000","last_undegraded":"2024-09-12T16:55:10.419678+0000","last_fullsized":"2024-09-12T16:55:10.419678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.043443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020791+0000","last_change":"2024-09-12T16:52:06.232237+0000","last_active":"2024-09-12T16:52:35.020791+0000","last_peered":"2024-09-12T16:52:35.020791+0000","last_clean":"2024-09-12T16:52:35.020791+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:52:35.020791+0000","last_undegraded":"2024-09-12T16:52:35.020791+0000","last_fullsized":"2024-09-12T16:52:35.020791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:08.018725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.407369+0000","last_change":"2024-09-12T16:51:58.142849+0000","last_active":"2024-09-12T16:55:12.407369+0000","last_peered":"2024-09-12T16:55:12.407369+0000","last_clean":"2024-09-12T16:55:12.407369+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:55:12.407369+0000","last_undegraded":"2024-09-12T16:55:12.407369+0000","last_fullsized":"2024-09-12T16:55:12.407369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.603060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043118+0000","last_change":"2024-09-12T16:51:56.145893+0000","last_active":"2024-09-12T16:52:35.043118+0000","last_peered":"2024-09-12T16:52:35.043118+0000","last_clean":"2024-09-12T16:52:35.043118+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:52:35.043118+0000","last_undegraded":"2024-09-12T16:52:35.043118+0000","last_fullsized":"2024-09-12T16:52:35.043118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:01.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031597+0000","last_change":"2024-09-12T16:52:00.179417+0000","last_active":"2024-09-12T16:52:35.031597+0000","last_peered":"2024-09-12T16:52:35.031597+0000","last_clean":"2024-09-12T16:52:35.031597+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:52:35.031597+0000","last_undegraded":"2024-09-12T16:52:35.031597+0000","last_fullsized":"2024-09-12T16:52:35.031597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:39.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.971611+0000","last_change":"2024-09-12T16:52:02.182087+0000","last_active":"2024-09-12T16:54:08.971611+0000","last_peered":"2024-09-12T16:54:08.971611+0000","last_clean":"2024-09-12T16:54:08.971611+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:54:08.971611+0000","last_undegraded":"2024-09-12T16:54:08.971611+0000","last_fullsized":"2024-09-12T16:54:08.971611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:10.821781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021023+0000","last_change":"2024-09-12T16:52:04.206758+0000","last_active":"2024-09-12T16:52:35.021023+0000","last_peered":"2024-09-12T16:52:35.021023+0000","last_clean":"2024-09-12T16:52:35.021023+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:52:35.021023+0000","last_undegraded":"2024-09-12T16:52:35.021023+0000","last_fullsized":"2024-09-12T16:52:35.021023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.089165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047680+0000","last_change":"2024-09-12T16:52:06.224320+0000","last_active":"2024-09-12T16:52:35.047680+0000","last_peered":"2024-09-12T16:52:35.047680+0000","last_clean":"2024-09-12T16:52:35.047680+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:52:35.047680+0000","last_undegraded":"2024-09-12T16:52:35.047680+0000","last_fullsized":"2024-09-12T16:52:35.047680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:34.785095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.062896+0000","last_change":"2024-09-12T16:51:58.141944+0000","last_active":"2024-09-12T16:55:12.062896+0000","last_peered":"2024-09-12T16:55:12.062896+0000","last_clean":"2024-09-12T16:55:12.062896+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:55:12.062896+0000","last_undegraded":"2024-09-12T16:55:12.062896+0000","last_fullsized":"2024-09-12T16:55:12.062896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047893+0000","last_change":"2024-09-12T16:51:56.169511+0000","last_active":"2024-09-12T16:52:35.047893+0000","last_peered":"2024-09-12T16:52:35.047893+0000","last_clean":"2024-09-12T16:52:35.047893+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:52:35.047893+0000","last_undegraded":"2024-09-12T16:52:35.047893+0000","last_fullsized":"2024-09-12T16:52:35.047893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:28.067613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020018+0000","last_change":"2024-09-12T16:52:00.183375+0000","last_active":"2024-09-12T16:52:35.020018+0000","last_peered":"2024-09-12T16:52:35.020018+0000","last_clean":"2024-09-12T16:52:35.020018+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:52:35.020018+0000","last_undegraded":"2024-09-12T16:52:35.020018+0000","last_fullsized":"2024-09-12T16:52:35.020018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.969978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.771290+0000","last_change":"2024-09-12T16:52:02.175268+0000","last_active":"2024-09-12T16:55:43.771290+0000","last_peered":"2024-09-12T16:55:43.771290+0000","last_clean":"2024-09-12T16:55:43.771290+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:55:43.771290+0000","last_undegraded":"2024-09-12T16:55:43.771290+0000","last_fullsized":"2024-09-12T16:55:43.771290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:54.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022138+0000","last_change":"2024-09-12T16:52:04.209135+0000","last_active":"2024-09-12T16:52:35.022138+0000","last_peered":"2024-09-12T16:52:35.022138+0000","last_clean":"2024-09-12T16:52:35.022138+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:52:35.022138+0000","last_undegraded":"2024-09-12T16:52:35.022138+0000","last_fullsized":"2024-09-12T16:52:35.022138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:49.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.442179+0000","last_change":"2024-09-12T16:52:06.237385+0000","last_active":"2024-09-12T16:54:11.442179+0000","last_peered":"2024-09-12T16:54:11.442179+0000","last_clean":"2024-09-12T16:54:11.442179+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:54:11.442179+0000","last_undegraded":"2024-09-12T16:54:11.442179+0000","last_fullsized":"2024-09-12T16:54:11.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:58.165732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406440+0000","last_change":"2024-09-12T16:51:58.168050+0000","last_active":"2024-09-12T16:55:12.406440+0000","last_peered":"2024-09-12T16:55:12.406440+0000","last_clean":"2024-09-12T16:55:12.406440+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:55:12.406440+0000","last_undegraded":"2024-09-12T16:55:12.406440+0000","last_fullsized":"2024-09-12T16:55:12.406440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:30.432926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.563604+0000","last_change":"2024-09-12T16:51:56.158228+0000","last_active":"2024-09-12T16:52:42.563604+0000","last_peered":"2024-09-12T16:52:42.563604+0000","last_clean":"2024-09-12T16:52:42.563604+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:52:42.563604+0000","last_undegraded":"2024-09-12T16:52:42.563604+0000","last_fullsized":"2024-09-12T16:52:42.563604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:35.587454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022978+0000","last_change":"2024-09-12T16:52:00.162253+0000","last_active":"2024-09-12T16:52:35.022978+0000","last_peered":"2024-09-12T16:52:35.022978+0000","last_clean":"2024-09-12T16:52:35.022978+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:52:35.022978+0000","last_undegraded":"2024-09-12T16:52:35.022978+0000","last_fullsized":"2024-09-12T16:52:35.022978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:02.417426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'27","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:36.031143+0000","last_change":"2024-09-12T16:52:02.212684+0000","last_active":"2024-09-12T16:54:36.031143+0000","last_peered":"2024-09-12T16:54:36.031143+0000","last_clean":"2024-09-12T16:54:36.031143+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:54:36.031143+0000","last_undegraded":"2024-09-12T16:54:36.031143+0000","last_fullsized":"2024-09-12T16:54:36.031143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:00.299441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032673+0000","last_change":"2024-09-12T16:52:04.209557+0000","last_active":"2024-09-12T16:52:35.032673+0000","last_peered":"2024-09-12T16:52:35.032673+0000","last_clean":"2024-09-12T16:52:35.032673+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:52:35.032673+0000","last_undegraded":"2024-09-12T16:52:35.032673+0000","last_fullsized":"2024-09-12T16:52:35.032673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:33.026740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.024814+0000","last_change":"2024-09-12T16:52:06.234752+0000","last_active":"2024-09-12T16:54:09.024814+0000","last_peered":"2024-09-12T16:54:09.024814+0000","last_clean":"2024-09-12T16:54:09.024814+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:54:09.024814+0000","last_undegraded":"2024-09-12T16:54:09.024814+0000","last_fullsized":"2024-09-12T16:54:09.024814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.433924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406497+0000","last_change":"2024-09-12T16:51:58.141857+0000","last_active":"2024-09-12T16:55:12.406497+0000","last_peered":"2024-09-12T16:55:12.406497+0000","last_clean":"2024-09-12T16:55:12.406497+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:55:12.406497+0000","last_undegraded":"2024-09-12T16:55:12.406497+0000","last_fullsized":"2024-09-12T16:55:12.406497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:34.368226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.365932+0000","last_change":"2024-09-12T16:51:56.157950+0000","last_active":"2024-09-12T16:55:12.365932+0000","last_peered":"2024-09-12T16:55:12.365932+0000","last_clean":"2024-09-12T16:55:12.365932+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:12.365932+0000","last_undegraded":"2024-09-12T16:55:12.365932+0000","last_fullsized":"2024-09-12T16:55:12.365932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:44.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:07.263520+0000","last_change":"2024-09-12T16:52:00.163609+0000","last_active":"2024-09-12T16:54:07.263520+0000","last_peered":"2024-09-12T16:54:07.263520+0000","last_clean":"2024-09-12T16:54:07.263520+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:54:07.263520+0000","last_undegraded":"2024-09-12T16:54:07.263520+0000","last_fullsized":"2024-09-12T16:54:07.263520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:40.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.481851+0000","last_change":"2024-09-12T16:52:02.212039+0000","last_active":"2024-09-12T16:55:11.481851+0000","last_peered":"2024-09-12T16:55:11.481851+0000","last_clean":"2024-09-12T16:55:11.481851+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:55:11.481851+0000","last_undegraded":"2024-09-12T16:55:11.481851+0000","last_fullsized":"2024-09-12T16:55:11.481851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:30.940482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022180+0000","last_change":"2024-09-12T16:52:04.194659+0000","last_active":"2024-09-12T16:52:35.022180+0000","last_peered":"2024-09-12T16:52:35.022180+0000","last_clean":"2024-09-12T16:52:35.022180+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:52:35.022180+0000","last_undegraded":"2024-09-12T16:52:35.022180+0000","last_fullsized":"2024-09-12T16:52:35.022180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:10.799769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.029336+0000","last_change":"2024-09-12T16:52:06.237422+0000","last_active":"2024-09-12T16:54:09.029336+0000","last_peered":"2024-09-12T16:54:09.029336+0000","last_clean":"2024-09-12T16:54:09.029336+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:54:09.029336+0000","last_undegraded":"2024-09-12T16:54:09.029336+0000","last_fullsized":"2024-09-12T16:54:09.029336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:35.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.020472+0000","last_change":"2024-09-12T16:51:58.171119+0000","last_active":"2024-09-12T16:54:11.020472+0000","last_peered":"2024-09-12T16:54:11.020472+0000","last_clean":"2024-09-12T16:54:11.020472+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:54:11.020472+0000","last_undegraded":"2024-09-12T16:54:11.020472+0000","last_fullsized":"2024-09-12T16:54:11.020472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:42.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015512+0000","last_change":"2024-09-12T16:51:56.153106+0000","last_active":"2024-09-12T16:52:35.015512+0000","last_peered":"2024-09-12T16:52:35.015512+0000","last_clean":"2024-09-12T16:52:35.015512+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:52:35.015512+0000","last_undegraded":"2024-09-12T16:52:35.015512+0000","last_fullsized":"2024-09-12T16:52:35.015512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:35.393789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'13","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450215+0000","last_change":"2024-09-12T16:51:58.149936+0000","last_active":"2024-09-12T16:54:11.450215+0000","last_peered":"2024-09-12T16:54:11.450215+0000","last_clean":"2024-09-12T16:54:11.450215+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:54:11.450215+0000","last_undegraded":"2024-09-12T16:54:11.450215+0000","last_fullsized":"2024-09-12T16:54:11.450215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:45.542639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.109318+0000","last_change":"2024-09-12T16:51:56.165393+0000","last_active":"2024-09-12T16:54:11.109318+0000","last_peered":"2024-09-12T16:54:11.109318+0000","last_clean":"2024-09-12T16:54:11.109318+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:54:11.109318+0000","last_undegraded":"2024-09-12T16:54:11.109318+0000","last_fullsized":"2024-09-12T16:54:11.109318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:22.213222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559962+0000","last_change":"2024-09-12T16:51:58.172460+0000","last_active":"2024-09-12T16:55:12.559962+0000","last_peered":"2024-09-12T16:55:12.559962+0000","last_clean":"2024-09-12T16:55:12.559962+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:55:12.559962+0000","last_undegraded":"2024-09-12T16:55:12.559962+0000","last_fullsized":"2024-09-12T16:55:12.559962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:11.477678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033006+0000","last_change":"2024-09-12T16:51:56.154964+0000","last_active":"2024-09-12T16:52:35.033006+0000","last_peered":"2024-09-12T16:52:35.033006+0000","last_clean":"2024-09-12T16:52:35.033006+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:52:35.033006+0000","last_undegraded":"2024-09-12T16:52:35.033006+0000","last_fullsized":"2024-09-12T16:52:35.033006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:09.313014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206890+0000","last_change":"2024-09-12T16:51:58.153420+0000","last_active":"2024-09-12T16:55:12.206890+0000","last_peered":"2024-09-12T16:55:12.206890+0000","last_clean":"2024-09-12T16:55:12.206890+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:55:12.206890+0000","last_undegraded":"2024-09-12T16:55:12.206890+0000","last_fullsized":"2024-09-12T16:55:12.206890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:45.866817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.748616+0000","last_change":"2024-09-12T16:51:56.170783+0000","last_active":"2024-09-12T16:54:06.748616+0000","last_peered":"2024-09-12T16:54:06.748616+0000","last_clean":"2024-09-12T16:54:06.748616+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:54:06.748616+0000","last_undegraded":"2024-09-12T16:54:06.748616+0000","last_fullsized":"2024-09-12T16:54:06.748616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:07.556912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.059507+0000","last_change":"2024-09-12T16:52:35.058216+0000","last_active":"2024-09-12T16:52:35.059507+0000","last_peered":"2024-09-12T16:52:35.059507+0000","last_clean":"2024-09-12T16:52:35.059507+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:52:35.059507+0000","last_undegraded":"2024-09-12T16:52:35.059507+0000","last_fullsized":"2024-09-12T16:52:35.059507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:04.174584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024027+0000","last_change":"2024-09-12T16:51:56.159691+0000","last_active":"2024-09-12T16:52:35.024027+0000","last_peered":"2024-09-12T16:52:35.024027+0000","last_clean":"2024-09-12T16:52:35.024027+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:52:35.024027+0000","last_undegraded":"2024-09-12T16:52:35.024027+0000","last_fullsized":"2024-09-12T16:52:35.024027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.592397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038033+0000","last_change":"2024-09-12T16:51:58.173240+0000","last_active":"2024-09-12T16:52:35.038033+0000","last_peered":"2024-09-12T16:52:35.038033+0000","last_clean":"2024-09-12T16:52:35.038033+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:52:35.038033+0000","last_undegraded":"2024-09-12T16:52:35.038033+0000","last_fullsized":"2024-09-12T16:52:35.038033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:49.259251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.573852+0000","last_change":"2024-09-12T16:51:56.165516+0000","last_active":"2024-09-12T16:52:42.573852+0000","last_peered":"2024-09-12T16:52:42.573852+0000","last_clean":"2024-09-12T16:52:42.573852+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:52:42.573852+0000","last_undegraded":"2024-09-12T16:52:42.573852+0000","last_fullsized":"2024-09-12T16:52:42.573852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:35.139651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762612+0000","last_change":"2024-09-12T16:51:58.149306+0000","last_active":"2024-09-12T16:53:25.762612+0000","last_peered":"2024-09-12T16:53:25.762612+0000","last_clean":"2024-09-12T16:53:25.762612+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:53:25.762612+0000","last_undegraded":"2024-09-12T16:53:25.762612+0000","last_fullsized":"2024-09-12T16:53:25.762612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092689+0000","last_change":"2024-09-12T16:51:56.150773+0000","last_active":"2024-09-12T16:52:41.092689+0000","last_peered":"2024-09-12T16:52:41.092689+0000","last_clean":"2024-09-12T16:52:41.092689+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:52:41.092689+0000","last_undegraded":"2024-09-12T16:52:41.092689+0000","last_fullsized":"2024-09-12T16:52:41.092689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:22.213222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.220234+0000","last_change":"2024-09-12T16:51:58.162339+0000","last_active":"2024-09-12T16:55:12.220234+0000","last_peered":"2024-09-12T16:55:12.220234+0000","last_clean":"2024-09-12T16:55:12.220234+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:55:12.220234+0000","last_undegraded":"2024-09-12T16:55:12.220234+0000","last_fullsized":"2024-09-12T16:55:12.220234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:52.597412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092203+0000","last_change":"2024-09-12T16:51:56.158411+0000","last_active":"2024-09-12T16:52:41.092203+0000","last_peered":"2024-09-12T16:52:41.092203+0000","last_clean":"2024-09-12T16:52:41.092203+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:52:41.092203+0000","last_undegraded":"2024-09-12T16:52:41.092203+0000","last_fullsized":"2024-09-12T16:52:41.092203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:45.612366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.159807+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:05.194424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023142+0000","last_change":"2024-09-12T16:51:56.155038+0000","last_active":"2024-09-12T16:52:35.023142+0000","last_peered":"2024-09-12T16:52:35.023142+0000","last_clean":"2024-09-12T16:52:35.023142+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:52:35.023142+0000","last_undegraded":"2024-09-12T16:52:35.023142+0000","last_fullsized":"2024-09-12T16:52:35.023142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:24.208686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491894+0000","last_change":"2024-09-12T16:51:58.159514+0000","last_active":"2024-09-12T16:55:12.491894+0000","last_peered":"2024-09-12T16:55:12.491894+0000","last_clean":"2024-09-12T16:55:12.491894+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:55:12.491894+0000","last_undegraded":"2024-09-12T16:55:12.491894+0000","last_fullsized":"2024-09-12T16:55:12.491894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.364726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021975+0000","last_change":"2024-09-12T16:51:56.167940+0000","last_active":"2024-09-12T16:52:35.021975+0000","last_peered":"2024-09-12T16:52:35.021975+0000","last_clean":"2024-09-12T16:52:35.021975+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:52:35.021975+0000","last_undegraded":"2024-09-12T16:52:35.021975+0000","last_fullsized":"2024-09-12T16:52:35.021975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:08.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405710+0000","last_change":"2024-09-12T16:51:58.176452+0000","last_active":"2024-09-12T16:55:12.405710+0000","last_peered":"2024-09-12T16:55:12.405710+0000","last_clean":"2024-09-12T16:55:12.405710+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:55:12.405710+0000","last_undegraded":"2024-09-12T16:55:12.405710+0000","last_fullsized":"2024-09-12T16:55:12.405710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:45.955514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033519+0000","last_change":"2024-09-12T16:51:56.166412+0000","last_active":"2024-09-12T16:52:35.033519+0000","last_peered":"2024-09-12T16:52:35.033519+0000","last_clean":"2024-09-12T16:52:35.033519+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:52:35.033519+0000","last_undegraded":"2024-09-12T16:52:35.033519+0000","last_fullsized":"2024-09-12T16:52:35.033519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:20.820430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.309364+0000","last_change":"2024-09-12T16:51:58.146572+0000","last_active":"2024-09-12T16:52:43.309364+0000","last_peered":"2024-09-12T16:52:43.309364+0000","last_clean":"2024-09-12T16:52:43.309364+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:52:43.309364+0000","last_undegraded":"2024-09-12T16:52:43.309364+0000","last_fullsized":"2024-09-12T16:52:43.309364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:01.315966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038391+0000","last_change":"2024-09-12T16:51:56.158751+0000","last_active":"2024-09-12T16:52:35.038391+0000","last_peered":"2024-09-12T16:52:35.038391+0000","last_clean":"2024-09-12T16:52:35.038391+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:52:35.038391+0000","last_undegraded":"2024-09-12T16:52:35.038391+0000","last_fullsized":"2024-09-12T16:52:35.038391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:44.033762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114250+0000","last_change":"2024-09-12T16:51:58.172245+0000","last_active":"2024-09-12T16:53:26.114250+0000","last_peered":"2024-09-12T16:53:26.114250+0000","last_clean":"2024-09-12T16:53:26.114250+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:53:26.114250+0000","last_undegraded":"2024-09-12T16:53:26.114250+0000","last_fullsized":"2024-09-12T16:53:26.114250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:30.077956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.087965+0000","last_change":"2024-09-12T16:51:56.153153+0000","last_active":"2024-09-12T16:52:41.087965+0000","last_peered":"2024-09-12T16:52:41.087965+0000","last_clean":"2024-09-12T16:52:41.087965+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:52:41.087965+0000","last_undegraded":"2024-09-12T16:52:41.087965+0000","last_fullsized":"2024-09-12T16:52:41.087965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:50.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204146+0000","last_change":"2024-09-12T16:51:58.148643+0000","last_active":"2024-09-12T16:55:12.204146+0000","last_peered":"2024-09-12T16:55:12.204146+0000","last_clean":"2024-09-12T16:55:12.204146+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:55:12.204146+0000","last_undegraded":"2024-09-12T16:55:12.204146+0000","last_fullsized":"2024-09-12T16:55:12.204146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:32.984633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048111+0000","last_change":"2024-09-12T16:51:56.166599+0000","last_active":"2024-09-12T16:52:35.048111+0000","last_peered":"2024-09-12T16:52:35.048111+0000","last_clean":"2024-09-12T16:52:35.048111+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:52:35.048111+0000","last_undegraded":"2024-09-12T16:52:35.048111+0000","last_fullsized":"2024-09-12T16:52:35.048111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.428924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206978+0000","last_change":"2024-09-12T16:52:35.049949+0000","last_active":"2024-09-12T16:55:12.206978+0000","last_peered":"2024-09-12T16:55:12.206978+0000","last_clean":"2024-09-12T16:55:12.206978+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:55:12.206978+0000","last_undegraded":"2024-09-12T16:55:12.206978+0000","last_fullsized":"2024-09-12T16:55:12.206978+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.495939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092683+0000","last_change":"2024-09-12T16:51:56.150301+0000","last_active":"2024-09-12T16:52:41.092683+0000","last_peered":"2024-09-12T16:52:41.092683+0000","last_clean":"2024-09-12T16:52:41.092683+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:52:41.092683+0000","last_undegraded":"2024-09-12T16:52:41.092683+0000","last_fullsized":"2024-09-12T16:52:41.092683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.592397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.434439+0000","last_change":"2024-09-12T16:51:58.159251+0000","last_active":"2024-09-12T16:54:11.434439+0000","last_peered":"2024-09-12T16:54:11.434439+0000","last_clean":"2024-09-12T16:54:11.434439+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:54:11.434439+0000","last_undegraded":"2024-09-12T16:54:11.434439+0000","last_fullsized":"2024-09-12T16:54:11.434439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:33.404970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.094347+0000","last_change":"2024-09-12T16:51:56.169106+0000","last_active":"2024-09-12T16:52:41.094347+0000","last_peered":"2024-09-12T16:52:41.094347+0000","last_clean":"2024-09-12T16:52:41.094347+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:52:41.094347+0000","last_undegraded":"2024-09-12T16:52:41.094347+0000","last_fullsized":"2024-09-12T16:52:41.094347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:11.710348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.567566+0000","last_change":"2024-09-12T16:51:56.155830+0000","last_active":"2024-09-12T16:52:42.567566+0000","last_peered":"2024-09-12T16:52:42.567566+0000","last_clean":"2024-09-12T16:52:42.567566+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:52:42.567566+0000","last_undegraded":"2024-09-12T16:52:42.567566+0000","last_fullsized":"2024-09-12T16:52:42.567566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.219841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030048+0000","last_change":"2024-09-12T16:51:58.164418+0000","last_active":"2024-09-12T16:52:35.030048+0000","last_peered":"2024-09-12T16:52:35.030048+0000","last_clean":"2024-09-12T16:52:35.030048+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:52:35.030048+0000","last_undegraded":"2024-09-12T16:52:35.030048+0000","last_fullsized":"2024-09-12T16:52:35.030048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:15.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025775+0000","last_change":"2024-09-12T16:51:56.171869+0000","last_active":"2024-09-12T16:52:35.025775+0000","last_peered":"2024-09-12T16:52:35.025775+0000","last_clean":"2024-09-12T16:52:35.025775+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:52:35.025775+0000","last_undegraded":"2024-09-12T16:52:35.025775+0000","last_fullsized":"2024-09-12T16:52:35.025775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:08.525437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.246329+0000","last_change":"2024-09-12T16:51:58.173368+0000","last_active":"2024-09-12T16:52:42.246329+0000","last_peered":"2024-09-12T16:52:42.246329+0000","last_clean":"2024-09-12T16:52:42.246329+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:52:42.246329+0000","last_undegraded":"2024-09-12T16:52:42.246329+0000","last_fullsized":"2024-09-12T16:52:42.246329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:45.341574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21619584,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":87,"num_write":310,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25817088,"data_stored":25817088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640307,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8758283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640308,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44764,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327076,"statfs":{"total":96636764160,"available":96590925824,"internally_reserved":0,"allocated":9646080,"data_stored":9347905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48904,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322936,"statfs":{"total":96636764160,"available":96586686464,"internally_reserved":0,"allocated":9625600,"data_stored":9346317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48344,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323496,"statfs":{"total":96636764160,"available":96587259904,"internally_reserved":0,"allocated":9052160,"data_stored":8759273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:55:45.138 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:55:45.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7fcd68640 1 Processor -- start 2024-09-12T16:55:45.275 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7fcd68640 1 -- start start 2024-09-12T16:55:45.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7fcd68640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff7f8111890 0x7ff7f8132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:45.276 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7fcd68640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f8073a90 con 0x7ff7f8110da0 2024-09-12T16:55:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7fcd68640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f80696e0 con 0x7ff7f8111890 2024-09-12T16:55:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7f5d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff7f8111890 0x7ff7f8132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7f659c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff7f8110da0 0x7ff7f8111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36732/0 (socket says 172.21.15.122:36732) 2024-09-12T16:55:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7f659c640 1 -- 172.21.15.122:0/519510215 learned_addr learned my addr 172.21.15.122:0/519510215 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.269+0000 7ff7f5d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff7f8111890 0x7ff7f8132450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58808/0 (socket says 172.21.15.122:58808) 2024-09-12T16:55:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7f5d9b640 1 -- 172.21.15.122:0/519510215 >> v1:172.21.15.122:6789/0 conn(0x7ff7f8110da0 legacy=0x7ff7f8111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7f5d9b640 1 -- 172.21.15.122:0/519510215 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f806dd50 con 0x7ff7f8111890 2024-09-12T16:55:45.277 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7f559a640 1 -- 172.21.15.122:0/519510215 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899996022 0 0) 0x7ff7f8073a90 con 0x7ff7f8110da0 2024-09-12T16:55:45.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7f5d9b640 1 --2- 172.21.15.122:0/519510215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8111890 0x7ff7f8132450 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009740 tx=0x7ff7ec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e50ec7a2c687241 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:45.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7f559a640 1 -- 172.21.15.122:0/519510215 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7ec0b0070 con 0x7ff7f8111890 2024-09-12T16:55:45.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7f559a640 1 -- 172.21.15.122:0/519510215 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ec0ab530 con 0x7ff7f8111890 2024-09-12T16:55:45.278 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7f559a640 1 -- 172.21.15.122:0/519510215 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7ec0ab830 con 0x7ff7f8111890 2024-09-12T16:55:45.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 -- 172.21.15.122:0/519510215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8111890 msgr2=0x7ff7f8132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:45.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 --2- 172.21.15.122:0/519510215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8111890 0x7ff7f8132450 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009740 tx=0x7ff7ec01c370 comp rx=0 tx=0).stop 2024-09-12T16:55:45.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 -- 172.21.15.122:0/519510215 shutdown_connections 2024-09-12T16:55:45.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 --2- 172.21.15.122:0/519510215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8111890 0x7ff7f8132450 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:45.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 -- 172.21.15.122:0/519510215 >> 172.21.15.122:0/519510215 conn(0x7ff7f8070900 msgr2=0x7ff7f8072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:45.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 -- 172.21.15.122:0/519510215 shutdown_connections 2024-09-12T16:55:45.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 -- 172.21.15.122:0/519510215 wait complete. 2024-09-12T16:55:45.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 Processor -- start 2024-09-12T16:55:45.280 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.273+0000 7ff7fcd68640 1 -- start start 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7fcd68640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8110da0 0x7ff7f81226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7fcd68640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8135330 con 0x7ff7f8110da0 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7f659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8110da0 0x7ff7f81226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7f659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8110da0 0x7ff7f81226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58814/0 (socket says 172.21.15.122:58814) 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7f659c640 1 -- 172.21.15.122:0/1359530383 learned_addr learned my addr 172.21.15.122:0/1359530383 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7f659c640 1 -- 172.21.15.122:0/1359530383 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f81140d0 con 0x7ff7f8110da0 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7f659c640 1 --2- 172.21.15.122:0/1359530383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8110da0 0x7ff7f81226b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800c3d0 tx=0x7ff7e800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7e6ffd640 1 -- 172.21.15.122:0/1359530383 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7e8007410 con 0x7ff7f8110da0 2024-09-12T16:55:45.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7e6ffd640 1 -- 172.21.15.122:0/1359530383 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e80075d0 con 0x7ff7f8110da0 2024-09-12T16:55:45.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f812f7b0 con 0x7ff7f8110da0 2024-09-12T16:55:45.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7e6ffd640 1 -- 172.21.15.122:0/1359530383 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7e8004960 con 0x7ff7f8110da0 2024-09-12T16:55:45.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f812fca0 con 0x7ff7f8110da0 2024-09-12T16:55:45.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f8111180 con 0x7ff7f8110da0 2024-09-12T16:55:45.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7e6ffd640 1 -- 172.21.15.122:0/1359530383 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff7e8011070 con 0x7ff7f8110da0 2024-09-12T16:55:45.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7e6ffd640 1 --2- 172.21.15.122:0/1359530383 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff7d803b200 0x7ff7d803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:45.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7e6ffd640 1 -- 172.21.15.122:0/1359530383 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff7e804f370 con 0x7ff7f8110da0 2024-09-12T16:55:45.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7f5d9b640 1 --2- 172.21.15.122:0/1359530383 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff7d803b200 0x7ff7d803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:45.285 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.277+0000 7ff7f5d9b640 1 --2- 172.21.15.122:0/1359530383 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff7d803b200 0x7ff7d803d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0ad000 tx=0x7ff7ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:45.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.281+0000 7ff7e6ffd640 1 -- 172.21.15.122:0/1359530383 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff7e8010d50 con 0x7ff7f8110da0 2024-09-12T16:55:45.451 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.445+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7f81275f0 con 0x7ff7f8110da0 2024-09-12T16:55:45.454 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.449+0000 7ff7e6ffd640 1 -- 172.21.15.122:0/1359530383 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+21197 (secure 0 0 0) 0x7ff7e8012d70 con 0x7ff7f8110da0 2024-09-12T16:55:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:55:45.455 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":34,"fsid":"5046056a-17be-43b6-80d1-88da5e3ce49b","created":"2024-09-12T16:51:29.157028+0000","modified":"2024-09-12T16:52:35.010817+0000","last_up_change":"2024-09-12T16:51:40.347390+0000","last_in_change":"2024-09-12T16:51:30.340067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:51:39.964026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:51:45.007883+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T16:51:54.106939+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T16:51:56.477618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T16:51:58.385962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T16:52:00.309725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T16:52:02.224418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T16:52:04.346550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b980825b-63eb-43eb-ac4e-92bc8be6c667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6801","nonce":3868153603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6803","nonce":3868153603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6807","nonce":3868153603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":3868153603},{"type":"v1","addr":"172.21.15.122:6805","nonce":3868153603}]},"public_addr":"172.21.15.122:6801/3868153603","cluster_addr":"172.21.15.122:6803/3868153603","heartbeat_back_addr":"172.21.15.122:6807/3868153603","heartbeat_front_addr":"172.21.15.122:6805/3868153603","state":["exists","up"]},{"osd":1,"uuid":"ee33c8ea-2ca6-4b30-aa17-9afe02f68eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6817","nonce":883447514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6819","nonce":883447514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6823","nonce":883447514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":883447514},{"type":"v1","addr":"172.21.15.151:6821","nonce":883447514}]},"public_addr":"172.21.15.151:6817/883447514","cluster_addr":"172.21.15.151:6819/883447514","heartbeat_back_addr":"172.21.15.151:6823/883447514","heartbeat_front_addr":"172.21.15.151:6821/883447514","state":["exists","up"]},{"osd":2,"uuid":"9d24c0c8-e615-47ba-b69f-3bfaeb68e4f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6801","nonce":1197700885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6803","nonce":1197700885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6807","nonce":1197700885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1197700885},{"type":"v1","addr":"172.21.15.151:6805","nonce":1197700885}]},"public_addr":"172.21.15.151:6801/1197700885","cluster_addr":"172.21.15.151:6803/1197700885","heartbeat_back_addr":"172.21.15.151:6807/1197700885","heartbeat_front_addr":"172.21.15.151:6805/1197700885","state":["exists","up"]},{"osd":3,"uuid":"61fba858-88d7-4f24-b3a4-cfed25eca39b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6809","nonce":987175333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6811","nonce":987175333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6815","nonce":987175333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":987175333},{"type":"v1","addr":"172.21.15.151:6813","nonce":987175333}]},"public_addr":"172.21.15.151:6809/987175333","cluster_addr":"172.21.15.151:6811/987175333","heartbeat_back_addr":"172.21.15.151:6815/987175333","heartbeat_front_addr":"172.21.15.151:6813/987175333","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:36.468476+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:37.504802+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:36.679834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:51:37.189623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]},{"pgid":"5.6","mappings":[{"from":0,"to":1}]},{"pgid":"5.7","mappings":[{"from":0,"to":2}]},{"pgid":"5.f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:55:45.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff7d803b200 msgr2=0x7ff7d803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:45.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 --2- 172.21.15.122:0/1359530383 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff7d803b200 0x7ff7d803d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0ad000 tx=0x7ff7ec008040 comp rx=0 tx=0).stop 2024-09-12T16:55:45.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8110da0 msgr2=0x7ff7f81226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:45.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 --2- 172.21.15.122:0/1359530383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8110da0 0x7ff7f81226b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800c3d0 tx=0x7ff7e800c890 comp rx=0 tx=0).stop 2024-09-12T16:55:45.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 shutdown_connections 2024-09-12T16:55:45.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 --2- 172.21.15.122:0/1359530383 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff7d803b200 0x7ff7d803d6c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:45.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 --2- 172.21.15.122:0/1359530383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7f8110da0 0x7ff7f81226b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:45.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 >> 172.21.15.122:0/1359530383 conn(0x7ff7f8070900 msgr2=0x7ff7f8129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:45.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 shutdown_connections 2024-09-12T16:55:45.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:45.453+0000 7ff7fcd68640 1 -- 172.21.15.122:0/1359530383 wait complete. 2024-09-12T16:55:46.555 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T16:55:46.556 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:55:46.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed8d52e640 1 Processor -- start 2024-09-12T16:55:46.690 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed8d52e640 1 -- start start 2024-09-12T16:55:46.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed8d52e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fed88129a20 0x7fed88129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:46.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed8d52e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8812a930 con 0x7fed8812a4f0 2024-09-12T16:55:46.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed8d52e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fed88069170 con 0x7fed88129a20 2024-09-12T16:55:46.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed86ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fed88129a20 0x7fed88129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:46.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed867fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fed8812a4f0 0x7fed8812cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36742/0 (socket says 172.21.15.122:36742) 2024-09-12T16:55:46.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed867fc640 1 -- 172.21.15.122:0/1028397678 learned_addr learned my addr 172.21.15.122:0/1028397678 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:46.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed86ffd640 1 -- 172.21.15.122:0/1028397678 >> v1:172.21.15.122:6789/0 conn(0x7fed8812a4f0 legacy=0x7fed8812cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:46.691 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.685+0000 7fed86ffd640 1 -- 172.21.15.122:0/1028397678 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed88114950 con 0x7fed88129a20 2024-09-12T16:55:46.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed86ffd640 1 --2- 172.21.15.122:0/1028397678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88129fb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fed78009740 tx=0x7fed7801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcae567440a67080 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:46.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed85ffb640 1 -- 172.21.15.122:0/1028397678 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed780b0070 con 0x7fed88129a20 2024-09-12T16:55:46.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed85ffb640 1 -- 172.21.15.122:0/1028397678 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed780ab530 con 0x7fed88129a20 2024-09-12T16:55:46.693 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed85ffb640 1 -- 172.21.15.122:0/1028397678 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed780ab830 con 0x7fed88129a20 2024-09-12T16:55:46.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 -- 172.21.15.122:0/1028397678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 msgr2=0x7fed88129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:46.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 --2- 172.21.15.122:0/1028397678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88129fb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fed78009740 tx=0x7fed7801c370 comp rx=0 tx=0).stop 2024-09-12T16:55:46.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 -- 172.21.15.122:0/1028397678 shutdown_connections 2024-09-12T16:55:46.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 --2- 172.21.15.122:0/1028397678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88129fb0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:46.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 -- 172.21.15.122:0/1028397678 >> 172.21.15.122:0/1028397678 conn(0x7fed88070d70 msgr2=0x7fed88073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:46.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 -- 172.21.15.122:0/1028397678 shutdown_connections 2024-09-12T16:55:46.694 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 -- 172.21.15.122:0/1028397678 wait complete. 2024-09-12T16:55:46.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 Processor -- start 2024-09-12T16:55:46.695 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 -- start start 2024-09-12T16:55:46.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88123870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:46.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed8d52e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fed88135ce0 con 0x7fed88129a20 2024-09-12T16:55:46.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed86ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88123870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:46.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed86ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88123870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58832/0 (socket says 172.21.15.122:58832) 2024-09-12T16:55:46.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed86ffd640 1 -- 172.21.15.122:0/2258696306 learned_addr learned my addr 172.21.15.122:0/2258696306 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:46.696 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed86ffd640 1 -- 172.21.15.122:0/2258696306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed88132920 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.689+0000 7fed86ffd640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88123870 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fed780ae040 tx=0x7fed7801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed780b0050 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed780b1040 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed780b58b0 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed88112ec0 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed88123db0 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed88129fb0 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fed780be030 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed7403b200 0x7fed7403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fed780bc070 con 0x7fed88129a20 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fed74047780 0x7fed74049c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:46.698 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed780044a0 con 0x7fed74047780 2024-09-12T16:55:46.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fed780ee2a0 con 0x7fed88129a20 2024-09-12T16:55:46.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed877fe640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fed74047780 0x7fed74049c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:46.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed867fc640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed7403b200 0x7fed7403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:46.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed877fe640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fed74047780 0x7fed74049c20 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:46.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed867fc640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed7403b200 0x7fed7403d6c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fed7c001650 tx=0x7fed7c007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:46.699 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.693+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 <== osd.0 v2:172.21.15.122:6800/3868153603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed780044a0 con 0x7fed74047780 2024-09-12T16:55:46.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.705+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 --> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed881130f0 con 0x7fed74047780 2024-09-12T16:55:46.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed6f7fe640 1 -- 172.21.15.122:0/2258696306 <== osd.0 v2:172.21.15.122:6800/3868153603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed8000adb0 con 0x7fed74047780 2024-09-12T16:55:46.712 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-12T16:55:46.713 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:55:46.713 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fed74047780 msgr2=0x7fed74049c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fed74047780 0x7fed74049c20 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed7403b200 msgr2=0x7fed7403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed7403b200 0x7fed7403d6c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fed7c001650 tx=0x7fed7c007ad0 comp rx=0 tx=0).stop 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 msgr2=0x7fed88123870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88123870 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fed780ae040 tx=0x7fed7801abb0 comp rx=0 tx=0).stop 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 shutdown_connections 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:6800/3868153603,v1:172.21.15.122:6801/3868153603] conn(0x7fed74047780 0x7fed74049c20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:46.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fed7403b200 0x7fed7403d6c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:46.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 --2- 172.21.15.122:0/2258696306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed88129a20 0x7fed88123870 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:46.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 >> 172.21.15.122:0/2258696306 conn(0x7fed88070d70 msgr2=0x7fed88127ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:46.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 shutdown_connections 2024-09-12T16:55:46.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.709+0000 7fed8d52e640 1 -- 172.21.15.122:0/2258696306 wait complete. 2024-09-12T16:55:46.728 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T16:55:46.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd78222b640 1 Processor -- start 2024-09-12T16:55:46.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd78222b640 1 -- start start 2024-09-12T16:55:46.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd78222b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd77c130260 0x7fd77c132650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:46.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd78222b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77c1122f0 con 0x7fd77c12d2e0 2024-09-12T16:55:46.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd78222b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fd77c06dcb0 con 0x7fd77c130260 2024-09-12T16:55:46.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd77b7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd77c12d2e0 0x7fd77c12d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36744/0 (socket says 172.21.15.122:36744) 2024-09-12T16:55:46.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd77b7fe640 1 -- 172.21.15.122:0/1652850606 learned_addr learned my addr 172.21.15.122:0/1652850606 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:46.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd77affd640 1 --2- 172.21.15.122:0/1652850606 >> v2:172.21.15.122:3300/0 conn(0x7fd77c130260 0x7fd77c132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:46.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd77a7fc640 1 -- 172.21.15.122:0/1652850606 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858553818 0 0) 0x7fd77c1122f0 con 0x7fd77c12d2e0 2024-09-12T16:55:46.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd77a7fc640 1 -- 172.21.15.122:0/1652850606 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd768003530 con 0x7fd77c12d2e0 2024-09-12T16:55:46.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd77affd640 1 -- 172.21.15.122:0/1652850606 >> v1:172.21.15.122:6789/0 conn(0x7fd77c12d2e0 legacy=0x7fd77c12d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:46.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.825+0000 7fd77affd640 1 -- 172.21.15.122:0/1652850606 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c073ad0 con 0x7fd77c130260 2024-09-12T16:55:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77affd640 1 --2- 172.21.15.122:0/1652850606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c130260 0x7fd77c132650 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd764009740 tx=0x7fd76401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5462acb662e8ad69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77a7fc640 1 -- 172.21.15.122:0/1652850606 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7640b0070 con 0x7fd77c130260 2024-09-12T16:55:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77a7fc640 1 -- 172.21.15.122:0/1652850606 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7640ab530 con 0x7fd77c130260 2024-09-12T16:55:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77a7fc640 1 -- 172.21.15.122:0/1652850606 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7640ab810 con 0x7fd77c130260 2024-09-12T16:55:46.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- 172.21.15.122:0/1652850606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c130260 msgr2=0x7fd77c132650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 --2- 172.21.15.122:0/1652850606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c130260 0x7fd77c132650 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd764009740 tx=0x7fd76401c370 comp rx=0 tx=0).stop 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- 172.21.15.122:0/1652850606 shutdown_connections 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 --2- 172.21.15.122:0/1652850606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c130260 0x7fd77c132650 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- 172.21.15.122:0/1652850606 >> 172.21.15.122:0/1652850606 conn(0x7fd77c070940 msgr2=0x7fd77c072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- 172.21.15.122:0/1652850606 shutdown_connections 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- 172.21.15.122:0/1652850606 wait complete. 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 Processor -- start 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- start start 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c12d2e0 0x7fd77c1c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c135740 con 0x7fd77c12d2e0 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c12d2e0 0x7fd77c1c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c12d2e0 0x7fd77c1c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58836/0 (socket says 172.21.15.122:58836) 2024-09-12T16:55:46.836 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77b7fe640 1 -- 172.21.15.122:0/377259786 learned_addr learned my addr 172.21.15.122:0/377259786 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:46.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77b7fe640 1 -- 172.21.15.122:0/377259786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c115ce0 con 0x7fd77c12d2e0 2024-09-12T16:55:46.837 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd77b7fe640 1 --2- 172.21.15.122:0/377259786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c12d2e0 0x7fd77c1c4b70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd77400cb40 tx=0x7fd77400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:46.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd773fff640 1 -- 172.21.15.122:0/377259786 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd77400ab50 con 0x7fd77c12d2e0 2024-09-12T16:55:46.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd773fff640 1 -- 172.21.15.122:0/377259786 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77400acf0 con 0x7fd77c12d2e0 2024-09-12T16:55:46.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77c1157b0 con 0x7fd77c12d2e0 2024-09-12T16:55:46.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd773fff640 1 -- 172.21.15.122:0/377259786 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd774012530 con 0x7fd77c12d2e0 2024-09-12T16:55:46.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.829+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77c1c5280 con 0x7fd77c12d2e0 2024-09-12T16:55:46.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.833+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd77c126e40 con 0x7fd77c12d2e0 2024-09-12T16:55:46.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.833+0000 7fd773fff640 1 -- 172.21.15.122:0/377259786 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd7740126d0 con 0x7fd77c12d2e0 2024-09-12T16:55:46.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.833+0000 7fd773fff640 1 --2- 172.21.15.122:0/377259786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd75c03b200 0x7fd75c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.833+0000 7fd773fff640 1 -- 172.21.15.122:0/377259786 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd77404fdb0 con 0x7fd77c12d2e0 2024-09-12T16:55:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.833+0000 7fd77affd640 1 --2- 172.21.15.122:0/377259786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd75c03b200 0x7fd75c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:46.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.833+0000 7fd77affd640 1 --2- 172.21.15.122:0/377259786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd75c03b200 0x7fd75c03d6c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd7640ad000 tx=0x7fd7640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:46.841 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.837+0000 7fd773fff640 1 -- 172.21.15.122:0/377259786 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd77401a360 con 0x7fd77c12d2e0 2024-09-12T16:55:47.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:46.997+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd77c1153f0 con 0x7fd75c03b200 2024-09-12T16:55:47.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.001+0000 7fd773fff640 1 -- 172.21.15.122:0/377259786 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd77c1153f0 con 0x7fd75c03b200 2024-09-12T16:55:47.006 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T16:55:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.001+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd75c03b200 msgr2=0x7fd75c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.001+0000 7fd78222b640 1 --2- 172.21.15.122:0/377259786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd75c03b200 0x7fd75c03d6c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd7640ad000 tx=0x7fd7640a6000 comp rx=0 tx=0).stop 2024-09-12T16:55:47.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.001+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c12d2e0 msgr2=0x7fd77c1c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.001+0000 7fd78222b640 1 --2- 172.21.15.122:0/377259786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c12d2e0 0x7fd77c1c4b70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd77400cb40 tx=0x7fd77400a060 comp rx=0 tx=0).stop 2024-09-12T16:55:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.005+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 shutdown_connections 2024-09-12T16:55:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.005+0000 7fd78222b640 1 --2- 172.21.15.122:0/377259786 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fd75c03b200 0x7fd75c03d6c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.005+0000 7fd78222b640 1 --2- 172.21.15.122:0/377259786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd77c12d2e0 0x7fd77c1c4b70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.005+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 >> 172.21.15.122:0/377259786 conn(0x7fd77c070940 msgr2=0x7fd77c12ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.005+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 shutdown_connections 2024-09-12T16:55:47.009 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.005+0000 7fd78222b640 1 -- 172.21.15.122:0/377259786 wait complete. 2024-09-12T16:55:47.023 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T16:55:47.023 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:55:47.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f7393341640 1 Processor -- start 2024-09-12T16:55:47.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f7393341640 1 -- start start 2024-09-12T16:55:47.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f7393341640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f738c06edf0 0x7f738c06f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f7393341640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f738c06feb0 con 0x7f738c06f710 2024-09-12T16:55:47.146 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f7393341640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f738c117060 con 0x7f738c06edf0 2024-09-12T16:55:47.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f73910dd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f738c06edf0 0x7f738c06f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f73908dc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f738c06f710 0x7f738c125400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36748/0 (socket says 172.21.15.122:36748) 2024-09-12T16:55:47.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f73908dc640 1 -- 172.21.15.122:0/2903104767 learned_addr learned my addr 172.21.15.122:0/2903104767 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:47.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f7383fff640 1 -- 172.21.15.122:0/2903104767 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868451027 0 0) 0x7f738c06feb0 con 0x7f738c06f710 2024-09-12T16:55:47.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f7383fff640 1 -- 172.21.15.122:0/2903104767 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7378003530 con 0x7f738c06f710 2024-09-12T16:55:47.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f7383fff640 1 -- 172.21.15.122:0/2903104767 <== mon.0 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3834598121 0 0) 0x7f7378003530 con 0x7f738c06f710 2024-09-12T16:55:47.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f73910dd640 1 -- 172.21.15.122:0/2903104767 >> v1:172.21.15.122:6789/0 conn(0x7f738c06f710 legacy=0x7f738c125400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.147 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.141+0000 7f73910dd640 1 -- 172.21.15.122:0/2903104767 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c0a0800 con 0x7f738c06edf0 2024-09-12T16:55:47.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f73910dd640 1 --2- 172.21.15.122:0/2903104767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c06f1d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f7388009dc0 tx=0x7f738801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b25eb8380c5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7383fff640 1 -- 172.21.15.122:0/2903104767 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73880b2070 con 0x7f738c06edf0 2024-09-12T16:55:47.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7383fff640 1 -- 172.21.15.122:0/2903104767 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73880a5570 con 0x7f738c06edf0 2024-09-12T16:55:47.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7383fff640 1 -- 172.21.15.122:0/2903104767 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f737c001630 con 0x7f738c06edf0 2024-09-12T16:55:47.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 -- 172.21.15.122:0/2903104767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 msgr2=0x7f738c06f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 --2- 172.21.15.122:0/2903104767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c06f1d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f7388009dc0 tx=0x7f738801c850 comp rx=0 tx=0).stop 2024-09-12T16:55:47.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 -- 172.21.15.122:0/2903104767 shutdown_connections 2024-09-12T16:55:47.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 --2- 172.21.15.122:0/2903104767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c06f1d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 -- 172.21.15.122:0/2903104767 >> 172.21.15.122:0/2903104767 conn(0x7f738c071e50 msgr2=0x7f738c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 -- 172.21.15.122:0/2903104767 shutdown_connections 2024-09-12T16:55:47.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 -- 172.21.15.122:0/2903104767 wait complete. 2024-09-12T16:55:47.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 Processor -- start 2024-09-12T16:55:47.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 -- start start 2024-09-12T16:55:47.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c124370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f7393341640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f738c06fca0 con 0x7f738c06edf0 2024-09-12T16:55:47.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f73910dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c124370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f73910dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c124370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58860/0 (socket says 172.21.15.122:58860) 2024-09-12T16:55:47.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f73910dd640 1 -- 172.21.15.122:0/2221330239 learned_addr learned my addr 172.21.15.122:0/2221330239 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f73910dd640 1 -- 172.21.15.122:0/2221330239 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c134370 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.145+0000 7f73910dd640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c124370 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f738801a480 tx=0x7f73880195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73880bd020 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73880a6a60 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c1299e0 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73880b2040 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c1354a0 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f738c06f1d0 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f73880c0020 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f737003b1d0 0x7f737003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f73880ea880 con 0x7f738c06edf0 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f73700476a0 0x7f7370049b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73880020c0 con 0x7f73700476a0 2024-09-12T16:55:47.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f73880ef2a0 con 0x7f738c06edf0 2024-09-12T16:55:47.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f73908dc640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f737003b1d0 0x7f737003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f73918de640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f73700476a0 0x7f7370049b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f73918de640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f73700476a0 0x7f7370049b40 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.149+0000 7f73908dc640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f737003b1d0 0x7f737003d690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f737c001640 tx=0x7f737c001150 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.153+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 <== osd.1 v2:172.21.15.151:6816/883447514 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73880020c0 con 0x7f73700476a0 2024-09-12T16:55:47.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 --> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f738c06f710 con 0x7f73700476a0 2024-09-12T16:55:47.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7381ffb640 1 -- 172.21.15.122:0/2221330239 <== osd.1 v2:172.21.15.151:6816/883447514 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f738c06f710 con 0x7f73700476a0 2024-09-12T16:55:47.170 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-12T16:55:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:55:47.170 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-12T16:55:47.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f73700476a0 msgr2=0x7f7370049b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f73700476a0 0x7f7370049b40 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f737003b1d0 msgr2=0x7f737003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f737003b1d0 0x7f737003d690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f737c001640 tx=0x7f737c001150 comp rx=0 tx=0).stop 2024-09-12T16:55:47.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 msgr2=0x7f738c124370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c124370 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f738801a480 tx=0x7f73880195f0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 shutdown_connections 2024-09-12T16:55:47.172 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6816/883447514,v1:172.21.15.151:6817/883447514] conn(0x7f73700476a0 0x7f7370049b40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f737003b1d0 0x7f737003d690 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 --2- 172.21.15.122:0/2221330239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f738c06edf0 0x7f738c124370 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 >> 172.21.15.122:0/2221330239 conn(0x7f738c071e50 msgr2=0x7f738c1265a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 shutdown_connections 2024-09-12T16:55:47.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.165+0000 7f7393341640 1 -- 172.21.15.122:0/2221330239 wait complete. 2024-09-12T16:55:47.185 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T16:55:47.305 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dd7011640 1 Processor -- start 2024-09-12T16:55:47.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dd7011640 1 -- start start 2024-09-12T16:55:47.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dd7011640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9dd006df40 0x7f9dd0134720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dd7011640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd0073bd0 con 0x7f9dd009c160 2024-09-12T16:55:47.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dd7011640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd009d1e0 con 0x7f9dd006df40 2024-09-12T16:55:47.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dcffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9dd006df40 0x7f9dd0134720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dd4dad640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f9dd009c160 0x7f9dd009c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36756/0 (socket says 172.21.15.122:36756) 2024-09-12T16:55:47.306 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dd4dad640 1 -- 172.21.15.122:0/3421052056 learned_addr learned my addr 172.21.15.122:0/3421052056 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:47.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dcffff640 1 -- 172.21.15.122:0/3421052056 >> v1:172.21.15.122:6789/0 conn(0x7f9dd009c160 legacy=0x7f9dd009c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dcf7fe640 1 -- 172.21.15.122:0/3421052056 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344121566 0 0) 0x7f9dd0073bd0 con 0x7f9dd009c160 2024-09-12T16:55:47.307 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.301+0000 7f9dcffff640 1 -- 172.21.15.122:0/3421052056 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd006e7f0 con 0x7f9dd006df40 2024-09-12T16:55:47.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dcffff640 1 --2- 172.21.15.122:0/3421052056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd0134720 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009740 tx=0x7f9db801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbf281dfecc68ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dcf7fe640 1 -- 172.21.15.122:0/3421052056 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db80b0070 con 0x7f9dd006df40 2024-09-12T16:55:47.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dcf7fe640 1 -- 172.21.15.122:0/3421052056 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db80ab530 con 0x7f9dd006df40 2024-09-12T16:55:47.309 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dcf7fe640 1 -- 172.21.15.122:0/3421052056 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db80ab830 con 0x7f9dd006df40 2024-09-12T16:55:47.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- 172.21.15.122:0/3421052056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 msgr2=0x7f9dd0134720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 --2- 172.21.15.122:0/3421052056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd0134720 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009740 tx=0x7f9db801c370 comp rx=0 tx=0).stop 2024-09-12T16:55:47.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- 172.21.15.122:0/3421052056 shutdown_connections 2024-09-12T16:55:47.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 --2- 172.21.15.122:0/3421052056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd0134720 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.311 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- 172.21.15.122:0/3421052056 >> 172.21.15.122:0/3421052056 conn(0x7f9dd00716a0 msgr2=0x7f9dd009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- 172.21.15.122:0/3421052056 shutdown_connections 2024-09-12T16:55:47.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- 172.21.15.122:0/3421052056 wait complete. 2024-09-12T16:55:47.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 Processor -- start 2024-09-12T16:55:47.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- start start 2024-09-12T16:55:47.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd01c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0137870 con 0x7f9dd006df40 2024-09-12T16:55:47.312 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd4dad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd01c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd4dad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd01c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58868/0 (socket says 172.21.15.122:58868) 2024-09-12T16:55:47.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd4dad640 1 -- 172.21.15.122:0/1569002246 learned_addr learned my addr 172.21.15.122:0/1569002246 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:47.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd4dad640 1 -- 172.21.15.122:0/1569002246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd011d4e0 con 0x7f9dd006df40 2024-09-12T16:55:47.313 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd4dad640 1 --2- 172.21.15.122:0/1569002246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd01c6cc0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c3d0 tx=0x7f9dc800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dcd7fa640 1 -- 172.21.15.122:0/1569002246 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc8007410 con 0x7f9dd006df40 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dcd7fa640 1 -- 172.21.15.122:0/1569002246 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc80075d0 con 0x7f9dd006df40 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd011e610 con 0x7f9dd006df40 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dcd7fa640 1 -- 172.21.15.122:0/1569002246 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc8004960 con 0x7f9dd006df40 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.305+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd011e1e0 con 0x7f9dd006df40 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.309+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd0076880 con 0x7f9dd006df40 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.309+0000 7f9dcd7fa640 1 -- 172.21.15.122:0/1569002246 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9dc8011070 con 0x7f9dd006df40 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.309+0000 7f9dcd7fa640 1 --2- 172.21.15.122:0/1569002246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9db003b1d0 0x7f9db003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.309+0000 7f9dcd7fa640 1 -- 172.21.15.122:0/1569002246 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9dc804f430 con 0x7f9dd006df40 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.309+0000 7f9dcffff640 1 --2- 172.21.15.122:0/1569002246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9db003b1d0 0x7f9db003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.315 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.309+0000 7f9dcffff640 1 --2- 172.21.15.122:0/1569002246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9db003b1d0 0x7f9db003d690 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9db80ad000 tx=0x7f9db8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.313+0000 7f9dcd7fa640 1 -- 172.21.15.122:0/1569002246 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9dc8010d50 con 0x7f9dd006df40 2024-09-12T16:55:47.482 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.477+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9dd011f0d0 con 0x7f9db003b1d0 2024-09-12T16:55:47.484 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dcd7fa640 1 -- 172.21.15.122:0/1569002246 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9dd011f0d0 con 0x7f9db003b1d0 2024-09-12T16:55:47.484 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T16:55:47.486 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9db003b1d0 msgr2=0x7f9db003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 --2- 172.21.15.122:0/1569002246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9db003b1d0 0x7f9db003d690 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9db80ad000 tx=0x7f9db8008040 comp rx=0 tx=0).stop 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 msgr2=0x7f9dd01c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 --2- 172.21.15.122:0/1569002246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd01c6cc0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c3d0 tx=0x7f9dc800c890 comp rx=0 tx=0).stop 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 shutdown_connections 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 --2- 172.21.15.122:0/1569002246 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f9db003b1d0 0x7f9db003d690 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 --2- 172.21.15.122:0/1569002246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9dd006df40 0x7f9dd01c6cc0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 >> 172.21.15.122:0/1569002246 conn(0x7f9dd00716a0 msgr2=0x7f9dd012ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 shutdown_connections 2024-09-12T16:55:47.487 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.481+0000 7f9dd7011640 1 -- 172.21.15.122:0/1569002246 wait complete. 2024-09-12T16:55:47.501 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T16:55:47.501 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:55:47.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.605+0000 7fa455a4b640 1 Processor -- start 2024-09-12T16:55:47.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.605+0000 7fa455a4b640 1 -- start start 2024-09-12T16:55:47.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa455a4b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa45012f6d0 0x7fa45012fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa455a4b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa450115c60 con 0x7fa45012bbf0 2024-09-12T16:55:47.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa455a4b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fa450115570 con 0x7fa45012f6d0 2024-09-12T16:55:47.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa44effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa45012f6d0 0x7fa45012fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.614 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa44e7fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa45012bbf0 0x7fa45012c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36764/0 (socket says 172.21.15.122:36764) 2024-09-12T16:55:47.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa44e7fc640 1 -- 172.21.15.122:0/1008595484 learned_addr learned my addr 172.21.15.122:0/1008595484 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:47.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa44effd640 1 -- 172.21.15.122:0/1008595484 >> v1:172.21.15.122:6789/0 conn(0x7fa45012bbf0 legacy=0x7fa45012c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa44dffb640 1 -- 172.21.15.122:0/1008595484 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199855036 0 0) 0x7fa450115c60 con 0x7fa45012bbf0 2024-09-12T16:55:47.615 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.609+0000 7fa44effd640 1 -- 172.21.15.122:0/1008595484 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45012fff0 con 0x7fa45012f6d0 2024-09-12T16:55:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa44effd640 1 --2- 172.21.15.122:0/1008595484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012f6d0 0x7fa45012fab0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa440009740 tx=0x7fa44001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffae93163df9584 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa44dffb640 1 -- 172.21.15.122:0/1008595484 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4400b0070 con 0x7fa45012f6d0 2024-09-12T16:55:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa44dffb640 1 -- 172.21.15.122:0/1008595484 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4400ab530 con 0x7fa45012f6d0 2024-09-12T16:55:47.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa44dffb640 1 -- 172.21.15.122:0/1008595484 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4400ab830 con 0x7fa45012f6d0 2024-09-12T16:55:47.619 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 -- 172.21.15.122:0/1008595484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012f6d0 msgr2=0x7fa45012fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 --2- 172.21.15.122:0/1008595484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012f6d0 0x7fa45012fab0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa440009740 tx=0x7fa44001c2e0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 -- 172.21.15.122:0/1008595484 shutdown_connections 2024-09-12T16:55:47.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 --2- 172.21.15.122:0/1008595484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012f6d0 0x7fa45012fab0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 -- 172.21.15.122:0/1008595484 >> 172.21.15.122:0/1008595484 conn(0x7fa45006fc50 msgr2=0x7fa450072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 -- 172.21.15.122:0/1008595484 shutdown_connections 2024-09-12T16:55:47.620 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 -- 172.21.15.122:0/1008595484 wait complete. 2024-09-12T16:55:47.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 Processor -- start 2024-09-12T16:55:47.621 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.613+0000 7fa455a4b640 1 -- start start 2024-09-12T16:55:47.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa455a4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012bbf0 0x7fa450124e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa455a4b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa450137d20 con 0x7fa45012bbf0 2024-09-12T16:55:47.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012bbf0 0x7fa450124e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.624 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012bbf0 0x7fa450124e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58892/0 (socket says 172.21.15.122:58892) 2024-09-12T16:55:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44effd640 1 -- 172.21.15.122:0/2927102308 learned_addr learned my addr 172.21.15.122:0/2927102308 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44effd640 1 -- 172.21.15.122:0/2927102308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa450135230 con 0x7fa45012bbf0 2024-09-12T16:55:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44effd640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012bbf0 0x7fa450124e70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa440019f10 tx=0x7fa44001ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4400bb070 con 0x7fa45012bbf0 2024-09-12T16:55:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa440004020 con 0x7fa45012bbf0 2024-09-12T16:55:47.625 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4501298c0 con 0x7fa45012bbf0 2024-09-12T16:55:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4400b0040 con 0x7fa45012bbf0 2024-09-12T16:55:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa450117bd0 con 0x7fa45012bbf0 2024-09-12T16:55:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4501184d0 con 0x7fa45012bbf0 2024-09-12T16:55:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa440004320 con 0x7fa45012bbf0 2024-09-12T16:55:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa43c03b1d0 0x7fa43c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa4400e9fa0 con 0x7fa45012bbf0 2024-09-12T16:55:47.626 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa43c0476a0 0x7fa43c049b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4400ab530 con 0x7fa43c0476a0 2024-09-12T16:55:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa4400ec5f0 con 0x7fa45012bbf0 2024-09-12T16:55:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44f7fe640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa43c0476a0 0x7fa43c049b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44e7fc640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa43c03b1d0 0x7fa43c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44f7fe640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa43c0476a0 0x7fa43c049b40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.617+0000 7fa44e7fc640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa43c03b1d0 0x7fa43c03d690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa444007fd0 tx=0x7fa4440078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.627 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.621+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 <== osd.2 v2:172.21.15.151:6800/1197700885 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4400ab530 con 0x7fa43c0476a0 2024-09-12T16:55:47.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 --> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa4501175b0 con 0x7fa43c0476a0 2024-09-12T16:55:47.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa437fff640 1 -- 172.21.15.122:0/2927102308 <== osd.2 v2:172.21.15.151:6800/1197700885 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa4501175b0 con 0x7fa43c0476a0 2024-09-12T16:55:47.640 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-12T16:55:47.640 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:55:47.640 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-12T16:55:47.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa43c0476a0 msgr2=0x7fa43c049b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa43c0476a0 0x7fa43c049b40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa43c03b1d0 msgr2=0x7fa43c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa43c03b1d0 0x7fa43c03d690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa444007fd0 tx=0x7fa4440078e0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012bbf0 msgr2=0x7fa450124e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012bbf0 0x7fa450124e70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa440019f10 tx=0x7fa44001ab20 comp rx=0 tx=0).stop 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 shutdown_connections 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6800/1197700885,v1:172.21.15.151:6801/1197700885] conn(0x7fa43c0476a0 0x7fa43c049b40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fa43c03b1d0 0x7fa43c03d690 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 --2- 172.21.15.122:0/2927102308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa45012bbf0 0x7fa450124e70 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 >> 172.21.15.122:0/2927102308 conn(0x7fa45006fc50 msgr2=0x7fa450072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 shutdown_connections 2024-09-12T16:55:47.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.633+0000 7fa455a4b640 1 -- 172.21.15.122:0/2927102308 wait complete. 2024-09-12T16:55:47.657 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T16:55:47.778 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e8130640 1 Processor -- start 2024-09-12T16:55:47.989 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e8130640 1 -- start start 2024-09-12T16:55:47.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e8130640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f60e012c700 0x7f60e01346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e8130640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60e0073830 con 0x7f60e012bc10 2024-09-12T16:55:47.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e8130640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f60e0071eb0 con 0x7f60e012c700 2024-09-12T16:55:47.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e5ecc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f60e012bc10 0x7f60e012bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36770/0 (socket says 172.21.15.122:36770) 2024-09-12T16:55:47.994 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e5ecc640 1 -- 172.21.15.122:0/3727460556 learned_addr learned my addr 172.21.15.122:0/3727460556 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e56cb640 1 --2- 172.21.15.122:0/3727460556 >> v2:172.21.15.122:3300/0 conn(0x7f60e012c700 0x7f60e01346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e4eca640 1 -- 172.21.15.122:0/3727460556 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141566482 0 0) 0x7f60e0073830 con 0x7f60e012bc10 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e4eca640 1 -- 172.21.15.122:0/3727460556 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60cc003530 con 0x7f60e012bc10 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e56cb640 1 -- 172.21.15.122:0/3727460556 >> v1:172.21.15.122:6789/0 conn(0x7f60e012bc10 legacy=0x7f60e012bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.773+0000 7f60e56cb640 1 -- 172.21.15.122:0/3727460556 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e00a30b0 con 0x7f60e012c700 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e56cb640 1 --2- 172.21.15.122:0/3727460556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012c700 0x7f60e01346a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f60d0009740 tx=0x7f60d001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b0182e83471dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e4eca640 1 -- 172.21.15.122:0/3727460556 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60d00b0070 con 0x7f60e012c700 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e4eca640 1 -- 172.21.15.122:0/3727460556 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d00ab530 con 0x7f60e012c700 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e4eca640 1 -- 172.21.15.122:0/3727460556 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60d00ab810 con 0x7f60e012c700 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- 172.21.15.122:0/3727460556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012c700 msgr2=0x7f60e01346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 --2- 172.21.15.122:0/3727460556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012c700 0x7f60e01346a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f60d0009740 tx=0x7f60d001c370 comp rx=0 tx=0).stop 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- 172.21.15.122:0/3727460556 shutdown_connections 2024-09-12T16:55:47.995 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 --2- 172.21.15.122:0/3727460556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012c700 0x7f60e01346a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- 172.21.15.122:0/3727460556 >> 172.21.15.122:0/3727460556 conn(0x7f60e00a0a60 msgr2=0x7f60e006e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- 172.21.15.122:0/3727460556 shutdown_connections 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- 172.21.15.122:0/3727460556 wait complete. 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 Processor -- start 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- start start 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012bc10 0x7f60e012a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0137790 con 0x7f60e012bc10 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e5ecc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012bc10 0x7f60e012a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e5ecc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012bc10 0x7f60e012a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58916/0 (socket says 172.21.15.122:58916) 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e5ecc640 1 -- 172.21.15.122:0/2973505881 learned_addr learned my addr 172.21.15.122:0/2973505881 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e5ecc640 1 -- 172.21.15.122:0/2973505881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e011c700 con 0x7f60e012bc10 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e5ecc640 1 --2- 172.21.15.122:0/2973505881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012bc10 0x7f60e012a430 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c450 tx=0x7f60dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.996 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60d67fc640 1 -- 172.21.15.122:0/2973505881 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60dc017070 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60d67fc640 1 -- 172.21.15.122:0/2973505881 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60dc005ce0 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e011d150 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60d67fc640 1 -- 172.21.15.122:0/2973505881 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60dc007200 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.777+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e012ab40 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.781+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e012bff0 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.781+0000 7f60d67fc640 1 -- 172.21.15.122:0/2973505881 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f60dc01a070 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.781+0000 7f60d67fc640 1 --2- 172.21.15.122:0/2973505881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60c403b180 0x7f60c403d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.781+0000 7f60d67fc640 1 -- 172.21.15.122:0/2973505881 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f60dc04eae0 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.781+0000 7f60e56cb640 1 --2- 172.21.15.122:0/2973505881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60c403b180 0x7f60c403d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.781+0000 7f60e56cb640 1 --2- 172.21.15.122:0/2973505881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60c403b180 0x7f60c403d640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f60d00ad000 tx=0x7f60d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.785+0000 7f60d67fc640 1 -- 172.21.15.122:0/2973505881 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f60dc012400 con 0x7f60e012bc10 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.953+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f60e011c090 con 0x7f60c403b180 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.953+0000 7f60d67fc640 1 -- 172.21.15.122:0/2973505881 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f60e011c090 con 0x7f60c403b180 2024-09-12T16:55:47.997 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60c403b180 msgr2=0x7f60c403d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 --2- 172.21.15.122:0/2973505881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60c403b180 0x7f60c403d640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f60d00ad000 tx=0x7f60d0008040 comp rx=0 tx=0).stop 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012bc10 msgr2=0x7f60e012a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 --2- 172.21.15.122:0/2973505881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012bc10 0x7f60e012a430 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c450 tx=0x7f60dc00c910 comp rx=0 tx=0).stop 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 shutdown_connections 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 --2- 172.21.15.122:0/2973505881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f60c403b180 0x7f60c403d640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 --2- 172.21.15.122:0/2973505881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e012bc10 0x7f60e012a430 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 >> 172.21.15.122:0/2973505881 conn(0x7f60e00a0a60 msgr2=0x7f60e00a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 shutdown_connections 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:47.957+0000 7f60e8130640 1 -- 172.21.15.122:0/2973505881 wait complete. 2024-09-12T16:55:47.998 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T16:55:47.999 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T16:55:48.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff61058b640 1 Processor -- start 2024-09-12T16:55:48.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff61058b640 1 -- start start 2024-09-12T16:55:48.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff61058b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff608129a20 0x7ff608129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff61058b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60812a930 con 0x7ff60812a4f0 2024-09-12T16:55:48.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff61058b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff608069170 con 0x7ff608129a20 2024-09-12T16:55:48.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff60e327640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff608129a20 0x7ff608129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff60db26640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff60812a4f0 0x7ff60812cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36780/0 (socket says 172.21.15.122:36780) 2024-09-12T16:55:48.126 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff60db26640 1 -- 172.21.15.122:0/2471052553 learned_addr learned my addr 172.21.15.122:0/2471052553 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:48.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff60e327640 1 -- 172.21.15.122:0/2471052553 >> v1:172.21.15.122:6789/0 conn(0x7ff60812a4f0 legacy=0x7ff60812cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff60e327640 1 -- 172.21.15.122:0/2471052553 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff608114950 con 0x7ff608129a20 2024-09-12T16:55:48.127 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.121+0000 7ff60d325640 1 -- 172.21.15.122:0/2471052553 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126610940 0 0) 0x7ff5f8001120 con 0x7ff60812a4f0 2024-09-12T16:55:48.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60e327640 1 --2- 172.21.15.122:0/2471052553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff608129fb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff604009740 tx=0x7ff60401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f314bf7f620164d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60d325640 1 -- 172.21.15.122:0/2471052553 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6040b0070 con 0x7ff608129a20 2024-09-12T16:55:48.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60d325640 1 -- 172.21.15.122:0/2471052553 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6040ab530 con 0x7ff608129a20 2024-09-12T16:55:48.129 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60d325640 1 -- 172.21.15.122:0/2471052553 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6040ab830 con 0x7ff608129a20 2024-09-12T16:55:48.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- 172.21.15.122:0/2471052553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 msgr2=0x7ff608129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 --2- 172.21.15.122:0/2471052553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff608129fb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff604009740 tx=0x7ff60401c370 comp rx=0 tx=0).stop 2024-09-12T16:55:48.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- 172.21.15.122:0/2471052553 shutdown_connections 2024-09-12T16:55:48.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 --2- 172.21.15.122:0/2471052553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff608129fb0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- 172.21.15.122:0/2471052553 >> 172.21.15.122:0/2471052553 conn(0x7ff608070d70 msgr2=0x7ff608073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:48.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- 172.21.15.122:0/2471052553 shutdown_connections 2024-09-12T16:55:48.130 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- 172.21.15.122:0/2471052553 wait complete. 2024-09-12T16:55:48.131 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 Processor -- start 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- start start 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff6081310a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff608135ce0 con 0x7ff608129a20 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60e327640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff6081310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60e327640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff6081310a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58932/0 (socket says 172.21.15.122:58932) 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60e327640 1 -- 172.21.15.122:0/4220867175 learned_addr learned my addr 172.21.15.122:0/4220867175 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60e327640 1 -- 172.21.15.122:0/4220867175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6081329f0 con 0x7ff608129a20 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff60e327640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff6081310a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff6040ae040 tx=0x7ff60401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6040b0050 con 0x7ff608129a20 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6040b1040 con 0x7ff608129a20 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6040b58b0 con 0x7ff608129a20 2024-09-12T16:55:48.132 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6081155a0 con 0x7ff608129a20 2024-09-12T16:55:48.133 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.125+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff608115ca0 con 0x7ff608129a20 2024-09-12T16:55:48.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff608129fb0 con 0x7ff608129a20 2024-09-12T16:55:48.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff6040be030 con 0x7ff608129a20 2024-09-12T16:55:48.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff5feffd640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff5ec03b180 0x7ff5ec03d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff6040bc070 con 0x7ff608129a20 2024-09-12T16:55:48.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff5feffd640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7ff5ec047620 0x7ff5ec049ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6040b8e50 con 0x7ff5ec047620 2024-09-12T16:55:48.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff6040ee2a0 con 0x7ff608129a20 2024-09-12T16:55:48.134 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff60db26640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff5ec03b180 0x7ff5ec03d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff60eb28640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7ff5ec047620 0x7ff5ec049ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff60db26640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff5ec03b180 0x7ff5ec03d640 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8000c10 tx=0x7ff5f8001260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.135 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.129+0000 7ff60eb28640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7ff5ec047620 0x7ff5ec049ac0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.136 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.133+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 <== osd.3 v2:172.21.15.151:6808/987175333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6040b8e50 con 0x7ff5ec047620 2024-09-12T16:55:48.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 --> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff60812a4f0 con 0x7ff5ec047620 2024-09-12T16:55:48.149 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff5feffd640 1 -- 172.21.15.122:0/4220867175 <== osd.3 v2:172.21.15.151:6808/987175333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff60812a4f0 con 0x7ff5ec047620 2024-09-12T16:55:48.150 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-12T16:55:48.150 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T16:55:48.150 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7ff5ec047620 msgr2=0x7ff5ec049ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7ff5ec047620 0x7ff5ec049ac0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff5ec03b180 msgr2=0x7ff5ec03d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff5ec03b180 0x7ff5ec03d640 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8000c10 tx=0x7ff5f8001260 comp rx=0 tx=0).stop 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 msgr2=0x7ff6081310a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff6081310a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff6040ae040 tx=0x7ff60401abb0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 shutdown_connections 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6808/987175333,v1:172.21.15.151:6809/987175333] conn(0x7ff5ec047620 0x7ff5ec049ac0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.151 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff5ec03b180 0x7ff5ec03d640 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 --2- 172.21.15.122:0/4220867175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608129a20 0x7ff6081310a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 >> 172.21.15.122:0/4220867175 conn(0x7ff608070d70 msgr2=0x7ff608127f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:48.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 shutdown_connections 2024-09-12T16:55:48.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.145+0000 7ff61058b640 1 -- 172.21.15.122:0/4220867175 wait complete. 2024-09-12T16:55:48.166 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T16:55:48.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.273+0000 7fdea9659640 1 Processor -- start 2024-09-12T16:55:48.279 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.273+0000 7fdea9659640 1 -- start start 2024-09-12T16:55:48.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.273+0000 7fdea9659640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdea412f160 0x7fdea4131550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea406dcb0 con 0x7fdea412c1b0 2024-09-12T16:55:48.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fdea412bdf0 con 0x7fdea412f160 2024-09-12T16:55:48.281 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fde9a7fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdea412f160 0x7fdea4131550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea2ffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fdea412c1b0 0x7fdea412c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36790/0 (socket says 172.21.15.122:36790) 2024-09-12T16:55:48.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea2ffd640 1 -- 172.21.15.122:0/1148218380 learned_addr learned my addr 172.21.15.122:0/1148218380 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:48.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fde9a7fc640 1 -- 172.21.15.122:0/1148218380 >> v1:172.21.15.122:6789/0 conn(0x7fdea412c1b0 legacy=0x7fdea412c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.282 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fde9a7fc640 1 -- 172.21.15.122:0/1148218380 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea4073ad0 con 0x7fdea412f160 2024-09-12T16:55:48.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fde9a7fc640 1 --2- 172.21.15.122:0/1148218380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412f160 0x7fdea4131550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009740 tx=0x7fde8c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8c14246cd047e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea27fc640 1 -- 172.21.15.122:0/1148218380 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde8c0b0070 con 0x7fdea412f160 2024-09-12T16:55:48.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea27fc640 1 -- 172.21.15.122:0/1148218380 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde8c0ab530 con 0x7fdea412f160 2024-09-12T16:55:48.283 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea27fc640 1 -- 172.21.15.122:0/1148218380 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde8c0ab830 con 0x7fdea412f160 2024-09-12T16:55:48.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 -- 172.21.15.122:0/1148218380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412f160 msgr2=0x7fdea4131550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 --2- 172.21.15.122:0/1148218380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412f160 0x7fdea4131550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009740 tx=0x7fde8c01c370 comp rx=0 tx=0).stop 2024-09-12T16:55:48.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 -- 172.21.15.122:0/1148218380 shutdown_connections 2024-09-12T16:55:48.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 --2- 172.21.15.122:0/1148218380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412f160 0x7fdea4131550 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 -- 172.21.15.122:0/1148218380 >> 172.21.15.122:0/1148218380 conn(0x7fdea4070940 msgr2=0x7fdea4072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:48.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 -- 172.21.15.122:0/1148218380 shutdown_connections 2024-09-12T16:55:48.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.277+0000 7fdea9659640 1 -- 172.21.15.122:0/1148218380 wait complete. 2024-09-12T16:55:48.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea9659640 1 Processor -- start 2024-09-12T16:55:48.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea9659640 1 -- start start 2024-09-12T16:55:48.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea9659640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412c1b0 0x7fdea4121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea9659640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdea4134640 con 0x7fdea412c1b0 2024-09-12T16:55:48.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412c1b0 0x7fdea4121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.288 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412c1b0 0x7fdea4121cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58956/0 (socket says 172.21.15.122:58956) 2024-09-12T16:55:48.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea2ffd640 1 -- 172.21.15.122:0/3084918607 learned_addr learned my addr 172.21.15.122:0/3084918607 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:48.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea2ffd640 1 -- 172.21.15.122:0/3084918607 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea4114640 con 0x7fdea412c1b0 2024-09-12T16:55:48.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea2ffd640 1 --2- 172.21.15.122:0/3084918607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412c1b0 0x7fdea4121cf0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fde9400c450 tx=0x7fde9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fde9bfff640 1 -- 172.21.15.122:0/3084918607 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde94017070 con 0x7fdea412c1b0 2024-09-12T16:55:48.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fde9bfff640 1 -- 172.21.15.122:0/3084918607 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde94005c20 con 0x7fdea412c1b0 2024-09-12T16:55:48.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fde9bfff640 1 -- 172.21.15.122:0/3084918607 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde940070d0 con 0x7fdea412c1b0 2024-09-12T16:55:48.289 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea41148f0 con 0x7fdea412c1b0 2024-09-12T16:55:48.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea4122230 con 0x7fdea412c1b0 2024-09-12T16:55:48.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea412c590 con 0x7fdea412c1b0 2024-09-12T16:55:48.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fde9bfff640 1 -- 172.21.15.122:0/3084918607 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fde9401a070 con 0x7fdea412c1b0 2024-09-12T16:55:48.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fde9bfff640 1 --2- 172.21.15.122:0/3084918607 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde8403b1d0 0x7fde8403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fde9bfff640 1 -- 172.21.15.122:0/3084918607 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fde9404ea90 con 0x7fdea412c1b0 2024-09-12T16:55:48.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.281+0000 7fde9a7fc640 1 --2- 172.21.15.122:0/3084918607 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde8403b1d0 0x7fde8403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.290 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.285+0000 7fde9a7fc640 1 --2- 172.21.15.122:0/3084918607 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde8403b1d0 0x7fde8403d690 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0ad000 tx=0x7fde8c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.291 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.285+0000 7fde9bfff640 1 -- 172.21.15.122:0/3084918607 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fde94019cd0 con 0x7fdea412c1b0 2024-09-12T16:55:48.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.449+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fdea41143e0 con 0x7fde8403b1d0 2024-09-12T16:55:48.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.453+0000 7fde9bfff640 1 -- 172.21.15.122:0/3084918607 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdea41143e0 con 0x7fde8403b1d0 2024-09-12T16:55:48.457 INFO:teuthology.orchestra.run.smithi122.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T16:55:48.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.453+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde8403b1d0 msgr2=0x7fde8403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.453+0000 7fdea9659640 1 --2- 172.21.15.122:0/3084918607 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde8403b1d0 0x7fde8403d690 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0ad000 tx=0x7fde8c0a6000 comp rx=0 tx=0).stop 2024-09-12T16:55:48.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.453+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412c1b0 msgr2=0x7fdea4121cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.453+0000 7fdea9659640 1 --2- 172.21.15.122:0/3084918607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412c1b0 0x7fdea4121cf0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fde9400c450 tx=0x7fde9400c910 comp rx=0 tx=0).stop 2024-09-12T16:55:48.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.457+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 shutdown_connections 2024-09-12T16:55:48.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.457+0000 7fdea9659640 1 --2- 172.21.15.122:0/3084918607 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde8403b1d0 0x7fde8403d690 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.457+0000 7fdea9659640 1 --2- 172.21.15.122:0/3084918607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdea412c1b0 0x7fdea4121cf0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.457+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 >> 172.21.15.122:0/3084918607 conn(0x7fdea4070940 msgr2=0x7fdea412ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:48.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.457+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 shutdown_connections 2024-09-12T16:55:48.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.457+0000 7fdea9659640 1 -- 172.21.15.122:0/3084918607 wait complete. 2024-09-12T16:55:48.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:55:48.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22fa5c4640 1 Processor -- start 2024-09-12T16:55:48.588 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22fa5c4640 1 -- start start 2024-09-12T16:55:48.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22fa5c4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f22f4132420 0x7f22f4134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22fa5c4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f412b9d0 con 0x7f22f412aee0 2024-09-12T16:55:48.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22fa5c4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f22f4071e70 con 0x7f22f4132420 2024-09-12T16:55:48.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22eb7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f22f4132420 0x7f22f4134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22f3fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f22f412aee0 0x7f22f412b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:36802/0 (socket says 172.21.15.122:36802) 2024-09-12T16:55:48.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22f3fff640 1 -- 172.21.15.122:0/1939925237 learned_addr learned my addr 172.21.15.122:0/1939925237 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:55:48.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22eb7fe640 1 -- 172.21.15.122:0/1939925237 >> v1:172.21.15.122:6789/0 conn(0x7f22f412aee0 legacy=0x7f22f412b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22eb7fe640 1 -- 172.21.15.122:0/1939925237 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f40008e0 con 0x7f22f4132420 2024-09-12T16:55:48.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22eb7fe640 1 --2- 172.21.15.122:0/1939925237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f4132420 0x7f22f4134810 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009740 tx=0x7f22dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c2cef44639013a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.591 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22f37fe640 1 -- 172.21.15.122:0/1939925237 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22dc0b1070 con 0x7f22f4132420 2024-09-12T16:55:48.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22f37fe640 1 -- 172.21.15.122:0/1939925237 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22dc0ac520 con 0x7f22f4132420 2024-09-12T16:55:48.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.585+0000 7f22f37fe640 1 -- 172.21.15.122:0/1939925237 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22dc0ac820 con 0x7f22f4132420 2024-09-12T16:55:48.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T16:55:48.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1939925237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f4132420 msgr2=0x7f22f4134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 --2- 172.21.15.122:0/1939925237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f4132420 0x7f22f4134810 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009740 tx=0x7f22dc01c370 comp rx=0 tx=0).stop 2024-09-12T16:55:48.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1939925237 shutdown_connections 2024-09-12T16:55:48.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 --2- 172.21.15.122:0/1939925237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f4132420 0x7f22f4134810 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1939925237 >> 172.21.15.122:0/1939925237 conn(0x7f22f40a0a60 msgr2=0x7f22f406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:48.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1939925237 shutdown_connections 2024-09-12T16:55:48.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1939925237 wait complete. 2024-09-12T16:55:48.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 Processor -- start 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- start start 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f412aee0 0x7f22f41298a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22f4137570 con 0x7f22f412aee0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f412aee0 0x7f22f41298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f412aee0 0x7f22f41298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:58968/0 (socket says 172.21.15.122:58968) 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f3fff640 1 -- 172.21.15.122:0/1964500881 learned_addr learned my addr 172.21.15.122:0/1964500881 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f3fff640 1 -- 172.21.15.122:0/1964500881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f4073a80 con 0x7f22f412aee0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f3fff640 1 --2- 172.21.15.122:0/1964500881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f412aee0 0x7f22f41298a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c450 tx=0x7f22e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f17fa640 1 -- 172.21.15.122:0/1964500881 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e4017070 con 0x7f22f412aee0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f17fa640 1 -- 172.21.15.122:0/1964500881 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e4005c20 con 0x7f22f412aee0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f17fa640 1 -- 172.21.15.122:0/1964500881 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e40070d0 con 0x7f22f412aee0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f411c510 con 0x7f22f412aee0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f4129fb0 con 0x7f22f412aee0 2024-09-12T16:55:48.597 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f411b300 con 0x7f22f412aee0 2024-09-12T16:55:48.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f17fa640 1 -- 172.21.15.122:0/1964500881 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f22e401a070 con 0x7f22f412aee0 2024-09-12T16:55:48.598 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f17fa640 1 --2- 172.21.15.122:0/1964500881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f22d403b180 0x7f22d403d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:55:48.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22f17fa640 1 -- 172.21.15.122:0/1964500881 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f22e404eae0 con 0x7f22f412aee0 2024-09-12T16:55:48.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.589+0000 7f22eb7fe640 1 --2- 172.21.15.122:0/1964500881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f22d403b180 0x7f22d403d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:55:48.600 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.593+0000 7f22eb7fe640 1 --2- 172.21.15.122:0/1964500881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f22d403b180 0x7f22d403d640 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0ae000 tx=0x7f22dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:55:48.601 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.593+0000 7f22f17fa640 1 -- 172.21.15.122:0/1964500881 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f22e401b3b0 con 0x7f22f412aee0 2024-09-12T16:55:48.754 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.749+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22f412b2c0 con 0x7f22d403b180 2024-09-12T16:55:48.782 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.777+0000 7f22f17fa640 1 -- 172.21.15.122:0/1964500881 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665983 (secure 0 0 0) 0x7f22f412b2c0 con 0x7f22d403b180 2024-09-12T16:55:48.787 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:55:48.794 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:55:48.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f22d403b180 msgr2=0x7f22d403d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 --2- 172.21.15.122:0/1964500881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f22d403b180 0x7f22d403d640 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0ae000 tx=0x7f22dc008040 comp rx=0 tx=0).stop 2024-09-12T16:55:48.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f412aee0 msgr2=0x7f22f41298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:55:48.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 --2- 172.21.15.122:0/1964500881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f412aee0 0x7f22f41298a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c450 tx=0x7f22e400c910 comp rx=0 tx=0).stop 2024-09-12T16:55:48.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 shutdown_connections 2024-09-12T16:55:48.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 --2- 172.21.15.122:0/1964500881 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f22d403b180 0x7f22d403d640 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 --2- 172.21.15.122:0/1964500881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22f412aee0 0x7f22f41298a0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:55:48.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 >> 172.21.15.122:0/1964500881 conn(0x7f22f40a0a60 msgr2=0x7f22f40a1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:55:48.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 shutdown_connections 2024-09-12T16:55:48.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:55:48.781+0000 7f22fa5c4640 1 -- 172.21.15.122:0/1964500881 wait complete. 2024-09-12T16:55:48.806 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-12T16:55:48.046977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5138,"num_read_kb":4724,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4565,"ondisk_log_size":4565,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165180,"kb_used_data":11320,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377322180,"statfs":{"total":386547056640,"available":386377912320,"internally_reserved":0,"allocated":11591680,"data_stored":10392979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25811503,"num_objects":-7,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006915"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.089853+0000","last_change":"2024-09-12T16:51:56.151833+0000","last_active":"2024-09-12T16:52:41.089853+0000","last_peered":"2024-09-12T16:52:41.089853+0000","last_clean":"2024-09-12T16:52:41.089853+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:52:41.089853+0000","last_undegraded":"2024-09-12T16:52:41.089853+0000","last_fullsized":"2024-09-12T16:52:41.089853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:07.556912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559689+0000","last_change":"2024-09-12T16:51:58.150328+0000","last_active":"2024-09-12T16:55:12.559689+0000","last_peered":"2024-09-12T16:55:12.559689+0000","last_clean":"2024-09-12T16:55:12.559689+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:55:12.559689+0000","last_undegraded":"2024-09-12T16:55:12.559689+0000","last_fullsized":"2024-09-12T16:55:12.559689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:31.991784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026353+0000","last_change":"2024-09-12T16:51:56.161722+0000","last_active":"2024-09-12T16:52:35.026353+0000","last_peered":"2024-09-12T16:52:35.026353+0000","last_clean":"2024-09-12T16:52:35.026353+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:52:35.026353+0000","last_undegraded":"2024-09-12T16:52:35.026353+0000","last_fullsized":"2024-09-12T16:52:35.026353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:40.529043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.493995+0000","last_change":"2024-09-12T16:51:58.166339+0000","last_active":"2024-09-12T16:55:12.493995+0000","last_peered":"2024-09-12T16:55:12.493995+0000","last_clean":"2024-09-12T16:55:12.493995+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:55:12.493995+0000","last_undegraded":"2024-09-12T16:55:12.493995+0000","last_fullsized":"2024-09-12T16:55:12.493995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.116016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048410+0000","last_change":"2024-09-12T16:51:56.164645+0000","last_active":"2024-09-12T16:52:35.048410+0000","last_peered":"2024-09-12T16:52:35.048410+0000","last_clean":"2024-09-12T16:52:35.048410+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:52:35.048410+0000","last_undegraded":"2024-09-12T16:52:35.048410+0000","last_fullsized":"2024-09-12T16:52:35.048410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:14.665769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.425082+0000","last_change":"2024-09-12T16:51:58.163269+0000","last_active":"2024-09-12T16:55:12.425082+0000","last_peered":"2024-09-12T16:55:12.425082+0000","last_clean":"2024-09-12T16:55:12.425082+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:55:12.425082+0000","last_undegraded":"2024-09-12T16:55:12.425082+0000","last_fullsized":"2024-09-12T16:55:12.425082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:17.060923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.018273+0000","last_change":"2024-09-12T16:51:56.150421+0000","last_active":"2024-09-12T16:52:35.018273+0000","last_peered":"2024-09-12T16:52:35.018273+0000","last_clean":"2024-09-12T16:52:35.018273+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:52:35.018273+0000","last_undegraded":"2024-09-12T16:52:35.018273+0000","last_fullsized":"2024-09-12T16:52:35.018273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:08.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559316+0000","last_change":"2024-09-12T16:51:58.165836+0000","last_active":"2024-09-12T16:55:12.559316+0000","last_peered":"2024-09-12T16:55:12.559316+0000","last_clean":"2024-09-12T16:55:12.559316+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:55:12.559316+0000","last_undegraded":"2024-09-12T16:55:12.559316+0000","last_fullsized":"2024-09-12T16:55:12.559316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.786300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038726+0000","last_change":"2024-09-12T16:51:56.155368+0000","last_active":"2024-09-12T16:52:35.038726+0000","last_peered":"2024-09-12T16:52:35.038726+0000","last_clean":"2024-09-12T16:52:35.038726+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:52:35.038726+0000","last_undegraded":"2024-09-12T16:52:35.038726+0000","last_fullsized":"2024-09-12T16:52:35.038726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:23.509728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.310094+0000","last_change":"2024-09-12T16:51:58.148537+0000","last_active":"2024-09-12T16:52:43.310094+0000","last_peered":"2024-09-12T16:52:43.310094+0000","last_clean":"2024-09-12T16:52:43.310094+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:52:43.310094+0000","last_undegraded":"2024-09-12T16:52:43.310094+0000","last_fullsized":"2024-09-12T16:52:43.310094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:36.641527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.818019+0000","last_change":"2024-09-12T16:51:56.149239+0000","last_active":"2024-09-12T16:55:43.818019+0000","last_peered":"2024-09-12T16:55:43.818019+0000","last_clean":"2024-09-12T16:55:43.818019+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:55:43.818019+0000","last_undegraded":"2024-09-12T16:55:43.818019+0000","last_fullsized":"2024-09-12T16:55:43.818019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:48.008590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.756687+0000","last_change":"2024-09-12T16:51:58.165599+0000","last_active":"2024-09-12T16:54:06.756687+0000","last_peered":"2024-09-12T16:54:06.756687+0000","last_clean":"2024-09-12T16:54:06.756687+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:54:06.756687+0000","last_undegraded":"2024-09-12T16:54:06.756687+0000","last_fullsized":"2024-09-12T16:54:06.756687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:30.151277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.917360+0000","last_change":"2024-09-12T16:51:56.154655+0000","last_active":"2024-09-12T16:55:11.917360+0000","last_peered":"2024-09-12T16:55:11.917360+0000","last_clean":"2024-09-12T16:55:11.917360+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:55:11.917360+0000","last_undegraded":"2024-09-12T16:55:11.917360+0000","last_fullsized":"2024-09-12T16:55:11.917360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:52.651580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491266+0000","last_change":"2024-09-12T16:51:58.156872+0000","last_active":"2024-09-12T16:55:12.491266+0000","last_peered":"2024-09-12T16:55:12.491266+0000","last_clean":"2024-09-12T16:55:12.491266+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:55:12.491266+0000","last_undegraded":"2024-09-12T16:55:12.491266+0000","last_fullsized":"2024-09-12T16:55:12.491266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:17.848281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.095549+0000","last_change":"2024-09-12T16:51:56.161773+0000","last_active":"2024-09-12T16:53:26.095549+0000","last_peered":"2024-09-12T16:53:26.095549+0000","last_clean":"2024-09-12T16:53:26.095549+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:53:26.095549+0000","last_undegraded":"2024-09-12T16:53:26.095549+0000","last_fullsized":"2024-09-12T16:53:26.095549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:05.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.490892+0000","last_change":"2024-09-12T16:52:35.060238+0000","last_active":"2024-09-12T16:55:12.490892+0000","last_peered":"2024-09-12T16:55:12.490892+0000","last_clean":"2024-09-12T16:55:12.490892+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:55:12.490892+0000","last_undegraded":"2024-09-12T16:55:12.490892+0000","last_fullsized":"2024-09-12T16:55:12.490892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:18.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'5","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508887+0000","last_change":"2024-09-12T16:51:58.152595+0000","last_active":"2024-09-12T16:55:12.508887+0000","last_peered":"2024-09-12T16:55:12.508887+0000","last_clean":"2024-09-12T16:55:12.508887+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:55:12.508887+0000","last_undegraded":"2024-09-12T16:55:12.508887+0000","last_fullsized":"2024-09-12T16:55:12.508887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:06.175184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047444+0000","last_change":"2024-09-12T16:51:56.158348+0000","last_active":"2024-09-12T16:52:35.047444+0000","last_peered":"2024-09-12T16:52:35.047444+0000","last_clean":"2024-09-12T16:52:35.047444+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:52:35.047444+0000","last_undegraded":"2024-09-12T16:52:35.047444+0000","last_fullsized":"2024-09-12T16:52:35.047444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:16.323536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.082244+0000","last_change":"2024-09-12T16:51:58.145539+0000","last_active":"2024-09-12T16:55:12.082244+0000","last_peered":"2024-09-12T16:55:12.082244+0000","last_clean":"2024-09-12T16:55:12.082244+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:55:12.082244+0000","last_undegraded":"2024-09-12T16:55:12.082244+0000","last_fullsized":"2024-09-12T16:55:12.082244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:58.380885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.940172+0000","last_change":"2024-09-12T16:51:56.150522+0000","last_active":"2024-09-12T16:55:11.940172+0000","last_peered":"2024-09-12T16:55:11.940172+0000","last_clean":"2024-09-12T16:55:11.940172+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:55:11.940172+0000","last_undegraded":"2024-09-12T16:55:11.940172+0000","last_fullsized":"2024-09-12T16:55:11.940172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:47.138309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450880+0000","last_change":"2024-09-12T16:51:58.147371+0000","last_active":"2024-09-12T16:54:11.450880+0000","last_peered":"2024-09-12T16:54:11.450880+0000","last_clean":"2024-09-12T16:54:11.450880+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:54:11.450880+0000","last_undegraded":"2024-09-12T16:54:11.450880+0000","last_fullsized":"2024-09-12T16:54:11.450880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.439266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044749+0000","last_change":"2024-09-12T16:51:56.164502+0000","last_active":"2024-09-12T16:52:35.044749+0000","last_peered":"2024-09-12T16:52:35.044749+0000","last_clean":"2024-09-12T16:52:35.044749+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:52:35.044749+0000","last_undegraded":"2024-09-12T16:52:35.044749+0000","last_fullsized":"2024-09-12T16:52:35.044749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:23.020353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.578829+0000","last_change":"2024-09-12T16:51:58.171720+0000","last_active":"2024-09-12T16:55:12.578829+0000","last_peered":"2024-09-12T16:55:12.578829+0000","last_clean":"2024-09-12T16:55:12.578829+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:55:12.578829+0000","last_undegraded":"2024-09-12T16:55:12.578829+0000","last_fullsized":"2024-09-12T16:55:12.578829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:43.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.042838+0000","last_change":"2024-09-12T16:51:56.164560+0000","last_active":"2024-09-12T16:52:35.042838+0000","last_peered":"2024-09-12T16:52:35.042838+0000","last_clean":"2024-09-12T16:52:35.042838+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:52:35.042838+0000","last_undegraded":"2024-09-12T16:52:35.042838+0000","last_fullsized":"2024-09-12T16:52:35.042838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:34.588010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.170393+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:20.778233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029650+0000","last_change":"2024-09-12T16:51:56.172466+0000","last_active":"2024-09-12T16:52:35.029650+0000","last_peered":"2024-09-12T16:52:35.029650+0000","last_clean":"2024-09-12T16:52:35.029650+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:52:35.029650+0000","last_undegraded":"2024-09-12T16:52:35.029650+0000","last_fullsized":"2024-09-12T16:52:35.029650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:16.998562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.024343+0000","last_change":"2024-09-12T16:51:58.154333+0000","last_active":"2024-09-12T16:54:26.024343+0000","last_peered":"2024-09-12T16:54:26.024343+0000","last_clean":"2024-09-12T16:54:26.024343+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:54:26.024343+0000","last_undegraded":"2024-09-12T16:54:26.024343+0000","last_fullsized":"2024-09-12T16:54:26.024343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:31.351742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.747323+0000","last_change":"2024-09-12T16:51:56.150214+0000","last_active":"2024-09-12T16:53:25.747323+0000","last_peered":"2024-09-12T16:53:25.747323+0000","last_clean":"2024-09-12T16:53:25.747323+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:53:25.747323+0000","last_undegraded":"2024-09-12T16:53:25.747323+0000","last_fullsized":"2024-09-12T16:53:25.747323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.360856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.449818+0000","last_change":"2024-09-12T16:52:06.228645+0000","last_active":"2024-09-12T16:55:12.449818+0000","last_peered":"2024-09-12T16:55:12.449818+0000","last_clean":"2024-09-12T16:55:12.449818+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:55:12.449818+0000","last_undegraded":"2024-09-12T16:55:12.449818+0000","last_fullsized":"2024-09-12T16:55:12.449818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.027430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559921+0000","last_change":"2024-09-12T16:51:58.158921+0000","last_active":"2024-09-12T16:55:12.559921+0000","last_peered":"2024-09-12T16:55:12.559921+0000","last_clean":"2024-09-12T16:55:12.559921+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:55:12.559921+0000","last_undegraded":"2024-09-12T16:55:12.559921+0000","last_fullsized":"2024-09-12T16:55:12.559921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:53.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.583779+0000","last_change":"2024-09-12T16:51:56.164082+0000","last_active":"2024-09-12T16:52:42.583779+0000","last_peered":"2024-09-12T16:52:42.583779+0000","last_clean":"2024-09-12T16:52:42.583779+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:52:42.583779+0000","last_undegraded":"2024-09-12T16:52:42.583779+0000","last_fullsized":"2024-09-12T16:52:42.583779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:02.249063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047258+0000","last_change":"2024-09-12T16:52:00.186679+0000","last_active":"2024-09-12T16:52:35.047258+0000","last_peered":"2024-09-12T16:52:35.047258+0000","last_clean":"2024-09-12T16:52:35.047258+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:52:35.047258+0000","last_undegraded":"2024-09-12T16:52:35.047258+0000","last_fullsized":"2024-09-12T16:52:35.047258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:56.774446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.671303+0000","last_change":"2024-09-12T16:52:02.211041+0000","last_active":"2024-09-12T16:55:43.671303+0000","last_peered":"2024-09-12T16:55:43.671303+0000","last_clean":"2024-09-12T16:55:43.671303+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:55:43.671303+0000","last_undegraded":"2024-09-12T16:55:43.671303+0000","last_fullsized":"2024-09-12T16:55:43.671303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:56.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046823+0000","last_change":"2024-09-12T16:52:04.216014+0000","last_active":"2024-09-12T16:52:35.046823+0000","last_peered":"2024-09-12T16:52:35.046823+0000","last_clean":"2024-09-12T16:52:35.046823+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:52:35.046823+0000","last_undegraded":"2024-09-12T16:52:35.046823+0000","last_fullsized":"2024-09-12T16:52:35.046823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.121629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.770372+0000","last_change":"2024-09-12T16:52:06.220823+0000","last_active":"2024-09-12T16:53:25.770372+0000","last_peered":"2024-09-12T16:53:25.770372+0000","last_clean":"2024-09-12T16:53:25.770372+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:53:25.770372+0000","last_undegraded":"2024-09-12T16:53:25.770372+0000","last_fullsized":"2024-09-12T16:53:25.770372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.834594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.769302+0000","last_change":"2024-09-12T16:51:58.172491+0000","last_active":"2024-09-12T16:54:06.769302+0000","last_peered":"2024-09-12T16:54:06.769302+0000","last_clean":"2024-09-12T16:54:06.769302+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:54:06.769302+0000","last_undegraded":"2024-09-12T16:54:06.769302+0000","last_fullsized":"2024-09-12T16:54:06.769302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:13.859827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.015475+0000","last_change":"2024-09-12T16:51:56.148926+0000","last_active":"2024-09-12T16:55:12.015475+0000","last_peered":"2024-09-12T16:55:12.015475+0000","last_clean":"2024-09-12T16:55:12.015475+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:12.015475+0000","last_undegraded":"2024-09-12T16:55:12.015475+0000","last_fullsized":"2024-09-12T16:55:12.015475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:08.525437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022624+0000","last_change":"2024-09-12T16:52:00.173177+0000","last_active":"2024-09-12T16:52:35.022624+0000","last_peered":"2024-09-12T16:52:35.022624+0000","last_clean":"2024-09-12T16:52:35.022624+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:52:35.022624+0000","last_undegraded":"2024-09-12T16:52:35.022624+0000","last_fullsized":"2024-09-12T16:52:35.022624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:29.445195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.045539+0000","last_change":"2024-09-12T16:52:02.183370+0000","last_active":"2024-09-12T16:52:35.045539+0000","last_peered":"2024-09-12T16:52:35.045539+0000","last_clean":"2024-09-12T16:52:35.045539+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:52:35.045539+0000","last_undegraded":"2024-09-12T16:52:35.045539+0000","last_fullsized":"2024-09-12T16:52:35.045539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.193774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044904+0000","last_change":"2024-09-12T16:52:04.210985+0000","last_active":"2024-09-12T16:52:35.044904+0000","last_peered":"2024-09-12T16:52:35.044904+0000","last_clean":"2024-09-12T16:52:35.044904+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:52:35.044904+0000","last_undegraded":"2024-09-12T16:52:35.044904+0000","last_fullsized":"2024-09-12T16:52:35.044904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:41.017144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021248+0000","last_change":"2024-09-12T16:52:06.224899+0000","last_active":"2024-09-12T16:52:35.021248+0000","last_peered":"2024-09-12T16:52:35.021248+0000","last_clean":"2024-09-12T16:52:35.021248+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:52:35.021248+0000","last_undegraded":"2024-09-12T16:52:35.021248+0000","last_fullsized":"2024-09-12T16:52:35.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:27.788906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559983+0000","last_change":"2024-09-12T16:51:58.165985+0000","last_active":"2024-09-12T16:55:12.559983+0000","last_peered":"2024-09-12T16:55:12.559983+0000","last_clean":"2024-09-12T16:55:12.559983+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:55:12.559983+0000","last_undegraded":"2024-09-12T16:55:12.559983+0000","last_fullsized":"2024-09-12T16:55:12.559983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.791071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023098+0000","last_change":"2024-09-12T16:51:56.153288+0000","last_active":"2024-09-12T16:52:35.023098+0000","last_peered":"2024-09-12T16:52:35.023098+0000","last_clean":"2024-09-12T16:52:35.023098+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:52:35.023098+0000","last_undegraded":"2024-09-12T16:52:35.023098+0000","last_fullsized":"2024-09-12T16:52:35.023098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:56.830974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029954+0000","last_change":"2024-09-12T16:52:00.166221+0000","last_active":"2024-09-12T16:52:35.029954+0000","last_peered":"2024-09-12T16:52:35.029954+0000","last_clean":"2024-09-12T16:52:35.029954+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:52:35.029954+0000","last_undegraded":"2024-09-12T16:52:35.029954+0000","last_fullsized":"2024-09-12T16:52:35.029954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:47.637135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017313+0000","last_change":"2024-09-12T16:52:02.202447+0000","last_active":"2024-09-12T16:52:35.017313+0000","last_peered":"2024-09-12T16:52:35.017313+0000","last_clean":"2024-09-12T16:52:35.017313+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:52:35.017313+0000","last_undegraded":"2024-09-12T16:52:35.017313+0000","last_fullsized":"2024-09-12T16:52:35.017313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:48.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.577588+0000","last_change":"2024-09-12T16:52:04.214865+0000","last_active":"2024-09-12T16:55:43.577588+0000","last_peered":"2024-09-12T16:55:43.577588+0000","last_clean":"2024-09-12T16:55:43.577588+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:55:43.577588+0000","last_undegraded":"2024-09-12T16:55:43.577588+0000","last_fullsized":"2024-09-12T16:55:43.577588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:36.658689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016249+0000","last_change":"2024-09-12T16:52:06.233885+0000","last_active":"2024-09-12T16:52:35.016249+0000","last_peered":"2024-09-12T16:52:35.016249+0000","last_clean":"2024-09-12T16:52:35.016249+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:52:35.016249+0000","last_undegraded":"2024-09-12T16:52:35.016249+0000","last_fullsized":"2024-09-12T16:52:35.016249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:05.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762116+0000","last_change":"2024-09-12T16:51:58.157856+0000","last_active":"2024-09-12T16:53:25.762116+0000","last_peered":"2024-09-12T16:53:25.762116+0000","last_clean":"2024-09-12T16:53:25.762116+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:53:25.762116+0000","last_undegraded":"2024-09-12T16:53:25.762116+0000","last_fullsized":"2024-09-12T16:53:25.762116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.575311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024635+0000","last_change":"2024-09-12T16:51:56.158840+0000","last_active":"2024-09-12T16:52:35.024635+0000","last_peered":"2024-09-12T16:52:35.024635+0000","last_clean":"2024-09-12T16:52:35.024635+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:52:35.024635+0000","last_undegraded":"2024-09-12T16:52:35.024635+0000","last_fullsized":"2024-09-12T16:52:35.024635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.795717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047933+0000","last_change":"2024-09-12T16:52:00.186758+0000","last_active":"2024-09-12T16:52:35.047933+0000","last_peered":"2024-09-12T16:52:35.047933+0000","last_clean":"2024-09-12T16:52:35.047933+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:52:35.047933+0000","last_undegraded":"2024-09-12T16:52:35.047933+0000","last_fullsized":"2024-09-12T16:52:35.047933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:11.029898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.876170+0000","last_change":"2024-09-12T16:52:02.201456+0000","last_active":"2024-09-12T16:55:43.876170+0000","last_peered":"2024-09-12T16:55:43.876170+0000","last_clean":"2024-09-12T16:55:43.876170+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:55:43.876170+0000","last_undegraded":"2024-09-12T16:55:43.876170+0000","last_fullsized":"2024-09-12T16:55:43.876170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:04.994969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.586516+0000","last_change":"2024-09-12T16:52:04.220126+0000","last_active":"2024-09-12T16:55:43.586516+0000","last_peered":"2024-09-12T16:55:43.586516+0000","last_clean":"2024-09-12T16:55:43.586516+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:55:43.586516+0000","last_undegraded":"2024-09-12T16:55:43.586516+0000","last_fullsized":"2024-09-12T16:55:43.586516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:41.797262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024505+0000","last_change":"2024-09-12T16:51:58.166638+0000","last_active":"2024-09-12T16:52:35.024505+0000","last_peered":"2024-09-12T16:52:35.024505+0000","last_clean":"2024-09-12T16:52:35.024505+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:52:35.024505+0000","last_undegraded":"2024-09-12T16:52:35.024505+0000","last_fullsized":"2024-09-12T16:52:35.024505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:09.865305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022574+0000","last_change":"2024-09-12T16:51:56.152053+0000","last_active":"2024-09-12T16:52:35.022574+0000","last_peered":"2024-09-12T16:52:35.022574+0000","last_clean":"2024-09-12T16:52:35.022574+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:52:35.022574+0000","last_undegraded":"2024-09-12T16:52:35.022574+0000","last_fullsized":"2024-09-12T16:52:35.022574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:05.944750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025774+0000","last_change":"2024-09-12T16:52:00.158540+0000","last_active":"2024-09-12T16:52:35.025774+0000","last_peered":"2024-09-12T16:52:35.025774+0000","last_clean":"2024-09-12T16:52:35.025774+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:52:35.025774+0000","last_undegraded":"2024-09-12T16:52:35.025774+0000","last_fullsized":"2024-09-12T16:52:35.025774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.058273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'44","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.692222+0000","last_change":"2024-09-12T16:52:02.185249+0000","last_active":"2024-09-12T16:55:43.692222+0000","last_peered":"2024-09-12T16:55:43.692222+0000","last_clean":"2024-09-12T16:55:43.692222+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:55:43.692222+0000","last_undegraded":"2024-09-12T16:55:43.692222+0000","last_fullsized":"2024-09-12T16:55:43.692222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:09.660762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029067+0000","last_change":"2024-09-12T16:52:04.216055+0000","last_active":"2024-09-12T16:52:35.029067+0000","last_peered":"2024-09-12T16:52:35.029067+0000","last_clean":"2024-09-12T16:52:35.029067+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:52:35.029067+0000","last_undegraded":"2024-09-12T16:52:35.029067+0000","last_fullsized":"2024-09-12T16:52:35.029067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:19.593146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.773290+0000","last_change":"2024-09-12T16:52:06.226575+0000","last_active":"2024-09-12T16:53:25.773290+0000","last_peered":"2024-09-12T16:53:25.773290+0000","last_clean":"2024-09-12T16:53:25.773290+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:53:25.773290+0000","last_undegraded":"2024-09-12T16:53:25.773290+0000","last_fullsized":"2024-09-12T16:53:25.773290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:47.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.059583+0000","last_change":"2024-09-12T16:51:58.154586+0000","last_active":"2024-09-12T16:55:12.059583+0000","last_peered":"2024-09-12T16:55:12.059583+0000","last_clean":"2024-09-12T16:55:12.059583+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:55:12.059583+0000","last_undegraded":"2024-09-12T16:55:12.059583+0000","last_fullsized":"2024-09-12T16:55:12.059583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:21.326630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.211592+0000","last_change":"2024-09-12T16:51:56.152647+0000","last_active":"2024-09-12T16:54:11.211592+0000","last_peered":"2024-09-12T16:54:11.211592+0000","last_clean":"2024-09-12T16:54:11.211592+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:54:11.211592+0000","last_undegraded":"2024-09-12T16:54:11.211592+0000","last_fullsized":"2024-09-12T16:54:11.211592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023417+0000","last_change":"2024-09-12T16:52:00.156973+0000","last_active":"2024-09-12T16:52:35.023417+0000","last_peered":"2024-09-12T16:52:35.023417+0000","last_clean":"2024-09-12T16:52:35.023417+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:52:35.023417+0000","last_undegraded":"2024-09-12T16:52:35.023417+0000","last_fullsized":"2024-09-12T16:52:35.023417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:53.962016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.778313+0000","last_change":"2024-09-12T16:52:02.209890+0000","last_active":"2024-09-12T16:55:43.778313+0000","last_peered":"2024-09-12T16:55:43.778313+0000","last_clean":"2024-09-12T16:55:43.778313+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:55:43.778313+0000","last_undegraded":"2024-09-12T16:55:43.778313+0000","last_fullsized":"2024-09-12T16:55:43.778313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:04.988153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023620+0000","last_change":"2024-09-12T16:52:04.194679+0000","last_active":"2024-09-12T16:52:35.023620+0000","last_peered":"2024-09-12T16:52:35.023620+0000","last_clean":"2024-09-12T16:52:35.023620+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:52:35.023620+0000","last_undegraded":"2024-09-12T16:52:35.023620+0000","last_fullsized":"2024-09-12T16:52:35.023620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:43.311077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:20.069130+0000","last_change":"2024-09-12T16:52:06.231060+0000","last_active":"2024-09-12T16:53:20.069130+0000","last_peered":"2024-09-12T16:53:20.069130+0000","last_clean":"2024-09-12T16:53:20.069130+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:53:20.069130+0000","last_undegraded":"2024-09-12T16:53:20.069130+0000","last_fullsized":"2024-09-12T16:53:20.069130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:38.753641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019518+0000","last_change":"2024-09-12T16:51:58.170102+0000","last_active":"2024-09-12T16:52:35.019518+0000","last_peered":"2024-09-12T16:52:35.019518+0000","last_clean":"2024-09-12T16:52:35.019518+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:52:35.019518+0000","last_undegraded":"2024-09-12T16:52:35.019518+0000","last_fullsized":"2024-09-12T16:52:35.019518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:03.745874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048163+0000","last_change":"2024-09-12T16:51:56.171021+0000","last_active":"2024-09-12T16:52:35.048163+0000","last_peered":"2024-09-12T16:52:35.048163+0000","last_clean":"2024-09-12T16:52:35.048163+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:52:35.048163+0000","last_undegraded":"2024-09-12T16:52:35.048163+0000","last_fullsized":"2024-09-12T16:52:35.048163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:34.631184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026093+0000","last_change":"2024-09-12T16:52:00.155974+0000","last_active":"2024-09-12T16:52:35.026093+0000","last_peered":"2024-09-12T16:52:35.026093+0000","last_clean":"2024-09-12T16:52:35.026093+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:52:35.026093+0000","last_undegraded":"2024-09-12T16:52:35.026093+0000","last_fullsized":"2024-09-12T16:52:35.026093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:53.769301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'40","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.700832+0000","last_change":"2024-09-12T16:52:02.203207+0000","last_active":"2024-09-12T16:55:43.700832+0000","last_peered":"2024-09-12T16:55:43.700832+0000","last_clean":"2024-09-12T16:55:43.700832+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:55:43.700832+0000","last_undegraded":"2024-09-12T16:55:43.700832+0000","last_fullsized":"2024-09-12T16:55:43.700832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:18.022593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.589627+0000","last_change":"2024-09-12T16:52:04.194703+0000","last_active":"2024-09-12T16:55:43.589627+0000","last_peered":"2024-09-12T16:55:43.589627+0000","last_clean":"2024-09-12T16:55:43.589627+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:55:43.589627+0000","last_undegraded":"2024-09-12T16:55:43.589627+0000","last_fullsized":"2024-09-12T16:55:43.589627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:45.145668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024038+0000","last_change":"2024-09-12T16:52:06.236389+0000","last_active":"2024-09-12T16:52:35.024038+0000","last_peered":"2024-09-12T16:52:35.024038+0000","last_clean":"2024-09-12T16:52:35.024038+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:52:35.024038+0000","last_undegraded":"2024-09-12T16:52:35.024038+0000","last_fullsized":"2024-09-12T16:52:35.024038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:42.125079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015430+0000","last_change":"2024-09-12T16:51:58.141456+0000","last_active":"2024-09-12T16:54:15.015430+0000","last_peered":"2024-09-12T16:54:15.015430+0000","last_clean":"2024-09-12T16:54:15.015430+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:54:15.015430+0000","last_undegraded":"2024-09-12T16:54:15.015430+0000","last_fullsized":"2024-09-12T16:54:15.015430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.544687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044239+0000","last_change":"2024-09-12T16:51:56.169441+0000","last_active":"2024-09-12T16:52:35.044239+0000","last_peered":"2024-09-12T16:52:35.044239+0000","last_clean":"2024-09-12T16:52:35.044239+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:52:35.044239+0000","last_undegraded":"2024-09-12T16:52:35.044239+0000","last_fullsized":"2024-09-12T16:52:35.044239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:56.370543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022426+0000","last_change":"2024-09-12T16:52:00.178084+0000","last_active":"2024-09-12T16:52:35.022426+0000","last_peered":"2024-09-12T16:52:35.022426+0000","last_clean":"2024-09-12T16:52:35.022426+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:52:35.022426+0000","last_undegraded":"2024-09-12T16:52:35.022426+0000","last_fullsized":"2024-09-12T16:52:35.022426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.597984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.799311+0000","last_change":"2024-09-12T16:52:02.201612+0000","last_active":"2024-09-12T16:55:43.799311+0000","last_peered":"2024-09-12T16:55:43.799311+0000","last_clean":"2024-09-12T16:55:43.799311+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:55:43.799311+0000","last_undegraded":"2024-09-12T16:55:43.799311+0000","last_fullsized":"2024-09-12T16:55:43.799311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:42.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021841+0000","last_change":"2024-09-12T16:52:04.198835+0000","last_active":"2024-09-12T16:52:35.021841+0000","last_peered":"2024-09-12T16:52:35.021841+0000","last_clean":"2024-09-12T16:52:35.021841+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:52:35.021841+0000","last_undegraded":"2024-09-12T16:52:35.021841+0000","last_fullsized":"2024-09-12T16:52:35.021841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.503485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.731668+0000","last_change":"2024-09-12T16:52:06.212053+0000","last_active":"2024-09-12T16:55:12.731668+0000","last_peered":"2024-09-12T16:55:12.731668+0000","last_clean":"2024-09-12T16:55:12.731668+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:55:12.731668+0000","last_undegraded":"2024-09-12T16:55:12.731668+0000","last_fullsized":"2024-09-12T16:55:12.731668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:15.749904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.060440+0000","last_change":"2024-09-12T16:51:58.171124+0000","last_active":"2024-09-12T16:55:12.060440+0000","last_peered":"2024-09-12T16:55:12.060440+0000","last_clean":"2024-09-12T16:55:12.060440+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:55:12.060440+0000","last_undegraded":"2024-09-12T16:55:12.060440+0000","last_fullsized":"2024-09-12T16:55:12.060440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:39.172648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026631+0000","last_change":"2024-09-12T16:51:56.169756+0000","last_active":"2024-09-12T16:52:35.026631+0000","last_peered":"2024-09-12T16:52:35.026631+0000","last_clean":"2024-09-12T16:52:35.026631+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:52:35.026631+0000","last_undegraded":"2024-09-12T16:52:35.026631+0000","last_fullsized":"2024-09-12T16:52:35.026631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:43.389321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027418+0000","last_change":"2024-09-12T16:52:00.186996+0000","last_active":"2024-09-12T16:52:35.027418+0000","last_peered":"2024-09-12T16:52:35.027418+0000","last_clean":"2024-09-12T16:52:35.027418+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:52:35.027418+0000","last_undegraded":"2024-09-12T16:52:35.027418+0000","last_fullsized":"2024-09-12T16:52:35.027418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:55.614591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.826845+0000","last_change":"2024-09-12T16:52:02.181402+0000","last_active":"2024-09-12T16:55:43.826845+0000","last_peered":"2024-09-12T16:55:43.826845+0000","last_clean":"2024-09-12T16:55:43.826845+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:55:43.826845+0000","last_undegraded":"2024-09-12T16:55:43.826845+0000","last_fullsized":"2024-09-12T16:55:43.826845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:57.545973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048724+0000","last_change":"2024-09-12T16:52:04.214150+0000","last_active":"2024-09-12T16:52:35.048724+0000","last_peered":"2024-09-12T16:52:35.048724+0000","last_clean":"2024-09-12T16:52:35.048724+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:52:35.048724+0000","last_undegraded":"2024-09-12T16:52:35.048724+0000","last_fullsized":"2024-09-12T16:52:35.048724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:04.618846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:08.605539+0000","last_change":"2024-09-12T16:52:06.231706+0000","last_active":"2024-09-12T16:54:08.605539+0000","last_peered":"2024-09-12T16:54:08.605539+0000","last_clean":"2024-09-12T16:54:08.605539+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:54:08.605539+0000","last_undegraded":"2024-09-12T16:54:08.605539+0000","last_fullsized":"2024-09-12T16:54:08.605539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:20.026659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'9","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.579477+0000","last_change":"2024-09-12T16:51:58.173915+0000","last_active":"2024-09-12T16:55:12.579477+0000","last_peered":"2024-09-12T16:55:12.579477+0000","last_clean":"2024-09-12T16:55:12.579477+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:55:12.579477+0000","last_undegraded":"2024-09-12T16:55:12.579477+0000","last_fullsized":"2024-09-12T16:55:12.579477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:53.515263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.898990+0000","last_change":"2024-09-12T16:51:56.159835+0000","last_active":"2024-09-12T16:55:11.898990+0000","last_peered":"2024-09-12T16:55:11.898990+0000","last_clean":"2024-09-12T16:55:11.898990+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:55:11.898990+0000","last_undegraded":"2024-09-12T16:55:11.898990+0000","last_fullsized":"2024-09-12T16:55:11.898990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:50.587070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022853+0000","last_change":"2024-09-12T16:52:00.167730+0000","last_active":"2024-09-12T16:52:35.022853+0000","last_peered":"2024-09-12T16:52:35.022853+0000","last_clean":"2024-09-12T16:52:35.022853+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:52:35.022853+0000","last_undegraded":"2024-09-12T16:52:35.022853+0000","last_fullsized":"2024-09-12T16:52:35.022853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:18.641624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.754640+0000","last_change":"2024-09-12T16:52:02.181396+0000","last_active":"2024-09-12T16:55:43.754640+0000","last_peered":"2024-09-12T16:55:43.754640+0000","last_clean":"2024-09-12T16:55:43.754640+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:55:43.754640+0000","last_undegraded":"2024-09-12T16:55:43.754640+0000","last_fullsized":"2024-09-12T16:55:43.754640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:02.688531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.578248+0000","last_change":"2024-09-12T16:52:04.202044+0000","last_active":"2024-09-12T16:55:43.578248+0000","last_peered":"2024-09-12T16:55:43.578248+0000","last_clean":"2024-09-12T16:55:43.578248+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:55:43.578248+0000","last_undegraded":"2024-09-12T16:55:43.578248+0000","last_fullsized":"2024-09-12T16:55:43.578248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:00.863167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'20","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.680761+0000","last_change":"2024-09-12T16:52:06.219575+0000","last_active":"2024-09-12T16:55:12.680761+0000","last_peered":"2024-09-12T16:55:12.680761+0000","last_clean":"2024-09-12T16:55:12.680761+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:55:12.680761+0000","last_undegraded":"2024-09-12T16:55:12.680761+0000","last_fullsized":"2024-09-12T16:55:12.680761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.073730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.245387+0000","last_change":"2024-09-12T16:51:58.168850+0000","last_active":"2024-09-12T16:52:42.245387+0000","last_peered":"2024-09-12T16:52:42.245387+0000","last_clean":"2024-09-12T16:52:42.245387+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:52:42.245387+0000","last_undegraded":"2024-09-12T16:52:42.245387+0000","last_fullsized":"2024-09-12T16:52:42.245387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:38.519723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030545+0000","last_change":"2024-09-12T16:51:56.163883+0000","last_active":"2024-09-12T16:52:35.030545+0000","last_peered":"2024-09-12T16:52:35.030545+0000","last_clean":"2024-09-12T16:52:35.030545+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:52:35.030545+0000","last_undegraded":"2024-09-12T16:52:35.030545+0000","last_fullsized":"2024-09-12T16:52:35.030545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:19.316288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":623,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.566986+0000","last_change":"2024-09-12T16:52:35.065861+0000","last_active":"2024-09-12T16:55:43.566986+0000","last_peered":"2024-09-12T16:55:43.566986+0000","last_clean":"2024-09-12T16:55:43.566986+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:55:43.566986+0000","last_undegraded":"2024-09-12T16:55:43.566986+0000","last_fullsized":"2024-09-12T16:55:43.566986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.323930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.454242+0000","last_change":"2024-09-12T16:52:02.209870+0000","last_active":"2024-09-12T16:54:11.454242+0000","last_peered":"2024-09-12T16:54:11.454242+0000","last_clean":"2024-09-12T16:54:11.454242+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:54:11.454242+0000","last_undegraded":"2024-09-12T16:54:11.454242+0000","last_fullsized":"2024-09-12T16:54:11.454242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.846097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":515,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.580728+0000","last_change":"2024-09-12T16:52:04.200303+0000","last_active":"2024-09-12T16:55:43.580728+0000","last_peered":"2024-09-12T16:55:43.580728+0000","last_clean":"2024-09-12T16:55:43.580728+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:55:43.580728+0000","last_undegraded":"2024-09-12T16:55:43.580728+0000","last_fullsized":"2024-09-12T16:55:43.580728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:06.974814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.990445+0000","last_change":"2024-09-12T16:52:06.226319+0000","last_active":"2024-09-12T16:54:10.990445+0000","last_peered":"2024-09-12T16:54:10.990445+0000","last_clean":"2024-09-12T16:54:10.990445+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:54:10.990445+0000","last_undegraded":"2024-09-12T16:54:10.990445+0000","last_fullsized":"2024-09-12T16:54:10.990445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:19.104184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204872+0000","last_change":"2024-09-12T16:51:58.172403+0000","last_active":"2024-09-12T16:55:12.204872+0000","last_peered":"2024-09-12T16:55:12.204872+0000","last_clean":"2024-09-12T16:55:12.204872+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.204872+0000","last_undegraded":"2024-09-12T16:55:12.204872+0000","last_fullsized":"2024-09-12T16:55:12.204872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:17.725825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023537+0000","last_change":"2024-09-12T16:51:56.164438+0000","last_active":"2024-09-12T16:52:35.023537+0000","last_peered":"2024-09-12T16:52:35.023537+0000","last_clean":"2024-09-12T16:52:35.023537+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:52:35.023537+0000","last_undegraded":"2024-09-12T16:52:35.023537+0000","last_fullsized":"2024-09-12T16:52:35.023537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:34.280592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048178+0000","last_change":"2024-09-12T16:52:00.189183+0000","last_active":"2024-09-12T16:52:35.048178+0000","last_peered":"2024-09-12T16:52:35.048178+0000","last_clean":"2024-09-12T16:52:35.048178+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:52:35.048178+0000","last_undegraded":"2024-09-12T16:52:35.048178+0000","last_fullsized":"2024-09-12T16:52:35.048178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:50.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'42","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.676524+0000","last_change":"2024-09-12T16:52:02.179426+0000","last_active":"2024-09-12T16:55:43.676524+0000","last_peered":"2024-09-12T16:55:43.676524+0000","last_clean":"2024-09-12T16:55:43.676524+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:55:43.676524+0000","last_undegraded":"2024-09-12T16:55:43.676524+0000","last_fullsized":"2024-09-12T16:55:43.676524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:17.890537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017029+0000","last_change":"2024-09-12T16:52:04.212757+0000","last_active":"2024-09-12T16:52:35.017029+0000","last_peered":"2024-09-12T16:52:35.017029+0000","last_clean":"2024-09-12T16:52:35.017029+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:52:35.017029+0000","last_undegraded":"2024-09-12T16:52:35.017029+0000","last_fullsized":"2024-09-12T16:52:35.017029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.808954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.633190+0000","last_change":"2024-09-12T16:52:06.227780+0000","last_active":"2024-09-12T16:55:12.633190+0000","last_peered":"2024-09-12T16:55:12.633190+0000","last_clean":"2024-09-12T16:55:12.633190+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:55:12.633190+0000","last_undegraded":"2024-09-12T16:55:12.633190+0000","last_fullsized":"2024-09-12T16:55:12.633190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:23.705849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.222251+0000","last_change":"2024-09-12T16:51:58.173604+0000","last_active":"2024-09-12T16:55:12.222251+0000","last_peered":"2024-09-12T16:55:12.222251+0000","last_clean":"2024-09-12T16:55:12.222251+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:55:12.222251+0000","last_undegraded":"2024-09-12T16:55:12.222251+0000","last_fullsized":"2024-09-12T16:55:12.222251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:03.163064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:41.013055+0000","last_change":"2024-09-12T16:51:41.681357+0000","last_active":"2024-09-12T16:53:41.013055+0000","last_peered":"2024-09-12T16:53:41.013055+0000","last_clean":"2024-09-12T16:53:41.013055+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:53:41.013055+0000","last_undegraded":"2024-09-12T16:53:41.013055+0000","last_fullsized":"2024-09-12T16:53:41.013055+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:40.347390+0000","last_clean_scrub_stamp":"2024-09-12T16:51:40.347390+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:18.394696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039279+0000","last_change":"2024-09-12T16:51:48.400219+0000","last_active":"2024-09-12T16:52:35.039279+0000","last_peered":"2024-09-12T16:52:35.039279+0000","last_clean":"2024-09-12T16:52:35.039279+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:52:35.039279+0000","last_undegraded":"2024-09-12T16:52:35.039279+0000","last_fullsized":"2024-09-12T16:52:35.039279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.307866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033268+0000","last_change":"2024-09-12T16:51:56.168803+0000","last_active":"2024-09-12T16:52:35.033268+0000","last_peered":"2024-09-12T16:52:35.033268+0000","last_clean":"2024-09-12T16:52:35.033268+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:52:35.033268+0000","last_undegraded":"2024-09-12T16:52:35.033268+0000","last_fullsized":"2024-09-12T16:52:35.033268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:25.625123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044074+0000","last_change":"2024-09-12T16:52:00.165360+0000","last_active":"2024-09-12T16:52:35.044074+0000","last_peered":"2024-09-12T16:52:35.044074+0000","last_clean":"2024-09-12T16:52:35.044074+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:52:35.044074+0000","last_undegraded":"2024-09-12T16:52:35.044074+0000","last_fullsized":"2024-09-12T16:52:35.044074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:19.218108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.903382+0000","last_change":"2024-09-12T16:52:02.208795+0000","last_active":"2024-09-12T16:55:43.903382+0000","last_peered":"2024-09-12T16:55:43.903382+0000","last_clean":"2024-09-12T16:55:43.903382+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:55:43.903382+0000","last_undegraded":"2024-09-12T16:55:43.903382+0000","last_fullsized":"2024-09-12T16:55:43.903382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:33.220579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024326+0000","last_change":"2024-09-12T16:52:04.190511+0000","last_active":"2024-09-12T16:52:35.024326+0000","last_peered":"2024-09-12T16:52:35.024326+0000","last_clean":"2024-09-12T16:52:35.024326+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:52:35.024326+0000","last_undegraded":"2024-09-12T16:52:35.024326+0000","last_fullsized":"2024-09-12T16:52:35.024326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:34.575751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.588965+0000","last_change":"2024-09-12T16:52:06.216437+0000","last_active":"2024-09-12T16:55:12.588965+0000","last_peered":"2024-09-12T16:55:12.588965+0000","last_clean":"2024-09-12T16:55:12.588965+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:55:12.588965+0000","last_undegraded":"2024-09-12T16:55:12.588965+0000","last_fullsized":"2024-09-12T16:55:12.588965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:11.640533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.560070+0000","last_change":"2024-09-12T16:51:58.165681+0000","last_active":"2024-09-12T16:55:12.560070+0000","last_peered":"2024-09-12T16:55:12.560070+0000","last_clean":"2024-09-12T16:55:12.560070+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:55:12.560070+0000","last_undegraded":"2024-09-12T16:55:12.560070+0000","last_fullsized":"2024-09-12T16:55:12.560070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.848528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:46.016611+0000","last_change":"2024-09-12T16:51:48.399639+0000","last_active":"2024-09-12T16:53:46.016611+0000","last_peered":"2024-09-12T16:53:46.016611+0000","last_clean":"2024-09-12T16:53:46.016611+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:53:46.016611+0000","last_undegraded":"2024-09-12T16:53:46.016611+0000","last_fullsized":"2024-09-12T16:53:46.016611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:58.533236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.846991+0000","last_change":"2024-09-12T16:51:56.170610+0000","last_active":"2024-09-12T16:55:11.846991+0000","last_peered":"2024-09-12T16:55:11.846991+0000","last_clean":"2024-09-12T16:55:11.846991+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:11.846991+0000","last_undegraded":"2024-09-12T16:55:11.846991+0000","last_fullsized":"2024-09-12T16:55:11.846991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:37.340264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043040+0000","last_change":"2024-09-12T16:52:35.040769+0000","last_active":"2024-09-12T16:52:35.043040+0000","last_peered":"2024-09-12T16:52:35.043040+0000","last_clean":"2024-09-12T16:52:35.043040+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:52:35.043040+0000","last_undegraded":"2024-09-12T16:52:35.043040+0000","last_fullsized":"2024-09-12T16:52:35.043040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'286","reported_seq":504,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.897969+0000","last_change":"2024-09-12T16:52:02.206307+0000","last_active":"2024-09-12T16:55:43.897969+0000","last_peered":"2024-09-12T16:55:43.897969+0000","last_clean":"2024-09-12T16:55:43.897969+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:55:43.897969+0000","last_undegraded":"2024-09-12T16:55:43.897969+0000","last_fullsized":"2024-09-12T16:55:43.897969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:35.817009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046840+0000","last_change":"2024-09-12T16:52:04.209015+0000","last_active":"2024-09-12T16:52:35.046840+0000","last_peered":"2024-09-12T16:52:35.046840+0000","last_clean":"2024-09-12T16:52:35.046840+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:52:35.046840+0000","last_undegraded":"2024-09-12T16:52:35.046840+0000","last_fullsized":"2024-09-12T16:52:35.046840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.156119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.766970+0000","last_change":"2024-09-12T16:52:06.227599+0000","last_active":"2024-09-12T16:53:25.766970+0000","last_peered":"2024-09-12T16:53:25.766970+0000","last_clean":"2024-09-12T16:53:25.766970+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:53:25.766970+0000","last_undegraded":"2024-09-12T16:53:25.766970+0000","last_fullsized":"2024-09-12T16:53:25.766970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:02.281631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508885+0000","last_change":"2024-09-12T16:51:58.158281+0000","last_active":"2024-09-12T16:55:12.508885+0000","last_peered":"2024-09-12T16:55:12.508885+0000","last_clean":"2024-09-12T16:55:12.508885+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:55:12.508885+0000","last_undegraded":"2024-09-12T16:55:12.508885+0000","last_fullsized":"2024-09-12T16:55:12.508885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:35.307006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.018288+0000","last_change":"2024-09-12T16:51:48.565817+0000","last_active":"2024-09-12T16:52:35.018288+0000","last_peered":"2024-09-12T16:52:35.018288+0000","last_clean":"2024-09-12T16:52:35.018288+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:52:35.018288+0000","last_undegraded":"2024-09-12T16:52:35.018288+0000","last_fullsized":"2024-09-12T16:52:35.018288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:05.344141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021089+0000","last_change":"2024-09-12T16:51:56.167557+0000","last_active":"2024-09-12T16:52:35.021089+0000","last_peered":"2024-09-12T16:52:35.021089+0000","last_clean":"2024-09-12T16:52:35.021089+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:52:35.021089+0000","last_undegraded":"2024-09-12T16:52:35.021089+0000","last_fullsized":"2024-09-12T16:52:35.021089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:46.448480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.057420+0000","last_change":"2024-09-12T16:52:35.055925+0000","last_active":"2024-09-12T16:52:35.057420+0000","last_peered":"2024-09-12T16:52:35.057420+0000","last_clean":"2024-09-12T16:52:35.057420+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:52:35.057420+0000","last_undegraded":"2024-09-12T16:52:35.057420+0000","last_fullsized":"2024-09-12T16:52:35.057420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:39.278393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419519+0000","last_change":"2024-09-12T16:52:02.183372+0000","last_active":"2024-09-12T16:55:10.419519+0000","last_peered":"2024-09-12T16:55:10.419519+0000","last_clean":"2024-09-12T16:55:10.419519+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:55:10.419519+0000","last_undegraded":"2024-09-12T16:55:10.419519+0000","last_fullsized":"2024-09-12T16:55:10.419519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:17.150188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023454+0000","last_change":"2024-09-12T16:52:04.189985+0000","last_active":"2024-09-12T16:52:35.023454+0000","last_peered":"2024-09-12T16:52:35.023454+0000","last_clean":"2024-09-12T16:52:35.023454+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:52:35.023454+0000","last_undegraded":"2024-09-12T16:52:35.023454+0000","last_fullsized":"2024-09-12T16:52:35.023454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:57.543211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032944+0000","last_change":"2024-09-12T16:52:06.229164+0000","last_active":"2024-09-12T16:52:35.032944+0000","last_peered":"2024-09-12T16:52:35.032944+0000","last_clean":"2024-09-12T16:52:35.032944+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:52:35.032944+0000","last_undegraded":"2024-09-12T16:52:35.032944+0000","last_fullsized":"2024-09-12T16:52:35.032944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:53.711707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.430239+0000","last_change":"2024-09-12T16:51:58.152002+0000","last_active":"2024-09-12T16:54:11.430239+0000","last_peered":"2024-09-12T16:54:11.430239+0000","last_clean":"2024-09-12T16:54:11.430239+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:54:11.430239+0000","last_undegraded":"2024-09-12T16:54:11.430239+0000","last_fullsized":"2024-09-12T16:54:11.430239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:09.830533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032753+0000","last_change":"2024-09-12T16:51:48.400929+0000","last_active":"2024-09-12T16:52:35.032753+0000","last_peered":"2024-09-12T16:52:35.032753+0000","last_clean":"2024-09-12T16:52:35.032753+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:52:35.032753+0000","last_undegraded":"2024-09-12T16:52:35.032753+0000","last_fullsized":"2024-09-12T16:52:35.032753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:21.707361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017052+0000","last_change":"2024-09-12T16:51:56.148951+0000","last_active":"2024-09-12T16:52:35.017052+0000","last_peered":"2024-09-12T16:52:35.017052+0000","last_clean":"2024-09-12T16:52:35.017052+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:52:35.017052+0000","last_undegraded":"2024-09-12T16:52:35.017052+0000","last_fullsized":"2024-09-12T16:52:35.017052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:03.940011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024125+0000","last_change":"2024-09-12T16:52:00.189223+0000","last_active":"2024-09-12T16:52:35.024125+0000","last_peered":"2024-09-12T16:52:35.024125+0000","last_clean":"2024-09-12T16:52:35.024125+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:52:35.024125+0000","last_undegraded":"2024-09-12T16:52:35.024125+0000","last_fullsized":"2024-09-12T16:52:35.024125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:19.787530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.470351+0000","last_change":"2024-09-12T16:52:02.207152+0000","last_active":"2024-09-12T16:55:11.470351+0000","last_peered":"2024-09-12T16:55:11.470351+0000","last_clean":"2024-09-12T16:55:11.470351+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:55:11.470351+0000","last_undegraded":"2024-09-12T16:55:11.470351+0000","last_fullsized":"2024-09-12T16:55:11.470351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:18.373274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049115+0000","last_change":"2024-09-12T16:52:04.214830+0000","last_active":"2024-09-12T16:52:35.049115+0000","last_peered":"2024-09-12T16:52:35.049115+0000","last_clean":"2024-09-12T16:52:35.049115+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:52:35.049115+0000","last_undegraded":"2024-09-12T16:52:35.049115+0000","last_fullsized":"2024-09-12T16:52:35.049115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:43.821701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.923598+0000","last_change":"2024-09-12T16:52:06.229880+0000","last_active":"2024-09-12T16:54:10.923598+0000","last_peered":"2024-09-12T16:54:10.923598+0000","last_clean":"2024-09-12T16:54:10.923598+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:54:10.923598+0000","last_undegraded":"2024-09-12T16:54:10.923598+0000","last_fullsized":"2024-09-12T16:54:10.923598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:22.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.035350+0000","last_change":"2024-09-12T16:51:58.173047+0000","last_active":"2024-09-12T16:52:35.035350+0000","last_peered":"2024-09-12T16:52:35.035350+0000","last_clean":"2024-09-12T16:52:35.035350+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:52:35.035350+0000","last_undegraded":"2024-09-12T16:52:35.035350+0000","last_fullsized":"2024-09-12T16:52:35.035350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.635466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.379858+0000","last_change":"2024-09-12T16:51:56.147322+0000","last_active":"2024-09-12T16:54:11.379858+0000","last_peered":"2024-09-12T16:54:11.379858+0000","last_clean":"2024-09-12T16:54:11.379858+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:54:11.379858+0000","last_undegraded":"2024-09-12T16:54:11.379858+0000","last_fullsized":"2024-09-12T16:54:11.379858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:37.340264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023414+0000","last_change":"2024-09-12T16:51:48.406183+0000","last_active":"2024-09-12T16:52:35.023414+0000","last_peered":"2024-09-12T16:52:35.023414+0000","last_clean":"2024-09-12T16:52:35.023414+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:52:35.023414+0000","last_undegraded":"2024-09-12T16:52:35.023414+0000","last_fullsized":"2024-09-12T16:52:35.023414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:06.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'5","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.551692+0000","last_change":"2024-09-12T16:52:00.160190+0000","last_active":"2024-09-12T16:55:43.551692+0000","last_peered":"2024-09-12T16:55:43.551692+0000","last_clean":"2024-09-12T16:55:43.551692+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:55:43.551692+0000","last_undegraded":"2024-09-12T16:55:43.551692+0000","last_fullsized":"2024-09-12T16:55:43.551692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:37.197687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.886587+0000","last_change":"2024-09-12T16:52:02.175160+0000","last_active":"2024-09-12T16:55:43.886587+0000","last_peered":"2024-09-12T16:55:43.886587+0000","last_clean":"2024-09-12T16:55:43.886587+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:55:43.886587+0000","last_undegraded":"2024-09-12T16:55:43.886587+0000","last_fullsized":"2024-09-12T16:55:43.886587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:03.322350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015201+0000","last_change":"2024-09-12T16:52:04.202004+0000","last_active":"2024-09-12T16:52:35.015201+0000","last_peered":"2024-09-12T16:52:35.015201+0000","last_clean":"2024-09-12T16:52:35.015201+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:52:35.015201+0000","last_undegraded":"2024-09-12T16:52:35.015201+0000","last_fullsized":"2024-09-12T16:52:35.015201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:53.277560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.293385+0000","last_change":"2024-09-12T16:52:06.230268+0000","last_active":"2024-09-12T16:54:11.293385+0000","last_peered":"2024-09-12T16:54:11.293385+0000","last_clean":"2024-09-12T16:54:11.293385+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:54:11.293385+0000","last_undegraded":"2024-09-12T16:54:11.293385+0000","last_fullsized":"2024-09-12T16:54:11.293385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:11.635227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204797+0000","last_change":"2024-09-12T16:51:58.171396+0000","last_active":"2024-09-12T16:55:12.204797+0000","last_peered":"2024-09-12T16:55:12.204797+0000","last_clean":"2024-09-12T16:55:12.204797+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:55:12.204797+0000","last_undegraded":"2024-09-12T16:55:12.204797+0000","last_fullsized":"2024-09-12T16:55:12.204797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:39.687440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.392759+0000","last_change":"2024-09-12T16:51:56.161919+0000","last_active":"2024-09-12T16:55:12.392759+0000","last_peered":"2024-09-12T16:55:12.392759+0000","last_clean":"2024-09-12T16:55:12.392759+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:12.392759+0000","last_undegraded":"2024-09-12T16:55:12.392759+0000","last_fullsized":"2024-09-12T16:55:12.392759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:31.068717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047661+0000","last_change":"2024-09-12T16:51:48.399706+0000","last_active":"2024-09-12T16:52:35.047661+0000","last_peered":"2024-09-12T16:52:35.047661+0000","last_clean":"2024-09-12T16:52:35.047661+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:52:35.047661+0000","last_undegraded":"2024-09-12T16:52:35.047661+0000","last_fullsized":"2024-09-12T16:52:35.047661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:15.814087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031695+0000","last_change":"2024-09-12T16:52:00.173390+0000","last_active":"2024-09-12T16:52:35.031695+0000","last_peered":"2024-09-12T16:52:35.031695+0000","last_clean":"2024-09-12T16:52:35.031695+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:52:35.031695+0000","last_undegraded":"2024-09-12T16:52:35.031695+0000","last_fullsized":"2024-09-12T16:52:35.031695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:45.833748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027310+0000","last_change":"2024-09-12T16:52:02.194130+0000","last_active":"2024-09-12T16:52:35.027310+0000","last_peered":"2024-09-12T16:52:35.027310+0000","last_clean":"2024-09-12T16:52:35.027310+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:52:35.027310+0000","last_undegraded":"2024-09-12T16:52:35.027310+0000","last_fullsized":"2024-09-12T16:52:35.027310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:27.141664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":391,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.575078+0000","last_change":"2024-09-12T16:52:04.193182+0000","last_active":"2024-09-12T16:55:43.575078+0000","last_peered":"2024-09-12T16:55:43.575078+0000","last_clean":"2024-09-12T16:55:43.575078+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:55:43.575078+0000","last_undegraded":"2024-09-12T16:55:43.575078+0000","last_fullsized":"2024-09-12T16:55:43.575078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:36.765558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047985+0000","last_change":"2024-09-12T16:52:06.215010+0000","last_active":"2024-09-12T16:52:35.047985+0000","last_peered":"2024-09-12T16:52:35.047985+0000","last_clean":"2024-09-12T16:52:35.047985+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:52:35.047985+0000","last_undegraded":"2024-09-12T16:52:35.047985+0000","last_fullsized":"2024-09-12T16:52:35.047985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:54.128906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.112528+0000","last_change":"2024-09-12T16:52:35.039684+0000","last_active":"2024-09-12T16:53:26.112528+0000","last_peered":"2024-09-12T16:53:26.112528+0000","last_clean":"2024-09-12T16:53:26.112528+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:53:26.112528+0000","last_undegraded":"2024-09-12T16:53:26.112528+0000","last_fullsized":"2024-09-12T16:53:26.112528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.545874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.050083+0000","last_change":"2024-09-12T16:51:56.169511+0000","last_active":"2024-09-12T16:52:35.050083+0000","last_peered":"2024-09-12T16:52:35.050083+0000","last_clean":"2024-09-12T16:52:35.050083+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:52:35.050083+0000","last_undegraded":"2024-09-12T16:52:35.050083+0000","last_fullsized":"2024-09-12T16:52:35.050083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:37.162306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025906+0000","last_change":"2024-09-12T16:51:48.405954+0000","last_active":"2024-09-12T16:52:35.025906+0000","last_peered":"2024-09-12T16:52:35.025906+0000","last_clean":"2024-09-12T16:52:35.025906+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:52:35.025906+0000","last_undegraded":"2024-09-12T16:52:35.025906+0000","last_fullsized":"2024-09-12T16:52:35.025906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022871+0000","last_change":"2024-09-12T16:52:00.171577+0000","last_active":"2024-09-12T16:52:35.022871+0000","last_peered":"2024-09-12T16:52:35.022871+0000","last_clean":"2024-09-12T16:52:35.022871+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:52:35.022871+0000","last_undegraded":"2024-09-12T16:52:35.022871+0000","last_fullsized":"2024-09-12T16:52:35.022871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.429060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034668+0000","last_change":"2024-09-12T16:52:02.213748+0000","last_active":"2024-09-12T16:52:35.034668+0000","last_peered":"2024-09-12T16:52:35.034668+0000","last_clean":"2024-09-12T16:52:35.034668+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:52:35.034668+0000","last_undegraded":"2024-09-12T16:52:35.034668+0000","last_fullsized":"2024-09-12T16:52:35.034668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:45.880129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.584131+0000","last_change":"2024-09-12T16:52:04.213686+0000","last_active":"2024-09-12T16:55:43.584131+0000","last_peered":"2024-09-12T16:55:43.584131+0000","last_clean":"2024-09-12T16:55:43.584131+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:55:43.584131+0000","last_undegraded":"2024-09-12T16:55:43.584131+0000","last_fullsized":"2024-09-12T16:55:43.584131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:03.491921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.104813+0000","last_change":"2024-09-12T16:52:06.223608+0000","last_active":"2024-09-12T16:55:12.104813+0000","last_peered":"2024-09-12T16:55:12.104813+0000","last_clean":"2024-09-12T16:55:12.104813+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:55:12.104813+0000","last_undegraded":"2024-09-12T16:55:12.104813+0000","last_fullsized":"2024-09-12T16:55:12.104813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:45.915952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405963+0000","last_change":"2024-09-12T16:51:58.169710+0000","last_active":"2024-09-12T16:55:12.405963+0000","last_peered":"2024-09-12T16:55:12.405963+0000","last_clean":"2024-09-12T16:55:12.405963+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:55:12.405963+0000","last_undegraded":"2024-09-12T16:55:12.405963+0000","last_fullsized":"2024-09-12T16:55:12.405963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:19.057567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.384261+0000","last_change":"2024-09-12T16:51:56.158532+0000","last_active":"2024-09-12T16:55:12.384261+0000","last_peered":"2024-09-12T16:55:12.384261+0000","last_clean":"2024-09-12T16:55:12.384261+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:12.384261+0000","last_undegraded":"2024-09-12T16:55:12.384261+0000","last_fullsized":"2024-09-12T16:55:12.384261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:54.713058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049659+0000","last_change":"2024-09-12T16:51:48.400908+0000","last_active":"2024-09-12T16:52:35.049659+0000","last_peered":"2024-09-12T16:52:35.049659+0000","last_clean":"2024-09-12T16:52:35.049659+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:52:35.049659+0000","last_undegraded":"2024-09-12T16:52:35.049659+0000","last_fullsized":"2024-09-12T16:52:35.049659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:45.370506+0000","last_clean_scrub_stamp":"2024-09-12T16:51:45.370506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:25.059679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021940+0000","last_change":"2024-09-12T16:52:00.177682+0000","last_active":"2024-09-12T16:52:35.021940+0000","last_peered":"2024-09-12T16:52:35.021940+0000","last_clean":"2024-09-12T16:52:35.021940+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:52:35.021940+0000","last_undegraded":"2024-09-12T16:52:35.021940+0000","last_fullsized":"2024-09-12T16:52:35.021940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:07.415377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.858986+0000","last_change":"2024-09-12T16:52:02.187458+0000","last_active":"2024-09-12T16:55:43.858986+0000","last_peered":"2024-09-12T16:55:43.858986+0000","last_clean":"2024-09-12T16:55:43.858986+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:55:43.858986+0000","last_undegraded":"2024-09-12T16:55:43.858986+0000","last_fullsized":"2024-09-12T16:55:43.858986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:39.799750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021656+0000","last_change":"2024-09-12T16:52:04.205957+0000","last_active":"2024-09-12T16:52:35.021656+0000","last_peered":"2024-09-12T16:52:35.021656+0000","last_clean":"2024-09-12T16:52:35.021656+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:52:35.021656+0000","last_undegraded":"2024-09-12T16:52:35.021656+0000","last_fullsized":"2024-09-12T16:52:35.021656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:09.625513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027967+0000","last_change":"2024-09-12T16:52:06.226131+0000","last_active":"2024-09-12T16:52:35.027967+0000","last_peered":"2024-09-12T16:52:35.027967+0000","last_clean":"2024-09-12T16:52:35.027967+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:52:35.027967+0000","last_undegraded":"2024-09-12T16:52:35.027967+0000","last_fullsized":"2024-09-12T16:52:35.027967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:27.891759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.467476+0000","last_change":"2024-09-12T16:52:06.233870+0000","last_active":"2024-09-12T16:55:12.467476+0000","last_peered":"2024-09-12T16:55:12.467476+0000","last_clean":"2024-09-12T16:55:12.467476+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:55:12.467476+0000","last_undegraded":"2024-09-12T16:55:12.467476+0000","last_fullsized":"2024-09-12T16:55:12.467476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:37.518504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.761344+0000","last_change":"2024-09-12T16:51:58.170146+0000","last_active":"2024-09-12T16:53:25.761344+0000","last_peered":"2024-09-12T16:53:25.761344+0000","last_clean":"2024-09-12T16:53:25.761344+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:53:25.761344+0000","last_undegraded":"2024-09-12T16:53:25.761344+0000","last_fullsized":"2024-09-12T16:53:25.761344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:48.025016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.357950+0000","last_change":"2024-09-12T16:51:56.163750+0000","last_active":"2024-09-12T16:55:12.357950+0000","last_peered":"2024-09-12T16:55:12.357950+0000","last_clean":"2024-09-12T16:55:12.357950+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:55:12.357950+0000","last_undegraded":"2024-09-12T16:55:12.357950+0000","last_fullsized":"2024-09-12T16:55:12.357950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:47.582510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032193+0000","last_change":"2024-09-12T16:52:00.176219+0000","last_active":"2024-09-12T16:52:35.032193+0000","last_peered":"2024-09-12T16:52:35.032193+0000","last_clean":"2024-09-12T16:52:35.032193+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:52:35.032193+0000","last_undegraded":"2024-09-12T16:52:35.032193+0000","last_fullsized":"2024-09-12T16:52:35.032193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:21.686238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.696470+0000","last_change":"2024-09-12T16:52:02.194377+0000","last_active":"2024-09-12T16:55:43.696470+0000","last_peered":"2024-09-12T16:55:43.696470+0000","last_clean":"2024-09-12T16:55:43.696470+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:55:43.696470+0000","last_undegraded":"2024-09-12T16:55:43.696470+0000","last_fullsized":"2024-09-12T16:55:43.696470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:35.662292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024735+0000","last_change":"2024-09-12T16:52:04.215450+0000","last_active":"2024-09-12T16:52:35.024735+0000","last_peered":"2024-09-12T16:52:35.024735+0000","last_clean":"2024-09-12T16:52:35.024735+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:52:35.024735+0000","last_undegraded":"2024-09-12T16:52:35.024735+0000","last_fullsized":"2024-09-12T16:52:35.024735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.120052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.497182+0000","last_change":"2024-09-12T16:52:06.212418+0000","last_active":"2024-09-12T16:55:12.497182+0000","last_peered":"2024-09-12T16:55:12.497182+0000","last_clean":"2024-09-12T16:55:12.497182+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:55:12.497182+0000","last_undegraded":"2024-09-12T16:55:12.497182+0000","last_fullsized":"2024-09-12T16:55:12.497182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:57.649089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'27","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.424657+0000","last_change":"2024-09-12T16:51:58.172876+0000","last_active":"2024-09-12T16:55:12.424657+0000","last_peered":"2024-09-12T16:55:12.424657+0000","last_clean":"2024-09-12T16:55:12.424657+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.424657+0000","last_undegraded":"2024-09-12T16:55:12.424657+0000","last_fullsized":"2024-09-12T16:55:12.424657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:16.676112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020927+0000","last_change":"2024-09-12T16:51:56.152311+0000","last_active":"2024-09-12T16:52:35.020927+0000","last_peered":"2024-09-12T16:52:35.020927+0000","last_clean":"2024-09-12T16:52:35.020927+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:52:35.020927+0000","last_undegraded":"2024-09-12T16:52:35.020927+0000","last_fullsized":"2024-09-12T16:52:35.020927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:31.068717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034344+0000","last_change":"2024-09-12T16:52:00.183813+0000","last_active":"2024-09-12T16:52:35.034344+0000","last_peered":"2024-09-12T16:52:35.034344+0000","last_clean":"2024-09-12T16:52:35.034344+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:52:35.034344+0000","last_undegraded":"2024-09-12T16:52:35.034344+0000","last_fullsized":"2024-09-12T16:52:35.034344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.454514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.479969+0000","last_change":"2024-09-12T16:52:02.184368+0000","last_active":"2024-09-12T16:55:11.479969+0000","last_peered":"2024-09-12T16:55:11.479969+0000","last_clean":"2024-09-12T16:55:11.479969+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:55:11.479969+0000","last_undegraded":"2024-09-12T16:55:11.479969+0000","last_fullsized":"2024-09-12T16:55:11.479969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:55.116071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017383+0000","last_change":"2024-09-12T16:52:04.216686+0000","last_active":"2024-09-12T16:52:35.017383+0000","last_peered":"2024-09-12T16:52:35.017383+0000","last_clean":"2024-09-12T16:52:35.017383+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:52:35.017383+0000","last_undegraded":"2024-09-12T16:52:35.017383+0000","last_fullsized":"2024-09-12T16:52:35.017383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.665774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022183+0000","last_change":"2024-09-12T16:52:06.225236+0000","last_active":"2024-09-12T16:52:35.022183+0000","last_peered":"2024-09-12T16:52:35.022183+0000","last_clean":"2024-09-12T16:52:35.022183+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:52:35.022183+0000","last_undegraded":"2024-09-12T16:52:35.022183+0000","last_fullsized":"2024-09-12T16:52:35.022183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.292498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559427+0000","last_change":"2024-09-12T16:51:58.171912+0000","last_active":"2024-09-12T16:55:12.559427+0000","last_peered":"2024-09-12T16:55:12.559427+0000","last_clean":"2024-09-12T16:55:12.559427+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:55:12.559427+0000","last_undegraded":"2024-09-12T16:55:12.559427+0000","last_fullsized":"2024-09-12T16:55:12.559427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:33.118187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.866905+0000","last_change":"2024-09-12T16:51:56.153340+0000","last_active":"2024-09-12T16:55:11.866905+0000","last_peered":"2024-09-12T16:55:11.866905+0000","last_clean":"2024-09-12T16:55:11.866905+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:55:11.866905+0000","last_undegraded":"2024-09-12T16:55:11.866905+0000","last_fullsized":"2024-09-12T16:55:11.866905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:43.389321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017569+0000","last_change":"2024-09-12T16:52:00.163603+0000","last_active":"2024-09-12T16:52:35.017569+0000","last_peered":"2024-09-12T16:52:35.017569+0000","last_clean":"2024-09-12T16:52:35.017569+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:52:35.017569+0000","last_undegraded":"2024-09-12T16:52:35.017569+0000","last_fullsized":"2024-09-12T16:52:35.017569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:17.118266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.868200+0000","last_change":"2024-09-12T16:52:02.180694+0000","last_active":"2024-09-12T16:55:43.868200+0000","last_peered":"2024-09-12T16:55:43.868200+0000","last_clean":"2024-09-12T16:55:43.868200+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:55:43.868200+0000","last_undegraded":"2024-09-12T16:55:43.868200+0000","last_fullsized":"2024-09-12T16:55:43.868200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.028291+0000","last_change":"2024-09-12T16:52:04.200667+0000","last_active":"2024-09-12T16:52:35.028291+0000","last_peered":"2024-09-12T16:52:35.028291+0000","last_clean":"2024-09-12T16:52:35.028291+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:52:35.028291+0000","last_undegraded":"2024-09-12T16:52:35.028291+0000","last_fullsized":"2024-09-12T16:52:35.028291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.487906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039574+0000","last_change":"2024-09-12T16:52:06.236861+0000","last_active":"2024-09-12T16:52:35.039574+0000","last_peered":"2024-09-12T16:52:35.039574+0000","last_clean":"2024-09-12T16:52:35.039574+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:52:35.039574+0000","last_undegraded":"2024-09-12T16:52:35.039574+0000","last_fullsized":"2024-09-12T16:52:35.039574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:29.568087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114298+0000","last_change":"2024-09-12T16:51:58.168169+0000","last_active":"2024-09-12T16:53:26.114298+0000","last_peered":"2024-09-12T16:53:26.114298+0000","last_clean":"2024-09-12T16:53:26.114298+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:53:26.114298+0000","last_undegraded":"2024-09-12T16:53:26.114298+0000","last_fullsized":"2024-09-12T16:53:26.114298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:56.585276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046409+0000","last_change":"2024-09-12T16:51:56.158362+0000","last_active":"2024-09-12T16:52:35.046409+0000","last_peered":"2024-09-12T16:52:35.046409+0000","last_clean":"2024-09-12T16:52:35.046409+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:52:35.046409+0000","last_undegraded":"2024-09-12T16:52:35.046409+0000","last_fullsized":"2024-09-12T16:52:35.046409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:58.692768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022824+0000","last_change":"2024-09-12T16:52:00.181358+0000","last_active":"2024-09-12T16:52:35.022824+0000","last_peered":"2024-09-12T16:52:35.022824+0000","last_clean":"2024-09-12T16:52:35.022824+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:52:35.022824+0000","last_undegraded":"2024-09-12T16:52:35.022824+0000","last_fullsized":"2024-09-12T16:52:35.022824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:32.384807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.843427+0000","last_change":"2024-09-12T16:52:02.181716+0000","last_active":"2024-09-12T16:55:43.843427+0000","last_peered":"2024-09-12T16:55:43.843427+0000","last_clean":"2024-09-12T16:55:43.843427+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:55:43.843427+0000","last_undegraded":"2024-09-12T16:55:43.843427+0000","last_fullsized":"2024-09-12T16:55:43.843427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.238474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016494+0000","last_change":"2024-09-12T16:52:04.211716+0000","last_active":"2024-09-12T16:52:35.016494+0000","last_peered":"2024-09-12T16:52:35.016494+0000","last_clean":"2024-09-12T16:52:35.016494+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:52:35.016494+0000","last_undegraded":"2024-09-12T16:52:35.016494+0000","last_fullsized":"2024-09-12T16:52:35.016494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.708673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406316+0000","last_change":"2024-09-12T16:51:58.158927+0000","last_active":"2024-09-12T16:55:12.406316+0000","last_peered":"2024-09-12T16:55:12.406316+0000","last_clean":"2024-09-12T16:55:12.406316+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:55:12.406316+0000","last_undegraded":"2024-09-12T16:55:12.406316+0000","last_fullsized":"2024-09-12T16:55:12.406316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:52.129370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022527+0000","last_change":"2024-09-12T16:51:56.157350+0000","last_active":"2024-09-12T16:52:35.022527+0000","last_peered":"2024-09-12T16:52:35.022527+0000","last_clean":"2024-09-12T16:52:35.022527+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:52:35.022527+0000","last_undegraded":"2024-09-12T16:52:35.022527+0000","last_fullsized":"2024-09-12T16:52:35.022527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:35.055723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025762+0000","last_change":"2024-09-12T16:52:00.159525+0000","last_active":"2024-09-12T16:52:35.025762+0000","last_peered":"2024-09-12T16:52:35.025762+0000","last_clean":"2024-09-12T16:52:35.025762+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:52:35.025762+0000","last_undegraded":"2024-09-12T16:52:35.025762+0000","last_fullsized":"2024-09-12T16:52:35.025762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:04.399510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.835655+0000","last_change":"2024-09-12T16:52:02.184114+0000","last_active":"2024-09-12T16:55:43.835655+0000","last_peered":"2024-09-12T16:55:43.835655+0000","last_clean":"2024-09-12T16:55:43.835655+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:55:43.835655+0000","last_undegraded":"2024-09-12T16:55:43.835655+0000","last_fullsized":"2024-09-12T16:55:43.835655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:51.260998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016853+0000","last_change":"2024-09-12T16:52:04.212854+0000","last_active":"2024-09-12T16:52:35.016853+0000","last_peered":"2024-09-12T16:52:35.016853+0000","last_clean":"2024-09-12T16:52:35.016853+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:52:35.016853+0000","last_undegraded":"2024-09-12T16:52:35.016853+0000","last_fullsized":"2024-09-12T16:52:35.016853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:31.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.284031+0000","last_change":"2024-09-12T16:52:06.224912+0000","last_active":"2024-09-12T16:54:11.284031+0000","last_peered":"2024-09-12T16:54:11.284031+0000","last_clean":"2024-09-12T16:54:11.284031+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:54:11.284031+0000","last_undegraded":"2024-09-12T16:54:11.284031+0000","last_fullsized":"2024-09-12T16:54:11.284031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:53.469591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762074+0000","last_change":"2024-09-12T16:51:58.157261+0000","last_active":"2024-09-12T16:53:25.762074+0000","last_peered":"2024-09-12T16:53:25.762074+0000","last_clean":"2024-09-12T16:53:25.762074+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:53:25.762074+0000","last_undegraded":"2024-09-12T16:53:25.762074+0000","last_fullsized":"2024-09-12T16:53:25.762074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:49.731949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.546723+0000","last_change":"2024-09-12T16:51:56.145141+0000","last_active":"2024-09-12T16:55:12.546723+0000","last_peered":"2024-09-12T16:55:12.546723+0000","last_clean":"2024-09-12T16:55:12.546723+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:12.546723+0000","last_undegraded":"2024-09-12T16:55:12.546723+0000","last_fullsized":"2024-09-12T16:55:12.546723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:56.176046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026467+0000","last_change":"2024-09-12T16:52:00.164196+0000","last_active":"2024-09-12T16:52:35.026467+0000","last_peered":"2024-09-12T16:52:35.026467+0000","last_clean":"2024-09-12T16:52:35.026467+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:52:35.026467+0000","last_undegraded":"2024-09-12T16:52:35.026467+0000","last_fullsized":"2024-09-12T16:52:35.026467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:24.903329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.851345+0000","last_change":"2024-09-12T16:52:02.212469+0000","last_active":"2024-09-12T16:55:43.851345+0000","last_peered":"2024-09-12T16:55:43.851345+0000","last_clean":"2024-09-12T16:55:43.851345+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:55:43.851345+0000","last_undegraded":"2024-09-12T16:55:43.851345+0000","last_fullsized":"2024-09-12T16:55:43.851345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043455+0000","last_change":"2024-09-12T16:52:04.211092+0000","last_active":"2024-09-12T16:52:35.043455+0000","last_peered":"2024-09-12T16:52:35.043455+0000","last_clean":"2024-09-12T16:52:35.043455+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:52:35.043455+0000","last_undegraded":"2024-09-12T16:52:35.043455+0000","last_fullsized":"2024-09-12T16:52:35.043455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:37.948154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031153+0000","last_change":"2024-09-12T16:52:06.224892+0000","last_active":"2024-09-12T16:52:35.031153+0000","last_peered":"2024-09-12T16:52:35.031153+0000","last_clean":"2024-09-12T16:52:35.031153+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:52:35.031153+0000","last_undegraded":"2024-09-12T16:52:35.031153+0000","last_fullsized":"2024-09-12T16:52:35.031153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:23.862554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406528+0000","last_change":"2024-09-12T16:51:58.175046+0000","last_active":"2024-09-12T16:55:12.406528+0000","last_peered":"2024-09-12T16:55:12.406528+0000","last_clean":"2024-09-12T16:55:12.406528+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:55:12.406528+0000","last_undegraded":"2024-09-12T16:55:12.406528+0000","last_fullsized":"2024-09-12T16:55:12.406528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:23.110954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032546+0000","last_change":"2024-09-12T16:51:56.166124+0000","last_active":"2024-09-12T16:52:35.032546+0000","last_peered":"2024-09-12T16:52:35.032546+0000","last_clean":"2024-09-12T16:52:35.032546+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:52:35.032546+0000","last_undegraded":"2024-09-12T16:52:35.032546+0000","last_fullsized":"2024-09-12T16:52:35.032546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:37.152636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019381+0000","last_change":"2024-09-12T16:52:00.168294+0000","last_active":"2024-09-12T16:52:35.019381+0000","last_peered":"2024-09-12T16:52:35.019381+0000","last_clean":"2024-09-12T16:52:35.019381+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:52:35.019381+0000","last_undegraded":"2024-09-12T16:52:35.019381+0000","last_fullsized":"2024-09-12T16:52:35.019381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:51.062344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.717682+0000","last_change":"2024-09-12T16:52:02.196172+0000","last_active":"2024-09-12T16:55:43.717682+0000","last_peered":"2024-09-12T16:55:43.717682+0000","last_clean":"2024-09-12T16:55:43.717682+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:55:43.717682+0000","last_undegraded":"2024-09-12T16:55:43.717682+0000","last_fullsized":"2024-09-12T16:55:43.717682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:02.649211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024118+0000","last_change":"2024-09-12T16:52:04.215112+0000","last_active":"2024-09-12T16:52:35.024118+0000","last_peered":"2024-09-12T16:52:35.024118+0000","last_clean":"2024-09-12T16:52:35.024118+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:52:35.024118+0000","last_undegraded":"2024-09-12T16:52:35.024118+0000","last_fullsized":"2024-09-12T16:52:35.024118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:24.385068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.437862+0000","last_change":"2024-09-12T16:52:06.234025+0000","last_active":"2024-09-12T16:54:11.437862+0000","last_peered":"2024-09-12T16:54:11.437862+0000","last_clean":"2024-09-12T16:54:11.437862+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:54:11.437862+0000","last_undegraded":"2024-09-12T16:54:11.437862+0000","last_fullsized":"2024-09-12T16:54:11.437862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:23.554247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491550+0000","last_change":"2024-09-12T16:51:58.153302+0000","last_active":"2024-09-12T16:55:12.491550+0000","last_peered":"2024-09-12T16:55:12.491550+0000","last_clean":"2024-09-12T16:55:12.491550+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:55:12.491550+0000","last_undegraded":"2024-09-12T16:55:12.491550+0000","last_fullsized":"2024-09-12T16:55:12.491550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:40.425831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.374105+0000","last_change":"2024-09-12T16:51:56.163659+0000","last_active":"2024-09-12T16:55:12.374105+0000","last_peered":"2024-09-12T16:55:12.374105+0000","last_clean":"2024-09-12T16:55:12.374105+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:55:12.374105+0000","last_undegraded":"2024-09-12T16:55:12.374105+0000","last_fullsized":"2024-09-12T16:55:12.374105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:06.765327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043977+0000","last_change":"2024-09-12T16:52:00.162650+0000","last_active":"2024-09-12T16:52:35.043977+0000","last_peered":"2024-09-12T16:52:35.043977+0000","last_clean":"2024-09-12T16:52:35.043977+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:52:35.043977+0000","last_undegraded":"2024-09-12T16:52:35.043977+0000","last_fullsized":"2024-09-12T16:52:35.043977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.597418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.050080+0000","last_change":"2024-09-12T16:52:02.216308+0000","last_active":"2024-09-12T16:52:35.050080+0000","last_peered":"2024-09-12T16:52:35.050080+0000","last_clean":"2024-09-12T16:52:35.050080+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:52:35.050080+0000","last_undegraded":"2024-09-12T16:52:35.050080+0000","last_fullsized":"2024-09-12T16:52:35.050080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:12.930560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":377,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.571876+0000","last_change":"2024-09-12T16:52:04.219251+0000","last_active":"2024-09-12T16:55:43.571876+0000","last_peered":"2024-09-12T16:55:43.571876+0000","last_clean":"2024-09-12T16:55:43.571876+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:55:43.571876+0000","last_undegraded":"2024-09-12T16:55:43.571876+0000","last_fullsized":"2024-09-12T16:55:43.571876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.043443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020791+0000","last_change":"2024-09-12T16:52:06.232237+0000","last_active":"2024-09-12T16:52:35.020791+0000","last_peered":"2024-09-12T16:52:35.020791+0000","last_clean":"2024-09-12T16:52:35.020791+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:52:35.020791+0000","last_undegraded":"2024-09-12T16:52:35.020791+0000","last_fullsized":"2024-09-12T16:52:35.020791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:08.018725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.407369+0000","last_change":"2024-09-12T16:51:58.142849+0000","last_active":"2024-09-12T16:55:12.407369+0000","last_peered":"2024-09-12T16:55:12.407369+0000","last_clean":"2024-09-12T16:55:12.407369+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:55:12.407369+0000","last_undegraded":"2024-09-12T16:55:12.407369+0000","last_fullsized":"2024-09-12T16:55:12.407369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.603060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043118+0000","last_change":"2024-09-12T16:51:56.145893+0000","last_active":"2024-09-12T16:52:35.043118+0000","last_peered":"2024-09-12T16:52:35.043118+0000","last_clean":"2024-09-12T16:52:35.043118+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:52:35.043118+0000","last_undegraded":"2024-09-12T16:52:35.043118+0000","last_fullsized":"2024-09-12T16:52:35.043118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:01.454908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031597+0000","last_change":"2024-09-12T16:52:00.179417+0000","last_active":"2024-09-12T16:52:35.031597+0000","last_peered":"2024-09-12T16:52:35.031597+0000","last_clean":"2024-09-12T16:52:35.031597+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:52:35.031597+0000","last_undegraded":"2024-09-12T16:52:35.031597+0000","last_fullsized":"2024-09-12T16:52:35.031597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:39.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.762354+0000","last_change":"2024-09-12T16:52:02.182087+0000","last_active":"2024-09-12T16:55:43.762354+0000","last_peered":"2024-09-12T16:55:43.762354+0000","last_clean":"2024-09-12T16:55:43.762354+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:55:43.762354+0000","last_undegraded":"2024-09-12T16:55:43.762354+0000","last_fullsized":"2024-09-12T16:55:43.762354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:10.821781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021023+0000","last_change":"2024-09-12T16:52:04.206758+0000","last_active":"2024-09-12T16:52:35.021023+0000","last_peered":"2024-09-12T16:52:35.021023+0000","last_clean":"2024-09-12T16:52:35.021023+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:52:35.021023+0000","last_undegraded":"2024-09-12T16:52:35.021023+0000","last_fullsized":"2024-09-12T16:52:35.021023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.089165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047680+0000","last_change":"2024-09-12T16:52:06.224320+0000","last_active":"2024-09-12T16:52:35.047680+0000","last_peered":"2024-09-12T16:52:35.047680+0000","last_clean":"2024-09-12T16:52:35.047680+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:52:35.047680+0000","last_undegraded":"2024-09-12T16:52:35.047680+0000","last_fullsized":"2024-09-12T16:52:35.047680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:34.785095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.062896+0000","last_change":"2024-09-12T16:51:58.141944+0000","last_active":"2024-09-12T16:55:12.062896+0000","last_peered":"2024-09-12T16:55:12.062896+0000","last_clean":"2024-09-12T16:55:12.062896+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:55:12.062896+0000","last_undegraded":"2024-09-12T16:55:12.062896+0000","last_fullsized":"2024-09-12T16:55:12.062896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047893+0000","last_change":"2024-09-12T16:51:56.169511+0000","last_active":"2024-09-12T16:52:35.047893+0000","last_peered":"2024-09-12T16:52:35.047893+0000","last_clean":"2024-09-12T16:52:35.047893+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:52:35.047893+0000","last_undegraded":"2024-09-12T16:52:35.047893+0000","last_fullsized":"2024-09-12T16:52:35.047893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:28.067613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020018+0000","last_change":"2024-09-12T16:52:00.183375+0000","last_active":"2024-09-12T16:52:35.020018+0000","last_peered":"2024-09-12T16:52:35.020018+0000","last_clean":"2024-09-12T16:52:35.020018+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:52:35.020018+0000","last_undegraded":"2024-09-12T16:52:35.020018+0000","last_fullsized":"2024-09-12T16:52:35.020018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.969978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.771290+0000","last_change":"2024-09-12T16:52:02.175268+0000","last_active":"2024-09-12T16:55:43.771290+0000","last_peered":"2024-09-12T16:55:43.771290+0000","last_clean":"2024-09-12T16:55:43.771290+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:55:43.771290+0000","last_undegraded":"2024-09-12T16:55:43.771290+0000","last_fullsized":"2024-09-12T16:55:43.771290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:54.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022138+0000","last_change":"2024-09-12T16:52:04.209135+0000","last_active":"2024-09-12T16:52:35.022138+0000","last_peered":"2024-09-12T16:52:35.022138+0000","last_clean":"2024-09-12T16:52:35.022138+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:52:35.022138+0000","last_undegraded":"2024-09-12T16:52:35.022138+0000","last_fullsized":"2024-09-12T16:52:35.022138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:49.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.442179+0000","last_change":"2024-09-12T16:52:06.237385+0000","last_active":"2024-09-12T16:54:11.442179+0000","last_peered":"2024-09-12T16:54:11.442179+0000","last_clean":"2024-09-12T16:54:11.442179+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:54:11.442179+0000","last_undegraded":"2024-09-12T16:54:11.442179+0000","last_fullsized":"2024-09-12T16:54:11.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:58.165732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406440+0000","last_change":"2024-09-12T16:51:58.168050+0000","last_active":"2024-09-12T16:55:12.406440+0000","last_peered":"2024-09-12T16:55:12.406440+0000","last_clean":"2024-09-12T16:55:12.406440+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:55:12.406440+0000","last_undegraded":"2024-09-12T16:55:12.406440+0000","last_fullsized":"2024-09-12T16:55:12.406440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:30.432926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.563604+0000","last_change":"2024-09-12T16:51:56.158228+0000","last_active":"2024-09-12T16:52:42.563604+0000","last_peered":"2024-09-12T16:52:42.563604+0000","last_clean":"2024-09-12T16:52:42.563604+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:52:42.563604+0000","last_undegraded":"2024-09-12T16:52:42.563604+0000","last_fullsized":"2024-09-12T16:52:42.563604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:35.587454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022978+0000","last_change":"2024-09-12T16:52:00.162253+0000","last_active":"2024-09-12T16:52:35.022978+0000","last_peered":"2024-09-12T16:52:35.022978+0000","last_clean":"2024-09-12T16:52:35.022978+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:52:35.022978+0000","last_undegraded":"2024-09-12T16:52:35.022978+0000","last_fullsized":"2024-09-12T16:52:35.022978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:02.417426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'30","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.705579+0000","last_change":"2024-09-12T16:52:02.212684+0000","last_active":"2024-09-12T16:55:43.705579+0000","last_peered":"2024-09-12T16:55:43.705579+0000","last_clean":"2024-09-12T16:55:43.705579+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:55:43.705579+0000","last_undegraded":"2024-09-12T16:55:43.705579+0000","last_fullsized":"2024-09-12T16:55:43.705579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:00.299441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032673+0000","last_change":"2024-09-12T16:52:04.209557+0000","last_active":"2024-09-12T16:52:35.032673+0000","last_peered":"2024-09-12T16:52:35.032673+0000","last_clean":"2024-09-12T16:52:35.032673+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:52:35.032673+0000","last_undegraded":"2024-09-12T16:52:35.032673+0000","last_fullsized":"2024-09-12T16:52:35.032673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:33.026740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.024814+0000","last_change":"2024-09-12T16:52:06.234752+0000","last_active":"2024-09-12T16:54:09.024814+0000","last_peered":"2024-09-12T16:54:09.024814+0000","last_clean":"2024-09-12T16:54:09.024814+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:54:09.024814+0000","last_undegraded":"2024-09-12T16:54:09.024814+0000","last_fullsized":"2024-09-12T16:54:09.024814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.433924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406497+0000","last_change":"2024-09-12T16:51:58.141857+0000","last_active":"2024-09-12T16:55:12.406497+0000","last_peered":"2024-09-12T16:55:12.406497+0000","last_clean":"2024-09-12T16:55:12.406497+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:55:12.406497+0000","last_undegraded":"2024-09-12T16:55:12.406497+0000","last_fullsized":"2024-09-12T16:55:12.406497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:34.368226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.365932+0000","last_change":"2024-09-12T16:51:56.157950+0000","last_active":"2024-09-12T16:55:12.365932+0000","last_peered":"2024-09-12T16:55:12.365932+0000","last_clean":"2024-09-12T16:55:12.365932+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:12.365932+0000","last_undegraded":"2024-09-12T16:55:12.365932+0000","last_fullsized":"2024-09-12T16:55:12.365932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:44.984215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:07.263520+0000","last_change":"2024-09-12T16:52:00.163609+0000","last_active":"2024-09-12T16:54:07.263520+0000","last_peered":"2024-09-12T16:54:07.263520+0000","last_clean":"2024-09-12T16:54:07.263520+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:54:07.263520+0000","last_undegraded":"2024-09-12T16:54:07.263520+0000","last_fullsized":"2024-09-12T16:54:07.263520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:40.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.723783+0000","last_change":"2024-09-12T16:52:02.212039+0000","last_active":"2024-09-12T16:55:43.723783+0000","last_peered":"2024-09-12T16:55:43.723783+0000","last_clean":"2024-09-12T16:55:43.723783+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:55:43.723783+0000","last_undegraded":"2024-09-12T16:55:43.723783+0000","last_fullsized":"2024-09-12T16:55:43.723783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:30.940482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022180+0000","last_change":"2024-09-12T16:52:04.194659+0000","last_active":"2024-09-12T16:52:35.022180+0000","last_peered":"2024-09-12T16:52:35.022180+0000","last_clean":"2024-09-12T16:52:35.022180+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:52:35.022180+0000","last_undegraded":"2024-09-12T16:52:35.022180+0000","last_fullsized":"2024-09-12T16:52:35.022180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:10.799769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.029336+0000","last_change":"2024-09-12T16:52:06.237422+0000","last_active":"2024-09-12T16:54:09.029336+0000","last_peered":"2024-09-12T16:54:09.029336+0000","last_clean":"2024-09-12T16:54:09.029336+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:54:09.029336+0000","last_undegraded":"2024-09-12T16:54:09.029336+0000","last_fullsized":"2024-09-12T16:54:09.029336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:35.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.020472+0000","last_change":"2024-09-12T16:51:58.171119+0000","last_active":"2024-09-12T16:54:11.020472+0000","last_peered":"2024-09-12T16:54:11.020472+0000","last_clean":"2024-09-12T16:54:11.020472+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:54:11.020472+0000","last_undegraded":"2024-09-12T16:54:11.020472+0000","last_fullsized":"2024-09-12T16:54:11.020472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:42.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015512+0000","last_change":"2024-09-12T16:51:56.153106+0000","last_active":"2024-09-12T16:52:35.015512+0000","last_peered":"2024-09-12T16:52:35.015512+0000","last_clean":"2024-09-12T16:52:35.015512+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:52:35.015512+0000","last_undegraded":"2024-09-12T16:52:35.015512+0000","last_fullsized":"2024-09-12T16:52:35.015512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:35.393789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'13","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450215+0000","last_change":"2024-09-12T16:51:58.149936+0000","last_active":"2024-09-12T16:54:11.450215+0000","last_peered":"2024-09-12T16:54:11.450215+0000","last_clean":"2024-09-12T16:54:11.450215+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:54:11.450215+0000","last_undegraded":"2024-09-12T16:54:11.450215+0000","last_fullsized":"2024-09-12T16:54:11.450215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:45.542639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.109318+0000","last_change":"2024-09-12T16:51:56.165393+0000","last_active":"2024-09-12T16:54:11.109318+0000","last_peered":"2024-09-12T16:54:11.109318+0000","last_clean":"2024-09-12T16:54:11.109318+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:54:11.109318+0000","last_undegraded":"2024-09-12T16:54:11.109318+0000","last_fullsized":"2024-09-12T16:54:11.109318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:22.213222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559962+0000","last_change":"2024-09-12T16:51:58.172460+0000","last_active":"2024-09-12T16:55:12.559962+0000","last_peered":"2024-09-12T16:55:12.559962+0000","last_clean":"2024-09-12T16:55:12.559962+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:55:12.559962+0000","last_undegraded":"2024-09-12T16:55:12.559962+0000","last_fullsized":"2024-09-12T16:55:12.559962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:11.477678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033006+0000","last_change":"2024-09-12T16:51:56.154964+0000","last_active":"2024-09-12T16:52:35.033006+0000","last_peered":"2024-09-12T16:52:35.033006+0000","last_clean":"2024-09-12T16:52:35.033006+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:52:35.033006+0000","last_undegraded":"2024-09-12T16:52:35.033006+0000","last_fullsized":"2024-09-12T16:52:35.033006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:09.313014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206890+0000","last_change":"2024-09-12T16:51:58.153420+0000","last_active":"2024-09-12T16:55:12.206890+0000","last_peered":"2024-09-12T16:55:12.206890+0000","last_clean":"2024-09-12T16:55:12.206890+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:55:12.206890+0000","last_undegraded":"2024-09-12T16:55:12.206890+0000","last_fullsized":"2024-09-12T16:55:12.206890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:45.866817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.748616+0000","last_change":"2024-09-12T16:51:56.170783+0000","last_active":"2024-09-12T16:54:06.748616+0000","last_peered":"2024-09-12T16:54:06.748616+0000","last_clean":"2024-09-12T16:54:06.748616+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:54:06.748616+0000","last_undegraded":"2024-09-12T16:54:06.748616+0000","last_fullsized":"2024-09-12T16:54:06.748616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:07.556912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.059507+0000","last_change":"2024-09-12T16:52:35.058216+0000","last_active":"2024-09-12T16:52:35.059507+0000","last_peered":"2024-09-12T16:52:35.059507+0000","last_clean":"2024-09-12T16:52:35.059507+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:52:35.059507+0000","last_undegraded":"2024-09-12T16:52:35.059507+0000","last_fullsized":"2024-09-12T16:52:35.059507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:04.174584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024027+0000","last_change":"2024-09-12T16:51:56.159691+0000","last_active":"2024-09-12T16:52:35.024027+0000","last_peered":"2024-09-12T16:52:35.024027+0000","last_clean":"2024-09-12T16:52:35.024027+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:52:35.024027+0000","last_undegraded":"2024-09-12T16:52:35.024027+0000","last_fullsized":"2024-09-12T16:52:35.024027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.592397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038033+0000","last_change":"2024-09-12T16:51:58.173240+0000","last_active":"2024-09-12T16:52:35.038033+0000","last_peered":"2024-09-12T16:52:35.038033+0000","last_clean":"2024-09-12T16:52:35.038033+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:52:35.038033+0000","last_undegraded":"2024-09-12T16:52:35.038033+0000","last_fullsized":"2024-09-12T16:52:35.038033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:49.259251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.573852+0000","last_change":"2024-09-12T16:51:56.165516+0000","last_active":"2024-09-12T16:52:42.573852+0000","last_peered":"2024-09-12T16:52:42.573852+0000","last_clean":"2024-09-12T16:52:42.573852+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:52:42.573852+0000","last_undegraded":"2024-09-12T16:52:42.573852+0000","last_fullsized":"2024-09-12T16:52:42.573852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:35.139651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762612+0000","last_change":"2024-09-12T16:51:58.149306+0000","last_active":"2024-09-12T16:53:25.762612+0000","last_peered":"2024-09-12T16:53:25.762612+0000","last_clean":"2024-09-12T16:53:25.762612+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:53:25.762612+0000","last_undegraded":"2024-09-12T16:53:25.762612+0000","last_fullsized":"2024-09-12T16:53:25.762612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092689+0000","last_change":"2024-09-12T16:51:56.150773+0000","last_active":"2024-09-12T16:52:41.092689+0000","last_peered":"2024-09-12T16:52:41.092689+0000","last_clean":"2024-09-12T16:52:41.092689+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:52:41.092689+0000","last_undegraded":"2024-09-12T16:52:41.092689+0000","last_fullsized":"2024-09-12T16:52:41.092689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:22.213222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.220234+0000","last_change":"2024-09-12T16:51:58.162339+0000","last_active":"2024-09-12T16:55:12.220234+0000","last_peered":"2024-09-12T16:55:12.220234+0000","last_clean":"2024-09-12T16:55:12.220234+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:55:12.220234+0000","last_undegraded":"2024-09-12T16:55:12.220234+0000","last_fullsized":"2024-09-12T16:55:12.220234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:52.597412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092203+0000","last_change":"2024-09-12T16:51:56.158411+0000","last_active":"2024-09-12T16:52:41.092203+0000","last_peered":"2024-09-12T16:52:41.092203+0000","last_clean":"2024-09-12T16:52:41.092203+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:52:41.092203+0000","last_undegraded":"2024-09-12T16:52:41.092203+0000","last_fullsized":"2024-09-12T16:52:41.092203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:45.612366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.159807+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:05.194424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023142+0000","last_change":"2024-09-12T16:51:56.155038+0000","last_active":"2024-09-12T16:52:35.023142+0000","last_peered":"2024-09-12T16:52:35.023142+0000","last_clean":"2024-09-12T16:52:35.023142+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:52:35.023142+0000","last_undegraded":"2024-09-12T16:52:35.023142+0000","last_fullsized":"2024-09-12T16:52:35.023142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:24.208686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491894+0000","last_change":"2024-09-12T16:51:58.159514+0000","last_active":"2024-09-12T16:55:12.491894+0000","last_peered":"2024-09-12T16:55:12.491894+0000","last_clean":"2024-09-12T16:55:12.491894+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:55:12.491894+0000","last_undegraded":"2024-09-12T16:55:12.491894+0000","last_fullsized":"2024-09-12T16:55:12.491894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.364726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021975+0000","last_change":"2024-09-12T16:51:56.167940+0000","last_active":"2024-09-12T16:52:35.021975+0000","last_peered":"2024-09-12T16:52:35.021975+0000","last_clean":"2024-09-12T16:52:35.021975+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:52:35.021975+0000","last_undegraded":"2024-09-12T16:52:35.021975+0000","last_fullsized":"2024-09-12T16:52:35.021975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:08.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405710+0000","last_change":"2024-09-12T16:51:58.176452+0000","last_active":"2024-09-12T16:55:12.405710+0000","last_peered":"2024-09-12T16:55:12.405710+0000","last_clean":"2024-09-12T16:55:12.405710+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:55:12.405710+0000","last_undegraded":"2024-09-12T16:55:12.405710+0000","last_fullsized":"2024-09-12T16:55:12.405710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:45.955514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.033519+0000","last_change":"2024-09-12T16:51:56.166412+0000","last_active":"2024-09-12T16:52:35.033519+0000","last_peered":"2024-09-12T16:52:35.033519+0000","last_clean":"2024-09-12T16:52:35.033519+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:52:35.033519+0000","last_undegraded":"2024-09-12T16:52:35.033519+0000","last_fullsized":"2024-09-12T16:52:35.033519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:20.820430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.309364+0000","last_change":"2024-09-12T16:51:58.146572+0000","last_active":"2024-09-12T16:52:43.309364+0000","last_peered":"2024-09-12T16:52:43.309364+0000","last_clean":"2024-09-12T16:52:43.309364+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:52:43.309364+0000","last_undegraded":"2024-09-12T16:52:43.309364+0000","last_fullsized":"2024-09-12T16:52:43.309364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:01.315966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038391+0000","last_change":"2024-09-12T16:51:56.158751+0000","last_active":"2024-09-12T16:52:35.038391+0000","last_peered":"2024-09-12T16:52:35.038391+0000","last_clean":"2024-09-12T16:52:35.038391+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:52:35.038391+0000","last_undegraded":"2024-09-12T16:52:35.038391+0000","last_fullsized":"2024-09-12T16:52:35.038391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:44.033762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114250+0000","last_change":"2024-09-12T16:51:58.172245+0000","last_active":"2024-09-12T16:53:26.114250+0000","last_peered":"2024-09-12T16:53:26.114250+0000","last_clean":"2024-09-12T16:53:26.114250+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:53:26.114250+0000","last_undegraded":"2024-09-12T16:53:26.114250+0000","last_fullsized":"2024-09-12T16:53:26.114250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:30.077956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.087965+0000","last_change":"2024-09-12T16:51:56.153153+0000","last_active":"2024-09-12T16:52:41.087965+0000","last_peered":"2024-09-12T16:52:41.087965+0000","last_clean":"2024-09-12T16:52:41.087965+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:52:41.087965+0000","last_undegraded":"2024-09-12T16:52:41.087965+0000","last_fullsized":"2024-09-12T16:52:41.087965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:50.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204146+0000","last_change":"2024-09-12T16:51:58.148643+0000","last_active":"2024-09-12T16:55:12.204146+0000","last_peered":"2024-09-12T16:55:12.204146+0000","last_clean":"2024-09-12T16:55:12.204146+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:55:12.204146+0000","last_undegraded":"2024-09-12T16:55:12.204146+0000","last_fullsized":"2024-09-12T16:55:12.204146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:32.984633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048111+0000","last_change":"2024-09-12T16:51:56.166599+0000","last_active":"2024-09-12T16:52:35.048111+0000","last_peered":"2024-09-12T16:52:35.048111+0000","last_clean":"2024-09-12T16:52:35.048111+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:52:35.048111+0000","last_undegraded":"2024-09-12T16:52:35.048111+0000","last_fullsized":"2024-09-12T16:52:35.048111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.428924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206978+0000","last_change":"2024-09-12T16:52:35.049949+0000","last_active":"2024-09-12T16:55:12.206978+0000","last_peered":"2024-09-12T16:55:12.206978+0000","last_clean":"2024-09-12T16:55:12.206978+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:55:12.206978+0000","last_undegraded":"2024-09-12T16:55:12.206978+0000","last_fullsized":"2024-09-12T16:55:12.206978+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.495939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.092683+0000","last_change":"2024-09-12T16:51:56.150301+0000","last_active":"2024-09-12T16:52:41.092683+0000","last_peered":"2024-09-12T16:52:41.092683+0000","last_clean":"2024-09-12T16:52:41.092683+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:52:41.092683+0000","last_undegraded":"2024-09-12T16:52:41.092683+0000","last_fullsized":"2024-09-12T16:52:41.092683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.592397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.434439+0000","last_change":"2024-09-12T16:51:58.159251+0000","last_active":"2024-09-12T16:54:11.434439+0000","last_peered":"2024-09-12T16:54:11.434439+0000","last_clean":"2024-09-12T16:54:11.434439+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:54:11.434439+0000","last_undegraded":"2024-09-12T16:54:11.434439+0000","last_fullsized":"2024-09-12T16:54:11.434439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:33.404970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.094347+0000","last_change":"2024-09-12T16:51:56.169106+0000","last_active":"2024-09-12T16:52:41.094347+0000","last_peered":"2024-09-12T16:52:41.094347+0000","last_clean":"2024-09-12T16:52:41.094347+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:52:41.094347+0000","last_undegraded":"2024-09-12T16:52:41.094347+0000","last_fullsized":"2024-09-12T16:52:41.094347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:11.710348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.567566+0000","last_change":"2024-09-12T16:51:56.155830+0000","last_active":"2024-09-12T16:52:42.567566+0000","last_peered":"2024-09-12T16:52:42.567566+0000","last_clean":"2024-09-12T16:52:42.567566+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:52:42.567566+0000","last_undegraded":"2024-09-12T16:52:42.567566+0000","last_fullsized":"2024-09-12T16:52:42.567566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.219841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030048+0000","last_change":"2024-09-12T16:51:58.164418+0000","last_active":"2024-09-12T16:52:35.030048+0000","last_peered":"2024-09-12T16:52:35.030048+0000","last_clean":"2024-09-12T16:52:35.030048+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:52:35.030048+0000","last_undegraded":"2024-09-12T16:52:35.030048+0000","last_fullsized":"2024-09-12T16:52:35.030048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:15.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025775+0000","last_change":"2024-09-12T16:51:56.171869+0000","last_active":"2024-09-12T16:52:35.025775+0000","last_peered":"2024-09-12T16:52:35.025775+0000","last_clean":"2024-09-12T16:52:35.025775+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:52:35.025775+0000","last_undegraded":"2024-09-12T16:52:35.025775+0000","last_fullsized":"2024-09-12T16:52:35.025775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:08.525437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.246329+0000","last_change":"2024-09-12T16:51:58.173368+0000","last_active":"2024-09-12T16:52:42.246329+0000","last_peered":"2024-09-12T16:52:42.246329+0000","last_clean":"2024-09-12T16:52:42.246329+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:52:42.246329+0000","last_undegraded":"2024-09-12T16:52:42.246329+0000","last_fullsized":"2024-09-12T16:52:42.246329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:45.341574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640308,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1036288,"data_stored":740498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673013,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":740621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48344,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323496,"statfs":{"total":96636764160,"available":96587259904,"internally_reserved":0,"allocated":9052160,"data_stored":8759273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:55:48.819 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.819 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.820 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.820 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.820 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.820 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.820 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.820 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.820 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.820 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.821 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.822 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.823 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.824 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.825 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.825 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.825 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.825 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.825 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.825 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.826 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.827 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.828 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.829 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.829 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.829 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.829 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.829 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.829 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.830 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.830 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.830 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.830 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.830 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.830 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.831 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.831 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.831 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.832 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.832 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.832 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.832 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.832 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.833 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.833 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.833 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.833 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.834 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.834 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.834 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.835 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.835 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.835 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.836 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T16:51:40.347390+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.836 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T16:51:45.370506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.836 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.837 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.837 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.837 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.838 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.838 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.838 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T16:51:45.370506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.838 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.839 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.839 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.839 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.839 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.839 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.840 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T16:51:45.370506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.840 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.840 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.841 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.841 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.841 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.841 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.841 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T16:51:45.370506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.841 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.841 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T16:51:45.370506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.842 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T16:51:45.370506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.843 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T16:51:45.370506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T16:51:45.370506+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.844 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.845 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.845 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.845 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.845 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.845 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.845 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.845 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.845 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.846 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.847 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.847 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.847 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.847 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.848 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.848 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.848 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.848 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.849 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.850 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.851 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.851 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.851 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.851 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.851 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.851 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.851 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.852 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.853 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.854 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.855 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.856 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.856 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.856 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.856 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.856 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.856 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.856 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.856 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.857 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.857 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.857 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.857 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.858 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.858 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.858 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.858 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.858 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.858 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.859 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.859 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.859 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.859 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.859 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:55:48.860 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T16:56:08.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:56:08.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.989+0000 7fde7601e640 1 Processor -- start 2024-09-12T16:56:08.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.989+0000 7fde7601e640 1 -- start start 2024-09-12T16:56:08.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fde7012aee0 0x7fde7012b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:08.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde700008e0 con 0x7fde7012f110 2024-09-12T16:56:08.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7fde70071e70 con 0x7fde7012aee0 2024-09-12T16:56:08.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6f7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fde7012aee0 0x7fde7012b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:08.997 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6effd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fde7012f110 0x7fde7012f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:33596/0 (socket says 172.21.15.122:33596) 2024-09-12T16:56:08.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6effd640 1 -- 172.21.15.122:0/4224334228 learned_addr learned my addr 172.21.15.122:0/4224334228 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:56:08.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6e7fc640 1 -- 172.21.15.122:0/4224334228 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137143320 0 0) 0x7fde700008e0 con 0x7fde7012f110 2024-09-12T16:56:08.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6e7fc640 1 -- 172.21.15.122:0/4224334228 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde58003530 con 0x7fde7012f110 2024-09-12T16:56:08.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6f7fe640 1 -- 172.21.15.122:0/4224334228 >> v1:172.21.15.122:6789/0 conn(0x7fde7012f110 legacy=0x7fde7012f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:08.998 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6f7fe640 1 -- 172.21.15.122:0/4224334228 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde700a30b0 con 0x7fde7012aee0 2024-09-12T16:56:09.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6f7fe640 1 --2- 172.21.15.122:0/4224334228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde7012b2c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fde60009740 tx=0x7fde6001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbd7e780681cc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:09.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6e7fc640 1 -- 172.21.15.122:0/4224334228 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde600b1070 con 0x7fde7012aee0 2024-09-12T16:56:09.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6e7fc640 1 -- 172.21.15.122:0/4224334228 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde600ac520 con 0x7fde7012aee0 2024-09-12T16:56:09.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde6e7fc640 1 -- 172.21.15.122:0/4224334228 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde600ac820 con 0x7fde7012aee0 2024-09-12T16:56:09.000 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 -- 172.21.15.122:0/4224334228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 msgr2=0x7fde7012b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:09.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 --2- 172.21.15.122:0/4224334228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde7012b2c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fde60009740 tx=0x7fde6001c370 comp rx=0 tx=0).stop 2024-09-12T16:56:09.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 -- 172.21.15.122:0/4224334228 shutdown_connections 2024-09-12T16:56:09.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 --2- 172.21.15.122:0/4224334228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde7012b2c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:09.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 -- 172.21.15.122:0/4224334228 >> 172.21.15.122:0/4224334228 conn(0x7fde700a0a60 msgr2=0x7fde7006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:56:09.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 -- 172.21.15.122:0/4224334228 shutdown_connections 2024-09-12T16:56:09.001 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.993+0000 7fde7601e640 1 -- 172.21.15.122:0/4224334228 wait complete. 2024-09-12T16:56:09.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde7601e640 1 Processor -- start 2024-09-12T16:56:09.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde7601e640 1 -- start start 2024-09-12T16:56:09.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde7601e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde701296c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:09.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde7601e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fde7012b980 con 0x7fde7012aee0 2024-09-12T16:56:09.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde701296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:09.004 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde701296c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51814/0 (socket says 172.21.15.122:51814) 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde6f7fe640 1 -- 172.21.15.122:0/826836327 learned_addr learned my addr 172.21.15.122:0/826836327 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde6f7fe640 1 -- 172.21.15.122:0/826836327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7011c2e0 con 0x7fde7012aee0 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde6f7fe640 1 --2- 172.21.15.122:0/826836327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde701296c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fde6001aa20 tx=0x7fde6001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde57fff640 1 -- 172.21.15.122:0/826836327 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde600b1050 con 0x7fde7012aee0 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde57fff640 1 -- 172.21.15.122:0/826836327 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde600b2040 con 0x7fde7012aee0 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde57fff640 1 -- 172.21.15.122:0/826836327 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde600b6740 con 0x7fde7012aee0 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde7011c510 con 0x7fde7012aee0 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde70129dd0 con 0x7fde7012aee0 2024-09-12T16:56:09.005 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7012b2c0 con 0x7fde7012aee0 2024-09-12T16:56:09.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde57fff640 1 -- 172.21.15.122:0/826836327 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fde600bf030 con 0x7fde7012aee0 2024-09-12T16:56:09.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde57fff640 1 --2- 172.21.15.122:0/826836327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde5c03b1d0 0x7fde5c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:09.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde57fff640 1 -- 172.21.15.122:0/826836327 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fde600bd070 con 0x7fde7012aee0 2024-09-12T16:56:09.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:08.997+0000 7fde6effd640 1 --2- 172.21.15.122:0/826836327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde5c03b1d0 0x7fde5c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:09.007 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.001+0000 7fde6effd640 1 --2- 172.21.15.122:0/826836327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde5c03b1d0 0x7fde5c03d690 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fde64007fd0 tx=0x7fde64007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:09.008 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.005+0000 7fde57fff640 1 -- 172.21.15.122:0/826836327 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fde600c6020 con 0x7fde7012aee0 2024-09-12T16:56:09.170 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.165+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde70073a80 con 0x7fde5c03b1d0 2024-09-12T16:56:09.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.193+0000 7fde57fff640 1 -- 172.21.15.122:0/826836327 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665609 (secure 0 0 0) 0x7fde640058c0 con 0x7fde5c03b1d0 2024-09-12T16:56:09.211 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:56:09.219 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:56:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde5c03b1d0 msgr2=0x7fde5c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 --2- 172.21.15.122:0/826836327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde5c03b1d0 0x7fde5c03d690 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fde64007fd0 tx=0x7fde64007900 comp rx=0 tx=0).stop 2024-09-12T16:56:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 msgr2=0x7fde701296c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 --2- 172.21.15.122:0/826836327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde701296c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fde6001aa20 tx=0x7fde6001abb0 comp rx=0 tx=0).stop 2024-09-12T16:56:09.220 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 shutdown_connections 2024-09-12T16:56:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 --2- 172.21.15.122:0/826836327 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7fde5c03b1d0 0x7fde5c03d690 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 --2- 172.21.15.122:0/826836327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde7012aee0 0x7fde701296c0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 >> 172.21.15.122:0/826836327 conn(0x7fde700a0a60 msgr2=0x7fde700a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:56:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 shutdown_connections 2024-09-12T16:56:09.221 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:09.201+0000 7fde7601e640 1 -- 172.21.15.122:0/826836327 wait complete. 2024-09-12T16:56:09.222 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-12T16:56:08.058925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5138,"num_read_kb":4724,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4570,"ondisk_log_size":4570,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156768,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330592,"statfs":{"total":386547056640,"available":386386526208,"internally_reserved":0,"allocated":2981888,"data_stored":1785572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007041"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.961062+0000","last_change":"2024-09-12T16:56:03.961062+0000","last_active":"2024-09-12T16:56:03.961062+0000","last_peered":"2024-09-12T16:56:03.961062+0000","last_clean":"2024-09-12T16:56:03.961062+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:56:03.961062+0000","last_undegraded":"2024-09-12T16:56:03.961062+0000","last_fullsized":"2024-09-12T16:56:03.961062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.960834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:37.770581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559689+0000","last_change":"2024-09-12T16:51:58.150328+0000","last_active":"2024-09-12T16:55:12.559689+0000","last_peered":"2024-09-12T16:55:12.559689+0000","last_clean":"2024-09-12T16:55:12.559689+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:55:12.559689+0000","last_undegraded":"2024-09-12T16:55:12.559689+0000","last_fullsized":"2024-09-12T16:55:12.559689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:31.991784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.441693+0000","last_change":"2024-09-12T16:56:02.441693+0000","last_active":"2024-09-12T16:56:02.441693+0000","last_peered":"2024-09-12T16:56:02.441693+0000","last_clean":"2024-09-12T16:56:02.441693+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:56:02.441693+0000","last_undegraded":"2024-09-12T16:56:02.441693+0000","last_fullsized":"2024-09-12T16:56:02.441693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.441477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:15.024861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.493995+0000","last_change":"2024-09-12T16:51:58.166339+0000","last_active":"2024-09-12T16:55:12.493995+0000","last_peered":"2024-09-12T16:55:12.493995+0000","last_clean":"2024-09-12T16:55:12.493995+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:55:12.493995+0000","last_undegraded":"2024-09-12T16:55:12.493995+0000","last_fullsized":"2024-09-12T16:55:12.493995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.116016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:01.020645+0000","last_change":"2024-09-12T16:51:56.164645+0000","last_active":"2024-09-12T16:54:01.020645+0000","last_peered":"2024-09-12T16:54:01.020645+0000","last_clean":"2024-09-12T16:54:01.020645+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:54:01.020645+0000","last_undegraded":"2024-09-12T16:54:01.020645+0000","last_fullsized":"2024-09-12T16:54:01.020645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.425082+0000","last_change":"2024-09-12T16:51:58.163269+0000","last_active":"2024-09-12T16:55:12.425082+0000","last_peered":"2024-09-12T16:55:12.425082+0000","last_clean":"2024-09-12T16:55:12.425082+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:55:12.425082+0000","last_undegraded":"2024-09-12T16:55:12.425082+0000","last_fullsized":"2024-09-12T16:55:12.425082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:17.060923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.000241+0000","last_change":"2024-09-12T16:55:59.000089+0000","last_active":"2024-09-12T16:55:59.000241+0000","last_peered":"2024-09-12T16:55:59.000241+0000","last_clean":"2024-09-12T16:55:59.000241+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:55:59.000241+0000","last_undegraded":"2024-09-12T16:55:59.000241+0000","last_fullsized":"2024-09-12T16:55:59.000241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.999904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.689260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559316+0000","last_change":"2024-09-12T16:51:58.165836+0000","last_active":"2024-09-12T16:55:12.559316+0000","last_peered":"2024-09-12T16:55:12.559316+0000","last_clean":"2024-09-12T16:55:12.559316+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:55:12.559316+0000","last_undegraded":"2024-09-12T16:55:12.559316+0000","last_fullsized":"2024-09-12T16:55:12.559316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.786300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038726+0000","last_change":"2024-09-12T16:51:56.155368+0000","last_active":"2024-09-12T16:52:35.038726+0000","last_peered":"2024-09-12T16:52:35.038726+0000","last_clean":"2024-09-12T16:52:35.038726+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:52:35.038726+0000","last_undegraded":"2024-09-12T16:52:35.038726+0000","last_fullsized":"2024-09-12T16:52:35.038726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:23.509728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:01.017611+0000","last_change":"2024-09-12T16:51:58.148537+0000","last_active":"2024-09-12T16:54:01.017611+0000","last_peered":"2024-09-12T16:54:01.017611+0000","last_clean":"2024-09-12T16:54:01.017611+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:54:01.017611+0000","last_undegraded":"2024-09-12T16:54:01.017611+0000","last_fullsized":"2024-09-12T16:54:01.017611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.818019+0000","last_change":"2024-09-12T16:51:56.149239+0000","last_active":"2024-09-12T16:55:43.818019+0000","last_peered":"2024-09-12T16:55:43.818019+0000","last_clean":"2024-09-12T16:55:43.818019+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:55:43.818019+0000","last_undegraded":"2024-09-12T16:55:43.818019+0000","last_fullsized":"2024-09-12T16:55:43.818019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:48.008590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.756687+0000","last_change":"2024-09-12T16:51:58.165599+0000","last_active":"2024-09-12T16:54:06.756687+0000","last_peered":"2024-09-12T16:54:06.756687+0000","last_clean":"2024-09-12T16:54:06.756687+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:54:06.756687+0000","last_undegraded":"2024-09-12T16:54:06.756687+0000","last_fullsized":"2024-09-12T16:54:06.756687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:30.151277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.917360+0000","last_change":"2024-09-12T16:51:56.154655+0000","last_active":"2024-09-12T16:55:11.917360+0000","last_peered":"2024-09-12T16:55:11.917360+0000","last_clean":"2024-09-12T16:55:11.917360+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:55:11.917360+0000","last_undegraded":"2024-09-12T16:55:11.917360+0000","last_fullsized":"2024-09-12T16:55:11.917360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:52.651580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491266+0000","last_change":"2024-09-12T16:51:58.156872+0000","last_active":"2024-09-12T16:55:12.491266+0000","last_peered":"2024-09-12T16:55:12.491266+0000","last_clean":"2024-09-12T16:55:12.491266+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:55:12.491266+0000","last_undegraded":"2024-09-12T16:55:12.491266+0000","last_fullsized":"2024-09-12T16:55:12.491266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:17.848281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.411580+0000","last_change":"2024-09-12T16:55:59.411580+0000","last_active":"2024-09-12T16:55:59.411580+0000","last_peered":"2024-09-12T16:55:59.411580+0000","last_clean":"2024-09-12T16:55:59.411580+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:55:59.411580+0000","last_undegraded":"2024-09-12T16:55:59.411580+0000","last_fullsized":"2024-09-12T16:55:59.411580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.411390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:57.337645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.490892+0000","last_change":"2024-09-12T16:52:35.060238+0000","last_active":"2024-09-12T16:55:12.490892+0000","last_peered":"2024-09-12T16:55:12.490892+0000","last_clean":"2024-09-12T16:55:12.490892+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:55:12.490892+0000","last_undegraded":"2024-09-12T16:55:12.490892+0000","last_fullsized":"2024-09-12T16:55:12.490892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:18.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'5","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508887+0000","last_change":"2024-09-12T16:51:58.152595+0000","last_active":"2024-09-12T16:55:12.508887+0000","last_peered":"2024-09-12T16:55:12.508887+0000","last_clean":"2024-09-12T16:55:12.508887+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:55:12.508887+0000","last_undegraded":"2024-09-12T16:55:12.508887+0000","last_fullsized":"2024-09-12T16:55:12.508887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:06.175184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.020166+0000","last_change":"2024-09-12T16:56:01.020166+0000","last_active":"2024-09-12T16:56:01.020166+0000","last_peered":"2024-09-12T16:56:01.020166+0000","last_clean":"2024-09-12T16:56:01.020166+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:56:01.020166+0000","last_undegraded":"2024-09-12T16:56:01.020166+0000","last_fullsized":"2024-09-12T16:56:01.020166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.019981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:17.549962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.082244+0000","last_change":"2024-09-12T16:51:58.145539+0000","last_active":"2024-09-12T16:55:12.082244+0000","last_peered":"2024-09-12T16:55:12.082244+0000","last_clean":"2024-09-12T16:55:12.082244+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:55:12.082244+0000","last_undegraded":"2024-09-12T16:55:12.082244+0000","last_fullsized":"2024-09-12T16:55:12.082244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:58.380885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.978515+0000","last_change":"2024-09-12T16:56:01.978515+0000","last_active":"2024-09-12T16:56:01.978515+0000","last_peered":"2024-09-12T16:56:01.978515+0000","last_clean":"2024-09-12T16:56:01.978515+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:56:01.978515+0000","last_undegraded":"2024-09-12T16:56:01.978515+0000","last_fullsized":"2024-09-12T16:56:01.978515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.978300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:23.170955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450880+0000","last_change":"2024-09-12T16:51:58.147371+0000","last_active":"2024-09-12T16:54:11.450880+0000","last_peered":"2024-09-12T16:54:11.450880+0000","last_clean":"2024-09-12T16:54:11.450880+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:54:11.450880+0000","last_undegraded":"2024-09-12T16:54:11.450880+0000","last_fullsized":"2024-09-12T16:54:11.450880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.439266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.024742+0000","last_change":"2024-09-12T16:56:00.024742+0000","last_active":"2024-09-12T16:56:00.024742+0000","last_peered":"2024-09-12T16:56:00.024742+0000","last_clean":"2024-09-12T16:56:00.024742+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:56:00.024742+0000","last_undegraded":"2024-09-12T16:56:00.024742+0000","last_fullsized":"2024-09-12T16:56:00.024742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.024672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:03.497187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.578829+0000","last_change":"2024-09-12T16:51:58.171720+0000","last_active":"2024-09-12T16:55:12.578829+0000","last_peered":"2024-09-12T16:55:12.578829+0000","last_clean":"2024-09-12T16:55:12.578829+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:55:12.578829+0000","last_undegraded":"2024-09-12T16:55:12.578829+0000","last_fullsized":"2024-09-12T16:55:12.578829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:43.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.029695+0000","last_change":"2024-09-12T16:55:59.029695+0000","last_active":"2024-09-12T16:55:59.029695+0000","last_peered":"2024-09-12T16:55:59.029695+0000","last_clean":"2024-09-12T16:55:59.029695+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:55:59.029695+0000","last_undegraded":"2024-09-12T16:55:59.029695+0000","last_fullsized":"2024-09-12T16:55:59.029695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.029505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.968614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.170393+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:20.778233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.453187+0000","last_change":"2024-09-12T16:55:58.453187+0000","last_active":"2024-09-12T16:55:58.453187+0000","last_peered":"2024-09-12T16:55:58.453187+0000","last_clean":"2024-09-12T16:55:58.453187+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:55:58.453187+0000","last_undegraded":"2024-09-12T16:55:58.453187+0000","last_fullsized":"2024-09-12T16:55:58.453187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.452993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.443665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.024343+0000","last_change":"2024-09-12T16:51:58.154333+0000","last_active":"2024-09-12T16:54:26.024343+0000","last_peered":"2024-09-12T16:54:26.024343+0000","last_clean":"2024-09-12T16:54:26.024343+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:54:26.024343+0000","last_undegraded":"2024-09-12T16:54:26.024343+0000","last_fullsized":"2024-09-12T16:54:26.024343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:31.351742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.747323+0000","last_change":"2024-09-12T16:51:56.150214+0000","last_active":"2024-09-12T16:53:25.747323+0000","last_peered":"2024-09-12T16:53:25.747323+0000","last_clean":"2024-09-12T16:53:25.747323+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:53:25.747323+0000","last_undegraded":"2024-09-12T16:53:25.747323+0000","last_fullsized":"2024-09-12T16:53:25.747323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.360856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.449818+0000","last_change":"2024-09-12T16:52:06.228645+0000","last_active":"2024-09-12T16:55:12.449818+0000","last_peered":"2024-09-12T16:55:12.449818+0000","last_clean":"2024-09-12T16:55:12.449818+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:55:12.449818+0000","last_undegraded":"2024-09-12T16:55:12.449818+0000","last_fullsized":"2024-09-12T16:55:12.449818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.027430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559921+0000","last_change":"2024-09-12T16:51:58.158921+0000","last_active":"2024-09-12T16:55:12.559921+0000","last_peered":"2024-09-12T16:55:12.559921+0000","last_clean":"2024-09-12T16:55:12.559921+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:55:12.559921+0000","last_undegraded":"2024-09-12T16:55:12.559921+0000","last_fullsized":"2024-09-12T16:55:12.559921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:53.998192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.009398+0000","last_change":"2024-09-12T16:56:02.009398+0000","last_active":"2024-09-12T16:56:02.009398+0000","last_peered":"2024-09-12T16:56:02.009398+0000","last_clean":"2024-09-12T16:56:02.009398+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:56:02.009398+0000","last_undegraded":"2024-09-12T16:56:02.009398+0000","last_fullsized":"2024-09-12T16:56:02.009398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.009210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:18.094619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047258+0000","last_change":"2024-09-12T16:52:00.186679+0000","last_active":"2024-09-12T16:52:35.047258+0000","last_peered":"2024-09-12T16:52:35.047258+0000","last_clean":"2024-09-12T16:52:35.047258+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:52:35.047258+0000","last_undegraded":"2024-09-12T16:52:35.047258+0000","last_fullsized":"2024-09-12T16:52:35.047258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:56.774446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.671303+0000","last_change":"2024-09-12T16:52:02.211041+0000","last_active":"2024-09-12T16:55:43.671303+0000","last_peered":"2024-09-12T16:55:43.671303+0000","last_clean":"2024-09-12T16:55:43.671303+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:55:43.671303+0000","last_undegraded":"2024-09-12T16:55:43.671303+0000","last_fullsized":"2024-09-12T16:55:43.671303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:56.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046823+0000","last_change":"2024-09-12T16:52:04.216014+0000","last_active":"2024-09-12T16:52:35.046823+0000","last_peered":"2024-09-12T16:52:35.046823+0000","last_clean":"2024-09-12T16:52:35.046823+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:52:35.046823+0000","last_undegraded":"2024-09-12T16:52:35.046823+0000","last_fullsized":"2024-09-12T16:52:35.046823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.121629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.770372+0000","last_change":"2024-09-12T16:52:06.220823+0000","last_active":"2024-09-12T16:53:25.770372+0000","last_peered":"2024-09-12T16:53:25.770372+0000","last_clean":"2024-09-12T16:53:25.770372+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:53:25.770372+0000","last_undegraded":"2024-09-12T16:53:25.770372+0000","last_fullsized":"2024-09-12T16:53:25.770372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.834594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.769302+0000","last_change":"2024-09-12T16:51:58.172491+0000","last_active":"2024-09-12T16:54:06.769302+0000","last_peered":"2024-09-12T16:54:06.769302+0000","last_clean":"2024-09-12T16:54:06.769302+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:54:06.769302+0000","last_undegraded":"2024-09-12T16:54:06.769302+0000","last_fullsized":"2024-09-12T16:54:06.769302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:13.859827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.866458+0000","last_change":"2024-09-12T16:55:53.866458+0000","last_active":"2024-09-12T16:55:53.866458+0000","last_peered":"2024-09-12T16:55:53.866458+0000","last_clean":"2024-09-12T16:55:53.866458+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:53.866458+0000","last_undegraded":"2024-09-12T16:55:53.866458+0000","last_fullsized":"2024-09-12T16:55:53.866458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.866257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:36.901200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022624+0000","last_change":"2024-09-12T16:52:00.173177+0000","last_active":"2024-09-12T16:52:35.022624+0000","last_peered":"2024-09-12T16:52:35.022624+0000","last_clean":"2024-09-12T16:52:35.022624+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:52:35.022624+0000","last_undegraded":"2024-09-12T16:52:35.022624+0000","last_fullsized":"2024-09-12T16:52:35.022624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:29.445195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.045539+0000","last_change":"2024-09-12T16:52:02.183370+0000","last_active":"2024-09-12T16:52:35.045539+0000","last_peered":"2024-09-12T16:52:35.045539+0000","last_clean":"2024-09-12T16:52:35.045539+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:52:35.045539+0000","last_undegraded":"2024-09-12T16:52:35.045539+0000","last_fullsized":"2024-09-12T16:52:35.045539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.193774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044904+0000","last_change":"2024-09-12T16:52:04.210985+0000","last_active":"2024-09-12T16:52:35.044904+0000","last_peered":"2024-09-12T16:52:35.044904+0000","last_clean":"2024-09-12T16:52:35.044904+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:52:35.044904+0000","last_undegraded":"2024-09-12T16:52:35.044904+0000","last_fullsized":"2024-09-12T16:52:35.044904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:41.017144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021248+0000","last_change":"2024-09-12T16:52:06.224899+0000","last_active":"2024-09-12T16:52:35.021248+0000","last_peered":"2024-09-12T16:52:35.021248+0000","last_clean":"2024-09-12T16:52:35.021248+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:52:35.021248+0000","last_undegraded":"2024-09-12T16:52:35.021248+0000","last_fullsized":"2024-09-12T16:52:35.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:27.788906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559983+0000","last_change":"2024-09-12T16:51:58.165985+0000","last_active":"2024-09-12T16:55:12.559983+0000","last_peered":"2024-09-12T16:55:12.559983+0000","last_clean":"2024-09-12T16:55:12.559983+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:55:12.559983+0000","last_undegraded":"2024-09-12T16:55:12.559983+0000","last_fullsized":"2024-09-12T16:55:12.559983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.791071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.057358+0000","last_change":"2024-09-12T16:56:01.057358+0000","last_active":"2024-09-12T16:56:01.057358+0000","last_peered":"2024-09-12T16:56:01.057358+0000","last_clean":"2024-09-12T16:56:01.057358+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:56:01.057358+0000","last_undegraded":"2024-09-12T16:56:01.057358+0000","last_fullsized":"2024-09-12T16:56:01.057358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.057181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:48.320895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029954+0000","last_change":"2024-09-12T16:52:00.166221+0000","last_active":"2024-09-12T16:52:35.029954+0000","last_peered":"2024-09-12T16:52:35.029954+0000","last_clean":"2024-09-12T16:52:35.029954+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:52:35.029954+0000","last_undegraded":"2024-09-12T16:52:35.029954+0000","last_fullsized":"2024-09-12T16:52:35.029954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:47.637135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017313+0000","last_change":"2024-09-12T16:52:02.202447+0000","last_active":"2024-09-12T16:52:35.017313+0000","last_peered":"2024-09-12T16:52:35.017313+0000","last_clean":"2024-09-12T16:52:35.017313+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:52:35.017313+0000","last_undegraded":"2024-09-12T16:52:35.017313+0000","last_fullsized":"2024-09-12T16:52:35.017313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:48.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.577588+0000","last_change":"2024-09-12T16:52:04.214865+0000","last_active":"2024-09-12T16:55:43.577588+0000","last_peered":"2024-09-12T16:55:43.577588+0000","last_clean":"2024-09-12T16:55:43.577588+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:55:43.577588+0000","last_undegraded":"2024-09-12T16:55:43.577588+0000","last_fullsized":"2024-09-12T16:55:43.577588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:36.658689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016249+0000","last_change":"2024-09-12T16:52:06.233885+0000","last_active":"2024-09-12T16:52:35.016249+0000","last_peered":"2024-09-12T16:52:35.016249+0000","last_clean":"2024-09-12T16:52:35.016249+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:52:35.016249+0000","last_undegraded":"2024-09-12T16:52:35.016249+0000","last_fullsized":"2024-09-12T16:52:35.016249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:05.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762116+0000","last_change":"2024-09-12T16:51:58.157856+0000","last_active":"2024-09-12T16:53:25.762116+0000","last_peered":"2024-09-12T16:53:25.762116+0000","last_clean":"2024-09-12T16:53:25.762116+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:53:25.762116+0000","last_undegraded":"2024-09-12T16:53:25.762116+0000","last_fullsized":"2024-09-12T16:53:25.762116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.575311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.882861+0000","last_change":"2024-09-12T16:55:49.882861+0000","last_active":"2024-09-12T16:55:49.882861+0000","last_peered":"2024-09-12T16:55:49.882861+0000","last_clean":"2024-09-12T16:55:49.882861+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:55:49.882861+0000","last_undegraded":"2024-09-12T16:55:49.882861+0000","last_fullsized":"2024-09-12T16:55:49.882861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.882666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:15.998089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047933+0000","last_change":"2024-09-12T16:52:00.186758+0000","last_active":"2024-09-12T16:52:35.047933+0000","last_peered":"2024-09-12T16:52:35.047933+0000","last_clean":"2024-09-12T16:52:35.047933+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:52:35.047933+0000","last_undegraded":"2024-09-12T16:52:35.047933+0000","last_fullsized":"2024-09-12T16:52:35.047933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:11.029898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.876170+0000","last_change":"2024-09-12T16:52:02.201456+0000","last_active":"2024-09-12T16:55:43.876170+0000","last_peered":"2024-09-12T16:55:43.876170+0000","last_clean":"2024-09-12T16:55:43.876170+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:55:43.876170+0000","last_undegraded":"2024-09-12T16:55:43.876170+0000","last_fullsized":"2024-09-12T16:55:43.876170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:04.994969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.586516+0000","last_change":"2024-09-12T16:52:04.220126+0000","last_active":"2024-09-12T16:55:43.586516+0000","last_peered":"2024-09-12T16:55:43.586516+0000","last_clean":"2024-09-12T16:55:43.586516+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:55:43.586516+0000","last_undegraded":"2024-09-12T16:55:43.586516+0000","last_fullsized":"2024-09-12T16:55:43.586516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:41.797262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024505+0000","last_change":"2024-09-12T16:51:58.166638+0000","last_active":"2024-09-12T16:52:35.024505+0000","last_peered":"2024-09-12T16:52:35.024505+0000","last_clean":"2024-09-12T16:52:35.024505+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:52:35.024505+0000","last_undegraded":"2024-09-12T16:52:35.024505+0000","last_fullsized":"2024-09-12T16:52:35.024505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:09.865305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.907335+0000","last_change":"2024-09-12T16:55:51.907335+0000","last_active":"2024-09-12T16:55:51.907335+0000","last_peered":"2024-09-12T16:55:51.907335+0000","last_clean":"2024-09-12T16:55:51.907335+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:55:51.907335+0000","last_undegraded":"2024-09-12T16:55:51.907335+0000","last_fullsized":"2024-09-12T16:55:51.907335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.907142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:07.393009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.025774+0000","last_change":"2024-09-12T16:52:00.158540+0000","last_active":"2024-09-12T16:52:35.025774+0000","last_peered":"2024-09-12T16:52:35.025774+0000","last_clean":"2024-09-12T16:52:35.025774+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:52:35.025774+0000","last_undegraded":"2024-09-12T16:52:35.025774+0000","last_fullsized":"2024-09-12T16:52:35.025774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:48.058273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'44","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.692222+0000","last_change":"2024-09-12T16:52:02.185249+0000","last_active":"2024-09-12T16:55:43.692222+0000","last_peered":"2024-09-12T16:55:43.692222+0000","last_clean":"2024-09-12T16:55:43.692222+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:55:43.692222+0000","last_undegraded":"2024-09-12T16:55:43.692222+0000","last_fullsized":"2024-09-12T16:55:43.692222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:09.660762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029067+0000","last_change":"2024-09-12T16:52:04.216055+0000","last_active":"2024-09-12T16:52:35.029067+0000","last_peered":"2024-09-12T16:52:35.029067+0000","last_clean":"2024-09-12T16:52:35.029067+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:52:35.029067+0000","last_undegraded":"2024-09-12T16:52:35.029067+0000","last_fullsized":"2024-09-12T16:52:35.029067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:19.593146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.773290+0000","last_change":"2024-09-12T16:52:06.226575+0000","last_active":"2024-09-12T16:53:25.773290+0000","last_peered":"2024-09-12T16:53:25.773290+0000","last_clean":"2024-09-12T16:53:25.773290+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:53:25.773290+0000","last_undegraded":"2024-09-12T16:53:25.773290+0000","last_fullsized":"2024-09-12T16:53:25.773290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:47.280150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.051013+0000","last_change":"2024-09-12T16:56:05.051013+0000","last_active":"2024-09-12T16:56:05.051013+0000","last_peered":"2024-09-12T16:56:05.051013+0000","last_clean":"2024-09-12T16:56:05.051013+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:56:05.051013+0000","last_undegraded":"2024-09-12T16:56:05.051013+0000","last_fullsized":"2024-09-12T16:56:05.051013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.050827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:50.475409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.905168+0000","last_change":"2024-09-12T16:55:54.905168+0000","last_active":"2024-09-12T16:55:54.905168+0000","last_peered":"2024-09-12T16:55:54.905168+0000","last_clean":"2024-09-12T16:55:54.905168+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:55:54.905168+0000","last_undegraded":"2024-09-12T16:55:54.905168+0000","last_fullsized":"2024-09-12T16:55:54.905168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:54.848288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023417+0000","last_change":"2024-09-12T16:52:00.156973+0000","last_active":"2024-09-12T16:52:35.023417+0000","last_peered":"2024-09-12T16:52:35.023417+0000","last_clean":"2024-09-12T16:52:35.023417+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:52:35.023417+0000","last_undegraded":"2024-09-12T16:52:35.023417+0000","last_fullsized":"2024-09-12T16:52:35.023417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:53.962016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.778313+0000","last_change":"2024-09-12T16:52:02.209890+0000","last_active":"2024-09-12T16:55:43.778313+0000","last_peered":"2024-09-12T16:55:43.778313+0000","last_clean":"2024-09-12T16:55:43.778313+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:55:43.778313+0000","last_undegraded":"2024-09-12T16:55:43.778313+0000","last_fullsized":"2024-09-12T16:55:43.778313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:04.988153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023620+0000","last_change":"2024-09-12T16:52:04.194679+0000","last_active":"2024-09-12T16:52:35.023620+0000","last_peered":"2024-09-12T16:52:35.023620+0000","last_clean":"2024-09-12T16:52:35.023620+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:52:35.023620+0000","last_undegraded":"2024-09-12T16:52:35.023620+0000","last_fullsized":"2024-09-12T16:52:35.023620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:43.311077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:20.069130+0000","last_change":"2024-09-12T16:52:06.231060+0000","last_active":"2024-09-12T16:53:20.069130+0000","last_peered":"2024-09-12T16:53:20.069130+0000","last_clean":"2024-09-12T16:53:20.069130+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:53:20.069130+0000","last_undegraded":"2024-09-12T16:53:20.069130+0000","last_fullsized":"2024-09-12T16:53:20.069130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:38.753641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019518+0000","last_change":"2024-09-12T16:51:58.170102+0000","last_active":"2024-09-12T16:52:35.019518+0000","last_peered":"2024-09-12T16:52:35.019518+0000","last_clean":"2024-09-12T16:52:35.019518+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:52:35.019518+0000","last_undegraded":"2024-09-12T16:52:35.019518+0000","last_fullsized":"2024-09-12T16:52:35.019518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:03.745874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.069150+0000","last_change":"2024-09-12T16:55:59.069150+0000","last_active":"2024-09-12T16:55:59.069150+0000","last_peered":"2024-09-12T16:55:59.069150+0000","last_clean":"2024-09-12T16:55:59.069150+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:55:59.069150+0000","last_undegraded":"2024-09-12T16:55:59.069150+0000","last_fullsized":"2024-09-12T16:55:59.069150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.068940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:14.552968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026093+0000","last_change":"2024-09-12T16:52:00.155974+0000","last_active":"2024-09-12T16:52:35.026093+0000","last_peered":"2024-09-12T16:52:35.026093+0000","last_clean":"2024-09-12T16:52:35.026093+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:52:35.026093+0000","last_undegraded":"2024-09-12T16:52:35.026093+0000","last_fullsized":"2024-09-12T16:52:35.026093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:53.769301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'40","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.700832+0000","last_change":"2024-09-12T16:52:02.203207+0000","last_active":"2024-09-12T16:55:43.700832+0000","last_peered":"2024-09-12T16:55:43.700832+0000","last_clean":"2024-09-12T16:55:43.700832+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:55:43.700832+0000","last_undegraded":"2024-09-12T16:55:43.700832+0000","last_fullsized":"2024-09-12T16:55:43.700832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:18.022593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.589627+0000","last_change":"2024-09-12T16:52:04.194703+0000","last_active":"2024-09-12T16:55:43.589627+0000","last_peered":"2024-09-12T16:55:43.589627+0000","last_clean":"2024-09-12T16:55:43.589627+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:55:43.589627+0000","last_undegraded":"2024-09-12T16:55:43.589627+0000","last_fullsized":"2024-09-12T16:55:43.589627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:45.145668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024038+0000","last_change":"2024-09-12T16:52:06.236389+0000","last_active":"2024-09-12T16:52:35.024038+0000","last_peered":"2024-09-12T16:52:35.024038+0000","last_clean":"2024-09-12T16:52:35.024038+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:52:35.024038+0000","last_undegraded":"2024-09-12T16:52:35.024038+0000","last_fullsized":"2024-09-12T16:52:35.024038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:42.125079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.925571+0000","last_change":"2024-09-12T16:56:04.925571+0000","last_active":"2024-09-12T16:56:04.925571+0000","last_peered":"2024-09-12T16:56:04.925571+0000","last_clean":"2024-09-12T16:56:04.925571+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:56:04.925571+0000","last_undegraded":"2024-09-12T16:56:04.925571+0000","last_fullsized":"2024-09-12T16:56:04.925571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.925364+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:32.101898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.090533+0000","last_change":"2024-09-12T16:56:00.090533+0000","last_active":"2024-09-12T16:56:00.090533+0000","last_peered":"2024-09-12T16:56:00.090533+0000","last_clean":"2024-09-12T16:56:00.090533+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:56:00.090533+0000","last_undegraded":"2024-09-12T16:56:00.090533+0000","last_fullsized":"2024-09-12T16:56:00.090533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.090336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:15.365705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022426+0000","last_change":"2024-09-12T16:52:00.178084+0000","last_active":"2024-09-12T16:52:35.022426+0000","last_peered":"2024-09-12T16:52:35.022426+0000","last_clean":"2024-09-12T16:52:35.022426+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:52:35.022426+0000","last_undegraded":"2024-09-12T16:52:35.022426+0000","last_fullsized":"2024-09-12T16:52:35.022426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:53.597984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.799311+0000","last_change":"2024-09-12T16:52:02.201612+0000","last_active":"2024-09-12T16:55:43.799311+0000","last_peered":"2024-09-12T16:55:43.799311+0000","last_clean":"2024-09-12T16:55:43.799311+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:55:43.799311+0000","last_undegraded":"2024-09-12T16:55:43.799311+0000","last_fullsized":"2024-09-12T16:55:43.799311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:42.817716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021841+0000","last_change":"2024-09-12T16:52:04.198835+0000","last_active":"2024-09-12T16:52:35.021841+0000","last_peered":"2024-09-12T16:52:35.021841+0000","last_clean":"2024-09-12T16:52:35.021841+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:52:35.021841+0000","last_undegraded":"2024-09-12T16:52:35.021841+0000","last_fullsized":"2024-09-12T16:52:35.021841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.503485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.731668+0000","last_change":"2024-09-12T16:52:06.212053+0000","last_active":"2024-09-12T16:55:12.731668+0000","last_peered":"2024-09-12T16:55:12.731668+0000","last_clean":"2024-09-12T16:55:12.731668+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:55:12.731668+0000","last_undegraded":"2024-09-12T16:55:12.731668+0000","last_fullsized":"2024-09-12T16:55:12.731668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:15.749904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.020804+0000","last_change":"2024-09-12T16:56:04.020804+0000","last_active":"2024-09-12T16:56:04.020804+0000","last_peered":"2024-09-12T16:56:04.020804+0000","last_clean":"2024-09-12T16:56:04.020804+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:56:04.020804+0000","last_undegraded":"2024-09-12T16:56:04.020804+0000","last_fullsized":"2024-09-12T16:56:04.020804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.020617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:53.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.431517+0000","last_change":"2024-09-12T16:55:52.431517+0000","last_active":"2024-09-12T16:55:52.431517+0000","last_peered":"2024-09-12T16:55:52.431517+0000","last_clean":"2024-09-12T16:55:52.431517+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:55:52.431517+0000","last_undegraded":"2024-09-12T16:55:52.431517+0000","last_fullsized":"2024-09-12T16:55:52.431517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.431331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:30.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027418+0000","last_change":"2024-09-12T16:52:00.186996+0000","last_active":"2024-09-12T16:52:35.027418+0000","last_peered":"2024-09-12T16:52:35.027418+0000","last_clean":"2024-09-12T16:52:35.027418+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:52:35.027418+0000","last_undegraded":"2024-09-12T16:52:35.027418+0000","last_fullsized":"2024-09-12T16:52:35.027418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:55.614591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.826845+0000","last_change":"2024-09-12T16:52:02.181402+0000","last_active":"2024-09-12T16:55:43.826845+0000","last_peered":"2024-09-12T16:55:43.826845+0000","last_clean":"2024-09-12T16:55:43.826845+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:55:43.826845+0000","last_undegraded":"2024-09-12T16:55:43.826845+0000","last_fullsized":"2024-09-12T16:55:43.826845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:57.545973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048724+0000","last_change":"2024-09-12T16:52:04.214150+0000","last_active":"2024-09-12T16:52:35.048724+0000","last_peered":"2024-09-12T16:52:35.048724+0000","last_clean":"2024-09-12T16:52:35.048724+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:52:35.048724+0000","last_undegraded":"2024-09-12T16:52:35.048724+0000","last_fullsized":"2024-09-12T16:52:35.048724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:04.618846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'7","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.675594+0000","last_change":"2024-09-12T16:52:06.231706+0000","last_active":"2024-09-12T16:55:12.675594+0000","last_peered":"2024-09-12T16:55:12.675594+0000","last_clean":"2024-09-12T16:55:12.675594+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:55:12.675594+0000","last_undegraded":"2024-09-12T16:55:12.675594+0000","last_fullsized":"2024-09-12T16:55:12.675594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'9","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.579477+0000","last_change":"2024-09-12T16:51:58.173915+0000","last_active":"2024-09-12T16:55:12.579477+0000","last_peered":"2024-09-12T16:55:12.579477+0000","last_clean":"2024-09-12T16:55:12.579477+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:55:12.579477+0000","last_undegraded":"2024-09-12T16:55:12.579477+0000","last_fullsized":"2024-09-12T16:55:12.579477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:53.515263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.103087+0000","last_change":"2024-09-12T16:55:58.103087+0000","last_active":"2024-09-12T16:55:58.103087+0000","last_peered":"2024-09-12T16:55:58.103087+0000","last_clean":"2024-09-12T16:55:58.103087+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:55:58.103087+0000","last_undegraded":"2024-09-12T16:55:58.103087+0000","last_fullsized":"2024-09-12T16:55:58.103087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.102908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:04.349009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022853+0000","last_change":"2024-09-12T16:52:00.167730+0000","last_active":"2024-09-12T16:52:35.022853+0000","last_peered":"2024-09-12T16:52:35.022853+0000","last_clean":"2024-09-12T16:52:35.022853+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:52:35.022853+0000","last_undegraded":"2024-09-12T16:52:35.022853+0000","last_fullsized":"2024-09-12T16:52:35.022853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:18.641624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.754640+0000","last_change":"2024-09-12T16:52:02.181396+0000","last_active":"2024-09-12T16:55:43.754640+0000","last_peered":"2024-09-12T16:55:43.754640+0000","last_clean":"2024-09-12T16:55:43.754640+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:55:43.754640+0000","last_undegraded":"2024-09-12T16:55:43.754640+0000","last_fullsized":"2024-09-12T16:55:43.754640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:02.688531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.578248+0000","last_change":"2024-09-12T16:52:04.202044+0000","last_active":"2024-09-12T16:55:43.578248+0000","last_peered":"2024-09-12T16:55:43.578248+0000","last_clean":"2024-09-12T16:55:43.578248+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:55:43.578248+0000","last_undegraded":"2024-09-12T16:55:43.578248+0000","last_fullsized":"2024-09-12T16:55:43.578248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:00.863167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'20","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.680761+0000","last_change":"2024-09-12T16:52:06.219575+0000","last_active":"2024-09-12T16:55:12.680761+0000","last_peered":"2024-09-12T16:55:12.680761+0000","last_clean":"2024-09-12T16:55:12.680761+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:55:12.680761+0000","last_undegraded":"2024-09-12T16:55:12.680761+0000","last_fullsized":"2024-09-12T16:55:12.680761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.073730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.985161+0000","last_change":"2024-09-12T16:56:02.985161+0000","last_active":"2024-09-12T16:56:02.985161+0000","last_peered":"2024-09-12T16:56:02.985161+0000","last_clean":"2024-09-12T16:56:02.985161+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:56:02.985161+0000","last_undegraded":"2024-09-12T16:56:02.985161+0000","last_fullsized":"2024-09-12T16:56:02.985161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.984950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:45.336637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.105529+0000","last_change":"2024-09-12T16:55:57.105529+0000","last_active":"2024-09-12T16:55:57.105529+0000","last_peered":"2024-09-12T16:55:57.105529+0000","last_clean":"2024-09-12T16:55:57.105529+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:55:57.105529+0000","last_undegraded":"2024-09-12T16:55:57.105529+0000","last_fullsized":"2024-09-12T16:55:57.105529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.105307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":623,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.566986+0000","last_change":"2024-09-12T16:52:35.065861+0000","last_active":"2024-09-12T16:55:43.566986+0000","last_peered":"2024-09-12T16:55:43.566986+0000","last_clean":"2024-09-12T16:55:43.566986+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:55:43.566986+0000","last_undegraded":"2024-09-12T16:55:43.566986+0000","last_fullsized":"2024-09-12T16:55:43.566986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.323930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.454242+0000","last_change":"2024-09-12T16:52:02.209870+0000","last_active":"2024-09-12T16:54:11.454242+0000","last_peered":"2024-09-12T16:54:11.454242+0000","last_clean":"2024-09-12T16:54:11.454242+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:54:11.454242+0000","last_undegraded":"2024-09-12T16:54:11.454242+0000","last_fullsized":"2024-09-12T16:54:11.454242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.846097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":515,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.580728+0000","last_change":"2024-09-12T16:52:04.200303+0000","last_active":"2024-09-12T16:55:43.580728+0000","last_peered":"2024-09-12T16:55:43.580728+0000","last_clean":"2024-09-12T16:55:43.580728+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:55:43.580728+0000","last_undegraded":"2024-09-12T16:55:43.580728+0000","last_fullsized":"2024-09-12T16:55:43.580728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:06.974814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.990445+0000","last_change":"2024-09-12T16:52:06.226319+0000","last_active":"2024-09-12T16:54:10.990445+0000","last_peered":"2024-09-12T16:54:10.990445+0000","last_clean":"2024-09-12T16:54:10.990445+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:54:10.990445+0000","last_undegraded":"2024-09-12T16:54:10.990445+0000","last_fullsized":"2024-09-12T16:54:10.990445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:19.104184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.019629+0000","last_change":"2024-09-12T16:56:06.019629+0000","last_active":"2024-09-12T16:56:06.019629+0000","last_peered":"2024-09-12T16:56:06.019629+0000","last_clean":"2024-09-12T16:56:06.019629+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:06.019629+0000","last_undegraded":"2024-09-12T16:56:06.019629+0000","last_fullsized":"2024-09-12T16:56:06.019629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.019448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.300837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.144883+0000","last_change":"2024-09-12T16:55:56.144883+0000","last_active":"2024-09-12T16:55:56.144883+0000","last_peered":"2024-09-12T16:55:56.144883+0000","last_clean":"2024-09-12T16:55:56.144883+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:55:56.144883+0000","last_undegraded":"2024-09-12T16:55:56.144883+0000","last_fullsized":"2024-09-12T16:55:56.144883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.144656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:33.152646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048178+0000","last_change":"2024-09-12T16:52:00.189183+0000","last_active":"2024-09-12T16:52:35.048178+0000","last_peered":"2024-09-12T16:52:35.048178+0000","last_clean":"2024-09-12T16:52:35.048178+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:52:35.048178+0000","last_undegraded":"2024-09-12T16:52:35.048178+0000","last_fullsized":"2024-09-12T16:52:35.048178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:50.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'42","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.676524+0000","last_change":"2024-09-12T16:52:02.179426+0000","last_active":"2024-09-12T16:55:43.676524+0000","last_peered":"2024-09-12T16:55:43.676524+0000","last_clean":"2024-09-12T16:55:43.676524+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:55:43.676524+0000","last_undegraded":"2024-09-12T16:55:43.676524+0000","last_fullsized":"2024-09-12T16:55:43.676524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:17.890537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017029+0000","last_change":"2024-09-12T16:52:04.212757+0000","last_active":"2024-09-12T16:52:35.017029+0000","last_peered":"2024-09-12T16:52:35.017029+0000","last_clean":"2024-09-12T16:52:35.017029+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:52:35.017029+0000","last_undegraded":"2024-09-12T16:52:35.017029+0000","last_fullsized":"2024-09-12T16:52:35.017029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.808954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.633190+0000","last_change":"2024-09-12T16:52:06.227780+0000","last_active":"2024-09-12T16:55:12.633190+0000","last_peered":"2024-09-12T16:55:12.633190+0000","last_clean":"2024-09-12T16:55:12.633190+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:55:12.633190+0000","last_undegraded":"2024-09-12T16:55:12.633190+0000","last_fullsized":"2024-09-12T16:55:12.633190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:23.705849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.222251+0000","last_change":"2024-09-12T16:51:58.173604+0000","last_active":"2024-09-12T16:55:12.222251+0000","last_peered":"2024-09-12T16:55:12.222251+0000","last_clean":"2024-09-12T16:55:12.222251+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:55:12.222251+0000","last_undegraded":"2024-09-12T16:55:12.222251+0000","last_fullsized":"2024-09-12T16:55:12.222251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:03.163064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.965741+0000","last_change":"2024-09-12T16:55:47.965741+0000","last_active":"2024-09-12T16:55:47.965741+0000","last_peered":"2024-09-12T16:55:47.965741+0000","last_clean":"2024-09-12T16:55:47.965741+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:55:47.965741+0000","last_undegraded":"2024-09-12T16:55:47.965741+0000","last_fullsized":"2024-09-12T16:55:47.965741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.965477+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:53.674876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.217462+0000","last_change":"2024-09-12T16:55:51.217300+0000","last_active":"2024-09-12T16:55:51.217462+0000","last_peered":"2024-09-12T16:55:51.217462+0000","last_clean":"2024-09-12T16:55:51.217462+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:55:51.217462+0000","last_undegraded":"2024-09-12T16:55:51.217462+0000","last_fullsized":"2024-09-12T16:55:51.217462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.217110+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:04.583269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.156907+0000","last_change":"2024-09-12T16:55:54.156773+0000","last_active":"2024-09-12T16:55:54.156907+0000","last_peered":"2024-09-12T16:55:54.156907+0000","last_clean":"2024-09-12T16:55:54.156907+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:55:54.156907+0000","last_undegraded":"2024-09-12T16:55:54.156907+0000","last_fullsized":"2024-09-12T16:55:54.156907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.156592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:41.292991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044074+0000","last_change":"2024-09-12T16:52:00.165360+0000","last_active":"2024-09-12T16:52:35.044074+0000","last_peered":"2024-09-12T16:52:35.044074+0000","last_clean":"2024-09-12T16:52:35.044074+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:52:35.044074+0000","last_undegraded":"2024-09-12T16:52:35.044074+0000","last_fullsized":"2024-09-12T16:52:35.044074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:19.218108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.903382+0000","last_change":"2024-09-12T16:52:02.208795+0000","last_active":"2024-09-12T16:55:43.903382+0000","last_peered":"2024-09-12T16:55:43.903382+0000","last_clean":"2024-09-12T16:55:43.903382+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:55:43.903382+0000","last_undegraded":"2024-09-12T16:55:43.903382+0000","last_fullsized":"2024-09-12T16:55:43.903382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:33.220579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024326+0000","last_change":"2024-09-12T16:52:04.190511+0000","last_active":"2024-09-12T16:52:35.024326+0000","last_peered":"2024-09-12T16:52:35.024326+0000","last_clean":"2024-09-12T16:52:35.024326+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:52:35.024326+0000","last_undegraded":"2024-09-12T16:52:35.024326+0000","last_fullsized":"2024-09-12T16:52:35.024326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:34.575751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.588965+0000","last_change":"2024-09-12T16:52:06.216437+0000","last_active":"2024-09-12T16:55:12.588965+0000","last_peered":"2024-09-12T16:55:12.588965+0000","last_clean":"2024-09-12T16:55:12.588965+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:55:12.588965+0000","last_undegraded":"2024-09-12T16:55:12.588965+0000","last_fullsized":"2024-09-12T16:55:12.588965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:11.640533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.560070+0000","last_change":"2024-09-12T16:51:58.165681+0000","last_active":"2024-09-12T16:55:12.560070+0000","last_peered":"2024-09-12T16:55:12.560070+0000","last_clean":"2024-09-12T16:55:12.560070+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:55:12.560070+0000","last_undegraded":"2024-09-12T16:55:12.560070+0000","last_fullsized":"2024-09-12T16:55:12.560070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.848528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.222007+0000","last_change":"2024-09-12T16:55:49.222007+0000","last_active":"2024-09-12T16:55:49.222007+0000","last_peered":"2024-09-12T16:55:49.222007+0000","last_clean":"2024-09-12T16:55:49.222007+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:55:49.222007+0000","last_undegraded":"2024-09-12T16:55:49.222007+0000","last_fullsized":"2024-09-12T16:55:49.222007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.221820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:10.179551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.395398+0000","last_change":"2024-09-12T16:55:51.395398+0000","last_active":"2024-09-12T16:55:51.395398+0000","last_peered":"2024-09-12T16:55:51.395398+0000","last_clean":"2024-09-12T16:55:51.395398+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:51.395398+0000","last_undegraded":"2024-09-12T16:55:51.395398+0000","last_fullsized":"2024-09-12T16:55:51.395398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.395218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:23.022360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043040+0000","last_change":"2024-09-12T16:52:35.040769+0000","last_active":"2024-09-12T16:52:35.043040+0000","last_peered":"2024-09-12T16:52:35.043040+0000","last_clean":"2024-09-12T16:52:35.043040+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:52:35.043040+0000","last_undegraded":"2024-09-12T16:52:35.043040+0000","last_fullsized":"2024-09-12T16:52:35.043040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:44.546730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'286","reported_seq":504,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.897969+0000","last_change":"2024-09-12T16:52:02.206307+0000","last_active":"2024-09-12T16:55:43.897969+0000","last_peered":"2024-09-12T16:55:43.897969+0000","last_clean":"2024-09-12T16:55:43.897969+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:55:43.897969+0000","last_undegraded":"2024-09-12T16:55:43.897969+0000","last_fullsized":"2024-09-12T16:55:43.897969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:35.817009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046840+0000","last_change":"2024-09-12T16:52:04.209015+0000","last_active":"2024-09-12T16:52:35.046840+0000","last_peered":"2024-09-12T16:52:35.046840+0000","last_clean":"2024-09-12T16:52:35.046840+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:52:35.046840+0000","last_undegraded":"2024-09-12T16:52:35.046840+0000","last_fullsized":"2024-09-12T16:52:35.046840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.156119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.766970+0000","last_change":"2024-09-12T16:52:06.227599+0000","last_active":"2024-09-12T16:53:25.766970+0000","last_peered":"2024-09-12T16:53:25.766970+0000","last_clean":"2024-09-12T16:53:25.766970+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:53:25.766970+0000","last_undegraded":"2024-09-12T16:53:25.766970+0000","last_fullsized":"2024-09-12T16:53:25.766970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:02.281631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508885+0000","last_change":"2024-09-12T16:51:58.158281+0000","last_active":"2024-09-12T16:55:12.508885+0000","last_peered":"2024-09-12T16:55:12.508885+0000","last_clean":"2024-09-12T16:55:12.508885+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:55:12.508885+0000","last_undegraded":"2024-09-12T16:55:12.508885+0000","last_fullsized":"2024-09-12T16:55:12.508885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:35.307006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.862977+0000","last_change":"2024-09-12T16:55:48.862720+0000","last_active":"2024-09-12T16:55:48.862977+0000","last_peered":"2024-09-12T16:55:48.862977+0000","last_clean":"2024-09-12T16:55:48.862977+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:55:48.862977+0000","last_undegraded":"2024-09-12T16:55:48.862977+0000","last_fullsized":"2024-09-12T16:55:48.862977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.862498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:44.689046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.400482+0000","last_change":"2024-09-12T16:55:48.400348+0000","last_active":"2024-09-12T16:55:48.400482+0000","last_peered":"2024-09-12T16:55:48.400482+0000","last_clean":"2024-09-12T16:55:48.400482+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:55:48.400482+0000","last_undegraded":"2024-09-12T16:55:48.400482+0000","last_fullsized":"2024-09-12T16:55:48.400482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.400137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.057420+0000","last_change":"2024-09-12T16:52:35.055925+0000","last_active":"2024-09-12T16:52:35.057420+0000","last_peered":"2024-09-12T16:52:35.057420+0000","last_clean":"2024-09-12T16:52:35.057420+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:52:35.057420+0000","last_undegraded":"2024-09-12T16:52:35.057420+0000","last_fullsized":"2024-09-12T16:52:35.057420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:39.278393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:10.419519+0000","last_change":"2024-09-12T16:52:02.183372+0000","last_active":"2024-09-12T16:55:10.419519+0000","last_peered":"2024-09-12T16:55:10.419519+0000","last_clean":"2024-09-12T16:55:10.419519+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:55:10.419519+0000","last_undegraded":"2024-09-12T16:55:10.419519+0000","last_fullsized":"2024-09-12T16:55:10.419519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:17.150188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023454+0000","last_change":"2024-09-12T16:52:04.189985+0000","last_active":"2024-09-12T16:52:35.023454+0000","last_peered":"2024-09-12T16:52:35.023454+0000","last_clean":"2024-09-12T16:52:35.023454+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:52:35.023454+0000","last_undegraded":"2024-09-12T16:52:35.023454+0000","last_fullsized":"2024-09-12T16:52:35.023454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:57.543211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032944+0000","last_change":"2024-09-12T16:52:06.229164+0000","last_active":"2024-09-12T16:52:35.032944+0000","last_peered":"2024-09-12T16:52:35.032944+0000","last_clean":"2024-09-12T16:52:35.032944+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:52:35.032944+0000","last_undegraded":"2024-09-12T16:52:35.032944+0000","last_fullsized":"2024-09-12T16:52:35.032944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:53.711707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.424942+0000","last_change":"2024-09-12T16:56:03.424942+0000","last_active":"2024-09-12T16:56:03.424942+0000","last_peered":"2024-09-12T16:56:03.424942+0000","last_clean":"2024-09-12T16:56:03.424942+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:56:03.424942+0000","last_undegraded":"2024-09-12T16:56:03.424942+0000","last_fullsized":"2024-09-12T16:56:03.424942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.424770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:52.914259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.245625+0000","last_change":"2024-09-12T16:55:50.245475+0000","last_active":"2024-09-12T16:55:50.245625+0000","last_peered":"2024-09-12T16:55:50.245625+0000","last_clean":"2024-09-12T16:55:50.245625+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:55:50.245625+0000","last_undegraded":"2024-09-12T16:55:50.245625+0000","last_fullsized":"2024-09-12T16:55:50.245625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.245287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:59.801323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.874078+0000","last_change":"2024-09-12T16:55:49.874078+0000","last_active":"2024-09-12T16:55:49.874078+0000","last_peered":"2024-09-12T16:55:49.874078+0000","last_clean":"2024-09-12T16:55:49.874078+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:55:49.874078+0000","last_undegraded":"2024-09-12T16:55:49.874078+0000","last_fullsized":"2024-09-12T16:55:49.874078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.873862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:42.226676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024125+0000","last_change":"2024-09-12T16:52:00.189223+0000","last_active":"2024-09-12T16:52:35.024125+0000","last_peered":"2024-09-12T16:52:35.024125+0000","last_clean":"2024-09-12T16:52:35.024125+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:52:35.024125+0000","last_undegraded":"2024-09-12T16:52:35.024125+0000","last_fullsized":"2024-09-12T16:52:35.024125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:19.787530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.470351+0000","last_change":"2024-09-12T16:52:02.207152+0000","last_active":"2024-09-12T16:55:11.470351+0000","last_peered":"2024-09-12T16:55:11.470351+0000","last_clean":"2024-09-12T16:55:11.470351+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:55:11.470351+0000","last_undegraded":"2024-09-12T16:55:11.470351+0000","last_fullsized":"2024-09-12T16:55:11.470351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:18.373274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.049115+0000","last_change":"2024-09-12T16:52:04.214830+0000","last_active":"2024-09-12T16:52:35.049115+0000","last_peered":"2024-09-12T16:52:35.049115+0000","last_clean":"2024-09-12T16:52:35.049115+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:52:35.049115+0000","last_undegraded":"2024-09-12T16:52:35.049115+0000","last_fullsized":"2024-09-12T16:52:35.049115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:43.821701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.923598+0000","last_change":"2024-09-12T16:52:06.229880+0000","last_active":"2024-09-12T16:54:10.923598+0000","last_peered":"2024-09-12T16:54:10.923598+0000","last_clean":"2024-09-12T16:54:10.923598+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:54:10.923598+0000","last_undegraded":"2024-09-12T16:54:10.923598+0000","last_fullsized":"2024-09-12T16:54:10.923598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:22.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.055532+0000","last_change":"2024-09-12T16:56:02.055532+0000","last_active":"2024-09-12T16:56:02.055532+0000","last_peered":"2024-09-12T16:56:02.055532+0000","last_clean":"2024-09-12T16:56:02.055532+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:56:02.055532+0000","last_undegraded":"2024-09-12T16:56:02.055532+0000","last_fullsized":"2024-09-12T16:56:02.055532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.055341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:23.968021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.859970+0000","last_change":"2024-09-12T16:55:50.859970+0000","last_active":"2024-09-12T16:55:50.859970+0000","last_peered":"2024-09-12T16:55:50.859970+0000","last_clean":"2024-09-12T16:55:50.859970+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:55:50.859970+0000","last_undegraded":"2024-09-12T16:55:50.859970+0000","last_fullsized":"2024-09-12T16:55:50.859970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.859731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:21.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.421319+0000","last_change":"2024-09-12T16:55:47.421094+0000","last_active":"2024-09-12T16:55:47.421319+0000","last_peered":"2024-09-12T16:55:47.421319+0000","last_clean":"2024-09-12T16:55:47.421319+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:55:47.421319+0000","last_undegraded":"2024-09-12T16:55:47.421319+0000","last_fullsized":"2024-09-12T16:55:47.421319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.420892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.729401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'5","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.551692+0000","last_change":"2024-09-12T16:52:00.160190+0000","last_active":"2024-09-12T16:55:43.551692+0000","last_peered":"2024-09-12T16:55:43.551692+0000","last_clean":"2024-09-12T16:55:43.551692+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:55:43.551692+0000","last_undegraded":"2024-09-12T16:55:43.551692+0000","last_fullsized":"2024-09-12T16:55:43.551692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:37.197687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.889823+0000","last_change":"2024-09-12T16:52:02.175160+0000","last_active":"2024-09-12T16:55:43.889823+0000","last_peered":"2024-09-12T16:55:43.889823+0000","last_clean":"2024-09-12T16:55:43.889823+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:55:43.889823+0000","last_undegraded":"2024-09-12T16:55:43.889823+0000","last_fullsized":"2024-09-12T16:55:43.889823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.015201+0000","last_change":"2024-09-12T16:52:04.202004+0000","last_active":"2024-09-12T16:52:35.015201+0000","last_peered":"2024-09-12T16:52:35.015201+0000","last_clean":"2024-09-12T16:52:35.015201+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:52:35.015201+0000","last_undegraded":"2024-09-12T16:52:35.015201+0000","last_fullsized":"2024-09-12T16:52:35.015201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:53.277560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.293385+0000","last_change":"2024-09-12T16:52:06.230268+0000","last_active":"2024-09-12T16:54:11.293385+0000","last_peered":"2024-09-12T16:54:11.293385+0000","last_clean":"2024-09-12T16:54:11.293385+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:54:11.293385+0000","last_undegraded":"2024-09-12T16:54:11.293385+0000","last_fullsized":"2024-09-12T16:54:11.293385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:11.635227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.051439+0000","last_change":"2024-09-12T16:56:03.051439+0000","last_active":"2024-09-12T16:56:03.051439+0000","last_peered":"2024-09-12T16:56:03.051439+0000","last_clean":"2024-09-12T16:56:03.051439+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:56:03.051439+0000","last_undegraded":"2024-09-12T16:56:03.051439+0000","last_fullsized":"2024-09-12T16:56:03.051439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.051259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.473399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.402377+0000","last_change":"2024-09-12T16:55:50.402377+0000","last_active":"2024-09-12T16:55:50.402377+0000","last_peered":"2024-09-12T16:55:50.402377+0000","last_clean":"2024-09-12T16:55:50.402377+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:50.402377+0000","last_undegraded":"2024-09-12T16:55:50.402377+0000","last_fullsized":"2024-09-12T16:55:50.402377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.402205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:11.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.165501+0000","last_change":"2024-09-12T16:55:52.165355+0000","last_active":"2024-09-12T16:55:52.165501+0000","last_peered":"2024-09-12T16:55:52.165501+0000","last_clean":"2024-09-12T16:55:52.165501+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:55:52.165501+0000","last_undegraded":"2024-09-12T16:55:52.165501+0000","last_fullsized":"2024-09-12T16:55:52.165501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.165177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031695+0000","last_change":"2024-09-12T16:52:00.173390+0000","last_active":"2024-09-12T16:52:35.031695+0000","last_peered":"2024-09-12T16:52:35.031695+0000","last_clean":"2024-09-12T16:52:35.031695+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:52:35.031695+0000","last_undegraded":"2024-09-12T16:52:35.031695+0000","last_fullsized":"2024-09-12T16:52:35.031695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:45.833748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027310+0000","last_change":"2024-09-12T16:52:02.194130+0000","last_active":"2024-09-12T16:52:35.027310+0000","last_peered":"2024-09-12T16:52:35.027310+0000","last_clean":"2024-09-12T16:52:35.027310+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:52:35.027310+0000","last_undegraded":"2024-09-12T16:52:35.027310+0000","last_fullsized":"2024-09-12T16:52:35.027310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:27.141664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":392,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.914812+0000","last_change":"2024-09-12T16:52:04.193182+0000","last_active":"2024-09-12T16:55:43.914812+0000","last_peered":"2024-09-12T16:55:43.914812+0000","last_clean":"2024-09-12T16:55:43.914812+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:55:43.914812+0000","last_undegraded":"2024-09-12T16:55:43.914812+0000","last_fullsized":"2024-09-12T16:55:43.914812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047985+0000","last_change":"2024-09-12T16:52:06.215010+0000","last_active":"2024-09-12T16:52:35.047985+0000","last_peered":"2024-09-12T16:52:35.047985+0000","last_clean":"2024-09-12T16:52:35.047985+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:52:35.047985+0000","last_undegraded":"2024-09-12T16:52:35.047985+0000","last_fullsized":"2024-09-12T16:52:35.047985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:54.128906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.112528+0000","last_change":"2024-09-12T16:52:35.039684+0000","last_active":"2024-09-12T16:53:26.112528+0000","last_peered":"2024-09-12T16:53:26.112528+0000","last_clean":"2024-09-12T16:53:26.112528+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:53:26.112528+0000","last_undegraded":"2024-09-12T16:53:26.112528+0000","last_fullsized":"2024-09-12T16:53:26.112528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:13.545874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.156907+0000","last_change":"2024-09-12T16:55:55.156907+0000","last_active":"2024-09-12T16:55:55.156907+0000","last_peered":"2024-09-12T16:55:55.156907+0000","last_clean":"2024-09-12T16:55:55.156907+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:55:55.156907+0000","last_undegraded":"2024-09-12T16:55:55.156907+0000","last_fullsized":"2024-09-12T16:55:55.156907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.156716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:37.213650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.363167+0000","last_change":"2024-09-12T16:55:49.363167+0000","last_active":"2024-09-12T16:55:49.363167+0000","last_peered":"2024-09-12T16:55:49.363167+0000","last_clean":"2024-09-12T16:55:49.363167+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:55:49.363167+0000","last_undegraded":"2024-09-12T16:55:49.363167+0000","last_fullsized":"2024-09-12T16:55:49.363167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.362978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:34.316423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022871+0000","last_change":"2024-09-12T16:52:00.171577+0000","last_active":"2024-09-12T16:52:35.022871+0000","last_peered":"2024-09-12T16:52:35.022871+0000","last_clean":"2024-09-12T16:52:35.022871+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:52:35.022871+0000","last_undegraded":"2024-09-12T16:52:35.022871+0000","last_fullsized":"2024-09-12T16:52:35.022871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:52.429060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034668+0000","last_change":"2024-09-12T16:52:02.213748+0000","last_active":"2024-09-12T16:52:35.034668+0000","last_peered":"2024-09-12T16:52:35.034668+0000","last_clean":"2024-09-12T16:52:35.034668+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:52:35.034668+0000","last_undegraded":"2024-09-12T16:52:35.034668+0000","last_fullsized":"2024-09-12T16:52:35.034668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:45.880129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.584131+0000","last_change":"2024-09-12T16:52:04.213686+0000","last_active":"2024-09-12T16:55:43.584131+0000","last_peered":"2024-09-12T16:55:43.584131+0000","last_clean":"2024-09-12T16:55:43.584131+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:55:43.584131+0000","last_undegraded":"2024-09-12T16:55:43.584131+0000","last_fullsized":"2024-09-12T16:55:43.584131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:03.491921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.104813+0000","last_change":"2024-09-12T16:52:06.223608+0000","last_active":"2024-09-12T16:55:12.104813+0000","last_peered":"2024-09-12T16:55:12.104813+0000","last_clean":"2024-09-12T16:55:12.104813+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:55:12.104813+0000","last_undegraded":"2024-09-12T16:55:12.104813+0000","last_fullsized":"2024-09-12T16:55:12.104813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:45.915952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.012738+0000","last_change":"2024-09-12T16:56:01.012738+0000","last_active":"2024-09-12T16:56:01.012738+0000","last_peered":"2024-09-12T16:56:01.012738+0000","last_clean":"2024-09-12T16:56:01.012738+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:56:01.012738+0000","last_undegraded":"2024-09-12T16:56:01.012738+0000","last_fullsized":"2024-09-12T16:56:01.012738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.012476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.560043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.912884+0000","last_change":"2024-09-12T16:55:48.912884+0000","last_active":"2024-09-12T16:55:48.912884+0000","last_peered":"2024-09-12T16:55:48.912884+0000","last_clean":"2024-09-12T16:55:48.912884+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:48.912884+0000","last_undegraded":"2024-09-12T16:55:48.912884+0000","last_fullsized":"2024-09-12T16:55:48.912884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.912682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:36.759579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.203291+0000","last_change":"2024-09-12T16:55:53.203060+0000","last_active":"2024-09-12T16:55:53.203291+0000","last_peered":"2024-09-12T16:55:53.203291+0000","last_clean":"2024-09-12T16:55:53.203291+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:55:53.203291+0000","last_undegraded":"2024-09-12T16:55:53.203291+0000","last_fullsized":"2024-09-12T16:55:53.203291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.202860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:18.010245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:01.020359+0000","last_change":"2024-09-12T16:52:00.177682+0000","last_active":"2024-09-12T16:54:01.020359+0000","last_peered":"2024-09-12T16:54:01.020359+0000","last_clean":"2024-09-12T16:54:01.020359+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:54:01.020359+0000","last_undegraded":"2024-09-12T16:54:01.020359+0000","last_fullsized":"2024-09-12T16:54:01.020359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.858986+0000","last_change":"2024-09-12T16:52:02.187458+0000","last_active":"2024-09-12T16:55:43.858986+0000","last_peered":"2024-09-12T16:55:43.858986+0000","last_clean":"2024-09-12T16:55:43.858986+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:55:43.858986+0000","last_undegraded":"2024-09-12T16:55:43.858986+0000","last_fullsized":"2024-09-12T16:55:43.858986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:39.799750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021656+0000","last_change":"2024-09-12T16:52:04.205957+0000","last_active":"2024-09-12T16:52:35.021656+0000","last_peered":"2024-09-12T16:52:35.021656+0000","last_clean":"2024-09-12T16:52:35.021656+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:52:35.021656+0000","last_undegraded":"2024-09-12T16:52:35.021656+0000","last_fullsized":"2024-09-12T16:52:35.021656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:09.625513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027967+0000","last_change":"2024-09-12T16:52:06.226131+0000","last_active":"2024-09-12T16:52:35.027967+0000","last_peered":"2024-09-12T16:52:35.027967+0000","last_clean":"2024-09-12T16:52:35.027967+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:52:35.027967+0000","last_undegraded":"2024-09-12T16:52:35.027967+0000","last_fullsized":"2024-09-12T16:52:35.027967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:27.891759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.467476+0000","last_change":"2024-09-12T16:52:06.233870+0000","last_active":"2024-09-12T16:55:12.467476+0000","last_peered":"2024-09-12T16:55:12.467476+0000","last_clean":"2024-09-12T16:55:12.467476+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:55:12.467476+0000","last_undegraded":"2024-09-12T16:55:12.467476+0000","last_fullsized":"2024-09-12T16:55:12.467476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:37.518504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.761344+0000","last_change":"2024-09-12T16:51:58.170146+0000","last_active":"2024-09-12T16:53:25.761344+0000","last_peered":"2024-09-12T16:53:25.761344+0000","last_clean":"2024-09-12T16:53:25.761344+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:53:25.761344+0000","last_undegraded":"2024-09-12T16:53:25.761344+0000","last_fullsized":"2024-09-12T16:53:25.761344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:48.025016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.017156+0000","last_change":"2024-09-12T16:56:03.017156+0000","last_active":"2024-09-12T16:56:03.017156+0000","last_peered":"2024-09-12T16:56:03.017156+0000","last_clean":"2024-09-12T16:56:03.017156+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:56:03.017156+0000","last_undegraded":"2024-09-12T16:56:03.017156+0000","last_fullsized":"2024-09-12T16:56:03.017156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.016945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:49.483897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032193+0000","last_change":"2024-09-12T16:52:00.176219+0000","last_active":"2024-09-12T16:52:35.032193+0000","last_peered":"2024-09-12T16:52:35.032193+0000","last_clean":"2024-09-12T16:52:35.032193+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:52:35.032193+0000","last_undegraded":"2024-09-12T16:52:35.032193+0000","last_fullsized":"2024-09-12T16:52:35.032193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:21.686238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.696470+0000","last_change":"2024-09-12T16:52:02.194377+0000","last_active":"2024-09-12T16:55:43.696470+0000","last_peered":"2024-09-12T16:55:43.696470+0000","last_clean":"2024-09-12T16:55:43.696470+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:55:43.696470+0000","last_undegraded":"2024-09-12T16:55:43.696470+0000","last_fullsized":"2024-09-12T16:55:43.696470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:35.662292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024735+0000","last_change":"2024-09-12T16:52:04.215450+0000","last_active":"2024-09-12T16:52:35.024735+0000","last_peered":"2024-09-12T16:52:35.024735+0000","last_clean":"2024-09-12T16:52:35.024735+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:52:35.024735+0000","last_undegraded":"2024-09-12T16:52:35.024735+0000","last_fullsized":"2024-09-12T16:52:35.024735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.120052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.497182+0000","last_change":"2024-09-12T16:52:06.212418+0000","last_active":"2024-09-12T16:55:12.497182+0000","last_peered":"2024-09-12T16:55:12.497182+0000","last_clean":"2024-09-12T16:55:12.497182+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:55:12.497182+0000","last_undegraded":"2024-09-12T16:55:12.497182+0000","last_fullsized":"2024-09-12T16:55:12.497182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:57.649089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'27","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.424657+0000","last_change":"2024-09-12T16:51:58.172876+0000","last_active":"2024-09-12T16:55:12.424657+0000","last_peered":"2024-09-12T16:55:12.424657+0000","last_clean":"2024-09-12T16:55:12.424657+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:55:12.424657+0000","last_undegraded":"2024-09-12T16:55:12.424657+0000","last_fullsized":"2024-09-12T16:55:12.424657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:16.676112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.909961+0000","last_change":"2024-09-12T16:55:52.909961+0000","last_active":"2024-09-12T16:55:52.909961+0000","last_peered":"2024-09-12T16:55:52.909961+0000","last_clean":"2024-09-12T16:55:52.909961+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:55:52.909961+0000","last_undegraded":"2024-09-12T16:55:52.909961+0000","last_fullsized":"2024-09-12T16:55:52.909961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.909777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:08.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034344+0000","last_change":"2024-09-12T16:52:00.183813+0000","last_active":"2024-09-12T16:52:35.034344+0000","last_peered":"2024-09-12T16:52:35.034344+0000","last_clean":"2024-09-12T16:52:35.034344+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:52:35.034344+0000","last_undegraded":"2024-09-12T16:52:35.034344+0000","last_fullsized":"2024-09-12T16:52:35.034344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.454514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.479969+0000","last_change":"2024-09-12T16:52:02.184368+0000","last_active":"2024-09-12T16:55:11.479969+0000","last_peered":"2024-09-12T16:55:11.479969+0000","last_clean":"2024-09-12T16:55:11.479969+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:55:11.479969+0000","last_undegraded":"2024-09-12T16:55:11.479969+0000","last_fullsized":"2024-09-12T16:55:11.479969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:55.116071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017383+0000","last_change":"2024-09-12T16:52:04.216686+0000","last_active":"2024-09-12T16:52:35.017383+0000","last_peered":"2024-09-12T16:52:35.017383+0000","last_clean":"2024-09-12T16:52:35.017383+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:52:35.017383+0000","last_undegraded":"2024-09-12T16:52:35.017383+0000","last_fullsized":"2024-09-12T16:52:35.017383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.665774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022183+0000","last_change":"2024-09-12T16:52:06.225236+0000","last_active":"2024-09-12T16:52:35.022183+0000","last_peered":"2024-09-12T16:52:35.022183+0000","last_clean":"2024-09-12T16:52:35.022183+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:52:35.022183+0000","last_undegraded":"2024-09-12T16:52:35.022183+0000","last_fullsized":"2024-09-12T16:52:35.022183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.292498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559427+0000","last_change":"2024-09-12T16:51:58.171912+0000","last_active":"2024-09-12T16:55:12.559427+0000","last_peered":"2024-09-12T16:55:12.559427+0000","last_clean":"2024-09-12T16:55:12.559427+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:55:12.559427+0000","last_undegraded":"2024-09-12T16:55:12.559427+0000","last_fullsized":"2024-09-12T16:55:12.559427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:33.118187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.924579+0000","last_change":"2024-09-12T16:55:55.924579+0000","last_active":"2024-09-12T16:55:55.924579+0000","last_peered":"2024-09-12T16:55:55.924579+0000","last_clean":"2024-09-12T16:55:55.924579+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:55:55.924579+0000","last_undegraded":"2024-09-12T16:55:55.924579+0000","last_fullsized":"2024-09-12T16:55:55.924579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.924395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017569+0000","last_change":"2024-09-12T16:52:00.163603+0000","last_active":"2024-09-12T16:52:35.017569+0000","last_peered":"2024-09-12T16:52:35.017569+0000","last_clean":"2024-09-12T16:52:35.017569+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:52:35.017569+0000","last_undegraded":"2024-09-12T16:52:35.017569+0000","last_fullsized":"2024-09-12T16:52:35.017569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:17.118266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.868200+0000","last_change":"2024-09-12T16:52:02.180694+0000","last_active":"2024-09-12T16:55:43.868200+0000","last_peered":"2024-09-12T16:55:43.868200+0000","last_clean":"2024-09-12T16:55:43.868200+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:55:43.868200+0000","last_undegraded":"2024-09-12T16:55:43.868200+0000","last_fullsized":"2024-09-12T16:55:43.868200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.028291+0000","last_change":"2024-09-12T16:52:04.200667+0000","last_active":"2024-09-12T16:52:35.028291+0000","last_peered":"2024-09-12T16:52:35.028291+0000","last_clean":"2024-09-12T16:52:35.028291+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:52:35.028291+0000","last_undegraded":"2024-09-12T16:52:35.028291+0000","last_fullsized":"2024-09-12T16:52:35.028291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.487906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039574+0000","last_change":"2024-09-12T16:52:06.236861+0000","last_active":"2024-09-12T16:52:35.039574+0000","last_peered":"2024-09-12T16:52:35.039574+0000","last_clean":"2024-09-12T16:52:35.039574+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:52:35.039574+0000","last_undegraded":"2024-09-12T16:52:35.039574+0000","last_fullsized":"2024-09-12T16:52:35.039574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:29.568087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114298+0000","last_change":"2024-09-12T16:51:58.168169+0000","last_active":"2024-09-12T16:53:26.114298+0000","last_peered":"2024-09-12T16:53:26.114298+0000","last_clean":"2024-09-12T16:53:26.114298+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:53:26.114298+0000","last_undegraded":"2024-09-12T16:53:26.114298+0000","last_fullsized":"2024-09-12T16:53:26.114298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:56.585276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.912389+0000","last_change":"2024-09-12T16:55:50.912389+0000","last_active":"2024-09-12T16:55:50.912389+0000","last_peered":"2024-09-12T16:55:50.912389+0000","last_clean":"2024-09-12T16:55:50.912389+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:55:50.912389+0000","last_undegraded":"2024-09-12T16:55:50.912389+0000","last_fullsized":"2024-09-12T16:55:50.912389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.912183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:49.304999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022824+0000","last_change":"2024-09-12T16:52:00.181358+0000","last_active":"2024-09-12T16:52:35.022824+0000","last_peered":"2024-09-12T16:52:35.022824+0000","last_clean":"2024-09-12T16:52:35.022824+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:52:35.022824+0000","last_undegraded":"2024-09-12T16:52:35.022824+0000","last_fullsized":"2024-09-12T16:52:35.022824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:32.384807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.843427+0000","last_change":"2024-09-12T16:52:02.181716+0000","last_active":"2024-09-12T16:55:43.843427+0000","last_peered":"2024-09-12T16:55:43.843427+0000","last_clean":"2024-09-12T16:55:43.843427+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:55:43.843427+0000","last_undegraded":"2024-09-12T16:55:43.843427+0000","last_fullsized":"2024-09-12T16:55:43.843427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.238474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016494+0000","last_change":"2024-09-12T16:52:04.211716+0000","last_active":"2024-09-12T16:52:35.016494+0000","last_peered":"2024-09-12T16:52:35.016494+0000","last_clean":"2024-09-12T16:52:35.016494+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:52:35.016494+0000","last_undegraded":"2024-09-12T16:52:35.016494+0000","last_fullsized":"2024-09-12T16:52:35.016494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.708673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406316+0000","last_change":"2024-09-12T16:51:58.158927+0000","last_active":"2024-09-12T16:55:12.406316+0000","last_peered":"2024-09-12T16:55:12.406316+0000","last_clean":"2024-09-12T16:55:12.406316+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:55:12.406316+0000","last_undegraded":"2024-09-12T16:55:12.406316+0000","last_fullsized":"2024-09-12T16:55:12.406316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:52.129370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.984556+0000","last_change":"2024-09-12T16:56:03.984556+0000","last_active":"2024-09-12T16:56:03.984556+0000","last_peered":"2024-09-12T16:56:03.984556+0000","last_clean":"2024-09-12T16:56:03.984556+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:56:03.984556+0000","last_undegraded":"2024-09-12T16:56:03.984556+0000","last_fullsized":"2024-09-12T16:56:03.984556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.984372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:57.918312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:04.016851+0000","last_change":"2024-09-12T16:52:00.159525+0000","last_active":"2024-09-12T16:54:04.016851+0000","last_peered":"2024-09-12T16:54:04.016851+0000","last_clean":"2024-09-12T16:54:04.016851+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:54:04.016851+0000","last_undegraded":"2024-09-12T16:54:04.016851+0000","last_fullsized":"2024-09-12T16:54:04.016851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.835655+0000","last_change":"2024-09-12T16:52:02.184114+0000","last_active":"2024-09-12T16:55:43.835655+0000","last_peered":"2024-09-12T16:55:43.835655+0000","last_clean":"2024-09-12T16:55:43.835655+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:55:43.835655+0000","last_undegraded":"2024-09-12T16:55:43.835655+0000","last_fullsized":"2024-09-12T16:55:43.835655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:51.260998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016853+0000","last_change":"2024-09-12T16:52:04.212854+0000","last_active":"2024-09-12T16:52:35.016853+0000","last_peered":"2024-09-12T16:52:35.016853+0000","last_clean":"2024-09-12T16:52:35.016853+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:52:35.016853+0000","last_undegraded":"2024-09-12T16:52:35.016853+0000","last_fullsized":"2024-09-12T16:52:35.016853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:31.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.284031+0000","last_change":"2024-09-12T16:52:06.224912+0000","last_active":"2024-09-12T16:54:11.284031+0000","last_peered":"2024-09-12T16:54:11.284031+0000","last_clean":"2024-09-12T16:54:11.284031+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:54:11.284031+0000","last_undegraded":"2024-09-12T16:54:11.284031+0000","last_fullsized":"2024-09-12T16:54:11.284031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:53.469591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:59.015579+0000","last_change":"2024-09-12T16:51:58.157261+0000","last_active":"2024-09-12T16:53:59.015579+0000","last_peered":"2024-09-12T16:53:59.015579+0000","last_clean":"2024-09-12T16:53:59.015579+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:53:59.015579+0000","last_undegraded":"2024-09-12T16:53:59.015579+0000","last_fullsized":"2024-09-12T16:53:59.015579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.951922+0000","last_change":"2024-09-12T16:55:51.951922+0000","last_active":"2024-09-12T16:55:51.951922+0000","last_peered":"2024-09-12T16:55:51.951922+0000","last_clean":"2024-09-12T16:55:51.951922+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:51.951922+0000","last_undegraded":"2024-09-12T16:55:51.951922+0000","last_fullsized":"2024-09-12T16:55:51.951922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.951717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.140563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.026467+0000","last_change":"2024-09-12T16:52:00.164196+0000","last_active":"2024-09-12T16:52:35.026467+0000","last_peered":"2024-09-12T16:52:35.026467+0000","last_clean":"2024-09-12T16:52:35.026467+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:52:35.026467+0000","last_undegraded":"2024-09-12T16:52:35.026467+0000","last_fullsized":"2024-09-12T16:52:35.026467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:24.903329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.851345+0000","last_change":"2024-09-12T16:52:02.212469+0000","last_active":"2024-09-12T16:55:43.851345+0000","last_peered":"2024-09-12T16:55:43.851345+0000","last_clean":"2024-09-12T16:55:43.851345+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:55:43.851345+0000","last_undegraded":"2024-09-12T16:55:43.851345+0000","last_fullsized":"2024-09-12T16:55:43.851345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043455+0000","last_change":"2024-09-12T16:52:04.211092+0000","last_active":"2024-09-12T16:52:35.043455+0000","last_peered":"2024-09-12T16:52:35.043455+0000","last_clean":"2024-09-12T16:52:35.043455+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:52:35.043455+0000","last_undegraded":"2024-09-12T16:52:35.043455+0000","last_fullsized":"2024-09-12T16:52:35.043455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:37.948154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031153+0000","last_change":"2024-09-12T16:52:06.224892+0000","last_active":"2024-09-12T16:52:35.031153+0000","last_peered":"2024-09-12T16:52:35.031153+0000","last_clean":"2024-09-12T16:52:35.031153+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:52:35.031153+0000","last_undegraded":"2024-09-12T16:52:35.031153+0000","last_fullsized":"2024-09-12T16:52:35.031153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:23.862554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406528+0000","last_change":"2024-09-12T16:51:58.175046+0000","last_active":"2024-09-12T16:55:12.406528+0000","last_peered":"2024-09-12T16:55:12.406528+0000","last_clean":"2024-09-12T16:55:12.406528+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:55:12.406528+0000","last_undegraded":"2024-09-12T16:55:12.406528+0000","last_fullsized":"2024-09-12T16:55:12.406528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:23.110954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.903403+0000","last_change":"2024-09-12T16:55:52.903403+0000","last_active":"2024-09-12T16:55:52.903403+0000","last_peered":"2024-09-12T16:55:52.903403+0000","last_clean":"2024-09-12T16:55:52.903403+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:55:52.903403+0000","last_undegraded":"2024-09-12T16:55:52.903403+0000","last_fullsized":"2024-09-12T16:55:52.903403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.903212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.981074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.019381+0000","last_change":"2024-09-12T16:52:00.168294+0000","last_active":"2024-09-12T16:52:35.019381+0000","last_peered":"2024-09-12T16:52:35.019381+0000","last_clean":"2024-09-12T16:52:35.019381+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:52:35.019381+0000","last_undegraded":"2024-09-12T16:52:35.019381+0000","last_fullsized":"2024-09-12T16:52:35.019381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:51.062344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.717682+0000","last_change":"2024-09-12T16:52:02.196172+0000","last_active":"2024-09-12T16:55:43.717682+0000","last_peered":"2024-09-12T16:55:43.717682+0000","last_clean":"2024-09-12T16:55:43.717682+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:55:43.717682+0000","last_undegraded":"2024-09-12T16:55:43.717682+0000","last_fullsized":"2024-09-12T16:55:43.717682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:02.649211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:04.016828+0000","last_change":"2024-09-12T16:52:04.215112+0000","last_active":"2024-09-12T16:54:04.016828+0000","last_peered":"2024-09-12T16:54:04.016828+0000","last_clean":"2024-09-12T16:54:04.016828+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:54:04.016828+0000","last_undegraded":"2024-09-12T16:54:04.016828+0000","last_fullsized":"2024-09-12T16:54:04.016828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.437862+0000","last_change":"2024-09-12T16:52:06.234025+0000","last_active":"2024-09-12T16:54:11.437862+0000","last_peered":"2024-09-12T16:54:11.437862+0000","last_clean":"2024-09-12T16:54:11.437862+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:54:11.437862+0000","last_undegraded":"2024-09-12T16:54:11.437862+0000","last_fullsized":"2024-09-12T16:54:11.437862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:23.554247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491550+0000","last_change":"2024-09-12T16:51:58.153302+0000","last_active":"2024-09-12T16:55:12.491550+0000","last_peered":"2024-09-12T16:55:12.491550+0000","last_clean":"2024-09-12T16:55:12.491550+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:55:12.491550+0000","last_undegraded":"2024-09-12T16:55:12.491550+0000","last_fullsized":"2024-09-12T16:55:12.491550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:40.425831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.025971+0000","last_change":"2024-09-12T16:56:06.025971+0000","last_active":"2024-09-12T16:56:06.025971+0000","last_peered":"2024-09-12T16:56:06.025971+0000","last_clean":"2024-09-12T16:56:06.025971+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:56:06.025971+0000","last_undegraded":"2024-09-12T16:56:06.025971+0000","last_fullsized":"2024-09-12T16:56:06.025971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.025789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:12.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043977+0000","last_change":"2024-09-12T16:52:00.162650+0000","last_active":"2024-09-12T16:52:35.043977+0000","last_peered":"2024-09-12T16:52:35.043977+0000","last_clean":"2024-09-12T16:52:35.043977+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:52:35.043977+0000","last_undegraded":"2024-09-12T16:52:35.043977+0000","last_fullsized":"2024-09-12T16:52:35.043977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.597418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.022048+0000","last_change":"2024-09-12T16:52:02.216308+0000","last_active":"2024-09-12T16:54:06.022048+0000","last_peered":"2024-09-12T16:54:06.022048+0000","last_clean":"2024-09-12T16:54:06.022048+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:54:06.022048+0000","last_undegraded":"2024-09-12T16:54:06.022048+0000","last_fullsized":"2024-09-12T16:54:06.022048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":377,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.571876+0000","last_change":"2024-09-12T16:52:04.219251+0000","last_active":"2024-09-12T16:55:43.571876+0000","last_peered":"2024-09-12T16:55:43.571876+0000","last_clean":"2024-09-12T16:55:43.571876+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:55:43.571876+0000","last_undegraded":"2024-09-12T16:55:43.571876+0000","last_fullsized":"2024-09-12T16:55:43.571876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.043443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020791+0000","last_change":"2024-09-12T16:52:06.232237+0000","last_active":"2024-09-12T16:52:35.020791+0000","last_peered":"2024-09-12T16:52:35.020791+0000","last_clean":"2024-09-12T16:52:35.020791+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:52:35.020791+0000","last_undegraded":"2024-09-12T16:52:35.020791+0000","last_fullsized":"2024-09-12T16:52:35.020791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:08.018725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.407369+0000","last_change":"2024-09-12T16:51:58.142849+0000","last_active":"2024-09-12T16:55:12.407369+0000","last_peered":"2024-09-12T16:55:12.407369+0000","last_clean":"2024-09-12T16:55:12.407369+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:55:12.407369+0000","last_undegraded":"2024-09-12T16:55:12.407369+0000","last_fullsized":"2024-09-12T16:55:12.407369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:42.603060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.904704+0000","last_change":"2024-09-12T16:55:54.904704+0000","last_active":"2024-09-12T16:55:54.904704+0000","last_peered":"2024-09-12T16:55:54.904704+0000","last_clean":"2024-09-12T16:55:54.904704+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:55:54.904704+0000","last_undegraded":"2024-09-12T16:55:54.904704+0000","last_fullsized":"2024-09-12T16:55:54.904704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.302723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031597+0000","last_change":"2024-09-12T16:52:00.179417+0000","last_active":"2024-09-12T16:52:35.031597+0000","last_peered":"2024-09-12T16:52:35.031597+0000","last_clean":"2024-09-12T16:52:35.031597+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:52:35.031597+0000","last_undegraded":"2024-09-12T16:52:35.031597+0000","last_fullsized":"2024-09-12T16:52:35.031597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:39.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.762354+0000","last_change":"2024-09-12T16:52:02.182087+0000","last_active":"2024-09-12T16:55:43.762354+0000","last_peered":"2024-09-12T16:55:43.762354+0000","last_clean":"2024-09-12T16:55:43.762354+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:55:43.762354+0000","last_undegraded":"2024-09-12T16:55:43.762354+0000","last_fullsized":"2024-09-12T16:55:43.762354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:10.821781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021023+0000","last_change":"2024-09-12T16:52:04.206758+0000","last_active":"2024-09-12T16:52:35.021023+0000","last_peered":"2024-09-12T16:52:35.021023+0000","last_clean":"2024-09-12T16:52:35.021023+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:52:35.021023+0000","last_undegraded":"2024-09-12T16:52:35.021023+0000","last_fullsized":"2024-09-12T16:52:35.021023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.089165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047680+0000","last_change":"2024-09-12T16:52:06.224320+0000","last_active":"2024-09-12T16:52:35.047680+0000","last_peered":"2024-09-12T16:52:35.047680+0000","last_clean":"2024-09-12T16:52:35.047680+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:52:35.047680+0000","last_undegraded":"2024-09-12T16:52:35.047680+0000","last_fullsized":"2024-09-12T16:52:35.047680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:34.785095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.062896+0000","last_change":"2024-09-12T16:51:58.141944+0000","last_active":"2024-09-12T16:55:12.062896+0000","last_peered":"2024-09-12T16:55:12.062896+0000","last_clean":"2024-09-12T16:55:12.062896+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:55:12.062896+0000","last_undegraded":"2024-09-12T16:55:12.062896+0000","last_fullsized":"2024-09-12T16:55:12.062896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.994386+0000","last_change":"2024-09-12T16:56:04.994386+0000","last_active":"2024-09-12T16:56:04.994386+0000","last_peered":"2024-09-12T16:56:04.994386+0000","last_clean":"2024-09-12T16:56:04.994386+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:56:04.994386+0000","last_undegraded":"2024-09-12T16:56:04.994386+0000","last_fullsized":"2024-09-12T16:56:04.994386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.994131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:46.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020018+0000","last_change":"2024-09-12T16:52:00.183375+0000","last_active":"2024-09-12T16:52:35.020018+0000","last_peered":"2024-09-12T16:52:35.020018+0000","last_clean":"2024-09-12T16:52:35.020018+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:52:35.020018+0000","last_undegraded":"2024-09-12T16:52:35.020018+0000","last_fullsized":"2024-09-12T16:52:35.020018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:40.969978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.771290+0000","last_change":"2024-09-12T16:52:02.175268+0000","last_active":"2024-09-12T16:55:43.771290+0000","last_peered":"2024-09-12T16:55:43.771290+0000","last_clean":"2024-09-12T16:55:43.771290+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:55:43.771290+0000","last_undegraded":"2024-09-12T16:55:43.771290+0000","last_fullsized":"2024-09-12T16:55:43.771290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:54.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022138+0000","last_change":"2024-09-12T16:52:04.209135+0000","last_active":"2024-09-12T16:52:35.022138+0000","last_peered":"2024-09-12T16:52:35.022138+0000","last_clean":"2024-09-12T16:52:35.022138+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:52:35.022138+0000","last_undegraded":"2024-09-12T16:52:35.022138+0000","last_fullsized":"2024-09-12T16:52:35.022138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:49.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.442179+0000","last_change":"2024-09-12T16:52:06.237385+0000","last_active":"2024-09-12T16:54:11.442179+0000","last_peered":"2024-09-12T16:54:11.442179+0000","last_clean":"2024-09-12T16:54:11.442179+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:54:11.442179+0000","last_undegraded":"2024-09-12T16:54:11.442179+0000","last_fullsized":"2024-09-12T16:54:11.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:58.165732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406440+0000","last_change":"2024-09-12T16:51:58.168050+0000","last_active":"2024-09-12T16:55:12.406440+0000","last_peered":"2024-09-12T16:55:12.406440+0000","last_clean":"2024-09-12T16:55:12.406440+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:55:12.406440+0000","last_undegraded":"2024-09-12T16:55:12.406440+0000","last_fullsized":"2024-09-12T16:55:12.406440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:30.432926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.393326+0000","last_change":"2024-09-12T16:55:53.393160+0000","last_active":"2024-09-12T16:55:53.393326+0000","last_peered":"2024-09-12T16:55:53.393326+0000","last_clean":"2024-09-12T16:55:53.393326+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:55:53.393326+0000","last_undegraded":"2024-09-12T16:55:53.393326+0000","last_fullsized":"2024-09-12T16:55:53.393326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.392972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.910111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022978+0000","last_change":"2024-09-12T16:52:00.162253+0000","last_active":"2024-09-12T16:52:35.022978+0000","last_peered":"2024-09-12T16:52:35.022978+0000","last_clean":"2024-09-12T16:52:35.022978+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:52:35.022978+0000","last_undegraded":"2024-09-12T16:52:35.022978+0000","last_fullsized":"2024-09-12T16:52:35.022978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:02.417426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'30","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.705579+0000","last_change":"2024-09-12T16:52:02.212684+0000","last_active":"2024-09-12T16:55:43.705579+0000","last_peered":"2024-09-12T16:55:43.705579+0000","last_clean":"2024-09-12T16:55:43.705579+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:55:43.705579+0000","last_undegraded":"2024-09-12T16:55:43.705579+0000","last_fullsized":"2024-09-12T16:55:43.705579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:00.299441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032673+0000","last_change":"2024-09-12T16:52:04.209557+0000","last_active":"2024-09-12T16:52:35.032673+0000","last_peered":"2024-09-12T16:52:35.032673+0000","last_clean":"2024-09-12T16:52:35.032673+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:52:35.032673+0000","last_undegraded":"2024-09-12T16:52:35.032673+0000","last_fullsized":"2024-09-12T16:52:35.032673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:33.026740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.024814+0000","last_change":"2024-09-12T16:52:06.234752+0000","last_active":"2024-09-12T16:54:09.024814+0000","last_peered":"2024-09-12T16:54:09.024814+0000","last_clean":"2024-09-12T16:54:09.024814+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:54:09.024814+0000","last_undegraded":"2024-09-12T16:54:09.024814+0000","last_fullsized":"2024-09-12T16:54:09.024814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.433924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406497+0000","last_change":"2024-09-12T16:51:58.141857+0000","last_active":"2024-09-12T16:55:12.406497+0000","last_peered":"2024-09-12T16:55:12.406497+0000","last_clean":"2024-09-12T16:55:12.406497+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:55:12.406497+0000","last_undegraded":"2024-09-12T16:55:12.406497+0000","last_fullsized":"2024-09-12T16:55:12.406497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:34.368226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.860201+0000","last_change":"2024-09-12T16:55:53.860045+0000","last_active":"2024-09-12T16:55:53.860201+0000","last_peered":"2024-09-12T16:55:53.860201+0000","last_clean":"2024-09-12T16:55:53.860201+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:53.860201+0000","last_undegraded":"2024-09-12T16:55:53.860201+0000","last_fullsized":"2024-09-12T16:55:53.860201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.859853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:42.401708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:07.263520+0000","last_change":"2024-09-12T16:52:00.163609+0000","last_active":"2024-09-12T16:54:07.263520+0000","last_peered":"2024-09-12T16:54:07.263520+0000","last_clean":"2024-09-12T16:54:07.263520+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:54:07.263520+0000","last_undegraded":"2024-09-12T16:54:07.263520+0000","last_fullsized":"2024-09-12T16:54:07.263520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:40.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.723783+0000","last_change":"2024-09-12T16:52:02.212039+0000","last_active":"2024-09-12T16:55:43.723783+0000","last_peered":"2024-09-12T16:55:43.723783+0000","last_clean":"2024-09-12T16:55:43.723783+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:55:43.723783+0000","last_undegraded":"2024-09-12T16:55:43.723783+0000","last_fullsized":"2024-09-12T16:55:43.723783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:30.940482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022180+0000","last_change":"2024-09-12T16:52:04.194659+0000","last_active":"2024-09-12T16:52:35.022180+0000","last_peered":"2024-09-12T16:52:35.022180+0000","last_clean":"2024-09-12T16:52:35.022180+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:52:35.022180+0000","last_undegraded":"2024-09-12T16:52:35.022180+0000","last_fullsized":"2024-09-12T16:52:35.022180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:10.799769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.029336+0000","last_change":"2024-09-12T16:52:06.237422+0000","last_active":"2024-09-12T16:54:09.029336+0000","last_peered":"2024-09-12T16:54:09.029336+0000","last_clean":"2024-09-12T16:54:09.029336+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:54:09.029336+0000","last_undegraded":"2024-09-12T16:54:09.029336+0000","last_fullsized":"2024-09-12T16:54:09.029336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:35.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.020472+0000","last_change":"2024-09-12T16:51:58.171119+0000","last_active":"2024-09-12T16:54:11.020472+0000","last_peered":"2024-09-12T16:54:11.020472+0000","last_clean":"2024-09-12T16:54:11.020472+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:54:11.020472+0000","last_undegraded":"2024-09-12T16:54:11.020472+0000","last_fullsized":"2024-09-12T16:54:11.020472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:42.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.937794+0000","last_change":"2024-09-12T16:55:56.937794+0000","last_active":"2024-09-12T16:55:56.937794+0000","last_peered":"2024-09-12T16:55:56.937794+0000","last_clean":"2024-09-12T16:55:56.937794+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:55:56.937794+0000","last_undegraded":"2024-09-12T16:55:56.937794+0000","last_fullsized":"2024-09-12T16:55:56.937794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.937568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:32.183469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'13","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.450215+0000","last_change":"2024-09-12T16:51:58.149936+0000","last_active":"2024-09-12T16:54:11.450215+0000","last_peered":"2024-09-12T16:54:11.450215+0000","last_clean":"2024-09-12T16:54:11.450215+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:54:11.450215+0000","last_undegraded":"2024-09-12T16:54:11.450215+0000","last_fullsized":"2024-09-12T16:54:11.450215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:45.542639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.401142+0000","last_change":"2024-09-12T16:55:56.401142+0000","last_active":"2024-09-12T16:55:56.401142+0000","last_peered":"2024-09-12T16:55:56.401142+0000","last_clean":"2024-09-12T16:55:56.401142+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:55:56.401142+0000","last_undegraded":"2024-09-12T16:55:56.401142+0000","last_fullsized":"2024-09-12T16:55:56.401142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.400960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:14.461538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559962+0000","last_change":"2024-09-12T16:51:58.172460+0000","last_active":"2024-09-12T16:55:12.559962+0000","last_peered":"2024-09-12T16:55:12.559962+0000","last_clean":"2024-09-12T16:55:12.559962+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:55:12.559962+0000","last_undegraded":"2024-09-12T16:55:12.559962+0000","last_fullsized":"2024-09-12T16:55:12.559962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:11.477678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:01.020483+0000","last_change":"2024-09-12T16:51:56.154964+0000","last_active":"2024-09-12T16:54:01.020483+0000","last_peered":"2024-09-12T16:54:01.020483+0000","last_clean":"2024-09-12T16:54:01.020483+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:54:01.020483+0000","last_undegraded":"2024-09-12T16:54:01.020483+0000","last_fullsized":"2024-09-12T16:54:01.020483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206890+0000","last_change":"2024-09-12T16:51:58.153420+0000","last_active":"2024-09-12T16:55:12.206890+0000","last_peered":"2024-09-12T16:55:12.206890+0000","last_clean":"2024-09-12T16:55:12.206890+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:55:12.206890+0000","last_undegraded":"2024-09-12T16:55:12.206890+0000","last_fullsized":"2024-09-12T16:55:12.206890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:45.866817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.440130+0000","last_change":"2024-09-12T16:55:54.440130+0000","last_active":"2024-09-12T16:55:54.440130+0000","last_peered":"2024-09-12T16:55:54.440130+0000","last_clean":"2024-09-12T16:55:54.440130+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:55:54.440130+0000","last_undegraded":"2024-09-12T16:55:54.440130+0000","last_fullsized":"2024-09-12T16:55:54.440130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.439958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:13.647744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.059507+0000","last_change":"2024-09-12T16:52:35.058216+0000","last_active":"2024-09-12T16:52:35.059507+0000","last_peered":"2024-09-12T16:52:35.059507+0000","last_clean":"2024-09-12T16:52:35.059507+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:52:35.059507+0000","last_undegraded":"2024-09-12T16:52:35.059507+0000","last_fullsized":"2024-09-12T16:52:35.059507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:04.174584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.406202+0000","last_change":"2024-09-12T16:55:57.406202+0000","last_active":"2024-09-12T16:55:57.406202+0000","last_peered":"2024-09-12T16:55:57.406202+0000","last_clean":"2024-09-12T16:55:57.406202+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:55:57.406202+0000","last_undegraded":"2024-09-12T16:55:57.406202+0000","last_fullsized":"2024-09-12T16:55:57.406202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.405992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:26.716714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.038033+0000","last_change":"2024-09-12T16:51:58.173240+0000","last_active":"2024-09-12T16:52:35.038033+0000","last_peered":"2024-09-12T16:52:35.038033+0000","last_clean":"2024-09-12T16:52:35.038033+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:52:35.038033+0000","last_undegraded":"2024-09-12T16:52:35.038033+0000","last_fullsized":"2024-09-12T16:52:35.038033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:49.259251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.952358+0000","last_change":"2024-09-12T16:55:55.952358+0000","last_active":"2024-09-12T16:55:55.952358+0000","last_peered":"2024-09-12T16:55:55.952358+0000","last_clean":"2024-09-12T16:55:55.952358+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:55:55.952358+0000","last_undegraded":"2024-09-12T16:55:55.952358+0000","last_fullsized":"2024-09-12T16:55:55.952358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.952167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:25.813446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.762612+0000","last_change":"2024-09-12T16:51:58.149306+0000","last_active":"2024-09-12T16:53:25.762612+0000","last_peered":"2024-09-12T16:53:25.762612+0000","last_clean":"2024-09-12T16:53:25.762612+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:53:25.762612+0000","last_undegraded":"2024-09-12T16:53:25.762612+0000","last_fullsized":"2024-09-12T16:53:25.762612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:31.938434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.987345+0000","last_change":"2024-09-12T16:55:57.987345+0000","last_active":"2024-09-12T16:55:57.987345+0000","last_peered":"2024-09-12T16:55:57.987345+0000","last_clean":"2024-09-12T16:55:57.987345+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:55:57.987345+0000","last_undegraded":"2024-09-12T16:55:57.987345+0000","last_fullsized":"2024-09-12T16:55:57.987345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.987068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:06.950990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.220234+0000","last_change":"2024-09-12T16:51:58.162339+0000","last_active":"2024-09-12T16:55:12.220234+0000","last_peered":"2024-09-12T16:55:12.220234+0000","last_clean":"2024-09-12T16:55:12.220234+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:55:12.220234+0000","last_undegraded":"2024-09-12T16:55:12.220234+0000","last_fullsized":"2024-09-12T16:55:12.220234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:52.597412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.432903+0000","last_change":"2024-09-12T16:55:55.432903+0000","last_active":"2024-09-12T16:55:55.432903+0000","last_peered":"2024-09-12T16:55:55.432903+0000","last_clean":"2024-09-12T16:55:55.432903+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:55:55.432903+0000","last_undegraded":"2024-09-12T16:55:55.432903+0000","last_fullsized":"2024-09-12T16:55:55.432903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.432712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.091150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559577+0000","last_change":"2024-09-12T16:51:58.159807+0000","last_active":"2024-09-12T16:55:12.559577+0000","last_peered":"2024-09-12T16:55:12.559577+0000","last_clean":"2024-09-12T16:55:12.559577+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:55:12.559577+0000","last_undegraded":"2024-09-12T16:55:12.559577+0000","last_fullsized":"2024-09-12T16:55:12.559577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:05.194424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.023142+0000","last_change":"2024-09-12T16:51:56.155038+0000","last_active":"2024-09-12T16:52:35.023142+0000","last_peered":"2024-09-12T16:52:35.023142+0000","last_clean":"2024-09-12T16:52:35.023142+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:52:35.023142+0000","last_undegraded":"2024-09-12T16:52:35.023142+0000","last_fullsized":"2024-09-12T16:52:35.023142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:24.208686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491894+0000","last_change":"2024-09-12T16:51:58.159514+0000","last_active":"2024-09-12T16:55:12.491894+0000","last_peered":"2024-09-12T16:55:12.491894+0000","last_clean":"2024-09-12T16:55:12.491894+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:55:12.491894+0000","last_undegraded":"2024-09-12T16:55:12.491894+0000","last_fullsized":"2024-09-12T16:55:12.491894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.364726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.392236+0000","last_change":"2024-09-12T16:56:00.392236+0000","last_active":"2024-09-12T16:56:00.392236+0000","last_peered":"2024-09-12T16:56:00.392236+0000","last_clean":"2024-09-12T16:56:00.392236+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:56:00.392236+0000","last_undegraded":"2024-09-12T16:56:00.392236+0000","last_fullsized":"2024-09-12T16:56:00.392236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.392055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:04.803837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.405710+0000","last_change":"2024-09-12T16:51:58.176452+0000","last_active":"2024-09-12T16:55:12.405710+0000","last_peered":"2024-09-12T16:55:12.405710+0000","last_clean":"2024-09-12T16:55:12.405710+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:55:12.405710+0000","last_undegraded":"2024-09-12T16:55:12.405710+0000","last_fullsized":"2024-09-12T16:55:12.405710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:45.955514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.980434+0000","last_change":"2024-09-12T16:55:56.980434+0000","last_active":"2024-09-12T16:55:56.980434+0000","last_peered":"2024-09-12T16:55:56.980434+0000","last_clean":"2024-09-12T16:55:56.980434+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:55:56.980434+0000","last_undegraded":"2024-09-12T16:55:56.980434+0000","last_fullsized":"2024-09-12T16:55:56.980434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.980237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:15.364632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:43.309364+0000","last_change":"2024-09-12T16:51:58.146572+0000","last_active":"2024-09-12T16:52:43.309364+0000","last_peered":"2024-09-12T16:52:43.309364+0000","last_clean":"2024-09-12T16:52:43.309364+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:52:43.309364+0000","last_undegraded":"2024-09-12T16:52:43.309364+0000","last_fullsized":"2024-09-12T16:52:43.309364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:01.315966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.999462+0000","last_change":"2024-09-12T16:55:57.999462+0000","last_active":"2024-09-12T16:55:57.999462+0000","last_peered":"2024-09-12T16:55:57.999462+0000","last_clean":"2024-09-12T16:55:57.999462+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:55:57.999462+0000","last_undegraded":"2024-09-12T16:55:57.999462+0000","last_fullsized":"2024-09-12T16:55:57.999462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.999280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.958335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:26.114250+0000","last_change":"2024-09-12T16:51:58.172245+0000","last_active":"2024-09-12T16:53:26.114250+0000","last_peered":"2024-09-12T16:53:26.114250+0000","last_clean":"2024-09-12T16:53:26.114250+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:53:26.114250+0000","last_undegraded":"2024-09-12T16:53:26.114250+0000","last_fullsized":"2024-09-12T16:53:26.114250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:30.077956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.087965+0000","last_change":"2024-09-12T16:51:56.153153+0000","last_active":"2024-09-12T16:52:41.087965+0000","last_peered":"2024-09-12T16:52:41.087965+0000","last_clean":"2024-09-12T16:52:41.087965+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:52:41.087965+0000","last_undegraded":"2024-09-12T16:52:41.087965+0000","last_fullsized":"2024-09-12T16:52:41.087965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:50.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.204146+0000","last_change":"2024-09-12T16:51:58.148643+0000","last_active":"2024-09-12T16:55:12.204146+0000","last_peered":"2024-09-12T16:55:12.204146+0000","last_clean":"2024-09-12T16:55:12.204146+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:55:12.204146+0000","last_undegraded":"2024-09-12T16:55:12.204146+0000","last_fullsized":"2024-09-12T16:55:12.204146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:32.984633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048111+0000","last_change":"2024-09-12T16:51:56.166599+0000","last_active":"2024-09-12T16:52:35.048111+0000","last_peered":"2024-09-12T16:52:35.048111+0000","last_clean":"2024-09-12T16:52:35.048111+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:52:35.048111+0000","last_undegraded":"2024-09-12T16:52:35.048111+0000","last_fullsized":"2024-09-12T16:52:35.048111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.428924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.206978+0000","last_change":"2024-09-12T16:52:35.049949+0000","last_active":"2024-09-12T16:55:12.206978+0000","last_peered":"2024-09-12T16:55:12.206978+0000","last_clean":"2024-09-12T16:55:12.206978+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:55:12.206978+0000","last_undegraded":"2024-09-12T16:55:12.206978+0000","last_fullsized":"2024-09-12T16:55:12.206978+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.495939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.983767+0000","last_change":"2024-09-12T16:55:59.983767+0000","last_active":"2024-09-12T16:55:59.983767+0000","last_peered":"2024-09-12T16:55:59.983767+0000","last_clean":"2024-09-12T16:55:59.983767+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:55:59.983767+0000","last_undegraded":"2024-09-12T16:55:59.983767+0000","last_fullsized":"2024-09-12T16:55:59.983767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.983590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:23.882360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.434439+0000","last_change":"2024-09-12T16:51:58.159251+0000","last_active":"2024-09-12T16:54:11.434439+0000","last_peered":"2024-09-12T16:54:11.434439+0000","last_clean":"2024-09-12T16:54:11.434439+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:54:11.434439+0000","last_undegraded":"2024-09-12T16:54:11.434439+0000","last_fullsized":"2024-09-12T16:54:11.434439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:33.404970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:41.094347+0000","last_change":"2024-09-12T16:51:56.169106+0000","last_active":"2024-09-12T16:52:41.094347+0000","last_peered":"2024-09-12T16:52:41.094347+0000","last_clean":"2024-09-12T16:52:41.094347+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:52:41.094347+0000","last_undegraded":"2024-09-12T16:52:41.094347+0000","last_fullsized":"2024-09-12T16:52:41.094347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:11.710348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.567566+0000","last_change":"2024-09-12T16:51:56.155830+0000","last_active":"2024-09-12T16:52:42.567566+0000","last_peered":"2024-09-12T16:52:42.567566+0000","last_clean":"2024-09-12T16:52:42.567566+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:52:42.567566+0000","last_undegraded":"2024-09-12T16:52:42.567566+0000","last_fullsized":"2024-09-12T16:52:42.567566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:55.097218+0000","last_clean_scrub_stamp":"2024-09-12T16:51:55.097218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.219841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.030048+0000","last_change":"2024-09-12T16:51:58.164418+0000","last_active":"2024-09-12T16:52:35.030048+0000","last_peered":"2024-09-12T16:52:35.030048+0000","last_clean":"2024-09-12T16:52:35.030048+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:52:35.030048+0000","last_undegraded":"2024-09-12T16:52:35.030048+0000","last_fullsized":"2024-09-12T16:52:35.030048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:15.103678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.427883+0000","last_change":"2024-09-12T16:56:01.427883+0000","last_active":"2024-09-12T16:56:01.427883+0000","last_peered":"2024-09-12T16:56:01.427883+0000","last_clean":"2024-09-12T16:56:01.427883+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:56:01.427883+0000","last_undegraded":"2024-09-12T16:56:01.427883+0000","last_fullsized":"2024-09-12T16:56:01.427883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.427706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:56.339223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:42.246329+0000","last_change":"2024-09-12T16:51:58.173368+0000","last_active":"2024-09-12T16:52:42.246329+0000","last_peered":"2024-09-12T16:52:42.246329+0000","last_clean":"2024-09-12T16:52:42.246329+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:52:42.246329+0000","last_undegraded":"2024-09-12T16:52:42.246329+0000","last_fullsized":"2024-09-12T16:52:42.246329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:45.341574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":474,"ondisk_log_size":474,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640312,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640313,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":740498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673017,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":740621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":151866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:56:09.236 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.237 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.237 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.237 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.237 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.237 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.237 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.238 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.238 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.238 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.238 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.238 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.238 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.238 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.238 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.239 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.239 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.239 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.239 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.239 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.239 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.239 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.239 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.240 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.240 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.240 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.241 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.241 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.241 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.241 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.242 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.242 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.242 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.242 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.242 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.242 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.242 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.242 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.243 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.243 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.243 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.243 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.243 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.244 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.244 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.244 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.244 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.244 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.244 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.244 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.245 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.245 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.245 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.245 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.245 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.245 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.245 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.246 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.246 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.246 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.246 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.246 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.246 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.246 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.246 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.247 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.247 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.247 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.247 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.247 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.247 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.247 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.247 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.248 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.248 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.248 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.248 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.248 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.248 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.248 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.249 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.249 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.249 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.249 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.249 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.249 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.249 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.249 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.250 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.250 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.250 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.250 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.250 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.251 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.251 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.251 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.251 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.252 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.253 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.253 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.253 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.253 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.253 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.254 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.255 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.255 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.255 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.255 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.255 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.255 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.256 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.256 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.256 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.256 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.256 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.256 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.256 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.256 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.257 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.257 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.257 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.257 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.257 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.257 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.257 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.258 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.258 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.258 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.258 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.258 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.258 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.258 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.258 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.259 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.259 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.259 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.259 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.259 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.259 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.259 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.259 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.260 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.260 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.260 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.260 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.260 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.260 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.260 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.261 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.261 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.261 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.262 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.262 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.262 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.262 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.263 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.263 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.263 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.263 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.263 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.264 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.264 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.264 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.264 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.264 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.264 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.265 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.265 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.265 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.265 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.265 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.265 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.265 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.265 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.266 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.266 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T16:51:55.097218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.266 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.266 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:09.266 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T16:56:29.267 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:56:29.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b9ef0f640 1 Processor -- start 2024-09-12T16:56:29.397 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b9ef0f640 1 -- start start 2024-09-12T16:56:29.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b9ef0f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5b98132420 0x7f5b98134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:29.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b9ef0f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9812b9d0 con 0x7f5b9812aee0 2024-09-12T16:56:29.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b9ef0f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f5b98071e70 con 0x7f5b98132420 2024-09-12T16:56:29.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b97fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5b98132420 0x7f5b98134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:29.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b9ccab640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5b9812aee0 0x7f5b9812b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52542/0 (socket says 172.21.15.122:52542) 2024-09-12T16:56:29.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b9ccab640 1 -- 172.21.15.122:0/3307509701 learned_addr learned my addr 172.21.15.122:0/3307509701 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:56:29.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b97fff640 1 -- 172.21.15.122:0/3307509701 >> v1:172.21.15.122:6789/0 conn(0x7f5b9812aee0 legacy=0x7f5b9812b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:29.398 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b97fff640 1 -- 172.21.15.122:0/3307509701 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b980008e0 con 0x7f5b98132420 2024-09-12T16:56:29.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b97fff640 1 --2- 172.21.15.122:0/3307509701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b98132420 0x7f5b98134810 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009740 tx=0x7f5b8c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9916f1abfe4f484b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:29.399 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b977fe640 1 -- 172.21.15.122:0/3307509701 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b8c0b1070 con 0x7f5b98132420 2024-09-12T16:56:29.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b977fe640 1 -- 172.21.15.122:0/3307509701 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0ac520 con 0x7f5b98132420 2024-09-12T16:56:29.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.392+0000 7f5b977fe640 1 -- 172.21.15.122:0/3307509701 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b8c0ac820 con 0x7f5b98132420 2024-09-12T16:56:29.400 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/3307509701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b98132420 msgr2=0x7f5b98134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:29.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 --2- 172.21.15.122:0/3307509701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b98132420 0x7f5b98134810 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009740 tx=0x7f5b8c01c370 comp rx=0 tx=0).stop 2024-09-12T16:56:29.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/3307509701 shutdown_connections 2024-09-12T16:56:29.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 --2- 172.21.15.122:0/3307509701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b98132420 0x7f5b98134810 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:29.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/3307509701 >> 172.21.15.122:0/3307509701 conn(0x7f5b980a0a60 msgr2=0x7f5b9806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:56:29.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/3307509701 shutdown_connections 2024-09-12T16:56:29.401 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/3307509701 wait complete. 2024-09-12T16:56:29.402 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 Processor -- start 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- start start 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9812aee0 0x7f5b981298a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5b98137570 con 0x7f5b9812aee0 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ccab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9812aee0 0x7f5b981298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ccab640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9812aee0 0x7f5b981298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49060/0 (socket says 172.21.15.122:49060) 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ccab640 1 -- 172.21.15.122:0/4194514842 learned_addr learned my addr 172.21.15.122:0/4194514842 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ccab640 1 -- 172.21.15.122:0/4194514842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b98073a80 con 0x7f5b9812aee0 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ccab640 1 --2- 172.21.15.122:0/4194514842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9812aee0 0x7f5b981298a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800c450 tx=0x7f5b8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b957fa640 1 -- 172.21.15.122:0/4194514842 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b88017070 con 0x7f5b9812aee0 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b957fa640 1 -- 172.21.15.122:0/4194514842 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b88005c20 con 0x7f5b9812aee0 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9811c510 con 0x7f5b9812aee0 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b957fa640 1 -- 172.21.15.122:0/4194514842 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b880070d0 con 0x7f5b9812aee0 2024-09-12T16:56:29.403 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b98129fb0 con 0x7f5b9812aee0 2024-09-12T16:56:29.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9811b300 con 0x7f5b9812aee0 2024-09-12T16:56:29.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.396+0000 7f5b957fa640 1 -- 172.21.15.122:0/4194514842 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5b8801a070 con 0x7f5b9812aee0 2024-09-12T16:56:29.404 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.400+0000 7f5b957fa640 1 --2- 172.21.15.122:0/4194514842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f5b8403b1d0 0x7f5b8403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:29.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.400+0000 7f5b957fa640 1 -- 172.21.15.122:0/4194514842 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5b8804ea90 con 0x7f5b9812aee0 2024-09-12T16:56:29.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.400+0000 7f5b97fff640 1 --2- 172.21.15.122:0/4194514842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f5b8403b1d0 0x7f5b8403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:29.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.400+0000 7f5b97fff640 1 --2- 172.21.15.122:0/4194514842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f5b8403b1d0 0x7f5b8403d690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0ae000 tx=0x7f5b8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:29.408 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.404+0000 7f5b957fa640 1 -- 172.21.15.122:0/4194514842 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5b88019cd0 con 0x7f5b9812aee0 2024-09-12T16:56:29.574 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.568+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b9812b2c0 con 0x7f5b8403b1d0 2024-09-12T16:56:29.602 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.600+0000 7f5b957fa640 1 -- 172.21.15.122:0/4194514842 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664679 (secure 0 0 0) 0x7f5b9812b2c0 con 0x7f5b8403b1d0 2024-09-12T16:56:29.605 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:56:29.616 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:56:29.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.604+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f5b8403b1d0 msgr2=0x7f5b8403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:29.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.604+0000 7f5b9ef0f640 1 --2- 172.21.15.122:0/4194514842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f5b8403b1d0 0x7f5b8403d690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0ae000 tx=0x7f5b8c008040 comp rx=0 tx=0).stop 2024-09-12T16:56:29.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.604+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9812aee0 msgr2=0x7f5b981298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:29.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.604+0000 7f5b9ef0f640 1 --2- 172.21.15.122:0/4194514842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9812aee0 0x7f5b981298a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800c450 tx=0x7f5b8800c910 comp rx=0 tx=0).stop 2024-09-12T16:56:29.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.608+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 shutdown_connections 2024-09-12T16:56:29.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.608+0000 7f5b9ef0f640 1 --2- 172.21.15.122:0/4194514842 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f5b8403b1d0 0x7f5b8403d690 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:29.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.608+0000 7f5b9ef0f640 1 --2- 172.21.15.122:0/4194514842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b9812aee0 0x7f5b981298a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:29.617 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.608+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 >> 172.21.15.122:0/4194514842 conn(0x7f5b980a0a60 msgr2=0x7f5b980a1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:56:29.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.608+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 shutdown_connections 2024-09-12T16:56:29.618 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:29.608+0000 7f5b9ef0f640 1 -- 172.21.15.122:0/4194514842 wait complete. 2024-09-12T16:56:29.631 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-12T16:56:28.069849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5138,"num_read_kb":4724,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4607,"ondisk_log_size":4607,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160928,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326432,"statfs":{"total":386547056640,"available":386382266368,"internally_reserved":0,"allocated":2981888,"data_stored":1785572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006891"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.961212+0000","last_change":"2024-09-12T16:56:03.961062+0000","last_active":"2024-09-12T16:56:03.961212+0000","last_peered":"2024-09-12T16:56:03.961212+0000","last_clean":"2024-09-12T16:56:03.961212+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:56:03.961212+0000","last_undegraded":"2024-09-12T16:56:03.961212+0000","last_fullsized":"2024-09-12T16:56:03.961212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.960834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:37.770581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.300472+0000","last_change":"2024-09-12T16:56:20.300472+0000","last_active":"2024-09-12T16:56:20.300472+0000","last_peered":"2024-09-12T16:56:20.300472+0000","last_clean":"2024-09-12T16:56:20.300472+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:56:20.300472+0000","last_undegraded":"2024-09-12T16:56:20.300472+0000","last_fullsized":"2024-09-12T16:56:20.300472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:20.300256+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:20.300256+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.300256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:32.742102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.441857+0000","last_change":"2024-09-12T16:56:02.441693+0000","last_active":"2024-09-12T16:56:02.441857+0000","last_peered":"2024-09-12T16:56:02.441857+0000","last_clean":"2024-09-12T16:56:02.441857+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:56:02.441857+0000","last_undegraded":"2024-09-12T16:56:02.441857+0000","last_fullsized":"2024-09-12T16:56:02.441857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.441477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:15.024861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.493995+0000","last_change":"2024-09-12T16:51:58.166339+0000","last_active":"2024-09-12T16:55:12.493995+0000","last_peered":"2024-09-12T16:55:12.493995+0000","last_clean":"2024-09-12T16:55:12.493995+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:55:12.493995+0000","last_undegraded":"2024-09-12T16:55:12.493995+0000","last_fullsized":"2024-09-12T16:55:12.493995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:46.116016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.033441+0000","last_change":"2024-09-12T16:56:16.033441+0000","last_active":"2024-09-12T16:56:16.033441+0000","last_peered":"2024-09-12T16:56:16.033441+0000","last_clean":"2024-09-12T16:56:16.033441+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:56:16.033441+0000","last_undegraded":"2024-09-12T16:56:16.033441+0000","last_fullsized":"2024-09-12T16:56:16.033441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:16.033239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:16.033239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.033239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:59.167081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.425082+0000","last_change":"2024-09-12T16:51:58.163269+0000","last_active":"2024-09-12T16:55:12.425082+0000","last_peered":"2024-09-12T16:55:12.425082+0000","last_clean":"2024-09-12T16:55:12.425082+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:55:12.425082+0000","last_undegraded":"2024-09-12T16:55:12.425082+0000","last_fullsized":"2024-09-12T16:55:12.425082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:17.060923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.000241+0000","last_change":"2024-09-12T16:55:59.000089+0000","last_active":"2024-09-12T16:55:59.000241+0000","last_peered":"2024-09-12T16:55:59.000241+0000","last_clean":"2024-09-12T16:55:59.000241+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:55:59.000241+0000","last_undegraded":"2024-09-12T16:55:59.000241+0000","last_fullsized":"2024-09-12T16:55:59.000241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.999904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.689260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.559316+0000","last_change":"2024-09-12T16:51:58.165836+0000","last_active":"2024-09-12T16:55:12.559316+0000","last_peered":"2024-09-12T16:55:12.559316+0000","last_clean":"2024-09-12T16:55:12.559316+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:55:12.559316+0000","last_undegraded":"2024-09-12T16:55:12.559316+0000","last_fullsized":"2024-09-12T16:55:12.559316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:31.786300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.054183+0000","last_change":"2024-09-12T16:56:15.054183+0000","last_active":"2024-09-12T16:56:15.054183+0000","last_peered":"2024-09-12T16:56:15.054183+0000","last_clean":"2024-09-12T16:56:15.054183+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:56:15.054183+0000","last_undegraded":"2024-09-12T16:56:15.054183+0000","last_fullsized":"2024-09-12T16:56:15.054183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:15.053960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:15.053960+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.053960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:40.643203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.330004+0000","last_change":"2024-09-12T16:56:21.330004+0000","last_active":"2024-09-12T16:56:21.330004+0000","last_peered":"2024-09-12T16:56:21.330004+0000","last_clean":"2024-09-12T16:56:21.330004+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:56:21.330004+0000","last_undegraded":"2024-09-12T16:56:21.330004+0000","last_fullsized":"2024-09-12T16:56:21.330004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:21.329825+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:21.329825+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.329825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:52.622109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.923745+0000","last_change":"2024-09-12T16:56:06.923745+0000","last_active":"2024-09-12T16:56:06.923745+0000","last_peered":"2024-09-12T16:56:06.923745+0000","last_clean":"2024-09-12T16:56:06.923745+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:56:06.923745+0000","last_undegraded":"2024-09-12T16:56:06.923745+0000","last_fullsized":"2024-09-12T16:56:06.923745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.923558+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.923558+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.923558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:45.607137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.769419+0000","last_change":"2024-09-12T16:51:58.165599+0000","last_active":"2024-09-12T16:54:06.769419+0000","last_peered":"2024-09-12T16:54:06.769419+0000","last_clean":"2024-09-12T16:54:06.769419+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:54:06.769419+0000","last_undegraded":"2024-09-12T16:54:06.769419+0000","last_fullsized":"2024-09-12T16:54:06.769419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.073104+0000","last_change":"2024-09-12T16:56:14.073104+0000","last_active":"2024-09-12T16:56:14.073104+0000","last_peered":"2024-09-12T16:56:14.073104+0000","last_clean":"2024-09-12T16:56:14.073104+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:56:14.073104+0000","last_undegraded":"2024-09-12T16:56:14.073104+0000","last_fullsized":"2024-09-12T16:56:14.073104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:14.072890+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:14.072890+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.072890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:52.398439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.924366+0000","last_change":"2024-09-12T16:56:14.924366+0000","last_active":"2024-09-12T16:56:14.924366+0000","last_peered":"2024-09-12T16:56:14.924366+0000","last_clean":"2024-09-12T16:56:14.924366+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:56:14.924366+0000","last_undegraded":"2024-09-12T16:56:14.924366+0000","last_fullsized":"2024-09-12T16:56:14.924366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:14.924132+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:14.924132+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.924132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:01.248598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.411580+0000","last_change":"2024-09-12T16:55:59.411580+0000","last_active":"2024-09-12T16:55:59.411580+0000","last_peered":"2024-09-12T16:55:59.411580+0000","last_clean":"2024-09-12T16:55:59.411580+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:55:59.411580+0000","last_undegraded":"2024-09-12T16:55:59.411580+0000","last_fullsized":"2024-09-12T16:55:59.411580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.411390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:57.337645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.969122+0000","last_change":"2024-09-12T16:56:15.969122+0000","last_active":"2024-09-12T16:56:15.969122+0000","last_peered":"2024-09-12T16:56:15.969122+0000","last_clean":"2024-09-12T16:56:15.969122+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:56:15.969122+0000","last_undegraded":"2024-09-12T16:56:15.969122+0000","last_fullsized":"2024-09-12T16:56:15.969122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:15.968939+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:15.968939+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.968939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:23.486079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'5","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.508887+0000","last_change":"2024-09-12T16:51:58.152595+0000","last_active":"2024-09-12T16:55:12.508887+0000","last_peered":"2024-09-12T16:55:12.508887+0000","last_clean":"2024-09-12T16:55:12.508887+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:55:12.508887+0000","last_undegraded":"2024-09-12T16:55:12.508887+0000","last_fullsized":"2024-09-12T16:55:12.508887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:06.175184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.020166+0000","last_change":"2024-09-12T16:56:01.020166+0000","last_active":"2024-09-12T16:56:01.020166+0000","last_peered":"2024-09-12T16:56:01.020166+0000","last_clean":"2024-09-12T16:56:01.020166+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:56:01.020166+0000","last_undegraded":"2024-09-12T16:56:01.020166+0000","last_fullsized":"2024-09-12T16:56:01.020166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.019981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:17.549962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'18","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.228716+0000","last_change":"2024-09-12T16:56:15.228716+0000","last_active":"2024-09-12T16:56:15.228716+0000","last_peered":"2024-09-12T16:56:15.228716+0000","last_clean":"2024-09-12T16:56:15.228716+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:56:15.228716+0000","last_undegraded":"2024-09-12T16:56:15.228716+0000","last_fullsized":"2024-09-12T16:56:15.228716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:15.228531+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:15.228531+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.228531+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:17.677439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.978515+0000","last_change":"2024-09-12T16:56:01.978515+0000","last_active":"2024-09-12T16:56:01.978515+0000","last_peered":"2024-09-12T16:56:01.978515+0000","last_clean":"2024-09-12T16:56:01.978515+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:56:01.978515+0000","last_undegraded":"2024-09-12T16:56:01.978515+0000","last_fullsized":"2024-09-12T16:56:01.978515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.978300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:23.170955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.200016+0000","last_change":"2024-09-12T16:56:16.200016+0000","last_active":"2024-09-12T16:56:16.200016+0000","last_peered":"2024-09-12T16:56:16.200016+0000","last_clean":"2024-09-12T16:56:16.200016+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:56:16.200016+0000","last_undegraded":"2024-09-12T16:56:16.200016+0000","last_fullsized":"2024-09-12T16:56:16.200016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:16.199840+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:16.199840+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.199840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:41.217788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.024742+0000","last_change":"2024-09-12T16:56:00.024742+0000","last_active":"2024-09-12T16:56:00.024742+0000","last_peered":"2024-09-12T16:56:00.024742+0000","last_clean":"2024-09-12T16:56:00.024742+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:56:00.024742+0000","last_undegraded":"2024-09-12T16:56:00.024742+0000","last_fullsized":"2024-09-12T16:56:00.024742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.024672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:03.497187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.360052+0000","last_change":"2024-09-12T16:56:14.360052+0000","last_active":"2024-09-12T16:56:14.360052+0000","last_peered":"2024-09-12T16:56:14.360052+0000","last_clean":"2024-09-12T16:56:14.360052+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:56:14.360052+0000","last_undegraded":"2024-09-12T16:56:14.360052+0000","last_fullsized":"2024-09-12T16:56:14.360052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:14.359876+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:14.359876+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.359876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:20.611388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.029695+0000","last_change":"2024-09-12T16:55:59.029695+0000","last_active":"2024-09-12T16:55:59.029695+0000","last_peered":"2024-09-12T16:55:59.029695+0000","last_clean":"2024-09-12T16:55:59.029695+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:55:59.029695+0000","last_undegraded":"2024-09-12T16:55:59.029695+0000","last_fullsized":"2024-09-12T16:55:59.029695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.029505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.968614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.919566+0000","last_change":"2024-09-12T16:56:12.919566+0000","last_active":"2024-09-12T16:56:12.919566+0000","last_peered":"2024-09-12T16:56:12.919566+0000","last_clean":"2024-09-12T16:56:12.919566+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:56:12.919566+0000","last_undegraded":"2024-09-12T16:56:12.919566+0000","last_fullsized":"2024-09-12T16:56:12.919566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:12.919380+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:12.919380+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.919380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:01.652496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.453187+0000","last_change":"2024-09-12T16:55:58.453187+0000","last_active":"2024-09-12T16:55:58.453187+0000","last_peered":"2024-09-12T16:55:58.453187+0000","last_clean":"2024-09-12T16:55:58.453187+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:55:58.453187+0000","last_undegraded":"2024-09-12T16:55:58.453187+0000","last_fullsized":"2024-09-12T16:55:58.453187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.452993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.443665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.259709+0000","last_change":"2024-09-12T16:56:18.259709+0000","last_active":"2024-09-12T16:56:18.259709+0000","last_peered":"2024-09-12T16:56:18.259709+0000","last_clean":"2024-09-12T16:56:18.259709+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:56:18.259709+0000","last_undegraded":"2024-09-12T16:56:18.259709+0000","last_fullsized":"2024-09-12T16:56:18.259709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:18.259509+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:18.259509+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.259509+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:11.920537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.032967+0000","last_change":"2024-09-12T16:56:13.032967+0000","last_active":"2024-09-12T16:56:13.032967+0000","last_peered":"2024-09-12T16:56:13.032967+0000","last_clean":"2024-09-12T16:56:13.032967+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:56:13.032967+0000","last_undegraded":"2024-09-12T16:56:13.032967+0000","last_fullsized":"2024-09-12T16:56:13.032967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:13.032745+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:13.032745+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.032745+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:11.625172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.449818+0000","last_change":"2024-09-12T16:52:06.228645+0000","last_active":"2024-09-12T16:55:12.449818+0000","last_peered":"2024-09-12T16:55:12.449818+0000","last_clean":"2024-09-12T16:55:12.449818+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:55:12.449818+0000","last_undegraded":"2024-09-12T16:55:12.449818+0000","last_fullsized":"2024-09-12T16:55:12.449818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.027430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.053711+0000","last_change":"2024-09-12T16:56:22.053711+0000","last_active":"2024-09-12T16:56:22.053711+0000","last_peered":"2024-09-12T16:56:22.053711+0000","last_clean":"2024-09-12T16:56:22.053711+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:56:22.053711+0000","last_undegraded":"2024-09-12T16:56:22.053711+0000","last_fullsized":"2024-09-12T16:56:22.053711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:22.053522+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:22.053522+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.053522+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:59.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.009398+0000","last_change":"2024-09-12T16:56:02.009398+0000","last_active":"2024-09-12T16:56:02.009398+0000","last_peered":"2024-09-12T16:56:02.009398+0000","last_clean":"2024-09-12T16:56:02.009398+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:56:02.009398+0000","last_undegraded":"2024-09-12T16:56:02.009398+0000","last_fullsized":"2024-09-12T16:56:02.009398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.009210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:18.094619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047258+0000","last_change":"2024-09-12T16:52:00.186679+0000","last_active":"2024-09-12T16:52:35.047258+0000","last_peered":"2024-09-12T16:52:35.047258+0000","last_clean":"2024-09-12T16:52:35.047258+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:52:35.047258+0000","last_undegraded":"2024-09-12T16:52:35.047258+0000","last_fullsized":"2024-09-12T16:52:35.047258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:56.774446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.671303+0000","last_change":"2024-09-12T16:52:02.211041+0000","last_active":"2024-09-12T16:55:43.671303+0000","last_peered":"2024-09-12T16:55:43.671303+0000","last_clean":"2024-09-12T16:55:43.671303+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:55:43.671303+0000","last_undegraded":"2024-09-12T16:55:43.671303+0000","last_fullsized":"2024-09-12T16:55:43.671303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:56.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.046823+0000","last_change":"2024-09-12T16:52:04.216014+0000","last_active":"2024-09-12T16:52:35.046823+0000","last_peered":"2024-09-12T16:52:35.046823+0000","last_clean":"2024-09-12T16:52:35.046823+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:52:35.046823+0000","last_undegraded":"2024-09-12T16:52:35.046823+0000","last_fullsized":"2024-09-12T16:52:35.046823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.121629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.770372+0000","last_change":"2024-09-12T16:52:06.220823+0000","last_active":"2024-09-12T16:53:25.770372+0000","last_peered":"2024-09-12T16:53:25.770372+0000","last_clean":"2024-09-12T16:53:25.770372+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:53:25.770372+0000","last_undegraded":"2024-09-12T16:53:25.770372+0000","last_fullsized":"2024-09-12T16:53:25.770372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.834594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.075544+0000","last_change":"2024-09-12T16:56:23.075544+0000","last_active":"2024-09-12T16:56:23.075544+0000","last_peered":"2024-09-12T16:56:23.075544+0000","last_clean":"2024-09-12T16:56:23.075544+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:56:23.075544+0000","last_undegraded":"2024-09-12T16:56:23.075544+0000","last_fullsized":"2024-09-12T16:56:23.075544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:23.075361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:23.075361+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.075361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:19.899752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.866458+0000","last_change":"2024-09-12T16:55:53.866458+0000","last_active":"2024-09-12T16:55:53.866458+0000","last_peered":"2024-09-12T16:55:53.866458+0000","last_clean":"2024-09-12T16:55:53.866458+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:53.866458+0000","last_undegraded":"2024-09-12T16:55:53.866458+0000","last_fullsized":"2024-09-12T16:55:53.866458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.866257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:36.901200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.358299+0000","last_change":"2024-09-12T16:56:21.358299+0000","last_active":"2024-09-12T16:56:21.358299+0000","last_peered":"2024-09-12T16:56:21.358299+0000","last_clean":"2024-09-12T16:56:21.358299+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:56:21.358299+0000","last_undegraded":"2024-09-12T16:56:21.358299+0000","last_fullsized":"2024-09-12T16:56:21.358299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:21.358117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:21.358117+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.358117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:01.559420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.045539+0000","last_change":"2024-09-12T16:52:02.183370+0000","last_active":"2024-09-12T16:52:35.045539+0000","last_peered":"2024-09-12T16:52:35.045539+0000","last_clean":"2024-09-12T16:52:35.045539+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:52:35.045539+0000","last_undegraded":"2024-09-12T16:52:35.045539+0000","last_fullsized":"2024-09-12T16:52:35.045539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:07.193774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.044904+0000","last_change":"2024-09-12T16:52:04.210985+0000","last_active":"2024-09-12T16:52:35.044904+0000","last_peered":"2024-09-12T16:52:35.044904+0000","last_clean":"2024-09-12T16:52:35.044904+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:52:35.044904+0000","last_undegraded":"2024-09-12T16:52:35.044904+0000","last_fullsized":"2024-09-12T16:52:35.044904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:41.017144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021248+0000","last_change":"2024-09-12T16:52:06.224899+0000","last_active":"2024-09-12T16:52:35.021248+0000","last_peered":"2024-09-12T16:52:35.021248+0000","last_clean":"2024-09-12T16:52:35.021248+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:52:35.021248+0000","last_undegraded":"2024-09-12T16:52:35.021248+0000","last_fullsized":"2024-09-12T16:52:35.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:27.788906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.123242+0000","last_change":"2024-09-12T16:56:24.123242+0000","last_active":"2024-09-12T16:56:24.123242+0000","last_peered":"2024-09-12T16:56:24.123242+0000","last_clean":"2024-09-12T16:56:24.123242+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:56:24.123242+0000","last_undegraded":"2024-09-12T16:56:24.123242+0000","last_fullsized":"2024-09-12T16:56:24.123242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:24.123050+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:24.123050+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.123050+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:32.942821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.057358+0000","last_change":"2024-09-12T16:56:01.057358+0000","last_active":"2024-09-12T16:56:01.057358+0000","last_peered":"2024-09-12T16:56:01.057358+0000","last_clean":"2024-09-12T16:56:01.057358+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:56:01.057358+0000","last_undegraded":"2024-09-12T16:56:01.057358+0000","last_fullsized":"2024-09-12T16:56:01.057358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.057181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:48.320895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.371894+0000","last_change":"2024-09-12T16:56:23.371894+0000","last_active":"2024-09-12T16:56:23.371894+0000","last_peered":"2024-09-12T16:56:23.371894+0000","last_clean":"2024-09-12T16:56:23.371894+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:56:23.371894+0000","last_undegraded":"2024-09-12T16:56:23.371894+0000","last_fullsized":"2024-09-12T16:56:23.371894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:23.371722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:23.371722+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.371722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:32.702443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017313+0000","last_change":"2024-09-12T16:52:02.202447+0000","last_active":"2024-09-12T16:52:35.017313+0000","last_peered":"2024-09-12T16:52:35.017313+0000","last_clean":"2024-09-12T16:52:35.017313+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:52:35.017313+0000","last_undegraded":"2024-09-12T16:52:35.017313+0000","last_fullsized":"2024-09-12T16:52:35.017313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:48.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.577588+0000","last_change":"2024-09-12T16:52:04.214865+0000","last_active":"2024-09-12T16:55:43.577588+0000","last_peered":"2024-09-12T16:55:43.577588+0000","last_clean":"2024-09-12T16:55:43.577588+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:55:43.577588+0000","last_undegraded":"2024-09-12T16:55:43.577588+0000","last_fullsized":"2024-09-12T16:55:43.577588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:36.658689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016249+0000","last_change":"2024-09-12T16:52:06.233885+0000","last_active":"2024-09-12T16:52:35.016249+0000","last_peered":"2024-09-12T16:52:35.016249+0000","last_clean":"2024-09-12T16:52:35.016249+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:52:35.016249+0000","last_undegraded":"2024-09-12T16:52:35.016249+0000","last_fullsized":"2024-09-12T16:52:35.016249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:05.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.409809+0000","last_change":"2024-09-12T16:56:05.409809+0000","last_active":"2024-09-12T16:56:05.409809+0000","last_peered":"2024-09-12T16:56:05.409809+0000","last_clean":"2024-09-12T16:56:05.409809+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:56:05.409809+0000","last_undegraded":"2024-09-12T16:56:05.409809+0000","last_fullsized":"2024-09-12T16:56:05.409809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:05.409623+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:05.409623+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.409623+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:09.725138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.882861+0000","last_change":"2024-09-12T16:55:49.882861+0000","last_active":"2024-09-12T16:55:49.882861+0000","last_peered":"2024-09-12T16:55:49.882861+0000","last_clean":"2024-09-12T16:55:49.882861+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:55:49.882861+0000","last_undegraded":"2024-09-12T16:55:49.882861+0000","last_fullsized":"2024-09-12T16:55:49.882861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.882666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:15.998089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047933+0000","last_change":"2024-09-12T16:52:00.186758+0000","last_active":"2024-09-12T16:52:35.047933+0000","last_peered":"2024-09-12T16:52:35.047933+0000","last_clean":"2024-09-12T16:52:35.047933+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:52:35.047933+0000","last_undegraded":"2024-09-12T16:52:35.047933+0000","last_fullsized":"2024-09-12T16:52:35.047933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:11.029898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.876170+0000","last_change":"2024-09-12T16:52:02.201456+0000","last_active":"2024-09-12T16:55:43.876170+0000","last_peered":"2024-09-12T16:55:43.876170+0000","last_clean":"2024-09-12T16:55:43.876170+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:55:43.876170+0000","last_undegraded":"2024-09-12T16:55:43.876170+0000","last_fullsized":"2024-09-12T16:55:43.876170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:04.994969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.586516+0000","last_change":"2024-09-12T16:52:04.220126+0000","last_active":"2024-09-12T16:55:43.586516+0000","last_peered":"2024-09-12T16:55:43.586516+0000","last_clean":"2024-09-12T16:55:43.586516+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:55:43.586516+0000","last_undegraded":"2024-09-12T16:55:43.586516+0000","last_fullsized":"2024-09-12T16:55:43.586516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:41.797262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.050560+0000","last_change":"2024-09-12T16:56:20.050421+0000","last_active":"2024-09-12T16:56:20.050560+0000","last_peered":"2024-09-12T16:56:20.050560+0000","last_clean":"2024-09-12T16:56:20.050560+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:56:20.050560+0000","last_undegraded":"2024-09-12T16:56:20.050560+0000","last_fullsized":"2024-09-12T16:56:20.050560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:20.050239+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:20.050239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.050239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:20.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.907335+0000","last_change":"2024-09-12T16:55:51.907335+0000","last_active":"2024-09-12T16:55:51.907335+0000","last_peered":"2024-09-12T16:55:51.907335+0000","last_clean":"2024-09-12T16:55:51.907335+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:55:51.907335+0000","last_undegraded":"2024-09-12T16:55:51.907335+0000","last_fullsized":"2024-09-12T16:55:51.907335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.907142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:07.393009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.349322+0000","last_change":"2024-09-12T16:56:23.349322+0000","last_active":"2024-09-12T16:56:23.349322+0000","last_peered":"2024-09-12T16:56:23.349322+0000","last_clean":"2024-09-12T16:56:23.349322+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:56:23.349322+0000","last_undegraded":"2024-09-12T16:56:23.349322+0000","last_fullsized":"2024-09-12T16:56:23.349322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:23.349052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:23.349052+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.349052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:29.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'53","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.006089+0000","last_change":"2024-09-12T16:56:25.005947+0000","last_active":"2024-09-12T16:56:25.006089+0000","last_peered":"2024-09-12T16:56:25.006089+0000","last_clean":"2024-09-12T16:56:25.006089+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:56:25.006089+0000","last_undegraded":"2024-09-12T16:56:25.006089+0000","last_fullsized":"2024-09-12T16:56:25.006089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'53","last_scrub_stamp":"2024-09-12T16:56:25.005701+0000","last_deep_scrub":"34'53","last_deep_scrub_stamp":"2024-09-12T16:56:25.005701+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.005701+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:29.541745+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.029067+0000","last_change":"2024-09-12T16:52:04.216055+0000","last_active":"2024-09-12T16:52:35.029067+0000","last_peered":"2024-09-12T16:52:35.029067+0000","last_clean":"2024-09-12T16:52:35.029067+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:52:35.029067+0000","last_undegraded":"2024-09-12T16:52:35.029067+0000","last_fullsized":"2024-09-12T16:52:35.029067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:19.593146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015463+0000","last_change":"2024-09-12T16:52:06.226575+0000","last_active":"2024-09-12T16:54:15.015463+0000","last_peered":"2024-09-12T16:54:15.015463+0000","last_clean":"2024-09-12T16:54:15.015463+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:54:15.015463+0000","last_undegraded":"2024-09-12T16:54:15.015463+0000","last_fullsized":"2024-09-12T16:54:15.015463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.051166+0000","last_change":"2024-09-12T16:56:05.051013+0000","last_active":"2024-09-12T16:56:05.051166+0000","last_peered":"2024-09-12T16:56:05.051166+0000","last_clean":"2024-09-12T16:56:05.051166+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:56:05.051166+0000","last_undegraded":"2024-09-12T16:56:05.051166+0000","last_fullsized":"2024-09-12T16:56:05.051166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.050827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:50.475409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.905168+0000","last_change":"2024-09-12T16:55:54.905168+0000","last_active":"2024-09-12T16:55:54.905168+0000","last_peered":"2024-09-12T16:55:54.905168+0000","last_clean":"2024-09-12T16:55:54.905168+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:55:54.905168+0000","last_undegraded":"2024-09-12T16:55:54.905168+0000","last_fullsized":"2024-09-12T16:55:54.905168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:54.848288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.337432+0000","last_change":"2024-09-12T16:56:18.337308+0000","last_active":"2024-09-12T16:56:18.337432+0000","last_peered":"2024-09-12T16:56:18.337432+0000","last_clean":"2024-09-12T16:56:18.337432+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:56:18.337432+0000","last_undegraded":"2024-09-12T16:56:18.337432+0000","last_fullsized":"2024-09-12T16:56:18.337432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:18.337128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:18.337128+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.337128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:29.062021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.778313+0000","last_change":"2024-09-12T16:52:02.209890+0000","last_active":"2024-09-12T16:55:43.778313+0000","last_peered":"2024-09-12T16:55:43.778313+0000","last_clean":"2024-09-12T16:55:43.778313+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:55:43.778313+0000","last_undegraded":"2024-09-12T16:55:43.778313+0000","last_fullsized":"2024-09-12T16:55:43.778313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:04.988153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:14.019175+0000","last_change":"2024-09-12T16:52:04.194679+0000","last_active":"2024-09-12T16:54:14.019175+0000","last_peered":"2024-09-12T16:54:14.019175+0000","last_clean":"2024-09-12T16:54:14.019175+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:54:14.019175+0000","last_undegraded":"2024-09-12T16:54:14.019175+0000","last_fullsized":"2024-09-12T16:54:14.019175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.020391+0000","last_change":"2024-09-12T16:52:06.231060+0000","last_active":"2024-09-12T16:54:11.020391+0000","last_peered":"2024-09-12T16:54:11.020391+0000","last_clean":"2024-09-12T16:54:11.020391+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:54:11.020391+0000","last_undegraded":"2024-09-12T16:54:11.020391+0000","last_fullsized":"2024-09-12T16:54:11.020391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.904512+0000","last_change":"2024-09-12T16:56:05.904375+0000","last_active":"2024-09-12T16:56:05.904512+0000","last_peered":"2024-09-12T16:56:05.904512+0000","last_clean":"2024-09-12T16:56:05.904512+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:56:05.904512+0000","last_undegraded":"2024-09-12T16:56:05.904512+0000","last_fullsized":"2024-09-12T16:56:05.904512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:05.904173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:05.904173+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.904173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:01.552829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.069390+0000","last_change":"2024-09-12T16:55:59.069150+0000","last_active":"2024-09-12T16:55:59.069390+0000","last_peered":"2024-09-12T16:55:59.069390+0000","last_clean":"2024-09-12T16:55:59.069390+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:55:59.069390+0000","last_undegraded":"2024-09-12T16:55:59.069390+0000","last_fullsized":"2024-09-12T16:55:59.069390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.068940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:14.552968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.380045+0000","last_change":"2024-09-12T16:56:22.380045+0000","last_active":"2024-09-12T16:56:22.380045+0000","last_peered":"2024-09-12T16:56:22.380045+0000","last_clean":"2024-09-12T16:56:22.380045+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:56:22.380045+0000","last_undegraded":"2024-09-12T16:56:22.380045+0000","last_fullsized":"2024-09-12T16:56:22.380045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.379868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.379868+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.379868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:57.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'40","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.702221+0000","last_change":"2024-09-12T16:52:02.203207+0000","last_active":"2024-09-12T16:55:43.702221+0000","last_peered":"2024-09-12T16:55:43.702221+0000","last_clean":"2024-09-12T16:55:43.702221+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:55:43.702221+0000","last_undegraded":"2024-09-12T16:55:43.702221+0000","last_fullsized":"2024-09-12T16:55:43.702221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":354,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.930575+0000","last_change":"2024-09-12T16:52:04.194703+0000","last_active":"2024-09-12T16:55:43.930575+0000","last_peered":"2024-09-12T16:55:43.930575+0000","last_clean":"2024-09-12T16:55:43.930575+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:55:43.930575+0000","last_undegraded":"2024-09-12T16:55:43.930575+0000","last_fullsized":"2024-09-12T16:55:43.930575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024038+0000","last_change":"2024-09-12T16:52:06.236389+0000","last_active":"2024-09-12T16:52:35.024038+0000","last_peered":"2024-09-12T16:52:35.024038+0000","last_clean":"2024-09-12T16:52:35.024038+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:52:35.024038+0000","last_undegraded":"2024-09-12T16:52:35.024038+0000","last_fullsized":"2024-09-12T16:52:35.024038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:42.125079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.925571+0000","last_change":"2024-09-12T16:56:04.925571+0000","last_active":"2024-09-12T16:56:04.925571+0000","last_peered":"2024-09-12T16:56:04.925571+0000","last_clean":"2024-09-12T16:56:04.925571+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:56:04.925571+0000","last_undegraded":"2024-09-12T16:56:04.925571+0000","last_fullsized":"2024-09-12T16:56:04.925571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.925364+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:32.101898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.090663+0000","last_change":"2024-09-12T16:56:00.090533+0000","last_active":"2024-09-12T16:56:00.090663+0000","last_peered":"2024-09-12T16:56:00.090663+0000","last_clean":"2024-09-12T16:56:00.090663+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:56:00.090663+0000","last_undegraded":"2024-09-12T16:56:00.090663+0000","last_fullsized":"2024-09-12T16:56:00.090663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.090336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:15.365705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.382408+0000","last_change":"2024-09-12T16:56:19.382163+0000","last_active":"2024-09-12T16:56:19.382408+0000","last_peered":"2024-09-12T16:56:19.382408+0000","last_clean":"2024-09-12T16:56:19.382408+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:56:19.382408+0000","last_undegraded":"2024-09-12T16:56:19.382408+0000","last_fullsized":"2024-09-12T16:56:19.382408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:19.381897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:19.381897+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.381897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:39.274144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":126,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.801010+0000","last_change":"2024-09-12T16:52:02.201612+0000","last_active":"2024-09-12T16:55:43.801010+0000","last_peered":"2024-09-12T16:55:43.801010+0000","last_clean":"2024-09-12T16:55:43.801010+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:55:43.801010+0000","last_undegraded":"2024-09-12T16:55:43.801010+0000","last_fullsized":"2024-09-12T16:55:43.801010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:14.018998+0000","last_change":"2024-09-12T16:52:04.198835+0000","last_active":"2024-09-12T16:54:14.018998+0000","last_peered":"2024-09-12T16:54:14.018998+0000","last_clean":"2024-09-12T16:54:14.018998+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:54:14.018998+0000","last_undegraded":"2024-09-12T16:54:14.018998+0000","last_fullsized":"2024-09-12T16:54:14.018998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.731668+0000","last_change":"2024-09-12T16:52:06.212053+0000","last_active":"2024-09-12T16:55:12.731668+0000","last_peered":"2024-09-12T16:55:12.731668+0000","last_clean":"2024-09-12T16:55:12.731668+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:55:12.731668+0000","last_undegraded":"2024-09-12T16:55:12.731668+0000","last_fullsized":"2024-09-12T16:55:12.731668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:15.749904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.020804+0000","last_change":"2024-09-12T16:56:04.020804+0000","last_active":"2024-09-12T16:56:04.020804+0000","last_peered":"2024-09-12T16:56:04.020804+0000","last_clean":"2024-09-12T16:56:04.020804+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:56:04.020804+0000","last_undegraded":"2024-09-12T16:56:04.020804+0000","last_fullsized":"2024-09-12T16:56:04.020804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.020617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:53.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.431517+0000","last_change":"2024-09-12T16:55:52.431517+0000","last_active":"2024-09-12T16:55:52.431517+0000","last_peered":"2024-09-12T16:55:52.431517+0000","last_clean":"2024-09-12T16:55:52.431517+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:55:52.431517+0000","last_undegraded":"2024-09-12T16:55:52.431517+0000","last_fullsized":"2024-09-12T16:55:52.431517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.431331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:30.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.008472+0000","last_change":"2024-09-12T16:56:18.008472+0000","last_active":"2024-09-12T16:56:18.008472+0000","last_peered":"2024-09-12T16:56:18.008472+0000","last_clean":"2024-09-12T16:56:18.008472+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:56:18.008472+0000","last_undegraded":"2024-09-12T16:56:18.008472+0000","last_fullsized":"2024-09-12T16:56:18.008472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:18.008262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:18.008262+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.008262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:32.869069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.826845+0000","last_change":"2024-09-12T16:52:02.181402+0000","last_active":"2024-09-12T16:55:43.826845+0000","last_peered":"2024-09-12T16:55:43.826845+0000","last_clean":"2024-09-12T16:55:43.826845+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:55:43.826845+0000","last_undegraded":"2024-09-12T16:55:43.826845+0000","last_fullsized":"2024-09-12T16:55:43.826845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:57.545973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048724+0000","last_change":"2024-09-12T16:52:04.214150+0000","last_active":"2024-09-12T16:52:35.048724+0000","last_peered":"2024-09-12T16:52:35.048724+0000","last_clean":"2024-09-12T16:52:35.048724+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:52:35.048724+0000","last_undegraded":"2024-09-12T16:52:35.048724+0000","last_fullsized":"2024-09-12T16:52:35.048724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:04.618846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'7","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.675594+0000","last_change":"2024-09-12T16:52:06.231706+0000","last_active":"2024-09-12T16:55:12.675594+0000","last_peered":"2024-09-12T16:55:12.675594+0000","last_clean":"2024-09-12T16:55:12.675594+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:55:12.675594+0000","last_undegraded":"2024-09-12T16:55:12.675594+0000","last_fullsized":"2024-09-12T16:55:12.675594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.007071+0000","last_change":"2024-09-12T16:56:19.007071+0000","last_active":"2024-09-12T16:56:19.007071+0000","last_peered":"2024-09-12T16:56:19.007071+0000","last_clean":"2024-09-12T16:56:19.007071+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:56:19.007071+0000","last_undegraded":"2024-09-12T16:56:19.007071+0000","last_fullsized":"2024-09-12T16:56:19.007071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:19.006789+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:19.006789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.006789+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:57.690077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.103221+0000","last_change":"2024-09-12T16:55:58.103087+0000","last_active":"2024-09-12T16:55:58.103221+0000","last_peered":"2024-09-12T16:55:58.103221+0000","last_clean":"2024-09-12T16:55:58.103221+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:55:58.103221+0000","last_undegraded":"2024-09-12T16:55:58.103221+0000","last_fullsized":"2024-09-12T16:55:58.103221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.102908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:04.349009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.386007+0000","last_change":"2024-09-12T16:56:20.386007+0000","last_active":"2024-09-12T16:56:20.386007+0000","last_peered":"2024-09-12T16:56:20.386007+0000","last_clean":"2024-09-12T16:56:20.386007+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:56:20.386007+0000","last_undegraded":"2024-09-12T16:56:20.386007+0000","last_fullsized":"2024-09-12T16:56:20.386007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:20.385826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:20.385826+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.385826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:33.071596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.754640+0000","last_change":"2024-09-12T16:52:02.181396+0000","last_active":"2024-09-12T16:55:43.754640+0000","last_peered":"2024-09-12T16:55:43.754640+0000","last_clean":"2024-09-12T16:55:43.754640+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:55:43.754640+0000","last_undegraded":"2024-09-12T16:55:43.754640+0000","last_fullsized":"2024-09-12T16:55:43.754640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:02.688531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.578248+0000","last_change":"2024-09-12T16:52:04.202044+0000","last_active":"2024-09-12T16:55:43.578248+0000","last_peered":"2024-09-12T16:55:43.578248+0000","last_clean":"2024-09-12T16:55:43.578248+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:55:43.578248+0000","last_undegraded":"2024-09-12T16:55:43.578248+0000","last_fullsized":"2024-09-12T16:55:43.578248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:00.863167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'20","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.759026+0000","last_change":"2024-09-12T16:52:06.219575+0000","last_active":"2024-09-12T16:55:12.759026+0000","last_peered":"2024-09-12T16:55:12.759026+0000","last_clean":"2024-09-12T16:55:12.759026+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:55:12.759026+0000","last_undegraded":"2024-09-12T16:55:12.759026+0000","last_fullsized":"2024-09-12T16:55:12.759026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.985161+0000","last_change":"2024-09-12T16:56:02.985161+0000","last_active":"2024-09-12T16:56:02.985161+0000","last_peered":"2024-09-12T16:56:02.985161+0000","last_clean":"2024-09-12T16:56:02.985161+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:56:02.985161+0000","last_undegraded":"2024-09-12T16:56:02.985161+0000","last_fullsized":"2024-09-12T16:56:02.985161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.984950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:45.336637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.105792+0000","last_change":"2024-09-12T16:55:57.105529+0000","last_active":"2024-09-12T16:55:57.105792+0000","last_peered":"2024-09-12T16:55:57.105792+0000","last_clean":"2024-09-12T16:55:57.105792+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:55:57.105792+0000","last_undegraded":"2024-09-12T16:55:57.105792+0000","last_fullsized":"2024-09-12T16:55:57.105792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.105307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'4","reported_seq":623,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.566986+0000","last_change":"2024-09-12T16:52:35.065861+0000","last_active":"2024-09-12T16:55:43.566986+0000","last_peered":"2024-09-12T16:55:43.566986+0000","last_clean":"2024-09-12T16:55:43.566986+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:55:43.566986+0000","last_undegraded":"2024-09-12T16:55:43.566986+0000","last_fullsized":"2024-09-12T16:55:43.566986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:34.323930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.454242+0000","last_change":"2024-09-12T16:52:02.209870+0000","last_active":"2024-09-12T16:54:11.454242+0000","last_peered":"2024-09-12T16:54:11.454242+0000","last_clean":"2024-09-12T16:54:11.454242+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:54:11.454242+0000","last_undegraded":"2024-09-12T16:54:11.454242+0000","last_fullsized":"2024-09-12T16:54:11.454242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:47.846097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":515,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.580728+0000","last_change":"2024-09-12T16:52:04.200303+0000","last_active":"2024-09-12T16:55:43.580728+0000","last_peered":"2024-09-12T16:55:43.580728+0000","last_clean":"2024-09-12T16:55:43.580728+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:55:43.580728+0000","last_undegraded":"2024-09-12T16:55:43.580728+0000","last_fullsized":"2024-09-12T16:55:43.580728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:06.974814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:15.015387+0000","last_change":"2024-09-12T16:52:06.226319+0000","last_active":"2024-09-12T16:54:15.015387+0000","last_peered":"2024-09-12T16:54:15.015387+0000","last_clean":"2024-09-12T16:54:15.015387+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:54:15.015387+0000","last_undegraded":"2024-09-12T16:54:15.015387+0000","last_fullsized":"2024-09-12T16:54:15.015387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.019629+0000","last_change":"2024-09-12T16:56:06.019629+0000","last_active":"2024-09-12T16:56:06.019629+0000","last_peered":"2024-09-12T16:56:06.019629+0000","last_clean":"2024-09-12T16:56:06.019629+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:06.019629+0000","last_undegraded":"2024-09-12T16:56:06.019629+0000","last_fullsized":"2024-09-12T16:56:06.019629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.019448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.300837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.145123+0000","last_change":"2024-09-12T16:55:56.144883+0000","last_active":"2024-09-12T16:55:56.145123+0000","last_peered":"2024-09-12T16:55:56.145123+0000","last_clean":"2024-09-12T16:55:56.145123+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:55:56.145123+0000","last_undegraded":"2024-09-12T16:55:56.145123+0000","last_fullsized":"2024-09-12T16:55:56.145123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.144656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:33.152646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.048178+0000","last_change":"2024-09-12T16:52:00.189183+0000","last_active":"2024-09-12T16:52:35.048178+0000","last_peered":"2024-09-12T16:52:35.048178+0000","last_clean":"2024-09-12T16:52:35.048178+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:52:35.048178+0000","last_undegraded":"2024-09-12T16:52:35.048178+0000","last_fullsized":"2024-09-12T16:52:35.048178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:50.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'42","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.676524+0000","last_change":"2024-09-12T16:52:02.179426+0000","last_active":"2024-09-12T16:55:43.676524+0000","last_peered":"2024-09-12T16:55:43.676524+0000","last_clean":"2024-09-12T16:55:43.676524+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:55:43.676524+0000","last_undegraded":"2024-09-12T16:55:43.676524+0000","last_fullsized":"2024-09-12T16:55:43.676524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:17.890537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017029+0000","last_change":"2024-09-12T16:52:04.212757+0000","last_active":"2024-09-12T16:52:35.017029+0000","last_peered":"2024-09-12T16:52:35.017029+0000","last_clean":"2024-09-12T16:52:35.017029+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:52:35.017029+0000","last_undegraded":"2024-09-12T16:52:35.017029+0000","last_fullsized":"2024-09-12T16:52:35.017029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.808954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.736882+0000","last_change":"2024-09-12T16:52:06.227780+0000","last_active":"2024-09-12T16:55:12.736882+0000","last_peered":"2024-09-12T16:55:12.736882+0000","last_clean":"2024-09-12T16:55:12.736882+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:55:12.736882+0000","last_undegraded":"2024-09-12T16:55:12.736882+0000","last_fullsized":"2024-09-12T16:55:12.736882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.048143+0000","last_change":"2024-09-12T16:56:17.048143+0000","last_active":"2024-09-12T16:56:17.048143+0000","last_peered":"2024-09-12T16:56:17.048143+0000","last_clean":"2024-09-12T16:56:17.048143+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:56:17.048143+0000","last_undegraded":"2024-09-12T16:56:17.048143+0000","last_fullsized":"2024-09-12T16:56:17.048143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:17.047963+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:17.047963+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.047963+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:42.891911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.965741+0000","last_change":"2024-09-12T16:55:47.965741+0000","last_active":"2024-09-12T16:55:47.965741+0000","last_peered":"2024-09-12T16:55:47.965741+0000","last_clean":"2024-09-12T16:55:47.965741+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:55:47.965741+0000","last_undegraded":"2024-09-12T16:55:47.965741+0000","last_fullsized":"2024-09-12T16:55:47.965741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.965477+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:53.674876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.217462+0000","last_change":"2024-09-12T16:55:51.217300+0000","last_active":"2024-09-12T16:55:51.217462+0000","last_peered":"2024-09-12T16:55:51.217462+0000","last_clean":"2024-09-12T16:55:51.217462+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:55:51.217462+0000","last_undegraded":"2024-09-12T16:55:51.217462+0000","last_fullsized":"2024-09-12T16:55:51.217462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.217110+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:04.583269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.156907+0000","last_change":"2024-09-12T16:55:54.156773+0000","last_active":"2024-09-12T16:55:54.156907+0000","last_peered":"2024-09-12T16:55:54.156907+0000","last_clean":"2024-09-12T16:55:54.156907+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:55:54.156907+0000","last_undegraded":"2024-09-12T16:55:54.156907+0000","last_fullsized":"2024-09-12T16:55:54.156907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.156592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:41.292991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.301262+0000","last_change":"2024-09-12T16:56:22.301262+0000","last_active":"2024-09-12T16:56:22.301262+0000","last_peered":"2024-09-12T16:56:22.301262+0000","last_clean":"2024-09-12T16:56:22.301262+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:56:22.301262+0000","last_undegraded":"2024-09-12T16:56:22.301262+0000","last_fullsized":"2024-09-12T16:56:22.301262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.301082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.301082+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.301082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:33.733394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.906023+0000","last_change":"2024-09-12T16:52:02.208795+0000","last_active":"2024-09-12T16:55:43.906023+0000","last_peered":"2024-09-12T16:55:43.906023+0000","last_clean":"2024-09-12T16:55:43.906023+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:55:43.906023+0000","last_undegraded":"2024-09-12T16:55:43.906023+0000","last_fullsized":"2024-09-12T16:55:43.906023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:14.019325+0000","last_change":"2024-09-12T16:52:04.190511+0000","last_active":"2024-09-12T16:54:14.019325+0000","last_peered":"2024-09-12T16:54:14.019325+0000","last_clean":"2024-09-12T16:54:14.019325+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:54:14.019325+0000","last_undegraded":"2024-09-12T16:54:14.019325+0000","last_fullsized":"2024-09-12T16:54:14.019325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.588965+0000","last_change":"2024-09-12T16:52:06.216437+0000","last_active":"2024-09-12T16:55:12.588965+0000","last_peered":"2024-09-12T16:55:12.588965+0000","last_clean":"2024-09-12T16:55:12.588965+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:55:12.588965+0000","last_undegraded":"2024-09-12T16:55:12.588965+0000","last_fullsized":"2024-09-12T16:55:12.588965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:11.640533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.003628+0000","last_change":"2024-09-12T16:56:18.003458+0000","last_active":"2024-09-12T16:56:18.003628+0000","last_peered":"2024-09-12T16:56:18.003628+0000","last_clean":"2024-09-12T16:56:18.003628+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:56:18.003628+0000","last_undegraded":"2024-09-12T16:56:18.003628+0000","last_fullsized":"2024-09-12T16:56:18.003628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:18.003280+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:18.003280+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.003280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:21.904327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.222007+0000","last_change":"2024-09-12T16:55:49.222007+0000","last_active":"2024-09-12T16:55:49.222007+0000","last_peered":"2024-09-12T16:55:49.222007+0000","last_clean":"2024-09-12T16:55:49.222007+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:55:49.222007+0000","last_undegraded":"2024-09-12T16:55:49.222007+0000","last_fullsized":"2024-09-12T16:55:49.222007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.221820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:10.179551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.395547+0000","last_change":"2024-09-12T16:55:51.395398+0000","last_active":"2024-09-12T16:55:51.395547+0000","last_peered":"2024-09-12T16:55:51.395547+0000","last_clean":"2024-09-12T16:55:51.395547+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:51.395547+0000","last_undegraded":"2024-09-12T16:55:51.395547+0000","last_fullsized":"2024-09-12T16:55:51.395547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.395218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:23.022360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.023806+0000","last_change":"2024-09-12T16:52:35.040769+0000","last_active":"2024-09-12T16:54:11.023806+0000","last_peered":"2024-09-12T16:54:11.023806+0000","last_clean":"2024-09-12T16:54:11.023806+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:54:11.023806+0000","last_undegraded":"2024-09-12T16:54:11.023806+0000","last_fullsized":"2024-09-12T16:54:11.023806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'286","reported_seq":505,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.910200+0000","last_change":"2024-09-12T16:52:02.206307+0000","last_active":"2024-09-12T16:55:43.910200+0000","last_peered":"2024-09-12T16:55:43.910200+0000","last_clean":"2024-09-12T16:55:43.910200+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:55:43.910200+0000","last_undegraded":"2024-09-12T16:55:43.910200+0000","last_fullsized":"2024-09-12T16:55:43.910200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.023579+0000","last_change":"2024-09-12T16:52:04.209015+0000","last_active":"2024-09-12T16:54:11.023579+0000","last_peered":"2024-09-12T16:54:11.023579+0000","last_clean":"2024-09-12T16:54:11.023579+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:54:11.023579+0000","last_undegraded":"2024-09-12T16:54:11.023579+0000","last_fullsized":"2024-09-12T16:54:11.023579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:16.021439+0000","last_change":"2024-09-12T16:52:06.227599+0000","last_active":"2024-09-12T16:54:16.021439+0000","last_peered":"2024-09-12T16:54:16.021439+0000","last_clean":"2024-09-12T16:54:16.021439+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:54:16.021439+0000","last_undegraded":"2024-09-12T16:54:16.021439+0000","last_fullsized":"2024-09-12T16:54:16.021439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.416324+0000","last_change":"2024-09-12T16:56:04.416157+0000","last_active":"2024-09-12T16:56:04.416324+0000","last_peered":"2024-09-12T16:56:04.416324+0000","last_clean":"2024-09-12T16:56:04.416324+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:56:04.416324+0000","last_undegraded":"2024-09-12T16:56:04.416324+0000","last_fullsized":"2024-09-12T16:56:04.416324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:04.415977+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:04.415977+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.415977+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:37.104330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.862977+0000","last_change":"2024-09-12T16:55:48.862720+0000","last_active":"2024-09-12T16:55:48.862977+0000","last_peered":"2024-09-12T16:55:48.862977+0000","last_clean":"2024-09-12T16:55:48.862977+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:55:48.862977+0000","last_undegraded":"2024-09-12T16:55:48.862977+0000","last_fullsized":"2024-09-12T16:55:48.862977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.862498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:44.689046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.400482+0000","last_change":"2024-09-12T16:55:48.400348+0000","last_active":"2024-09-12T16:55:48.400482+0000","last_peered":"2024-09-12T16:55:48.400482+0000","last_clean":"2024-09-12T16:55:48.400482+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:55:48.400482+0000","last_undegraded":"2024-09-12T16:55:48.400482+0000","last_fullsized":"2024-09-12T16:55:48.400482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.400137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.977807+0000","last_change":"2024-09-12T16:56:16.977655+0000","last_active":"2024-09-12T16:56:16.977807+0000","last_peered":"2024-09-12T16:56:16.977807+0000","last_clean":"2024-09-12T16:56:16.977807+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:56:16.977807+0000","last_undegraded":"2024-09-12T16:56:16.977807+0000","last_fullsized":"2024-09-12T16:56:16.977807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:16.977493+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:16.977493+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.977493+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.955215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.977261+0000","last_change":"2024-09-12T16:56:23.977261+0000","last_active":"2024-09-12T16:56:23.977261+0000","last_peered":"2024-09-12T16:56:23.977261+0000","last_clean":"2024-09-12T16:56:23.977261+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:56:23.977261+0000","last_undegraded":"2024-09-12T16:56:23.977261+0000","last_fullsized":"2024-09-12T16:56:23.977261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-12T16:56:23.977064+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-12T16:56:23.977064+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.977064+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:21.211807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.017960+0000","last_change":"2024-09-12T16:52:04.189985+0000","last_active":"2024-09-12T16:54:09.017960+0000","last_peered":"2024-09-12T16:54:09.017960+0000","last_clean":"2024-09-12T16:54:09.017960+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:54:09.017960+0000","last_undegraded":"2024-09-12T16:54:09.017960+0000","last_fullsized":"2024-09-12T16:54:09.017960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032944+0000","last_change":"2024-09-12T16:52:06.229164+0000","last_active":"2024-09-12T16:52:35.032944+0000","last_peered":"2024-09-12T16:52:35.032944+0000","last_clean":"2024-09-12T16:52:35.032944+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:52:35.032944+0000","last_undegraded":"2024-09-12T16:52:35.032944+0000","last_fullsized":"2024-09-12T16:52:35.032944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:53.711707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.425100+0000","last_change":"2024-09-12T16:56:03.424942+0000","last_active":"2024-09-12T16:56:03.425100+0000","last_peered":"2024-09-12T16:56:03.425100+0000","last_clean":"2024-09-12T16:56:03.425100+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:56:03.425100+0000","last_undegraded":"2024-09-12T16:56:03.425100+0000","last_fullsized":"2024-09-12T16:56:03.425100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.424770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:52.914259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.245625+0000","last_change":"2024-09-12T16:55:50.245475+0000","last_active":"2024-09-12T16:55:50.245625+0000","last_peered":"2024-09-12T16:55:50.245625+0000","last_clean":"2024-09-12T16:55:50.245625+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:55:50.245625+0000","last_undegraded":"2024-09-12T16:55:50.245625+0000","last_fullsized":"2024-09-12T16:55:50.245625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.245287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:59.801323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.874234+0000","last_change":"2024-09-12T16:55:49.874078+0000","last_active":"2024-09-12T16:55:49.874234+0000","last_peered":"2024-09-12T16:55:49.874234+0000","last_clean":"2024-09-12T16:55:49.874234+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:55:49.874234+0000","last_undegraded":"2024-09-12T16:55:49.874234+0000","last_fullsized":"2024-09-12T16:55:49.874234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.873862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:42.226676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.331395+0000","last_change":"2024-09-12T16:56:17.331395+0000","last_active":"2024-09-12T16:56:17.331395+0000","last_peered":"2024-09-12T16:56:17.331395+0000","last_clean":"2024-09-12T16:56:17.331395+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:56:17.331395+0000","last_undegraded":"2024-09-12T16:56:17.331395+0000","last_fullsized":"2024-09-12T16:56:17.331395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:17.331215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:17.331215+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.331215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:34.713043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.500298+0000","last_change":"2024-09-12T16:52:02.207152+0000","last_active":"2024-09-12T16:55:11.500298+0000","last_peered":"2024-09-12T16:55:11.500298+0000","last_clean":"2024-09-12T16:55:11.500298+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:55:11.500298+0000","last_undegraded":"2024-09-12T16:55:11.500298+0000","last_fullsized":"2024-09-12T16:55:11.500298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:16.025159+0000","last_change":"2024-09-12T16:52:04.214830+0000","last_active":"2024-09-12T16:54:16.025159+0000","last_peered":"2024-09-12T16:54:16.025159+0000","last_clean":"2024-09-12T16:54:16.025159+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:54:16.025159+0000","last_undegraded":"2024-09-12T16:54:16.025159+0000","last_fullsized":"2024-09-12T16:54:16.025159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:16.021321+0000","last_change":"2024-09-12T16:52:06.229880+0000","last_active":"2024-09-12T16:54:16.021321+0000","last_peered":"2024-09-12T16:54:16.021321+0000","last_clean":"2024-09-12T16:54:16.021321+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:54:16.021321+0000","last_undegraded":"2024-09-12T16:54:16.021321+0000","last_fullsized":"2024-09-12T16:54:16.021321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.055683+0000","last_change":"2024-09-12T16:56:02.055532+0000","last_active":"2024-09-12T16:56:02.055683+0000","last_peered":"2024-09-12T16:56:02.055683+0000","last_clean":"2024-09-12T16:56:02.055683+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:56:02.055683+0000","last_undegraded":"2024-09-12T16:56:02.055683+0000","last_fullsized":"2024-09-12T16:56:02.055683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.055341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:23.968021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.860193+0000","last_change":"2024-09-12T16:55:50.859970+0000","last_active":"2024-09-12T16:55:50.860193+0000","last_peered":"2024-09-12T16:55:50.860193+0000","last_clean":"2024-09-12T16:55:50.860193+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:55:50.860193+0000","last_undegraded":"2024-09-12T16:55:50.860193+0000","last_fullsized":"2024-09-12T16:55:50.860193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.859731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:21.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.421319+0000","last_change":"2024-09-12T16:55:47.421094+0000","last_active":"2024-09-12T16:55:47.421319+0000","last_peered":"2024-09-12T16:55:47.421319+0000","last_clean":"2024-09-12T16:55:47.421319+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:55:47.421319+0000","last_undegraded":"2024-09-12T16:55:47.421319+0000","last_fullsized":"2024-09-12T16:55:47.421319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.420892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.729401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'7","reported_seq":242,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.362629+0000","last_change":"2024-09-12T16:56:16.362629+0000","last_active":"2024-09-12T16:56:16.362629+0000","last_peered":"2024-09-12T16:56:16.362629+0000","last_clean":"2024-09-12T16:56:16.362629+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:56:16.362629+0000","last_undegraded":"2024-09-12T16:56:16.362629+0000","last_fullsized":"2024-09-12T16:56:16.362629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T16:56:16.362444+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T16:56:16.362444+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.362444+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:59.250843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.889823+0000","last_change":"2024-09-12T16:52:02.175160+0000","last_active":"2024-09-12T16:55:43.889823+0000","last_peered":"2024-09-12T16:55:43.889823+0000","last_clean":"2024-09-12T16:55:43.889823+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:55:43.889823+0000","last_undegraded":"2024-09-12T16:55:43.889823+0000","last_fullsized":"2024-09-12T16:55:43.889823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:10.014309+0000","last_change":"2024-09-12T16:52:04.202004+0000","last_active":"2024-09-12T16:54:10.014309+0000","last_peered":"2024-09-12T16:54:10.014309+0000","last_clean":"2024-09-12T16:54:10.014309+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:54:10.014309+0000","last_undegraded":"2024-09-12T16:54:10.014309+0000","last_fullsized":"2024-09-12T16:54:10.014309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.293385+0000","last_change":"2024-09-12T16:52:06.230268+0000","last_active":"2024-09-12T16:54:11.293385+0000","last_peered":"2024-09-12T16:54:11.293385+0000","last_clean":"2024-09-12T16:54:11.293385+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:54:11.293385+0000","last_undegraded":"2024-09-12T16:54:11.293385+0000","last_fullsized":"2024-09-12T16:54:11.293385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:11.635227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.051578+0000","last_change":"2024-09-12T16:56:03.051439+0000","last_active":"2024-09-12T16:56:03.051578+0000","last_peered":"2024-09-12T16:56:03.051578+0000","last_clean":"2024-09-12T16:56:03.051578+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:56:03.051578+0000","last_undegraded":"2024-09-12T16:56:03.051578+0000","last_fullsized":"2024-09-12T16:56:03.051578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.051259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.473399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.402509+0000","last_change":"2024-09-12T16:55:50.402377+0000","last_active":"2024-09-12T16:55:50.402509+0000","last_peered":"2024-09-12T16:55:50.402509+0000","last_clean":"2024-09-12T16:55:50.402509+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:50.402509+0000","last_undegraded":"2024-09-12T16:55:50.402509+0000","last_fullsized":"2024-09-12T16:55:50.402509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.402205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:11.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.165501+0000","last_change":"2024-09-12T16:55:52.165355+0000","last_active":"2024-09-12T16:55:52.165501+0000","last_peered":"2024-09-12T16:55:52.165501+0000","last_clean":"2024-09-12T16:55:52.165501+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:55:52.165501+0000","last_undegraded":"2024-09-12T16:55:52.165501+0000","last_fullsized":"2024-09-12T16:55:52.165501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.165177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.021819+0000","last_change":"2024-09-12T16:52:00.173390+0000","last_active":"2024-09-12T16:54:06.021819+0000","last_peered":"2024-09-12T16:54:06.021819+0000","last_clean":"2024-09-12T16:54:06.021819+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:54:06.021819+0000","last_undegraded":"2024-09-12T16:54:06.021819+0000","last_fullsized":"2024-09-12T16:54:06.021819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.020147+0000","last_change":"2024-09-12T16:52:02.194130+0000","last_active":"2024-09-12T16:54:11.020147+0000","last_peered":"2024-09-12T16:54:11.020147+0000","last_clean":"2024-09-12T16:54:11.020147+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:54:11.020147+0000","last_undegraded":"2024-09-12T16:54:11.020147+0000","last_fullsized":"2024-09-12T16:54:11.020147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":392,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.914812+0000","last_change":"2024-09-12T16:52:04.193182+0000","last_active":"2024-09-12T16:55:43.914812+0000","last_peered":"2024-09-12T16:55:43.914812+0000","last_clean":"2024-09-12T16:55:43.914812+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:55:43.914812+0000","last_undegraded":"2024-09-12T16:55:43.914812+0000","last_fullsized":"2024-09-12T16:55:43.914812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047985+0000","last_change":"2024-09-12T16:52:06.215010+0000","last_active":"2024-09-12T16:52:35.047985+0000","last_peered":"2024-09-12T16:52:35.047985+0000","last_clean":"2024-09-12T16:52:35.047985+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:52:35.047985+0000","last_undegraded":"2024-09-12T16:52:35.047985+0000","last_fullsized":"2024-09-12T16:52:35.047985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:54.128906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.931844+0000","last_change":"2024-09-12T16:56:07.931844+0000","last_active":"2024-09-12T16:56:07.931844+0000","last_peered":"2024-09-12T16:56:07.931844+0000","last_clean":"2024-09-12T16:56:07.931844+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:56:07.931844+0000","last_undegraded":"2024-09-12T16:56:07.931844+0000","last_fullsized":"2024-09-12T16:56:07.931844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:07.931663+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:07.931663+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.931663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:16.321154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.157073+0000","last_change":"2024-09-12T16:55:55.156907+0000","last_active":"2024-09-12T16:55:55.157073+0000","last_peered":"2024-09-12T16:55:55.157073+0000","last_clean":"2024-09-12T16:55:55.157073+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:55:55.157073+0000","last_undegraded":"2024-09-12T16:55:55.157073+0000","last_fullsized":"2024-09-12T16:55:55.157073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.156716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:37.213650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.363365+0000","last_change":"2024-09-12T16:55:49.363167+0000","last_active":"2024-09-12T16:55:49.363365+0000","last_peered":"2024-09-12T16:55:49.363365+0000","last_clean":"2024-09-12T16:55:49.363365+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:55:49.363365+0000","last_undegraded":"2024-09-12T16:55:49.363365+0000","last_fullsized":"2024-09-12T16:55:49.363365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.362978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:34.316423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.021749+0000","last_change":"2024-09-12T16:52:00.171577+0000","last_active":"2024-09-12T16:54:06.021749+0000","last_peered":"2024-09-12T16:54:06.021749+0000","last_clean":"2024-09-12T16:54:06.021749+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:54:06.021749+0000","last_undegraded":"2024-09-12T16:54:06.021749+0000","last_fullsized":"2024-09-12T16:54:06.021749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.023340+0000","last_change":"2024-09-12T16:52:02.213748+0000","last_active":"2024-09-12T16:54:11.023340+0000","last_peered":"2024-09-12T16:54:11.023340+0000","last_clean":"2024-09-12T16:54:11.023340+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:54:11.023340+0000","last_undegraded":"2024-09-12T16:54:11.023340+0000","last_fullsized":"2024-09-12T16:54:11.023340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.925306+0000","last_change":"2024-09-12T16:52:04.213686+0000","last_active":"2024-09-12T16:55:43.925306+0000","last_peered":"2024-09-12T16:55:43.925306+0000","last_clean":"2024-09-12T16:55:43.925306+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:55:43.925306+0000","last_undegraded":"2024-09-12T16:55:43.925306+0000","last_fullsized":"2024-09-12T16:55:43.925306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.104813+0000","last_change":"2024-09-12T16:52:06.223608+0000","last_active":"2024-09-12T16:55:12.104813+0000","last_peered":"2024-09-12T16:55:12.104813+0000","last_clean":"2024-09-12T16:55:12.104813+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:55:12.104813+0000","last_undegraded":"2024-09-12T16:55:12.104813+0000","last_fullsized":"2024-09-12T16:55:12.104813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:45.915952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.012997+0000","last_change":"2024-09-12T16:56:01.012738+0000","last_active":"2024-09-12T16:56:01.012997+0000","last_peered":"2024-09-12T16:56:01.012997+0000","last_clean":"2024-09-12T16:56:01.012997+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:56:01.012997+0000","last_undegraded":"2024-09-12T16:56:01.012997+0000","last_fullsized":"2024-09-12T16:56:01.012997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.012476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.560043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.913060+0000","last_change":"2024-09-12T16:55:48.912884+0000","last_active":"2024-09-12T16:55:48.913060+0000","last_peered":"2024-09-12T16:55:48.913060+0000","last_clean":"2024-09-12T16:55:48.913060+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:48.913060+0000","last_undegraded":"2024-09-12T16:55:48.913060+0000","last_fullsized":"2024-09-12T16:55:48.913060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.912682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:36.759579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.203291+0000","last_change":"2024-09-12T16:55:53.203060+0000","last_active":"2024-09-12T16:55:53.203291+0000","last_peered":"2024-09-12T16:55:53.203291+0000","last_clean":"2024-09-12T16:55:53.203291+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:55:53.203291+0000","last_undegraded":"2024-09-12T16:55:53.203291+0000","last_fullsized":"2024-09-12T16:55:53.203291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.202860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:18.010245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:01.020359+0000","last_change":"2024-09-12T16:52:00.177682+0000","last_active":"2024-09-12T16:54:01.020359+0000","last_peered":"2024-09-12T16:54:01.020359+0000","last_clean":"2024-09-12T16:54:01.020359+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:54:01.020359+0000","last_undegraded":"2024-09-12T16:54:01.020359+0000","last_fullsized":"2024-09-12T16:54:01.020359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'99","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.022342+0000","last_change":"2024-09-12T16:56:23.022342+0000","last_active":"2024-09-12T16:56:23.022342+0000","last_peered":"2024-09-12T16:56:23.022342+0000","last_clean":"2024-09-12T16:56:23.022342+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:56:23.022342+0000","last_undegraded":"2024-09-12T16:56:23.022342+0000","last_fullsized":"2024-09-12T16:56:23.022342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'99","last_scrub_stamp":"2024-09-12T16:56:23.022095+0000","last_deep_scrub":"34'99","last_deep_scrub_stamp":"2024-09-12T16:56:23.022095+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.022095+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:37.853754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.017809+0000","last_change":"2024-09-12T16:52:04.205957+0000","last_active":"2024-09-12T16:54:09.017809+0000","last_peered":"2024-09-12T16:54:09.017809+0000","last_clean":"2024-09-12T16:54:09.017809+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:54:09.017809+0000","last_undegraded":"2024-09-12T16:54:09.017809+0000","last_fullsized":"2024-09-12T16:54:09.017809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.027967+0000","last_change":"2024-09-12T16:52:06.226131+0000","last_active":"2024-09-12T16:52:35.027967+0000","last_peered":"2024-09-12T16:52:35.027967+0000","last_clean":"2024-09-12T16:52:35.027967+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:52:35.027967+0000","last_undegraded":"2024-09-12T16:52:35.027967+0000","last_fullsized":"2024-09-12T16:52:35.027967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:27.891759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.571704+0000","last_change":"2024-09-12T16:52:06.233870+0000","last_active":"2024-09-12T16:55:12.571704+0000","last_peered":"2024-09-12T16:55:12.571704+0000","last_clean":"2024-09-12T16:55:12.571704+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:55:12.571704+0000","last_undegraded":"2024-09-12T16:55:12.571704+0000","last_fullsized":"2024-09-12T16:55:12.571704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.951658+0000","last_change":"2024-09-12T16:56:08.951658+0000","last_active":"2024-09-12T16:56:08.951658+0000","last_peered":"2024-09-12T16:56:08.951658+0000","last_clean":"2024-09-12T16:56:08.951658+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:56:08.951658+0000","last_undegraded":"2024-09-12T16:56:08.951658+0000","last_fullsized":"2024-09-12T16:56:08.951658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:08.951469+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:08.951469+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.951469+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:13.785426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.017156+0000","last_change":"2024-09-12T16:56:03.017156+0000","last_active":"2024-09-12T16:56:03.017156+0000","last_peered":"2024-09-12T16:56:03.017156+0000","last_clean":"2024-09-12T16:56:03.017156+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:56:03.017156+0000","last_undegraded":"2024-09-12T16:56:03.017156+0000","last_fullsized":"2024-09-12T16:56:03.017156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.016945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:49.483897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.339081+0000","last_change":"2024-09-12T16:56:24.339081+0000","last_active":"2024-09-12T16:56:24.339081+0000","last_peered":"2024-09-12T16:56:24.339081+0000","last_clean":"2024-09-12T16:56:24.339081+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:56:24.339081+0000","last_undegraded":"2024-09-12T16:56:24.339081+0000","last_fullsized":"2024-09-12T16:56:24.339081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:24.338899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:24.338899+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.338899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:22.081195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.696470+0000","last_change":"2024-09-12T16:52:02.194377+0000","last_active":"2024-09-12T16:55:43.696470+0000","last_peered":"2024-09-12T16:55:43.696470+0000","last_clean":"2024-09-12T16:55:43.696470+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:55:43.696470+0000","last_undegraded":"2024-09-12T16:55:43.696470+0000","last_fullsized":"2024-09-12T16:55:43.696470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:35.662292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.024735+0000","last_change":"2024-09-12T16:52:04.215450+0000","last_active":"2024-09-12T16:52:35.024735+0000","last_peered":"2024-09-12T16:52:35.024735+0000","last_clean":"2024-09-12T16:52:35.024735+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:52:35.024735+0000","last_undegraded":"2024-09-12T16:52:35.024735+0000","last_fullsized":"2024-09-12T16:52:35.024735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.120052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.513358+0000","last_change":"2024-09-12T16:52:06.212418+0000","last_active":"2024-09-12T16:55:12.513358+0000","last_peered":"2024-09-12T16:55:12.513358+0000","last_clean":"2024-09-12T16:55:12.513358+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:55:12.513358+0000","last_undegraded":"2024-09-12T16:55:12.513358+0000","last_fullsized":"2024-09-12T16:55:12.513358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'28","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.066153+0000","last_change":"2024-09-12T16:56:07.066153+0000","last_active":"2024-09-12T16:56:07.066153+0000","last_peered":"2024-09-12T16:56:07.066153+0000","last_clean":"2024-09-12T16:56:07.066153+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:07.066153+0000","last_undegraded":"2024-09-12T16:56:07.066153+0000","last_fullsized":"2024-09-12T16:56:07.066153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-12T16:56:07.065953+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-12T16:56:07.065953+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.065953+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:47.680595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.909961+0000","last_change":"2024-09-12T16:55:52.909961+0000","last_active":"2024-09-12T16:55:52.909961+0000","last_peered":"2024-09-12T16:55:52.909961+0000","last_clean":"2024-09-12T16:55:52.909961+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:55:52.909961+0000","last_undegraded":"2024-09-12T16:55:52.909961+0000","last_fullsized":"2024-09-12T16:55:52.909961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.909777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:08.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.034344+0000","last_change":"2024-09-12T16:52:00.183813+0000","last_active":"2024-09-12T16:52:35.034344+0000","last_peered":"2024-09-12T16:52:35.034344+0000","last_clean":"2024-09-12T16:52:35.034344+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:52:35.034344+0000","last_undegraded":"2024-09-12T16:52:35.034344+0000","last_fullsized":"2024-09-12T16:52:35.034344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.454514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.479969+0000","last_change":"2024-09-12T16:52:02.184368+0000","last_active":"2024-09-12T16:55:11.479969+0000","last_peered":"2024-09-12T16:55:11.479969+0000","last_clean":"2024-09-12T16:55:11.479969+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:55:11.479969+0000","last_undegraded":"2024-09-12T16:55:11.479969+0000","last_fullsized":"2024-09-12T16:55:11.479969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:55.116071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.017383+0000","last_change":"2024-09-12T16:52:04.216686+0000","last_active":"2024-09-12T16:52:35.017383+0000","last_peered":"2024-09-12T16:52:35.017383+0000","last_clean":"2024-09-12T16:52:35.017383+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:52:35.017383+0000","last_undegraded":"2024-09-12T16:52:35.017383+0000","last_fullsized":"2024-09-12T16:52:35.017383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.665774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022183+0000","last_change":"2024-09-12T16:52:06.225236+0000","last_active":"2024-09-12T16:52:35.022183+0000","last_peered":"2024-09-12T16:52:35.022183+0000","last_clean":"2024-09-12T16:52:35.022183+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:52:35.022183+0000","last_undegraded":"2024-09-12T16:52:35.022183+0000","last_fullsized":"2024-09-12T16:52:35.022183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.292498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.390574+0000","last_change":"2024-09-12T16:56:06.390574+0000","last_active":"2024-09-12T16:56:06.390574+0000","last_peered":"2024-09-12T16:56:06.390574+0000","last_clean":"2024-09-12T16:56:06.390574+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:56:06.390574+0000","last_undegraded":"2024-09-12T16:56:06.390574+0000","last_fullsized":"2024-09-12T16:56:06.390574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.390389+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.390389+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.390389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:52.854862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.924579+0000","last_change":"2024-09-12T16:55:55.924579+0000","last_active":"2024-09-12T16:55:55.924579+0000","last_peered":"2024-09-12T16:55:55.924579+0000","last_clean":"2024-09-12T16:55:55.924579+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:55:55.924579+0000","last_undegraded":"2024-09-12T16:55:55.924579+0000","last_fullsized":"2024-09-12T16:55:55.924579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.924395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.041934+0000","last_change":"2024-09-12T16:56:19.041934+0000","last_active":"2024-09-12T16:56:19.041934+0000","last_peered":"2024-09-12T16:56:19.041934+0000","last_clean":"2024-09-12T16:56:19.041934+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:56:19.041934+0000","last_undegraded":"2024-09-12T16:56:19.041934+0000","last_fullsized":"2024-09-12T16:56:19.041934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:19.041752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:19.041752+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.041752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:05.426092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.868200+0000","last_change":"2024-09-12T16:52:02.180694+0000","last_active":"2024-09-12T16:55:43.868200+0000","last_peered":"2024-09-12T16:55:43.868200+0000","last_clean":"2024-09-12T16:55:43.868200+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:55:43.868200+0000","last_undegraded":"2024-09-12T16:55:43.868200+0000","last_fullsized":"2024-09-12T16:55:43.868200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:36.692111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.028291+0000","last_change":"2024-09-12T16:52:04.200667+0000","last_active":"2024-09-12T16:52:35.028291+0000","last_peered":"2024-09-12T16:52:35.028291+0000","last_clean":"2024-09-12T16:52:35.028291+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:52:35.028291+0000","last_undegraded":"2024-09-12T16:52:35.028291+0000","last_fullsized":"2024-09-12T16:52:35.028291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:11.487906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039574+0000","last_change":"2024-09-12T16:52:06.236861+0000","last_active":"2024-09-12T16:52:35.039574+0000","last_peered":"2024-09-12T16:52:35.039574+0000","last_clean":"2024-09-12T16:52:35.039574+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:52:35.039574+0000","last_undegraded":"2024-09-12T16:52:35.039574+0000","last_fullsized":"2024-09-12T16:52:35.039574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:29.568087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.075950+0000","last_change":"2024-09-12T16:56:21.075950+0000","last_active":"2024-09-12T16:56:21.075950+0000","last_peered":"2024-09-12T16:56:21.075950+0000","last_clean":"2024-09-12T16:56:21.075950+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:56:21.075950+0000","last_undegraded":"2024-09-12T16:56:21.075950+0000","last_fullsized":"2024-09-12T16:56:21.075950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:21.075769+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:21.075769+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.075769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.894857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.912389+0000","last_change":"2024-09-12T16:55:50.912389+0000","last_active":"2024-09-12T16:55:50.912389+0000","last_peered":"2024-09-12T16:55:50.912389+0000","last_clean":"2024-09-12T16:55:50.912389+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:55:50.912389+0000","last_undegraded":"2024-09-12T16:55:50.912389+0000","last_fullsized":"2024-09-12T16:55:50.912389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.912183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:49.304999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022824+0000","last_change":"2024-09-12T16:52:00.181358+0000","last_active":"2024-09-12T16:52:35.022824+0000","last_peered":"2024-09-12T16:52:35.022824+0000","last_clean":"2024-09-12T16:52:35.022824+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:52:35.022824+0000","last_undegraded":"2024-09-12T16:52:35.022824+0000","last_fullsized":"2024-09-12T16:52:35.022824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:32.384807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.843427+0000","last_change":"2024-09-12T16:52:02.181716+0000","last_active":"2024-09-12T16:55:43.843427+0000","last_peered":"2024-09-12T16:55:43.843427+0000","last_clean":"2024-09-12T16:55:43.843427+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:55:43.843427+0000","last_undegraded":"2024-09-12T16:55:43.843427+0000","last_fullsized":"2024-09-12T16:55:43.843427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:48.238474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016494+0000","last_change":"2024-09-12T16:52:04.211716+0000","last_active":"2024-09-12T16:52:35.016494+0000","last_peered":"2024-09-12T16:52:35.016494+0000","last_clean":"2024-09-12T16:52:35.016494+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:52:35.016494+0000","last_undegraded":"2024-09-12T16:52:35.016494+0000","last_fullsized":"2024-09-12T16:52:35.016494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.708673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.423943+0000","last_change":"2024-09-12T16:51:58.158927+0000","last_active":"2024-09-12T16:55:12.423943+0000","last_peered":"2024-09-12T16:55:12.423943+0000","last_clean":"2024-09-12T16:55:12.423943+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:55:12.423943+0000","last_undegraded":"2024-09-12T16:55:12.423943+0000","last_fullsized":"2024-09-12T16:55:12.423943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.984556+0000","last_change":"2024-09-12T16:56:03.984556+0000","last_active":"2024-09-12T16:56:03.984556+0000","last_peered":"2024-09-12T16:56:03.984556+0000","last_clean":"2024-09-12T16:56:03.984556+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:56:03.984556+0000","last_undegraded":"2024-09-12T16:56:03.984556+0000","last_fullsized":"2024-09-12T16:56:03.984556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.984372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:57.918312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:04.016851+0000","last_change":"2024-09-12T16:52:00.159525+0000","last_active":"2024-09-12T16:54:04.016851+0000","last_peered":"2024-09-12T16:54:04.016851+0000","last_clean":"2024-09-12T16:54:04.016851+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:54:04.016851+0000","last_undegraded":"2024-09-12T16:54:04.016851+0000","last_fullsized":"2024-09-12T16:54:04.016851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.835655+0000","last_change":"2024-09-12T16:52:02.184114+0000","last_active":"2024-09-12T16:55:43.835655+0000","last_peered":"2024-09-12T16:55:43.835655+0000","last_clean":"2024-09-12T16:55:43.835655+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:55:43.835655+0000","last_undegraded":"2024-09-12T16:55:43.835655+0000","last_fullsized":"2024-09-12T16:55:43.835655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:51.260998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.016853+0000","last_change":"2024-09-12T16:52:04.212854+0000","last_active":"2024-09-12T16:52:35.016853+0000","last_peered":"2024-09-12T16:52:35.016853+0000","last_clean":"2024-09-12T16:52:35.016853+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:52:35.016853+0000","last_undegraded":"2024-09-12T16:52:35.016853+0000","last_fullsized":"2024-09-12T16:52:35.016853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:31.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.284031+0000","last_change":"2024-09-12T16:52:06.224912+0000","last_active":"2024-09-12T16:54:11.284031+0000","last_peered":"2024-09-12T16:54:11.284031+0000","last_clean":"2024-09-12T16:54:11.284031+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:54:11.284031+0000","last_undegraded":"2024-09-12T16:54:11.284031+0000","last_fullsized":"2024-09-12T16:54:11.284031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:53.469591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.377076+0000","last_change":"2024-09-12T16:56:08.377076+0000","last_active":"2024-09-12T16:56:08.377076+0000","last_peered":"2024-09-12T16:56:08.377076+0000","last_clean":"2024-09-12T16:56:08.377076+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:56:08.377076+0000","last_undegraded":"2024-09-12T16:56:08.377076+0000","last_fullsized":"2024-09-12T16:56:08.377076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:08.376890+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:08.376890+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.376890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:31.874130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.951922+0000","last_change":"2024-09-12T16:55:51.951922+0000","last_active":"2024-09-12T16:55:51.951922+0000","last_peered":"2024-09-12T16:55:51.951922+0000","last_clean":"2024-09-12T16:55:51.951922+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:51.951922+0000","last_undegraded":"2024-09-12T16:55:51.951922+0000","last_fullsized":"2024-09-12T16:55:51.951922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.951717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.140563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.014305+0000","last_change":"2024-09-12T16:56:22.014305+0000","last_active":"2024-09-12T16:56:22.014305+0000","last_peered":"2024-09-12T16:56:22.014305+0000","last_clean":"2024-09-12T16:56:22.014305+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:56:22.014305+0000","last_undegraded":"2024-09-12T16:56:22.014305+0000","last_fullsized":"2024-09-12T16:56:22.014305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.014069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.014069+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.014069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:56.910230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.851345+0000","last_change":"2024-09-12T16:52:02.212469+0000","last_active":"2024-09-12T16:55:43.851345+0000","last_peered":"2024-09-12T16:55:43.851345+0000","last_clean":"2024-09-12T16:55:43.851345+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:55:43.851345+0000","last_undegraded":"2024-09-12T16:55:43.851345+0000","last_fullsized":"2024-09-12T16:55:43.851345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043455+0000","last_change":"2024-09-12T16:52:04.211092+0000","last_active":"2024-09-12T16:52:35.043455+0000","last_peered":"2024-09-12T16:52:35.043455+0000","last_clean":"2024-09-12T16:52:35.043455+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:52:35.043455+0000","last_undegraded":"2024-09-12T16:52:35.043455+0000","last_fullsized":"2024-09-12T16:52:35.043455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:37.948154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031153+0000","last_change":"2024-09-12T16:52:06.224892+0000","last_active":"2024-09-12T16:52:35.031153+0000","last_peered":"2024-09-12T16:52:35.031153+0000","last_clean":"2024-09-12T16:52:35.031153+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:52:35.031153+0000","last_undegraded":"2024-09-12T16:52:35.031153+0000","last_fullsized":"2024-09-12T16:52:35.031153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:23.862554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.406528+0000","last_change":"2024-09-12T16:51:58.175046+0000","last_active":"2024-09-12T16:55:12.406528+0000","last_peered":"2024-09-12T16:55:12.406528+0000","last_clean":"2024-09-12T16:55:12.406528+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:55:12.406528+0000","last_undegraded":"2024-09-12T16:55:12.406528+0000","last_fullsized":"2024-09-12T16:55:12.406528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:23.110954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.903403+0000","last_change":"2024-09-12T16:55:52.903403+0000","last_active":"2024-09-12T16:55:52.903403+0000","last_peered":"2024-09-12T16:55:52.903403+0000","last_clean":"2024-09-12T16:55:52.903403+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:55:52.903403+0000","last_undegraded":"2024-09-12T16:55:52.903403+0000","last_fullsized":"2024-09-12T16:55:52.903403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.903212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.981074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.057858+0000","last_change":"2024-09-12T16:56:21.057858+0000","last_active":"2024-09-12T16:56:21.057858+0000","last_peered":"2024-09-12T16:56:21.057858+0000","last_clean":"2024-09-12T16:56:21.057858+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:56:21.057858+0000","last_undegraded":"2024-09-12T16:56:21.057858+0000","last_fullsized":"2024-09-12T16:56:21.057858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:21.057647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:21.057647+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.057647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:19.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.719819+0000","last_change":"2024-09-12T16:52:02.196172+0000","last_active":"2024-09-12T16:55:43.719819+0000","last_peered":"2024-09-12T16:55:43.719819+0000","last_clean":"2024-09-12T16:55:43.719819+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:55:43.719819+0000","last_undegraded":"2024-09-12T16:55:43.719819+0000","last_fullsized":"2024-09-12T16:55:43.719819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:04.016828+0000","last_change":"2024-09-12T16:52:04.215112+0000","last_active":"2024-09-12T16:54:04.016828+0000","last_peered":"2024-09-12T16:54:04.016828+0000","last_clean":"2024-09-12T16:54:04.016828+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:54:04.016828+0000","last_undegraded":"2024-09-12T16:54:04.016828+0000","last_fullsized":"2024-09-12T16:54:04.016828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.437862+0000","last_change":"2024-09-12T16:52:06.234025+0000","last_active":"2024-09-12T16:54:11.437862+0000","last_peered":"2024-09-12T16:54:11.437862+0000","last_clean":"2024-09-12T16:54:11.437862+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:54:11.437862+0000","last_undegraded":"2024-09-12T16:54:11.437862+0000","last_fullsized":"2024-09-12T16:54:11.437862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:23.554247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.425701+0000","last_change":"2024-09-12T16:56:07.425701+0000","last_active":"2024-09-12T16:56:07.425701+0000","last_peered":"2024-09-12T16:56:07.425701+0000","last_clean":"2024-09-12T16:56:07.425701+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:56:07.425701+0000","last_undegraded":"2024-09-12T16:56:07.425701+0000","last_fullsized":"2024-09-12T16:56:07.425701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:07.425524+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:07.425524+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.425524+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:11.714958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.025971+0000","last_change":"2024-09-12T16:56:06.025971+0000","last_active":"2024-09-12T16:56:06.025971+0000","last_peered":"2024-09-12T16:56:06.025971+0000","last_clean":"2024-09-12T16:56:06.025971+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:56:06.025971+0000","last_undegraded":"2024-09-12T16:56:06.025971+0000","last_fullsized":"2024-09-12T16:56:06.025971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.025789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:12.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.043977+0000","last_change":"2024-09-12T16:52:00.162650+0000","last_active":"2024-09-12T16:52:35.043977+0000","last_peered":"2024-09-12T16:52:35.043977+0000","last_clean":"2024-09-12T16:52:35.043977+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:52:35.043977+0000","last_undegraded":"2024-09-12T16:52:35.043977+0000","last_fullsized":"2024-09-12T16:52:35.043977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.597418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.022048+0000","last_change":"2024-09-12T16:52:02.216308+0000","last_active":"2024-09-12T16:54:06.022048+0000","last_peered":"2024-09-12T16:54:06.022048+0000","last_clean":"2024-09-12T16:54:06.022048+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:54:06.022048+0000","last_undegraded":"2024-09-12T16:54:06.022048+0000","last_fullsized":"2024-09-12T16:54:06.022048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":378,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.912059+0000","last_change":"2024-09-12T16:52:04.219251+0000","last_active":"2024-09-12T16:55:43.912059+0000","last_peered":"2024-09-12T16:55:43.912059+0000","last_clean":"2024-09-12T16:55:43.912059+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:55:43.912059+0000","last_undegraded":"2024-09-12T16:55:43.912059+0000","last_fullsized":"2024-09-12T16:55:43.912059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.020791+0000","last_change":"2024-09-12T16:52:06.232237+0000","last_active":"2024-09-12T16:52:35.020791+0000","last_peered":"2024-09-12T16:52:35.020791+0000","last_clean":"2024-09-12T16:52:35.020791+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:52:35.020791+0000","last_undegraded":"2024-09-12T16:52:35.020791+0000","last_fullsized":"2024-09-12T16:52:35.020791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:08.018725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.928072+0000","last_change":"2024-09-12T16:56:11.928072+0000","last_active":"2024-09-12T16:56:11.928072+0000","last_peered":"2024-09-12T16:56:11.928072+0000","last_clean":"2024-09-12T16:56:11.928072+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:56:11.928072+0000","last_undegraded":"2024-09-12T16:56:11.928072+0000","last_fullsized":"2024-09-12T16:56:11.928072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T16:56:11.927896+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T16:56:11.927896+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.927896+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:56.881341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.904704+0000","last_change":"2024-09-12T16:55:54.904704+0000","last_active":"2024-09-12T16:55:54.904704+0000","last_peered":"2024-09-12T16:55:54.904704+0000","last_clean":"2024-09-12T16:55:54.904704+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:55:54.904704+0000","last_undegraded":"2024-09-12T16:55:54.904704+0000","last_fullsized":"2024-09-12T16:55:54.904704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.302723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.031597+0000","last_change":"2024-09-12T16:52:00.179417+0000","last_active":"2024-09-12T16:52:35.031597+0000","last_peered":"2024-09-12T16:52:35.031597+0000","last_clean":"2024-09-12T16:52:35.031597+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:52:35.031597+0000","last_undegraded":"2024-09-12T16:52:35.031597+0000","last_fullsized":"2024-09-12T16:52:35.031597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:39.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.762354+0000","last_change":"2024-09-12T16:52:02.182087+0000","last_active":"2024-09-12T16:55:43.762354+0000","last_peered":"2024-09-12T16:55:43.762354+0000","last_clean":"2024-09-12T16:55:43.762354+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:55:43.762354+0000","last_undegraded":"2024-09-12T16:55:43.762354+0000","last_fullsized":"2024-09-12T16:55:43.762354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:10.821781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021023+0000","last_change":"2024-09-12T16:52:04.206758+0000","last_active":"2024-09-12T16:52:35.021023+0000","last_peered":"2024-09-12T16:52:35.021023+0000","last_clean":"2024-09-12T16:52:35.021023+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:52:35.021023+0000","last_undegraded":"2024-09-12T16:52:35.021023+0000","last_fullsized":"2024-09-12T16:52:35.021023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:17.089165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047680+0000","last_change":"2024-09-12T16:52:06.224320+0000","last_active":"2024-09-12T16:52:35.047680+0000","last_peered":"2024-09-12T16:52:35.047680+0000","last_clean":"2024-09-12T16:52:35.047680+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:52:35.047680+0000","last_undegraded":"2024-09-12T16:52:35.047680+0000","last_fullsized":"2024-09-12T16:52:35.047680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:34.785095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.965285+0000","last_change":"2024-09-12T16:56:10.965285+0000","last_active":"2024-09-12T16:56:10.965285+0000","last_peered":"2024-09-12T16:56:10.965285+0000","last_clean":"2024-09-12T16:56:10.965285+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:56:10.965285+0000","last_undegraded":"2024-09-12T16:56:10.965285+0000","last_fullsized":"2024-09-12T16:56:10.965285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:10.965111+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:10.965111+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.965111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:11.089393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.994386+0000","last_change":"2024-09-12T16:56:04.994386+0000","last_active":"2024-09-12T16:56:04.994386+0000","last_peered":"2024-09-12T16:56:04.994386+0000","last_clean":"2024-09-12T16:56:04.994386+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:56:04.994386+0000","last_undegraded":"2024-09-12T16:56:04.994386+0000","last_fullsized":"2024-09-12T16:56:04.994386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.994131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:46.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.010216+0000","last_change":"2024-09-12T16:56:20.010216+0000","last_active":"2024-09-12T16:56:20.010216+0000","last_peered":"2024-09-12T16:56:20.010216+0000","last_clean":"2024-09-12T16:56:20.010216+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:56:20.010216+0000","last_undegraded":"2024-09-12T16:56:20.010216+0000","last_fullsized":"2024-09-12T16:56:20.010216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:20.009949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:20.009949+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.009949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:39.317042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.771290+0000","last_change":"2024-09-12T16:52:02.175268+0000","last_active":"2024-09-12T16:55:43.771290+0000","last_peered":"2024-09-12T16:55:43.771290+0000","last_clean":"2024-09-12T16:55:43.771290+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:55:43.771290+0000","last_undegraded":"2024-09-12T16:55:43.771290+0000","last_fullsized":"2024-09-12T16:55:43.771290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:54.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022138+0000","last_change":"2024-09-12T16:52:04.209135+0000","last_active":"2024-09-12T16:52:35.022138+0000","last_peered":"2024-09-12T16:52:35.022138+0000","last_clean":"2024-09-12T16:52:35.022138+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:52:35.022138+0000","last_undegraded":"2024-09-12T16:52:35.022138+0000","last_fullsized":"2024-09-12T16:52:35.022138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:49.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.442179+0000","last_change":"2024-09-12T16:52:06.237385+0000","last_active":"2024-09-12T16:54:11.442179+0000","last_peered":"2024-09-12T16:54:11.442179+0000","last_clean":"2024-09-12T16:54:11.442179+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:54:11.442179+0000","last_undegraded":"2024-09-12T16:54:11.442179+0000","last_fullsized":"2024-09-12T16:54:11.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:58.165732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.126036+0000","last_change":"2024-09-12T16:56:25.126036+0000","last_active":"2024-09-12T16:56:25.126036+0000","last_peered":"2024-09-12T16:56:25.126036+0000","last_clean":"2024-09-12T16:56:25.126036+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:56:25.126036+0000","last_undegraded":"2024-09-12T16:56:25.126036+0000","last_fullsized":"2024-09-12T16:56:25.126036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:25.125828+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:25.125828+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.125828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:17.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.393326+0000","last_change":"2024-09-12T16:55:53.393160+0000","last_active":"2024-09-12T16:55:53.393326+0000","last_peered":"2024-09-12T16:55:53.393326+0000","last_clean":"2024-09-12T16:55:53.393326+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:55:53.393326+0000","last_undegraded":"2024-09-12T16:55:53.393326+0000","last_fullsized":"2024-09-12T16:55:53.393326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.392972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.910111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.362805+0000","last_change":"2024-09-12T16:56:25.362805+0000","last_active":"2024-09-12T16:56:25.362805+0000","last_peered":"2024-09-12T16:56:25.362805+0000","last_clean":"2024-09-12T16:56:25.362805+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:56:25.362805+0000","last_undegraded":"2024-09-12T16:56:25.362805+0000","last_fullsized":"2024-09-12T16:56:25.362805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:25.362579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:25.362579+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.362579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:35.190759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'30","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.705579+0000","last_change":"2024-09-12T16:52:02.212684+0000","last_active":"2024-09-12T16:55:43.705579+0000","last_peered":"2024-09-12T16:55:43.705579+0000","last_clean":"2024-09-12T16:55:43.705579+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:55:43.705579+0000","last_undegraded":"2024-09-12T16:55:43.705579+0000","last_fullsized":"2024-09-12T16:55:43.705579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:00.299441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032673+0000","last_change":"2024-09-12T16:52:04.209557+0000","last_active":"2024-09-12T16:52:35.032673+0000","last_peered":"2024-09-12T16:52:35.032673+0000","last_clean":"2024-09-12T16:52:35.032673+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:52:35.032673+0000","last_undegraded":"2024-09-12T16:52:35.032673+0000","last_fullsized":"2024-09-12T16:52:35.032673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:33.026740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.024814+0000","last_change":"2024-09-12T16:52:06.234752+0000","last_active":"2024-09-12T16:54:09.024814+0000","last_peered":"2024-09-12T16:54:09.024814+0000","last_clean":"2024-09-12T16:54:09.024814+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:54:09.024814+0000","last_undegraded":"2024-09-12T16:54:09.024814+0000","last_fullsized":"2024-09-12T16:54:09.024814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.433924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.950692+0000","last_change":"2024-09-12T16:56:09.950692+0000","last_active":"2024-09-12T16:56:09.950692+0000","last_peered":"2024-09-12T16:56:09.950692+0000","last_clean":"2024-09-12T16:56:09.950692+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:56:09.950692+0000","last_undegraded":"2024-09-12T16:56:09.950692+0000","last_fullsized":"2024-09-12T16:56:09.950692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:09.950480+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:09.950480+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.950480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:09.258989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.860201+0000","last_change":"2024-09-12T16:55:53.860045+0000","last_active":"2024-09-12T16:55:53.860201+0000","last_peered":"2024-09-12T16:55:53.860201+0000","last_clean":"2024-09-12T16:55:53.860201+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:53.860201+0000","last_undegraded":"2024-09-12T16:55:53.860201+0000","last_fullsized":"2024-09-12T16:55:53.860201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.859853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:42.401708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:07.263520+0000","last_change":"2024-09-12T16:52:00.163609+0000","last_active":"2024-09-12T16:54:07.263520+0000","last_peered":"2024-09-12T16:54:07.263520+0000","last_clean":"2024-09-12T16:54:07.263520+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:54:07.263520+0000","last_undegraded":"2024-09-12T16:54:07.263520+0000","last_fullsized":"2024-09-12T16:54:07.263520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:59.122149+0000","last_clean_scrub_stamp":"2024-09-12T16:51:59.122149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:40.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.723783+0000","last_change":"2024-09-12T16:52:02.212039+0000","last_active":"2024-09-12T16:55:43.723783+0000","last_peered":"2024-09-12T16:55:43.723783+0000","last_clean":"2024-09-12T16:55:43.723783+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:55:43.723783+0000","last_undegraded":"2024-09-12T16:55:43.723783+0000","last_fullsized":"2024-09-12T16:55:43.723783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:30.940482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022180+0000","last_change":"2024-09-12T16:52:04.194659+0000","last_active":"2024-09-12T16:52:35.022180+0000","last_peered":"2024-09-12T16:52:35.022180+0000","last_clean":"2024-09-12T16:52:35.022180+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:52:35.022180+0000","last_undegraded":"2024-09-12T16:52:35.022180+0000","last_fullsized":"2024-09-12T16:52:35.022180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:10.799769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.029336+0000","last_change":"2024-09-12T16:52:06.237422+0000","last_active":"2024-09-12T16:54:09.029336+0000","last_peered":"2024-09-12T16:54:09.029336+0000","last_clean":"2024-09-12T16:54:09.029336+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:54:09.029336+0000","last_undegraded":"2024-09-12T16:54:09.029336+0000","last_fullsized":"2024-09-12T16:54:09.029336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:35.031132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.108738+0000","last_change":"2024-09-12T16:56:10.108586+0000","last_active":"2024-09-12T16:56:10.108738+0000","last_peered":"2024-09-12T16:56:10.108738+0000","last_clean":"2024-09-12T16:56:10.108738+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:56:10.108738+0000","last_undegraded":"2024-09-12T16:56:10.108738+0000","last_fullsized":"2024-09-12T16:56:10.108738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:10.108400+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:10.108400+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.108400+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:12.926248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.938046+0000","last_change":"2024-09-12T16:55:56.937794+0000","last_active":"2024-09-12T16:55:56.938046+0000","last_peered":"2024-09-12T16:55:56.938046+0000","last_clean":"2024-09-12T16:55:56.938046+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:55:56.938046+0000","last_undegraded":"2024-09-12T16:55:56.938046+0000","last_fullsized":"2024-09-12T16:55:56.938046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.937568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:32.183469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.333207+0000","last_change":"2024-09-12T16:56:12.333068+0000","last_active":"2024-09-12T16:56:12.333207+0000","last_peered":"2024-09-12T16:56:12.333207+0000","last_clean":"2024-09-12T16:56:12.333207+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:56:12.333207+0000","last_undegraded":"2024-09-12T16:56:12.333207+0000","last_fullsized":"2024-09-12T16:56:12.333207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:12.332887+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:12.332887+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.332887+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:01.522871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.401315+0000","last_change":"2024-09-12T16:55:56.401142+0000","last_active":"2024-09-12T16:55:56.401315+0000","last_peered":"2024-09-12T16:55:56.401315+0000","last_clean":"2024-09-12T16:55:56.401315+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:55:56.401315+0000","last_undegraded":"2024-09-12T16:55:56.401315+0000","last_fullsized":"2024-09-12T16:55:56.401315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.400960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:14.461538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.578413+0000","last_change":"2024-09-12T16:51:58.172460+0000","last_active":"2024-09-12T16:55:12.578413+0000","last_peered":"2024-09-12T16:55:12.578413+0000","last_clean":"2024-09-12T16:55:12.578413+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:55:12.578413+0000","last_undegraded":"2024-09-12T16:55:12.578413+0000","last_fullsized":"2024-09-12T16:55:12.578413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.042238+0000","last_change":"2024-09-12T16:56:07.042238+0000","last_active":"2024-09-12T16:56:07.042238+0000","last_peered":"2024-09-12T16:56:07.042238+0000","last_clean":"2024-09-12T16:56:07.042238+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:56:07.042238+0000","last_undegraded":"2024-09-12T16:56:07.042238+0000","last_fullsized":"2024-09-12T16:56:07.042238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:07.042037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:07.042037+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.042037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.852652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.396791+0000","last_change":"2024-09-12T16:56:10.396647+0000","last_active":"2024-09-12T16:56:10.396791+0000","last_peered":"2024-09-12T16:56:10.396791+0000","last_clean":"2024-09-12T16:56:10.396791+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:56:10.396791+0000","last_undegraded":"2024-09-12T16:56:10.396791+0000","last_fullsized":"2024-09-12T16:56:10.396791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:10.396473+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:10.396473+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.396473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:10.833391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.440316+0000","last_change":"2024-09-12T16:55:54.440130+0000","last_active":"2024-09-12T16:55:54.440316+0000","last_peered":"2024-09-12T16:55:54.440316+0000","last_clean":"2024-09-12T16:55:54.440316+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:55:54.440316+0000","last_undegraded":"2024-09-12T16:55:54.440316+0000","last_fullsized":"2024-09-12T16:55:54.440316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.439958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:13.647744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.375456+0000","last_change":"2024-09-12T16:56:09.375456+0000","last_active":"2024-09-12T16:56:09.375456+0000","last_peered":"2024-09-12T16:56:09.375456+0000","last_clean":"2024-09-12T16:56:09.375456+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:56:09.375456+0000","last_undegraded":"2024-09-12T16:56:09.375456+0000","last_fullsized":"2024-09-12T16:56:09.375456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-12T16:56:09.375291+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-12T16:56:09.375291+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.375291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:02.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.406473+0000","last_change":"2024-09-12T16:55:57.406202+0000","last_active":"2024-09-12T16:55:57.406473+0000","last_peered":"2024-09-12T16:55:57.406473+0000","last_clean":"2024-09-12T16:55:57.406473+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:55:57.406473+0000","last_undegraded":"2024-09-12T16:55:57.406473+0000","last_fullsized":"2024-09-12T16:55:57.406473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.405992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:26.716714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.099350+0000","last_change":"2024-09-12T16:56:09.099205+0000","last_active":"2024-09-12T16:56:09.099350+0000","last_peered":"2024-09-12T16:56:09.099350+0000","last_clean":"2024-09-12T16:56:09.099350+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:56:09.099350+0000","last_undegraded":"2024-09-12T16:56:09.099350+0000","last_fullsized":"2024-09-12T16:56:09.099350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:09.099018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:09.099018+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.099018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:17.509989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.952554+0000","last_change":"2024-09-12T16:55:55.952358+0000","last_active":"2024-09-12T16:55:55.952554+0000","last_peered":"2024-09-12T16:55:55.952554+0000","last_clean":"2024-09-12T16:55:55.952554+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:55:55.952554+0000","last_undegraded":"2024-09-12T16:55:55.952554+0000","last_fullsized":"2024-09-12T16:55:55.952554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.952167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:25.813446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.362007+0000","last_change":"2024-09-12T16:56:11.362007+0000","last_active":"2024-09-12T16:56:11.362007+0000","last_peered":"2024-09-12T16:56:11.362007+0000","last_clean":"2024-09-12T16:56:11.362007+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:56:11.362007+0000","last_undegraded":"2024-09-12T16:56:11.362007+0000","last_fullsized":"2024-09-12T16:56:11.362007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:11.361791+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:11.361791+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.361791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:50.554072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.987602+0000","last_change":"2024-09-12T16:55:57.987345+0000","last_active":"2024-09-12T16:55:57.987602+0000","last_peered":"2024-09-12T16:55:57.987602+0000","last_clean":"2024-09-12T16:55:57.987602+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:55:57.987602+0000","last_undegraded":"2024-09-12T16:55:57.987602+0000","last_fullsized":"2024-09-12T16:55:57.987602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.987068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:06.950990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.106577+0000","last_change":"2024-09-12T16:56:08.106418+0000","last_active":"2024-09-12T16:56:08.106577+0000","last_peered":"2024-09-12T16:56:08.106577+0000","last_clean":"2024-09-12T16:56:08.106577+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:56:08.106577+0000","last_undegraded":"2024-09-12T16:56:08.106577+0000","last_fullsized":"2024-09-12T16:56:08.106577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:08.106230+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:08.106230+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.106230+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:35.973906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.433107+0000","last_change":"2024-09-12T16:55:55.432903+0000","last_active":"2024-09-12T16:55:55.433107+0000","last_peered":"2024-09-12T16:55:55.433107+0000","last_clean":"2024-09-12T16:55:55.433107+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:55:55.433107+0000","last_undegraded":"2024-09-12T16:55:55.433107+0000","last_fullsized":"2024-09-12T16:55:55.433107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.432712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.091150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.194089+0000","last_change":"2024-09-12T16:56:14.194089+0000","last_active":"2024-09-12T16:56:14.194089+0000","last_peered":"2024-09-12T16:56:14.194089+0000","last_clean":"2024-09-12T16:56:14.194089+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:56:14.194089+0000","last_undegraded":"2024-09-12T16:56:14.194089+0000","last_fullsized":"2024-09-12T16:56:14.194089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:14.193905+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:14.193905+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.193905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:20.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.030089+0000","last_change":"2024-09-12T16:56:09.029934+0000","last_active":"2024-09-12T16:56:09.030089+0000","last_peered":"2024-09-12T16:56:09.030089+0000","last_clean":"2024-09-12T16:56:09.030089+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:56:09.030089+0000","last_undegraded":"2024-09-12T16:56:09.030089+0000","last_fullsized":"2024-09-12T16:56:09.030089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:09.029746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:09.029746+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.029746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:03.041324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.491894+0000","last_change":"2024-09-12T16:51:58.159514+0000","last_active":"2024-09-12T16:55:12.491894+0000","last_peered":"2024-09-12T16:55:12.491894+0000","last_clean":"2024-09-12T16:55:12.491894+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:55:12.491894+0000","last_undegraded":"2024-09-12T16:55:12.491894+0000","last_fullsized":"2024-09-12T16:55:12.491894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:51:57.107561+0000","last_clean_scrub_stamp":"2024-09-12T16:51:57.107561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:26.364726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.392236+0000","last_change":"2024-09-12T16:56:00.392236+0000","last_active":"2024-09-12T16:56:00.392236+0000","last_peered":"2024-09-12T16:56:00.392236+0000","last_clean":"2024-09-12T16:56:00.392236+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:56:00.392236+0000","last_undegraded":"2024-09-12T16:56:00.392236+0000","last_fullsized":"2024-09-12T16:56:00.392236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.392055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:04.803837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.363788+0000","last_change":"2024-09-12T16:56:13.363788+0000","last_active":"2024-09-12T16:56:13.363788+0000","last_peered":"2024-09-12T16:56:13.363788+0000","last_clean":"2024-09-12T16:56:13.363788+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:56:13.363788+0000","last_undegraded":"2024-09-12T16:56:13.363788+0000","last_fullsized":"2024-09-12T16:56:13.363788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:13.363599+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:13.363599+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.363599+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.980599+0000","last_change":"2024-09-12T16:55:56.980434+0000","last_active":"2024-09-12T16:55:56.980599+0000","last_peered":"2024-09-12T16:55:56.980599+0000","last_clean":"2024-09-12T16:55:56.980599+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:55:56.980599+0000","last_undegraded":"2024-09-12T16:55:56.980599+0000","last_fullsized":"2024-09-12T16:55:56.980599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.980237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:15.364632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.210631+0000","last_change":"2024-09-12T16:56:17.210631+0000","last_active":"2024-09-12T16:56:17.210631+0000","last_peered":"2024-09-12T16:56:17.210631+0000","last_clean":"2024-09-12T16:56:17.210631+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:56:17.210631+0000","last_undegraded":"2024-09-12T16:56:17.210631+0000","last_fullsized":"2024-09-12T16:56:17.210631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:17.210420+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:17.210420+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.210420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:27.115703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.999627+0000","last_change":"2024-09-12T16:55:57.999462+0000","last_active":"2024-09-12T16:55:57.999627+0000","last_peered":"2024-09-12T16:55:57.999627+0000","last_clean":"2024-09-12T16:55:57.999627+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:55:57.999627+0000","last_undegraded":"2024-09-12T16:55:57.999627+0000","last_fullsized":"2024-09-12T16:55:57.999627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.999280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.958335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.119798+0000","last_change":"2024-09-12T16:56:12.119798+0000","last_active":"2024-09-12T16:56:12.119798+0000","last_peered":"2024-09-12T16:56:12.119798+0000","last_clean":"2024-09-12T16:56:12.119798+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:56:12.119798+0000","last_undegraded":"2024-09-12T16:56:12.119798+0000","last_fullsized":"2024-09-12T16:56:12.119798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:12.119628+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:12.119628+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.119628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.835640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.045599+0000","last_change":"2024-09-12T16:56:08.045457+0000","last_active":"2024-09-12T16:56:08.045599+0000","last_peered":"2024-09-12T16:56:08.045599+0000","last_clean":"2024-09-12T16:56:08.045599+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:56:08.045599+0000","last_undegraded":"2024-09-12T16:56:08.045599+0000","last_fullsized":"2024-09-12T16:56:08.045599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:08.045272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:08.045272+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.045272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.816254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.096441+0000","last_change":"2024-09-12T16:56:11.096441+0000","last_active":"2024-09-12T16:56:11.096441+0000","last_peered":"2024-09-12T16:56:11.096441+0000","last_clean":"2024-09-12T16:56:11.096441+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:56:11.096441+0000","last_undegraded":"2024-09-12T16:56:11.096441+0000","last_fullsized":"2024-09-12T16:56:11.096441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:11.096227+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:11.096227+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.096227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:02.873110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.073202+0000","last_change":"2024-09-12T16:56:10.073063+0000","last_active":"2024-09-12T16:56:10.073202+0000","last_peered":"2024-09-12T16:56:10.073202+0000","last_clean":"2024-09-12T16:56:10.073202+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:56:10.073202+0000","last_undegraded":"2024-09-12T16:56:10.073202+0000","last_fullsized":"2024-09-12T16:56:10.073202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:10.072860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:10.072860+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.072860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:55.441106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.911634+0000","last_change":"2024-09-12T16:56:13.911634+0000","last_active":"2024-09-12T16:56:13.911634+0000","last_peered":"2024-09-12T16:56:13.911634+0000","last_clean":"2024-09-12T16:56:13.911634+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:56:13.911634+0000","last_undegraded":"2024-09-12T16:56:13.911634+0000","last_fullsized":"2024-09-12T16:56:13.911634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:13.911459+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:13.911459+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.911459+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:23.988896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.983767+0000","last_change":"2024-09-12T16:55:59.983767+0000","last_active":"2024-09-12T16:55:59.983767+0000","last_peered":"2024-09-12T16:55:59.983767+0000","last_clean":"2024-09-12T16:55:59.983767+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:55:59.983767+0000","last_undegraded":"2024-09-12T16:55:59.983767+0000","last_fullsized":"2024-09-12T16:55:59.983767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.983590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:23.882360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.157609+0000","last_change":"2024-09-12T16:56:13.157345+0000","last_active":"2024-09-12T16:56:13.157609+0000","last_peered":"2024-09-12T16:56:13.157609+0000","last_clean":"2024-09-12T16:56:13.157609+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:56:13.157609+0000","last_undegraded":"2024-09-12T16:56:13.157609+0000","last_fullsized":"2024-09-12T16:56:13.157609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:13.157069+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:13.157069+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.157069+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:40.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.064485+0000","last_change":"2024-09-12T16:56:11.064485+0000","last_active":"2024-09-12T16:56:11.064485+0000","last_peered":"2024-09-12T16:56:11.064485+0000","last_clean":"2024-09-12T16:56:11.064485+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:56:11.064485+0000","last_undegraded":"2024-09-12T16:56:11.064485+0000","last_fullsized":"2024-09-12T16:56:11.064485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:11.064306+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:11.064306+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.064306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.818102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.073587+0000","last_change":"2024-09-12T16:56:12.073587+0000","last_active":"2024-09-12T16:56:12.073587+0000","last_peered":"2024-09-12T16:56:12.073587+0000","last_clean":"2024-09-12T16:56:12.073587+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:56:12.073587+0000","last_undegraded":"2024-09-12T16:56:12.073587+0000","last_fullsized":"2024-09-12T16:56:12.073587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:12.073409+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:12.073409+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.073409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:11.864469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.309025+0000","last_change":"2024-09-12T16:56:15.309025+0000","last_active":"2024-09-12T16:56:15.309025+0000","last_peered":"2024-09-12T16:56:15.309025+0000","last_clean":"2024-09-12T16:56:15.309025+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:56:15.309025+0000","last_undegraded":"2024-09-12T16:56:15.309025+0000","last_fullsized":"2024-09-12T16:56:15.309025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:15.308840+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:15.308840+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.308840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:26.096395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.427883+0000","last_change":"2024-09-12T16:56:01.427883+0000","last_active":"2024-09-12T16:56:01.427883+0000","last_peered":"2024-09-12T16:56:01.427883+0000","last_clean":"2024-09-12T16:56:01.427883+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:56:01.427883+0000","last_undegraded":"2024-09-12T16:56:01.427883+0000","last_fullsized":"2024-09-12T16:56:01.427883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.427706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:56.339223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.286721+0000","last_change":"2024-09-12T16:56:19.286721+0000","last_active":"2024-09-12T16:56:19.286721+0000","last_peered":"2024-09-12T16:56:19.286721+0000","last_clean":"2024-09-12T16:56:19.286721+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:56:19.286721+0000","last_undegraded":"2024-09-12T16:56:19.286721+0000","last_fullsized":"2024-09-12T16:56:19.286721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:19.286513+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:19.286513+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.286513+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:30.010412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1399,"ondisk_log_size":1399,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640316,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640317,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":740498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673021,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44660,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327180,"statfs":{"total":96636764160,"available":96591032320,"internally_reserved":0,"allocated":1019904,"data_stored":740621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":151866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:56:29.642 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.642 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.642 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.642 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.643 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.643 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.643 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.643 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.643 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.644 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.644 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.644 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.644 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.644 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.644 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.645 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.645 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.645 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.645 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.645 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.645 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.645 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.646 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.646 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.646 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.646 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.646 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.647 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.647 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.647 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.647 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.647 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.647 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.648 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.648 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.648 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.648 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.648 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.649 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.649 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.649 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.649 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.649 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.649 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.650 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.650 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.650 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.650 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.650 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.650 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.650 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.651 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.651 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.651 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.651 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.651 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.651 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.652 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.652 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.652 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.652 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.652 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.652 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.652 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.653 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.653 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.653 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.653 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.653 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.653 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.653 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.653 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.654 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.655 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.655 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.655 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.655 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.655 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.655 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.655 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.655 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.656 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.656 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.656 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.656 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.656 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.656 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.656 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.656 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.657 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.657 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.657 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.657 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.657 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.657 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.657 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.657 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T16:51:59.122149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.658 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.659 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.659 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T16:51:57.107561+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=51, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:29.659 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T16:56:49.660 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:56:49.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f7588c640 1 Processor -- start 2024-09-12T16:56:49.788 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f7588c640 1 -- start start 2024-09-12T16:56:49.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f7588c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f70132420 0x7f6f70134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:49.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f7588c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7012b9d0 con 0x7f6f7012aee0 2024-09-12T16:56:49.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f7588c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f6f70071e70 con 0x7f6f70132420 2024-09-12T16:56:49.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6e7fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f70132420 0x7f6f70134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:49.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6effd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6f7012aee0 0x7f6f7012b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:35002/0 (socket says 172.21.15.122:35002) 2024-09-12T16:56:49.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6e7fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f70132420 0x7f6f70134810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38278/0 (socket says 172.21.15.122:38278) 2024-09-12T16:56:49.789 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6effd640 1 -- 172.21.15.122:0/2662041755 learned_addr learned my addr 172.21.15.122:0/2662041755 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:56:49.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6e7fc640 1 -- 172.21.15.122:0/2662041755 >> v1:172.21.15.122:6789/0 conn(0x7f6f7012aee0 legacy=0x7f6f7012b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:49.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6e7fc640 1 -- 172.21.15.122:0/2662041755 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f700008e0 con 0x7f6f70132420 2024-09-12T16:56:49.790 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6dffb640 1 -- 172.21.15.122:0/2662041755 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980725966 0 0) 0x7f6f7012b9d0 con 0x7f6f7012aee0 2024-09-12T16:56:49.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6e7fc640 1 --2- 172.21.15.122:0/2662041755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f70132420 0x7f6f70134810 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009740 tx=0x7f6f5801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f032981b5279d2f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:49.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6dffb640 1 -- 172.21.15.122:0/2662041755 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f580b1070 con 0x7f6f70132420 2024-09-12T16:56:49.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6dffb640 1 -- 172.21.15.122:0/2662041755 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f580ac520 con 0x7f6f70132420 2024-09-12T16:56:49.791 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.784+0000 7f6f6dffb640 1 -- 172.21.15.122:0/2662041755 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f580ac820 con 0x7f6f70132420 2024-09-12T16:56:49.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- 172.21.15.122:0/2662041755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f70132420 msgr2=0x7f6f70134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:49.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 --2- 172.21.15.122:0/2662041755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f70132420 0x7f6f70134810 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009740 tx=0x7f6f5801c370 comp rx=0 tx=0).stop 2024-09-12T16:56:49.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- 172.21.15.122:0/2662041755 shutdown_connections 2024-09-12T16:56:49.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 --2- 172.21.15.122:0/2662041755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f70132420 0x7f6f70134810 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:49.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- 172.21.15.122:0/2662041755 >> 172.21.15.122:0/2662041755 conn(0x7f6f700a0a60 msgr2=0x7f6f7006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:56:49.792 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- 172.21.15.122:0/2662041755 shutdown_connections 2024-09-12T16:56:49.793 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- 172.21.15.122:0/2662041755 wait complete. 2024-09-12T16:56:49.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 Processor -- start 2024-09-12T16:56:49.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- start start 2024-09-12T16:56:49.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7012aee0 0x7f6f70129640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:49.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6f70137570 con 0x7f6f7012aee0 2024-09-12T16:56:49.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f6effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7012aee0 0x7f6f70129640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:49.794 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f6effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7012aee0 0x7f6f70129640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38286/0 (socket says 172.21.15.122:38286) 2024-09-12T16:56:49.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f6effd640 1 -- 172.21.15.122:0/1919252419 learned_addr learned my addr 172.21.15.122:0/1919252419 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:56:49.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f6effd640 1 -- 172.21.15.122:0/1919252419 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f70073a80 con 0x7f6f7012aee0 2024-09-12T16:56:49.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f6effd640 1 --2- 172.21.15.122:0/1919252419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7012aee0 0x7f6f70129640 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c3d0 tx=0x7f6f6000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:49.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f67fff640 1 -- 172.21.15.122:0/1919252419 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f60007410 con 0x7f6f7012aee0 2024-09-12T16:56:49.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f67fff640 1 -- 172.21.15.122:0/1919252419 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f600075d0 con 0x7f6f7012aee0 2024-09-12T16:56:49.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7011be50 con 0x7f6f7012aee0 2024-09-12T16:56:49.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f67fff640 1 -- 172.21.15.122:0/1919252419 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f60004960 con 0x7f6f7012aee0 2024-09-12T16:56:49.795 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7011c4a0 con 0x7f6f7012aee0 2024-09-12T16:56:49.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7012b2c0 con 0x7f6f7012aee0 2024-09-12T16:56:49.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f67fff640 1 -- 172.21.15.122:0/1919252419 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6f60011070 con 0x7f6f7012aee0 2024-09-12T16:56:49.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f67fff640 1 --2- 172.21.15.122:0/1919252419 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f5003b1d0 0x7f6f5003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:56:49.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.788+0000 7f6f67fff640 1 -- 172.21.15.122:0/1919252419 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6f6004f370 con 0x7f6f7012aee0 2024-09-12T16:56:49.796 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.792+0000 7f6f6e7fc640 1 --2- 172.21.15.122:0/1919252419 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f5003b1d0 0x7f6f5003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:56:49.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.792+0000 7f6f6e7fc640 1 --2- 172.21.15.122:0/1919252419 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f5003b1d0 0x7f6f5003d690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f580ae000 tx=0x7f6f58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:56:49.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.796+0000 7f6f67fff640 1 -- 172.21.15.122:0/1919252419 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6f60010d50 con 0x7f6f7012aee0 2024-09-12T16:56:49.959 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.952+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f70072170 con 0x7f6f5003b1d0 2024-09-12T16:56:49.987 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.984+0000 7f6f67fff640 1 -- 172.21.15.122:0/1919252419 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665528 (secure 0 0 0) 0x7f6f70072170 con 0x7f6f5003b1d0 2024-09-12T16:56:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:56:50.004 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f5003b1d0 msgr2=0x7f6f5003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 --2- 172.21.15.122:0/1919252419 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f5003b1d0 0x7f6f5003d690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f580ae000 tx=0x7f6f58008040 comp rx=0 tx=0).stop 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7012aee0 msgr2=0x7f6f70129640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 --2- 172.21.15.122:0/1919252419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7012aee0 0x7f6f70129640 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c3d0 tx=0x7f6f6000c890 comp rx=0 tx=0).stop 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 shutdown_connections 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 --2- 172.21.15.122:0/1919252419 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f6f5003b1d0 0x7f6f5003d690 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 --2- 172.21.15.122:0/1919252419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f7012aee0 0x7f6f70129640 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 >> 172.21.15.122:0/1919252419 conn(0x7f6f700a0a60 msgr2=0x7f6f700a10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 shutdown_connections 2024-09-12T16:56:50.006 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:56:49.992+0000 7f6f7588c640 1 -- 172.21.15.122:0/1919252419 wait complete. 2024-09-12T16:56:50.015 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-12T16:56:48.081004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5138,"num_read_kb":4724,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1685,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4725,"ondisk_log_size":4725,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":169312,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":166329,"kb_avail":377318048,"statfs":{"total":386547056640,"available":386373681152,"internally_reserved":0,"allocated":2981888,"data_stored":1785572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":170321686},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006970"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.961212+0000","last_change":"2024-09-12T16:56:03.961062+0000","last_active":"2024-09-12T16:56:03.961212+0000","last_peered":"2024-09-12T16:56:03.961212+0000","last_clean":"2024-09-12T16:56:03.961212+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:56:03.961212+0000","last_undegraded":"2024-09-12T16:56:03.961212+0000","last_fullsized":"2024-09-12T16:56:03.961212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.960834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:37.770581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.300472+0000","last_change":"2024-09-12T16:56:20.300472+0000","last_active":"2024-09-12T16:56:20.300472+0000","last_peered":"2024-09-12T16:56:20.300472+0000","last_clean":"2024-09-12T16:56:20.300472+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:56:20.300472+0000","last_undegraded":"2024-09-12T16:56:20.300472+0000","last_fullsized":"2024-09-12T16:56:20.300472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:20.300256+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:20.300256+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.300256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:32.742102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.441857+0000","last_change":"2024-09-12T16:56:02.441693+0000","last_active":"2024-09-12T16:56:02.441857+0000","last_peered":"2024-09-12T16:56:02.441857+0000","last_clean":"2024-09-12T16:56:02.441857+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:56:02.441857+0000","last_undegraded":"2024-09-12T16:56:02.441857+0000","last_fullsized":"2024-09-12T16:56:02.441857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.441477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:15.024861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.240000+0000","last_change":"2024-09-12T16:56:31.240000+0000","last_active":"2024-09-12T16:56:31.240000+0000","last_peered":"2024-09-12T16:56:31.240000+0000","last_clean":"2024-09-12T16:56:31.240000+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:56:31.240000+0000","last_undegraded":"2024-09-12T16:56:31.240000+0000","last_fullsized":"2024-09-12T16:56:31.240000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:31.239807+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:31.239807+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.239807+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.495353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.033441+0000","last_change":"2024-09-12T16:56:16.033441+0000","last_active":"2024-09-12T16:56:16.033441+0000","last_peered":"2024-09-12T16:56:16.033441+0000","last_clean":"2024-09-12T16:56:16.033441+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:56:16.033441+0000","last_undegraded":"2024-09-12T16:56:16.033441+0000","last_fullsized":"2024-09-12T16:56:16.033441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:16.033239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:16.033239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.033239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:59.167081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.269328+0000","last_change":"2024-09-12T16:56:32.269328+0000","last_active":"2024-09-12T16:56:32.269328+0000","last_peered":"2024-09-12T16:56:32.269328+0000","last_clean":"2024-09-12T16:56:32.269328+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:56:32.269328+0000","last_undegraded":"2024-09-12T16:56:32.269328+0000","last_fullsized":"2024-09-12T16:56:32.269328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:32.269147+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:32.269147+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.269147+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:37.703397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.000241+0000","last_change":"2024-09-12T16:55:59.000089+0000","last_active":"2024-09-12T16:55:59.000241+0000","last_peered":"2024-09-12T16:55:59.000241+0000","last_clean":"2024-09-12T16:55:59.000241+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:55:59.000241+0000","last_undegraded":"2024-09-12T16:55:59.000241+0000","last_fullsized":"2024-09-12T16:55:59.000241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.999904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.689260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.304553+0000","last_change":"2024-09-12T16:56:33.304553+0000","last_active":"2024-09-12T16:56:33.304553+0000","last_peered":"2024-09-12T16:56:33.304553+0000","last_clean":"2024-09-12T16:56:33.304553+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:56:33.304553+0000","last_undegraded":"2024-09-12T16:56:33.304553+0000","last_fullsized":"2024-09-12T16:56:33.304553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:33.304373+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:33.304373+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.304373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:42.426109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.054183+0000","last_change":"2024-09-12T16:56:15.054183+0000","last_active":"2024-09-12T16:56:15.054183+0000","last_peered":"2024-09-12T16:56:15.054183+0000","last_clean":"2024-09-12T16:56:15.054183+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:56:15.054183+0000","last_undegraded":"2024-09-12T16:56:15.054183+0000","last_fullsized":"2024-09-12T16:56:15.054183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:15.053960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:15.053960+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.053960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:40.643203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.330004+0000","last_change":"2024-09-12T16:56:21.330004+0000","last_active":"2024-09-12T16:56:21.330004+0000","last_peered":"2024-09-12T16:56:21.330004+0000","last_clean":"2024-09-12T16:56:21.330004+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:56:21.330004+0000","last_undegraded":"2024-09-12T16:56:21.330004+0000","last_fullsized":"2024-09-12T16:56:21.330004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:21.329825+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:21.329825+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.329825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:52.622109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.923745+0000","last_change":"2024-09-12T16:56:06.923745+0000","last_active":"2024-09-12T16:56:06.923745+0000","last_peered":"2024-09-12T16:56:06.923745+0000","last_clean":"2024-09-12T16:56:06.923745+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:56:06.923745+0000","last_undegraded":"2024-09-12T16:56:06.923745+0000","last_fullsized":"2024-09-12T16:56:06.923745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.923558+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.923558+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.923558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:45.607137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.344087+0000","last_change":"2024-09-12T16:56:34.344087+0000","last_active":"2024-09-12T16:56:34.344087+0000","last_peered":"2024-09-12T16:56:34.344087+0000","last_clean":"2024-09-12T16:56:34.344087+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:56:34.344087+0000","last_undegraded":"2024-09-12T16:56:34.344087+0000","last_fullsized":"2024-09-12T16:56:34.344087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:34.343897+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:34.343897+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.343897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:18.965351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.073104+0000","last_change":"2024-09-12T16:56:14.073104+0000","last_active":"2024-09-12T16:56:14.073104+0000","last_peered":"2024-09-12T16:56:14.073104+0000","last_clean":"2024-09-12T16:56:14.073104+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:56:14.073104+0000","last_undegraded":"2024-09-12T16:56:14.073104+0000","last_fullsized":"2024-09-12T16:56:14.073104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:14.072890+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:14.072890+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.072890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:52.398439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.924366+0000","last_change":"2024-09-12T16:56:14.924366+0000","last_active":"2024-09-12T16:56:14.924366+0000","last_peered":"2024-09-12T16:56:14.924366+0000","last_clean":"2024-09-12T16:56:14.924366+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:56:14.924366+0000","last_undegraded":"2024-09-12T16:56:14.924366+0000","last_fullsized":"2024-09-12T16:56:14.924366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:14.924132+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:14.924132+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.924132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:01.248598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.411580+0000","last_change":"2024-09-12T16:55:59.411580+0000","last_active":"2024-09-12T16:55:59.411580+0000","last_peered":"2024-09-12T16:55:59.411580+0000","last_clean":"2024-09-12T16:55:59.411580+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:55:59.411580+0000","last_undegraded":"2024-09-12T16:55:59.411580+0000","last_fullsized":"2024-09-12T16:55:59.411580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.411390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:57.337645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.969122+0000","last_change":"2024-09-12T16:56:15.969122+0000","last_active":"2024-09-12T16:56:15.969122+0000","last_peered":"2024-09-12T16:56:15.969122+0000","last_clean":"2024-09-12T16:56:15.969122+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:56:15.969122+0000","last_undegraded":"2024-09-12T16:56:15.969122+0000","last_fullsized":"2024-09-12T16:56:15.969122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:15.968939+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:15.968939+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.968939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:23.486079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.198469+0000","last_change":"2024-09-12T16:56:30.198297+0000","last_active":"2024-09-12T16:56:30.198469+0000","last_peered":"2024-09-12T16:56:30.198469+0000","last_clean":"2024-09-12T16:56:30.198469+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:56:30.198469+0000","last_undegraded":"2024-09-12T16:56:30.198469+0000","last_fullsized":"2024-09-12T16:56:30.198469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:30.198091+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:30.198091+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.198091+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:32.759529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.020318+0000","last_change":"2024-09-12T16:56:01.020166+0000","last_active":"2024-09-12T16:56:01.020318+0000","last_peered":"2024-09-12T16:56:01.020318+0000","last_clean":"2024-09-12T16:56:01.020318+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:56:01.020318+0000","last_undegraded":"2024-09-12T16:56:01.020318+0000","last_fullsized":"2024-09-12T16:56:01.020318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.019981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:17.549962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.228861+0000","last_change":"2024-09-12T16:56:15.228716+0000","last_active":"2024-09-12T16:56:15.228861+0000","last_peered":"2024-09-12T16:56:15.228861+0000","last_clean":"2024-09-12T16:56:15.228861+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:56:15.228861+0000","last_undegraded":"2024-09-12T16:56:15.228861+0000","last_fullsized":"2024-09-12T16:56:15.228861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:15.228531+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:15.228531+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.228531+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:17.677439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.978515+0000","last_change":"2024-09-12T16:56:01.978515+0000","last_active":"2024-09-12T16:56:01.978515+0000","last_peered":"2024-09-12T16:56:01.978515+0000","last_clean":"2024-09-12T16:56:01.978515+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:56:01.978515+0000","last_undegraded":"2024-09-12T16:56:01.978515+0000","last_fullsized":"2024-09-12T16:56:01.978515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.978300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:23.170955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.200170+0000","last_change":"2024-09-12T16:56:16.200016+0000","last_active":"2024-09-12T16:56:16.200170+0000","last_peered":"2024-09-12T16:56:16.200170+0000","last_clean":"2024-09-12T16:56:16.200170+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:56:16.200170+0000","last_undegraded":"2024-09-12T16:56:16.200170+0000","last_fullsized":"2024-09-12T16:56:16.200170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:16.199840+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:16.199840+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.199840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:41.217788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.024798+0000","last_change":"2024-09-12T16:56:00.024742+0000","last_active":"2024-09-12T16:56:00.024798+0000","last_peered":"2024-09-12T16:56:00.024798+0000","last_clean":"2024-09-12T16:56:00.024798+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:56:00.024798+0000","last_undegraded":"2024-09-12T16:56:00.024798+0000","last_fullsized":"2024-09-12T16:56:00.024798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.024672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:03.497187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.360052+0000","last_change":"2024-09-12T16:56:14.360052+0000","last_active":"2024-09-12T16:56:14.360052+0000","last_peered":"2024-09-12T16:56:14.360052+0000","last_clean":"2024-09-12T16:56:14.360052+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:56:14.360052+0000","last_undegraded":"2024-09-12T16:56:14.360052+0000","last_fullsized":"2024-09-12T16:56:14.360052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:14.359876+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:14.359876+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.359876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:20.611388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.029962+0000","last_change":"2024-09-12T16:55:59.029695+0000","last_active":"2024-09-12T16:55:59.029962+0000","last_peered":"2024-09-12T16:55:59.029962+0000","last_clean":"2024-09-12T16:55:59.029962+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:55:59.029962+0000","last_undegraded":"2024-09-12T16:55:59.029962+0000","last_fullsized":"2024-09-12T16:55:59.029962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.029505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.968614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.919566+0000","last_change":"2024-09-12T16:56:12.919566+0000","last_active":"2024-09-12T16:56:12.919566+0000","last_peered":"2024-09-12T16:56:12.919566+0000","last_clean":"2024-09-12T16:56:12.919566+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:56:12.919566+0000","last_undegraded":"2024-09-12T16:56:12.919566+0000","last_fullsized":"2024-09-12T16:56:12.919566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:12.919380+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:12.919380+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.919380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:01.652496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.453187+0000","last_change":"2024-09-12T16:55:58.453187+0000","last_active":"2024-09-12T16:55:58.453187+0000","last_peered":"2024-09-12T16:55:58.453187+0000","last_clean":"2024-09-12T16:55:58.453187+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:55:58.453187+0000","last_undegraded":"2024-09-12T16:55:58.453187+0000","last_fullsized":"2024-09-12T16:55:58.453187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.452993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.443665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.259709+0000","last_change":"2024-09-12T16:56:18.259709+0000","last_active":"2024-09-12T16:56:18.259709+0000","last_peered":"2024-09-12T16:56:18.259709+0000","last_clean":"2024-09-12T16:56:18.259709+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:56:18.259709+0000","last_undegraded":"2024-09-12T16:56:18.259709+0000","last_fullsized":"2024-09-12T16:56:18.259709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:18.259509+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:18.259509+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.259509+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:11.920537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.033140+0000","last_change":"2024-09-12T16:56:13.032967+0000","last_active":"2024-09-12T16:56:13.033140+0000","last_peered":"2024-09-12T16:56:13.033140+0000","last_clean":"2024-09-12T16:56:13.033140+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:56:13.033140+0000","last_undegraded":"2024-09-12T16:56:13.033140+0000","last_fullsized":"2024-09-12T16:56:13.033140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:13.032745+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:13.032745+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.032745+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:11.625172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.449818+0000","last_change":"2024-09-12T16:52:06.228645+0000","last_active":"2024-09-12T16:55:12.449818+0000","last_peered":"2024-09-12T16:55:12.449818+0000","last_clean":"2024-09-12T16:55:12.449818+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:55:12.449818+0000","last_undegraded":"2024-09-12T16:55:12.449818+0000","last_fullsized":"2024-09-12T16:55:12.449818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.027430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.053860+0000","last_change":"2024-09-12T16:56:22.053711+0000","last_active":"2024-09-12T16:56:22.053860+0000","last_peered":"2024-09-12T16:56:22.053860+0000","last_clean":"2024-09-12T16:56:22.053860+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:56:22.053860+0000","last_undegraded":"2024-09-12T16:56:22.053860+0000","last_fullsized":"2024-09-12T16:56:22.053860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:22.053522+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:22.053522+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.053522+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:59.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.009540+0000","last_change":"2024-09-12T16:56:02.009398+0000","last_active":"2024-09-12T16:56:02.009540+0000","last_peered":"2024-09-12T16:56:02.009540+0000","last_clean":"2024-09-12T16:56:02.009540+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:56:02.009540+0000","last_undegraded":"2024-09-12T16:56:02.009540+0000","last_fullsized":"2024-09-12T16:56:02.009540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.009210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:18.094619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.221372+0000","last_change":"2024-09-12T16:56:42.221372+0000","last_active":"2024-09-12T16:56:42.221372+0000","last_peered":"2024-09-12T16:56:42.221372+0000","last_clean":"2024-09-12T16:56:42.221372+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:56:42.221372+0000","last_undegraded":"2024-09-12T16:56:42.221372+0000","last_fullsized":"2024-09-12T16:56:42.221372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:42.221088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:42.221088+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.221088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:08.414428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.671303+0000","last_change":"2024-09-12T16:52:02.211041+0000","last_active":"2024-09-12T16:55:43.671303+0000","last_peered":"2024-09-12T16:55:43.671303+0000","last_clean":"2024-09-12T16:55:43.671303+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:55:43.671303+0000","last_undegraded":"2024-09-12T16:55:43.671303+0000","last_fullsized":"2024-09-12T16:55:43.671303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:56.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.522766+0000","last_change":"2024-09-12T16:56:41.522766+0000","last_active":"2024-09-12T16:56:41.522766+0000","last_peered":"2024-09-12T16:56:41.522766+0000","last_clean":"2024-09-12T16:56:41.522766+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:56:41.522766+0000","last_undegraded":"2024-09-12T16:56:41.522766+0000","last_fullsized":"2024-09-12T16:56:41.522766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.522584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.522584+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.522584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:22.233238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:53:25.770372+0000","last_change":"2024-09-12T16:52:06.220823+0000","last_active":"2024-09-12T16:53:25.770372+0000","last_peered":"2024-09-12T16:53:25.770372+0000","last_clean":"2024-09-12T16:53:25.770372+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:53:25.770372+0000","last_undegraded":"2024-09-12T16:53:25.770372+0000","last_fullsized":"2024-09-12T16:53:25.770372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:41.834594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.075544+0000","last_change":"2024-09-12T16:56:23.075544+0000","last_active":"2024-09-12T16:56:23.075544+0000","last_peered":"2024-09-12T16:56:23.075544+0000","last_clean":"2024-09-12T16:56:23.075544+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:56:23.075544+0000","last_undegraded":"2024-09-12T16:56:23.075544+0000","last_fullsized":"2024-09-12T16:56:23.075544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:23.075361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:23.075361+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.075361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:19.899752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.866594+0000","last_change":"2024-09-12T16:55:53.866458+0000","last_active":"2024-09-12T16:55:53.866594+0000","last_peered":"2024-09-12T16:55:53.866594+0000","last_clean":"2024-09-12T16:55:53.866594+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:53.866594+0000","last_undegraded":"2024-09-12T16:55:53.866594+0000","last_fullsized":"2024-09-12T16:55:53.866594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.866257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:36.901200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.358444+0000","last_change":"2024-09-12T16:56:21.358299+0000","last_active":"2024-09-12T16:56:21.358444+0000","last_peered":"2024-09-12T16:56:21.358444+0000","last_clean":"2024-09-12T16:56:21.358444+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:56:21.358444+0000","last_undegraded":"2024-09-12T16:56:21.358444+0000","last_fullsized":"2024-09-12T16:56:21.358444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:21.358117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:21.358117+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.358117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:01.559420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.493576+0000","last_change":"2024-09-12T16:56:34.493576+0000","last_active":"2024-09-12T16:56:34.493576+0000","last_peered":"2024-09-12T16:56:34.493576+0000","last_clean":"2024-09-12T16:56:34.493576+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:56:34.493576+0000","last_undegraded":"2024-09-12T16:56:34.493576+0000","last_fullsized":"2024-09-12T16:56:34.493576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-12T16:56:34.493374+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-12T16:56:34.493374+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.493374+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:50.187740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.544537+0000","last_change":"2024-09-12T16:56:39.544537+0000","last_active":"2024-09-12T16:56:39.544537+0000","last_peered":"2024-09-12T16:56:39.544537+0000","last_clean":"2024-09-12T16:56:39.544537+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:56:39.544537+0000","last_undegraded":"2024-09-12T16:56:39.544537+0000","last_fullsized":"2024-09-12T16:56:39.544537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.544357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.544357+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.544357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:36.508956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.021248+0000","last_change":"2024-09-12T16:52:06.224899+0000","last_active":"2024-09-12T16:52:35.021248+0000","last_peered":"2024-09-12T16:52:35.021248+0000","last_clean":"2024-09-12T16:52:35.021248+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:52:35.021248+0000","last_undegraded":"2024-09-12T16:52:35.021248+0000","last_fullsized":"2024-09-12T16:52:35.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:27.788906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.123242+0000","last_change":"2024-09-12T16:56:24.123242+0000","last_active":"2024-09-12T16:56:24.123242+0000","last_peered":"2024-09-12T16:56:24.123242+0000","last_clean":"2024-09-12T16:56:24.123242+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:56:24.123242+0000","last_undegraded":"2024-09-12T16:56:24.123242+0000","last_fullsized":"2024-09-12T16:56:24.123242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:24.123050+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:24.123050+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.123050+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:32.942821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.057505+0000","last_change":"2024-09-12T16:56:01.057358+0000","last_active":"2024-09-12T16:56:01.057505+0000","last_peered":"2024-09-12T16:56:01.057505+0000","last_clean":"2024-09-12T16:56:01.057505+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:56:01.057505+0000","last_undegraded":"2024-09-12T16:56:01.057505+0000","last_fullsized":"2024-09-12T16:56:01.057505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.057181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:48.320895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.371894+0000","last_change":"2024-09-12T16:56:23.371894+0000","last_active":"2024-09-12T16:56:23.371894+0000","last_peered":"2024-09-12T16:56:23.371894+0000","last_clean":"2024-09-12T16:56:23.371894+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:56:23.371894+0000","last_undegraded":"2024-09-12T16:56:23.371894+0000","last_fullsized":"2024-09-12T16:56:23.371894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:23.371722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:23.371722+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.371722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:32.702443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.005898+0000","last_change":"2024-09-12T16:56:28.005734+0000","last_active":"2024-09-12T16:56:28.005898+0000","last_peered":"2024-09-12T16:56:28.005898+0000","last_clean":"2024-09-12T16:56:28.005898+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:56:28.005898+0000","last_undegraded":"2024-09-12T16:56:28.005898+0000","last_fullsized":"2024-09-12T16:56:28.005898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:28.005551+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:28.005551+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.005551+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:32.321067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.577588+0000","last_change":"2024-09-12T16:52:04.214865+0000","last_active":"2024-09-12T16:55:43.577588+0000","last_peered":"2024-09-12T16:55:43.577588+0000","last_clean":"2024-09-12T16:55:43.577588+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:55:43.577588+0000","last_undegraded":"2024-09-12T16:55:43.577588+0000","last_fullsized":"2024-09-12T16:55:43.577588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:36.658689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.064316+0000","last_change":"2024-09-12T16:56:41.064316+0000","last_active":"2024-09-12T16:56:41.064316+0000","last_peered":"2024-09-12T16:56:41.064316+0000","last_clean":"2024-09-12T16:56:41.064316+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:56:41.064316+0000","last_undegraded":"2024-09-12T16:56:41.064316+0000","last_fullsized":"2024-09-12T16:56:41.064316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.064050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.064050+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.064050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:56.640802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.409809+0000","last_change":"2024-09-12T16:56:05.409809+0000","last_active":"2024-09-12T16:56:05.409809+0000","last_peered":"2024-09-12T16:56:05.409809+0000","last_clean":"2024-09-12T16:56:05.409809+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:56:05.409809+0000","last_undegraded":"2024-09-12T16:56:05.409809+0000","last_fullsized":"2024-09-12T16:56:05.409809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:05.409623+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:05.409623+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.409623+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:09.725138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.883001+0000","last_change":"2024-09-12T16:55:49.882861+0000","last_active":"2024-09-12T16:55:49.883001+0000","last_peered":"2024-09-12T16:55:49.883001+0000","last_clean":"2024-09-12T16:55:49.883001+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:55:49.883001+0000","last_undegraded":"2024-09-12T16:55:49.883001+0000","last_fullsized":"2024-09-12T16:55:49.883001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.882666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:15.998089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.204889+0000","last_change":"2024-09-12T16:56:43.204889+0000","last_active":"2024-09-12T16:56:43.204889+0000","last_peered":"2024-09-12T16:56:43.204889+0000","last_clean":"2024-09-12T16:56:43.204889+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:56:43.204889+0000","last_undegraded":"2024-09-12T16:56:43.204889+0000","last_fullsized":"2024-09-12T16:56:43.204889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:43.204616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:43.204616+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.204616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:44.818830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.990167+0000","last_change":"2024-09-12T16:56:28.990167+0000","last_active":"2024-09-12T16:56:28.990167+0000","last_peered":"2024-09-12T16:56:28.990167+0000","last_clean":"2024-09-12T16:56:28.990167+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:56:28.990167+0000","last_undegraded":"2024-09-12T16:56:28.990167+0000","last_fullsized":"2024-09-12T16:56:28.990167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:28.989951+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:28.989951+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.989951+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:15.454424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.374347+0000","last_change":"2024-09-12T16:56:38.374212+0000","last_active":"2024-09-12T16:56:38.374347+0000","last_peered":"2024-09-12T16:56:38.374347+0000","last_clean":"2024-09-12T16:56:38.374347+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:56:38.374347+0000","last_undegraded":"2024-09-12T16:56:38.374347+0000","last_fullsized":"2024-09-12T16:56:38.374347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:38.374018+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:38.374018+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.374018+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.005339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.050560+0000","last_change":"2024-09-12T16:56:20.050421+0000","last_active":"2024-09-12T16:56:20.050560+0000","last_peered":"2024-09-12T16:56:20.050560+0000","last_clean":"2024-09-12T16:56:20.050560+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:56:20.050560+0000","last_undegraded":"2024-09-12T16:56:20.050560+0000","last_fullsized":"2024-09-12T16:56:20.050560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:20.050239+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:20.050239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.050239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:20.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.907472+0000","last_change":"2024-09-12T16:55:51.907335+0000","last_active":"2024-09-12T16:55:51.907472+0000","last_peered":"2024-09-12T16:55:51.907472+0000","last_clean":"2024-09-12T16:55:51.907472+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:55:51.907472+0000","last_undegraded":"2024-09-12T16:55:51.907472+0000","last_fullsized":"2024-09-12T16:55:51.907472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.907142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:07.393009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.349322+0000","last_change":"2024-09-12T16:56:23.349322+0000","last_active":"2024-09-12T16:56:23.349322+0000","last_peered":"2024-09-12T16:56:23.349322+0000","last_clean":"2024-09-12T16:56:23.349322+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:56:23.349322+0000","last_undegraded":"2024-09-12T16:56:23.349322+0000","last_fullsized":"2024-09-12T16:56:23.349322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:23.349052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:23.349052+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.349052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:29.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'53","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.006089+0000","last_change":"2024-09-12T16:56:25.005947+0000","last_active":"2024-09-12T16:56:25.006089+0000","last_peered":"2024-09-12T16:56:25.006089+0000","last_clean":"2024-09-12T16:56:25.006089+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:56:25.006089+0000","last_undegraded":"2024-09-12T16:56:25.006089+0000","last_fullsized":"2024-09-12T16:56:25.006089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'53","last_scrub_stamp":"2024-09-12T16:56:25.005701+0000","last_deep_scrub":"34'53","last_deep_scrub_stamp":"2024-09-12T16:56:25.005701+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.005701+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:29.541745+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.409384+0000","last_change":"2024-09-12T16:56:40.409384+0000","last_active":"2024-09-12T16:56:40.409384+0000","last_peered":"2024-09-12T16:56:40.409384+0000","last_clean":"2024-09-12T16:56:40.409384+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:56:40.409384+0000","last_undegraded":"2024-09-12T16:56:40.409384+0000","last_fullsized":"2024-09-12T16:56:40.409384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.409170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.409170+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.409170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:50.796522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.053635+0000","last_change":"2024-09-12T16:56:38.053635+0000","last_active":"2024-09-12T16:56:38.053635+0000","last_peered":"2024-09-12T16:56:38.053635+0000","last_clean":"2024-09-12T16:56:38.053635+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:56:38.053635+0000","last_undegraded":"2024-09-12T16:56:38.053635+0000","last_fullsized":"2024-09-12T16:56:38.053635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:38.053453+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:38.053453+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.053453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.986575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.051166+0000","last_change":"2024-09-12T16:56:05.051013+0000","last_active":"2024-09-12T16:56:05.051166+0000","last_peered":"2024-09-12T16:56:05.051166+0000","last_clean":"2024-09-12T16:56:05.051166+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:56:05.051166+0000","last_undegraded":"2024-09-12T16:56:05.051166+0000","last_fullsized":"2024-09-12T16:56:05.051166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.050827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:50.475409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.905402+0000","last_change":"2024-09-12T16:55:54.905168+0000","last_active":"2024-09-12T16:55:54.905402+0000","last_peered":"2024-09-12T16:55:54.905402+0000","last_clean":"2024-09-12T16:55:54.905402+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:55:54.905402+0000","last_undegraded":"2024-09-12T16:55:54.905402+0000","last_fullsized":"2024-09-12T16:55:54.905402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:54.848288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.337432+0000","last_change":"2024-09-12T16:56:18.337308+0000","last_active":"2024-09-12T16:56:18.337432+0000","last_peered":"2024-09-12T16:56:18.337432+0000","last_clean":"2024-09-12T16:56:18.337432+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:56:18.337432+0000","last_undegraded":"2024-09-12T16:56:18.337432+0000","last_fullsized":"2024-09-12T16:56:18.337432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:18.337128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:18.337128+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.337128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:29.062021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.780682+0000","last_change":"2024-09-12T16:52:02.209890+0000","last_active":"2024-09-12T16:55:43.780682+0000","last_peered":"2024-09-12T16:55:43.780682+0000","last_clean":"2024-09-12T16:55:43.780682+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:55:43.780682+0000","last_undegraded":"2024-09-12T16:55:43.780682+0000","last_fullsized":"2024-09-12T16:55:43.780682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.365019+0000","last_change":"2024-09-12T16:56:37.365019+0000","last_active":"2024-09-12T16:56:37.365019+0000","last_peered":"2024-09-12T16:56:37.365019+0000","last_clean":"2024-09-12T16:56:37.365019+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:56:37.365019+0000","last_undegraded":"2024-09-12T16:56:37.365019+0000","last_fullsized":"2024-09-12T16:56:37.365019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:37.364847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:37.364847+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.364847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:23.142205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.526572+0000","last_change":"2024-09-12T16:56:43.526572+0000","last_active":"2024-09-12T16:56:43.526572+0000","last_peered":"2024-09-12T16:56:43.526572+0000","last_clean":"2024-09-12T16:56:43.526572+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:56:43.526572+0000","last_undegraded":"2024-09-12T16:56:43.526572+0000","last_fullsized":"2024-09-12T16:56:43.526572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:43.526380+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:43.526380+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.526380+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.801749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.904512+0000","last_change":"2024-09-12T16:56:05.904375+0000","last_active":"2024-09-12T16:56:05.904512+0000","last_peered":"2024-09-12T16:56:05.904512+0000","last_clean":"2024-09-12T16:56:05.904512+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:56:05.904512+0000","last_undegraded":"2024-09-12T16:56:05.904512+0000","last_fullsized":"2024-09-12T16:56:05.904512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:05.904173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:05.904173+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.904173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:01.552829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.069390+0000","last_change":"2024-09-12T16:55:59.069150+0000","last_active":"2024-09-12T16:55:59.069390+0000","last_peered":"2024-09-12T16:55:59.069390+0000","last_clean":"2024-09-12T16:55:59.069390+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:55:59.069390+0000","last_undegraded":"2024-09-12T16:55:59.069390+0000","last_fullsized":"2024-09-12T16:55:59.069390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.068940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:14.552968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.380181+0000","last_change":"2024-09-12T16:56:22.380045+0000","last_active":"2024-09-12T16:56:22.380181+0000","last_peered":"2024-09-12T16:56:22.380181+0000","last_clean":"2024-09-12T16:56:22.380181+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:56:22.380181+0000","last_undegraded":"2024-09-12T16:56:22.380181+0000","last_fullsized":"2024-09-12T16:56:22.380181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.379868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.379868+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.379868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:57.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'40","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.702221+0000","last_change":"2024-09-12T16:52:02.203207+0000","last_active":"2024-09-12T16:55:43.702221+0000","last_peered":"2024-09-12T16:55:43.702221+0000","last_clean":"2024-09-12T16:55:43.702221+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:55:43.702221+0000","last_undegraded":"2024-09-12T16:55:43.702221+0000","last_fullsized":"2024-09-12T16:55:43.702221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.317532+0000","last_change":"2024-09-12T16:56:36.317532+0000","last_active":"2024-09-12T16:56:36.317532+0000","last_peered":"2024-09-12T16:56:36.317532+0000","last_clean":"2024-09-12T16:56:36.317532+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:56:36.317532+0000","last_undegraded":"2024-09-12T16:56:36.317532+0000","last_fullsized":"2024-09-12T16:56:36.317532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.317357+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.317357+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.317357+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:50.723946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:19.020488+0000","last_change":"2024-09-12T16:52:06.236389+0000","last_active":"2024-09-12T16:54:19.020488+0000","last_peered":"2024-09-12T16:54:19.020488+0000","last_clean":"2024-09-12T16:54:19.020488+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:54:19.020488+0000","last_undegraded":"2024-09-12T16:54:19.020488+0000","last_fullsized":"2024-09-12T16:54:19.020488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.925722+0000","last_change":"2024-09-12T16:56:04.925571+0000","last_active":"2024-09-12T16:56:04.925722+0000","last_peered":"2024-09-12T16:56:04.925722+0000","last_clean":"2024-09-12T16:56:04.925722+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:56:04.925722+0000","last_undegraded":"2024-09-12T16:56:04.925722+0000","last_fullsized":"2024-09-12T16:56:04.925722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.925364+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:32.101898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.090663+0000","last_change":"2024-09-12T16:56:00.090533+0000","last_active":"2024-09-12T16:56:00.090663+0000","last_peered":"2024-09-12T16:56:00.090663+0000","last_clean":"2024-09-12T16:56:00.090663+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:56:00.090663+0000","last_undegraded":"2024-09-12T16:56:00.090663+0000","last_fullsized":"2024-09-12T16:56:00.090663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.090336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:15.365705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.382408+0000","last_change":"2024-09-12T16:56:19.382163+0000","last_active":"2024-09-12T16:56:19.382408+0000","last_peered":"2024-09-12T16:56:19.382408+0000","last_clean":"2024-09-12T16:56:19.382408+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:56:19.382408+0000","last_undegraded":"2024-09-12T16:56:19.382408+0000","last_fullsized":"2024-09-12T16:56:19.382408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:19.381897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:19.381897+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.381897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:39.274144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":126,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.801010+0000","last_change":"2024-09-12T16:52:02.201612+0000","last_active":"2024-09-12T16:55:43.801010+0000","last_peered":"2024-09-12T16:55:43.801010+0000","last_clean":"2024-09-12T16:55:43.801010+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:55:43.801010+0000","last_undegraded":"2024-09-12T16:55:43.801010+0000","last_fullsized":"2024-09-12T16:55:43.801010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.317586+0000","last_change":"2024-09-12T16:56:35.317586+0000","last_active":"2024-09-12T16:56:35.317586+0000","last_peered":"2024-09-12T16:56:35.317586+0000","last_clean":"2024-09-12T16:56:35.317586+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:56:35.317586+0000","last_undegraded":"2024-09-12T16:56:35.317586+0000","last_fullsized":"2024-09-12T16:56:35.317586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.317410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.317410+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.317410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:18.356487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.741973+0000","last_change":"2024-09-12T16:52:06.212053+0000","last_active":"2024-09-12T16:55:12.741973+0000","last_peered":"2024-09-12T16:55:12.741973+0000","last_clean":"2024-09-12T16:55:12.741973+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:55:12.741973+0000","last_undegraded":"2024-09-12T16:55:12.741973+0000","last_fullsized":"2024-09-12T16:55:12.741973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.020950+0000","last_change":"2024-09-12T16:56:04.020804+0000","last_active":"2024-09-12T16:56:04.020950+0000","last_peered":"2024-09-12T16:56:04.020950+0000","last_clean":"2024-09-12T16:56:04.020950+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:56:04.020950+0000","last_undegraded":"2024-09-12T16:56:04.020950+0000","last_fullsized":"2024-09-12T16:56:04.020950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.020617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:53.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.431669+0000","last_change":"2024-09-12T16:55:52.431517+0000","last_active":"2024-09-12T16:55:52.431669+0000","last_peered":"2024-09-12T16:55:52.431669+0000","last_clean":"2024-09-12T16:55:52.431669+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:55:52.431669+0000","last_undegraded":"2024-09-12T16:55:52.431669+0000","last_fullsized":"2024-09-12T16:55:52.431669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.431331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:30.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.008607+0000","last_change":"2024-09-12T16:56:18.008472+0000","last_active":"2024-09-12T16:56:18.008607+0000","last_peered":"2024-09-12T16:56:18.008607+0000","last_clean":"2024-09-12T16:56:18.008607+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:56:18.008607+0000","last_undegraded":"2024-09-12T16:56:18.008607+0000","last_fullsized":"2024-09-12T16:56:18.008607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:18.008262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:18.008262+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.008262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:32.869069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'44","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.455387+0000","last_change":"2024-09-12T16:56:33.455122+0000","last_active":"2024-09-12T16:56:33.455387+0000","last_peered":"2024-09-12T16:56:33.455387+0000","last_clean":"2024-09-12T16:56:33.455387+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:56:33.455387+0000","last_undegraded":"2024-09-12T16:56:33.455387+0000","last_fullsized":"2024-09-12T16:56:33.455387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-12T16:56:33.454879+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-12T16:56:33.454879+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.454879+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:45.966553+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.026870+0000","last_change":"2024-09-12T16:52:04.214150+0000","last_active":"2024-09-12T16:54:21.026870+0000","last_peered":"2024-09-12T16:54:21.026870+0000","last_clean":"2024-09-12T16:54:21.026870+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:54:21.026870+0000","last_undegraded":"2024-09-12T16:54:21.026870+0000","last_fullsized":"2024-09-12T16:54:21.026870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'7","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.675594+0000","last_change":"2024-09-12T16:52:06.231706+0000","last_active":"2024-09-12T16:55:12.675594+0000","last_peered":"2024-09-12T16:55:12.675594+0000","last_clean":"2024-09-12T16:55:12.675594+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:55:12.675594+0000","last_undegraded":"2024-09-12T16:55:12.675594+0000","last_fullsized":"2024-09-12T16:55:12.675594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.007311+0000","last_change":"2024-09-12T16:56:19.007071+0000","last_active":"2024-09-12T16:56:19.007311+0000","last_peered":"2024-09-12T16:56:19.007311+0000","last_clean":"2024-09-12T16:56:19.007311+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:56:19.007311+0000","last_undegraded":"2024-09-12T16:56:19.007311+0000","last_fullsized":"2024-09-12T16:56:19.007311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:19.006789+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:19.006789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.006789+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:57.690077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.103221+0000","last_change":"2024-09-12T16:55:58.103087+0000","last_active":"2024-09-12T16:55:58.103221+0000","last_peered":"2024-09-12T16:55:58.103221+0000","last_clean":"2024-09-12T16:55:58.103221+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:55:58.103221+0000","last_undegraded":"2024-09-12T16:55:58.103221+0000","last_fullsized":"2024-09-12T16:55:58.103221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.102908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:04.349009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.386158+0000","last_change":"2024-09-12T16:56:20.386007+0000","last_active":"2024-09-12T16:56:20.386158+0000","last_peered":"2024-09-12T16:56:20.386158+0000","last_clean":"2024-09-12T16:56:20.386158+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:56:20.386158+0000","last_undegraded":"2024-09-12T16:56:20.386158+0000","last_fullsized":"2024-09-12T16:56:20.386158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:20.385826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:20.385826+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.385826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:33.071596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.998018+0000","last_change":"2024-09-12T16:56:25.997882+0000","last_active":"2024-09-12T16:56:25.998018+0000","last_peered":"2024-09-12T16:56:25.998018+0000","last_clean":"2024-09-12T16:56:25.998018+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:56:25.998018+0000","last_undegraded":"2024-09-12T16:56:25.998018+0000","last_fullsized":"2024-09-12T16:56:25.998018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T16:56:25.997691+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T16:56:25.997691+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.997691+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:15.487181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.986764+0000","last_change":"2024-09-12T16:56:31.986615+0000","last_active":"2024-09-12T16:56:31.986764+0000","last_peered":"2024-09-12T16:56:31.986764+0000","last_clean":"2024-09-12T16:56:31.986764+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:56:31.986764+0000","last_undegraded":"2024-09-12T16:56:31.986764+0000","last_fullsized":"2024-09-12T16:56:31.986764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:31.986435+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:31.986435+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.986435+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:25.564125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'22","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.443777+0000","last_change":"2024-09-12T16:56:43.443777+0000","last_active":"2024-09-12T16:56:43.443777+0000","last_peered":"2024-09-12T16:56:43.443777+0000","last_clean":"2024-09-12T16:56:43.443777+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:56:43.443777+0000","last_undegraded":"2024-09-12T16:56:43.443777+0000","last_fullsized":"2024-09-12T16:56:43.443777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-12T16:56:43.443561+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-12T16:56:43.443561+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.443561+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:00.897956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.985410+0000","last_change":"2024-09-12T16:56:02.985161+0000","last_active":"2024-09-12T16:56:02.985410+0000","last_peered":"2024-09-12T16:56:02.985410+0000","last_clean":"2024-09-12T16:56:02.985410+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:56:02.985410+0000","last_undegraded":"2024-09-12T16:56:02.985410+0000","last_fullsized":"2024-09-12T16:56:02.985410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.984950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:45.336637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.105792+0000","last_change":"2024-09-12T16:55:57.105529+0000","last_active":"2024-09-12T16:55:57.105792+0000","last_peered":"2024-09-12T16:55:57.105792+0000","last_clean":"2024-09-12T16:55:57.105792+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:55:57.105792+0000","last_undegraded":"2024-09-12T16:55:57.105792+0000","last_fullsized":"2024-09-12T16:55:57.105792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.105307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'7","reported_seq":635,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.390694+0000","last_change":"2024-09-12T16:56:26.390535+0000","last_active":"2024-09-12T16:56:26.390694+0000","last_peered":"2024-09-12T16:56:26.390694+0000","last_clean":"2024-09-12T16:56:26.390694+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:56:26.390694+0000","last_undegraded":"2024-09-12T16:56:26.390694+0000","last_fullsized":"2024-09-12T16:56:26.390694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T16:56:26.390345+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T16:56:26.390345+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.390345+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:52.719580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.026674+0000","last_change":"2024-09-12T16:52:02.209870+0000","last_active":"2024-09-12T16:54:21.026674+0000","last_peered":"2024-09-12T16:54:21.026674+0000","last_clean":"2024-09-12T16:54:21.026674+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:54:21.026674+0000","last_undegraded":"2024-09-12T16:54:21.026674+0000","last_fullsized":"2024-09-12T16:54:21.026674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.521793+0000","last_change":"2024-09-12T16:56:37.521793+0000","last_active":"2024-09-12T16:56:37.521793+0000","last_peered":"2024-09-12T16:56:37.521793+0000","last_clean":"2024-09-12T16:56:37.521793+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:56:37.521793+0000","last_undegraded":"2024-09-12T16:56:37.521793+0000","last_fullsized":"2024-09-12T16:56:37.521793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:37.521618+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:37.521618+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.521618+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:42.714606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.054825+0000","last_change":"2024-09-12T16:56:37.054825+0000","last_active":"2024-09-12T16:56:37.054825+0000","last_peered":"2024-09-12T16:56:37.054825+0000","last_clean":"2024-09-12T16:56:37.054825+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:56:37.054825+0000","last_undegraded":"2024-09-12T16:56:37.054825+0000","last_fullsized":"2024-09-12T16:56:37.054825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:37.054637+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:37.054637+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.054637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:41.076261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.019783+0000","last_change":"2024-09-12T16:56:06.019629+0000","last_active":"2024-09-12T16:56:06.019783+0000","last_peered":"2024-09-12T16:56:06.019783+0000","last_clean":"2024-09-12T16:56:06.019783+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:06.019783+0000","last_undegraded":"2024-09-12T16:56:06.019783+0000","last_fullsized":"2024-09-12T16:56:06.019783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.019448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.300837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.145123+0000","last_change":"2024-09-12T16:55:56.144883+0000","last_active":"2024-09-12T16:55:56.145123+0000","last_peered":"2024-09-12T16:55:56.145123+0000","last_clean":"2024-09-12T16:55:56.145123+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:55:56.145123+0000","last_undegraded":"2024-09-12T16:55:56.145123+0000","last_fullsized":"2024-09-12T16:55:56.145123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.144656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:33.152646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.228993+0000","last_change":"2024-09-12T16:56:39.228993+0000","last_active":"2024-09-12T16:56:39.228993+0000","last_peered":"2024-09-12T16:56:39.228993+0000","last_clean":"2024-09-12T16:56:39.228993+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:56:39.228993+0000","last_undegraded":"2024-09-12T16:56:39.228993+0000","last_fullsized":"2024-09-12T16:56:39.228993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.228794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.228794+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.228794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:39.754327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.426959+0000","last_change":"2024-09-12T16:56:32.426735+0000","last_active":"2024-09-12T16:56:32.426959+0000","last_peered":"2024-09-12T16:56:32.426959+0000","last_clean":"2024-09-12T16:56:32.426959+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:56:32.426959+0000","last_undegraded":"2024-09-12T16:56:32.426959+0000","last_fullsized":"2024-09-12T16:56:32.426959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T16:56:32.426491+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T16:56:32.426491+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.426491+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:29.540681+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.953447+0000","last_change":"2024-09-12T16:56:30.953290+0000","last_active":"2024-09-12T16:56:30.953447+0000","last_peered":"2024-09-12T16:56:30.953447+0000","last_clean":"2024-09-12T16:56:30.953447+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:56:30.953447+0000","last_undegraded":"2024-09-12T16:56:30.953447+0000","last_fullsized":"2024-09-12T16:56:30.953447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:30.953116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:30.953116+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.953116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:00.872368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.528323+0000","last_change":"2024-09-12T16:56:42.528323+0000","last_active":"2024-09-12T16:56:42.528323+0000","last_peered":"2024-09-12T16:56:42.528323+0000","last_clean":"2024-09-12T16:56:42.528323+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:56:42.528323+0000","last_undegraded":"2024-09-12T16:56:42.528323+0000","last_fullsized":"2024-09-12T16:56:42.528323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-12T16:56:42.528129+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-12T16:56:42.528129+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.528129+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:58.012156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.048143+0000","last_change":"2024-09-12T16:56:17.048143+0000","last_active":"2024-09-12T16:56:17.048143+0000","last_peered":"2024-09-12T16:56:17.048143+0000","last_clean":"2024-09-12T16:56:17.048143+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:56:17.048143+0000","last_undegraded":"2024-09-12T16:56:17.048143+0000","last_fullsized":"2024-09-12T16:56:17.048143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:17.047963+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:17.047963+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.047963+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:42.891911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.965741+0000","last_change":"2024-09-12T16:55:47.965741+0000","last_active":"2024-09-12T16:55:47.965741+0000","last_peered":"2024-09-12T16:55:47.965741+0000","last_clean":"2024-09-12T16:55:47.965741+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:55:47.965741+0000","last_undegraded":"2024-09-12T16:55:47.965741+0000","last_fullsized":"2024-09-12T16:55:47.965741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.965477+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:53.674876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.217462+0000","last_change":"2024-09-12T16:55:51.217300+0000","last_active":"2024-09-12T16:55:51.217462+0000","last_peered":"2024-09-12T16:55:51.217462+0000","last_clean":"2024-09-12T16:55:51.217462+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:55:51.217462+0000","last_undegraded":"2024-09-12T16:55:51.217462+0000","last_fullsized":"2024-09-12T16:55:51.217462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.217110+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:04.583269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.156907+0000","last_change":"2024-09-12T16:55:54.156773+0000","last_active":"2024-09-12T16:55:54.156907+0000","last_peered":"2024-09-12T16:55:54.156907+0000","last_clean":"2024-09-12T16:55:54.156907+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:55:54.156907+0000","last_undegraded":"2024-09-12T16:55:54.156907+0000","last_fullsized":"2024-09-12T16:55:54.156907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.156592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:41.292991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.301262+0000","last_change":"2024-09-12T16:56:22.301262+0000","last_active":"2024-09-12T16:56:22.301262+0000","last_peered":"2024-09-12T16:56:22.301262+0000","last_clean":"2024-09-12T16:56:22.301262+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:56:22.301262+0000","last_undegraded":"2024-09-12T16:56:22.301262+0000","last_fullsized":"2024-09-12T16:56:22.301262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.301082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.301082+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.301082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:33.733394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:45.213649+0000","last_change":"2024-09-12T16:56:45.213649+0000","last_active":"2024-09-12T16:56:45.213649+0000","last_peered":"2024-09-12T16:56:45.213649+0000","last_clean":"2024-09-12T16:56:45.213649+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:56:45.213649+0000","last_undegraded":"2024-09-12T16:56:45.213649+0000","last_fullsized":"2024-09-12T16:56:45.213649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-12T16:56:45.213465+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-12T16:56:45.213465+0000","last_clean_scrub_stamp":"2024-09-12T16:56:45.213465+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.026418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.310119+0000","last_change":"2024-09-12T16:56:34.310119+0000","last_active":"2024-09-12T16:56:34.310119+0000","last_peered":"2024-09-12T16:56:34.310119+0000","last_clean":"2024-09-12T16:56:34.310119+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:56:34.310119+0000","last_undegraded":"2024-09-12T16:56:34.310119+0000","last_fullsized":"2024-09-12T16:56:34.310119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:34.309932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:34.309932+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.309932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:55.003538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.077725+0000","last_change":"2024-09-12T16:56:39.077725+0000","last_active":"2024-09-12T16:56:39.077725+0000","last_peered":"2024-09-12T16:56:39.077725+0000","last_clean":"2024-09-12T16:56:39.077725+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:56:39.077725+0000","last_undegraded":"2024-09-12T16:56:39.077725+0000","last_fullsized":"2024-09-12T16:56:39.077725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-09-12T16:56:39.077541+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-09-12T16:56:39.077541+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.077541+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:57.697338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.003628+0000","last_change":"2024-09-12T16:56:18.003458+0000","last_active":"2024-09-12T16:56:18.003628+0000","last_peered":"2024-09-12T16:56:18.003628+0000","last_clean":"2024-09-12T16:56:18.003628+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:56:18.003628+0000","last_undegraded":"2024-09-12T16:56:18.003628+0000","last_fullsized":"2024-09-12T16:56:18.003628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:18.003280+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:18.003280+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.003280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:21.904327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.222007+0000","last_change":"2024-09-12T16:55:49.222007+0000","last_active":"2024-09-12T16:55:49.222007+0000","last_peered":"2024-09-12T16:55:49.222007+0000","last_clean":"2024-09-12T16:55:49.222007+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:55:49.222007+0000","last_undegraded":"2024-09-12T16:55:49.222007+0000","last_fullsized":"2024-09-12T16:55:49.222007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.221820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:10.179551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.395547+0000","last_change":"2024-09-12T16:55:51.395398+0000","last_active":"2024-09-12T16:55:51.395547+0000","last_peered":"2024-09-12T16:55:51.395547+0000","last_clean":"2024-09-12T16:55:51.395547+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:51.395547+0000","last_undegraded":"2024-09-12T16:55:51.395547+0000","last_fullsized":"2024-09-12T16:55:51.395547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.395218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:23.022360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.277660+0000","last_change":"2024-09-12T16:56:38.277660+0000","last_active":"2024-09-12T16:56:38.277660+0000","last_peered":"2024-09-12T16:56:38.277660+0000","last_clean":"2024-09-12T16:56:38.277660+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:56:38.277660+0000","last_undegraded":"2024-09-12T16:56:38.277660+0000","last_fullsized":"2024-09-12T16:56:38.277660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:38.277489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:38.277489+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.277489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:24.398107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'296","reported_seq":523,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.435580+0000","last_change":"2024-09-12T16:56:31.435580+0000","last_active":"2024-09-12T16:56:31.435580+0000","last_peered":"2024-09-12T16:56:31.435580+0000","last_clean":"2024-09-12T16:56:31.435580+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:56:31.435580+0000","last_undegraded":"2024-09-12T16:56:31.435580+0000","last_fullsized":"2024-09-12T16:56:31.435580+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'296","last_scrub_stamp":"2024-09-12T16:56:31.435371+0000","last_deep_scrub":"34'296","last_deep_scrub_stamp":"2024-09-12T16:56:31.435371+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.435371+0000","objects_scrubbed":10,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:56.722358+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.023579+0000","last_change":"2024-09-12T16:52:04.209015+0000","last_active":"2024-09-12T16:54:11.023579+0000","last_peered":"2024-09-12T16:54:11.023579+0000","last_clean":"2024-09-12T16:54:11.023579+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:54:11.023579+0000","last_undegraded":"2024-09-12T16:54:11.023579+0000","last_fullsized":"2024-09-12T16:54:11.023579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:45.534988+0000","last_change":"2024-09-12T16:56:45.534988+0000","last_active":"2024-09-12T16:56:45.534988+0000","last_peered":"2024-09-12T16:56:45.534988+0000","last_clean":"2024-09-12T16:56:45.534988+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:56:45.534988+0000","last_undegraded":"2024-09-12T16:56:45.534988+0000","last_fullsized":"2024-09-12T16:56:45.534988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T16:56:45.534804+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T16:56:45.534804+0000","last_clean_scrub_stamp":"2024-09-12T16:56:45.534804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:01.620213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.416324+0000","last_change":"2024-09-12T16:56:04.416157+0000","last_active":"2024-09-12T16:56:04.416324+0000","last_peered":"2024-09-12T16:56:04.416324+0000","last_clean":"2024-09-12T16:56:04.416324+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:56:04.416324+0000","last_undegraded":"2024-09-12T16:56:04.416324+0000","last_fullsized":"2024-09-12T16:56:04.416324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:04.415977+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:04.415977+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.415977+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:37.104330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.862977+0000","last_change":"2024-09-12T16:55:48.862720+0000","last_active":"2024-09-12T16:55:48.862977+0000","last_peered":"2024-09-12T16:55:48.862977+0000","last_clean":"2024-09-12T16:55:48.862977+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:55:48.862977+0000","last_undegraded":"2024-09-12T16:55:48.862977+0000","last_fullsized":"2024-09-12T16:55:48.862977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.862498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:44.689046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.400482+0000","last_change":"2024-09-12T16:55:48.400348+0000","last_active":"2024-09-12T16:55:48.400482+0000","last_peered":"2024-09-12T16:55:48.400482+0000","last_clean":"2024-09-12T16:55:48.400482+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:55:48.400482+0000","last_undegraded":"2024-09-12T16:55:48.400482+0000","last_fullsized":"2024-09-12T16:55:48.400482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.400137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.977807+0000","last_change":"2024-09-12T16:56:16.977655+0000","last_active":"2024-09-12T16:56:16.977807+0000","last_peered":"2024-09-12T16:56:16.977807+0000","last_clean":"2024-09-12T16:56:16.977807+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:56:16.977807+0000","last_undegraded":"2024-09-12T16:56:16.977807+0000","last_fullsized":"2024-09-12T16:56:16.977807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:16.977493+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:16.977493+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.977493+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.955215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.977261+0000","last_change":"2024-09-12T16:56:23.977261+0000","last_active":"2024-09-12T16:56:23.977261+0000","last_peered":"2024-09-12T16:56:23.977261+0000","last_clean":"2024-09-12T16:56:23.977261+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:56:23.977261+0000","last_undegraded":"2024-09-12T16:56:23.977261+0000","last_fullsized":"2024-09-12T16:56:23.977261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-12T16:56:23.977064+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-12T16:56:23.977064+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.977064+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:21.211807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.304696+0000","last_change":"2024-09-12T16:56:33.304696+0000","last_active":"2024-09-12T16:56:33.304696+0000","last_peered":"2024-09-12T16:56:33.304696+0000","last_clean":"2024-09-12T16:56:33.304696+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:56:33.304696+0000","last_undegraded":"2024-09-12T16:56:33.304696+0000","last_fullsized":"2024-09-12T16:56:33.304696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:33.304516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:33.304516+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.304516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:08.164344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.026464+0000","last_change":"2024-09-12T16:52:06.229164+0000","last_active":"2024-09-12T16:54:21.026464+0000","last_peered":"2024-09-12T16:54:21.026464+0000","last_clean":"2024-09-12T16:54:21.026464+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:54:21.026464+0000","last_undegraded":"2024-09-12T16:54:21.026464+0000","last_fullsized":"2024-09-12T16:54:21.026464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.425100+0000","last_change":"2024-09-12T16:56:03.424942+0000","last_active":"2024-09-12T16:56:03.425100+0000","last_peered":"2024-09-12T16:56:03.425100+0000","last_clean":"2024-09-12T16:56:03.425100+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:56:03.425100+0000","last_undegraded":"2024-09-12T16:56:03.425100+0000","last_fullsized":"2024-09-12T16:56:03.425100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.424770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:52.914259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.245625+0000","last_change":"2024-09-12T16:55:50.245475+0000","last_active":"2024-09-12T16:55:50.245625+0000","last_peered":"2024-09-12T16:55:50.245625+0000","last_clean":"2024-09-12T16:55:50.245625+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:55:50.245625+0000","last_undegraded":"2024-09-12T16:55:50.245625+0000","last_fullsized":"2024-09-12T16:55:50.245625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.245287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:59.801323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.874234+0000","last_change":"2024-09-12T16:55:49.874078+0000","last_active":"2024-09-12T16:55:49.874234+0000","last_peered":"2024-09-12T16:55:49.874234+0000","last_clean":"2024-09-12T16:55:49.874234+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:55:49.874234+0000","last_undegraded":"2024-09-12T16:55:49.874234+0000","last_fullsized":"2024-09-12T16:55:49.874234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.873862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:42.226676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.331395+0000","last_change":"2024-09-12T16:56:17.331395+0000","last_active":"2024-09-12T16:56:17.331395+0000","last_peered":"2024-09-12T16:56:17.331395+0000","last_clean":"2024-09-12T16:56:17.331395+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:56:17.331395+0000","last_undegraded":"2024-09-12T16:56:17.331395+0000","last_fullsized":"2024-09-12T16:56:17.331395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:17.331215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:17.331215+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.331215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:34.713043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:11.500298+0000","last_change":"2024-09-12T16:52:02.207152+0000","last_active":"2024-09-12T16:55:11.500298+0000","last_peered":"2024-09-12T16:55:11.500298+0000","last_clean":"2024-09-12T16:55:11.500298+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:55:11.500298+0000","last_undegraded":"2024-09-12T16:55:11.500298+0000","last_fullsized":"2024-09-12T16:55:11.500298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:16.025159+0000","last_change":"2024-09-12T16:52:04.214830+0000","last_active":"2024-09-12T16:54:16.025159+0000","last_peered":"2024-09-12T16:54:16.025159+0000","last_clean":"2024-09-12T16:54:16.025159+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:54:16.025159+0000","last_undegraded":"2024-09-12T16:54:16.025159+0000","last_fullsized":"2024-09-12T16:54:16.025159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:44.503552+0000","last_change":"2024-09-12T16:56:44.503552+0000","last_active":"2024-09-12T16:56:44.503552+0000","last_peered":"2024-09-12T16:56:44.503552+0000","last_clean":"2024-09-12T16:56:44.503552+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:56:44.503552+0000","last_undegraded":"2024-09-12T16:56:44.503552+0000","last_fullsized":"2024-09-12T16:56:44.503552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:44.503362+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:44.503362+0000","last_clean_scrub_stamp":"2024-09-12T16:56:44.503362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:31.767076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.055683+0000","last_change":"2024-09-12T16:56:02.055532+0000","last_active":"2024-09-12T16:56:02.055683+0000","last_peered":"2024-09-12T16:56:02.055683+0000","last_clean":"2024-09-12T16:56:02.055683+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:56:02.055683+0000","last_undegraded":"2024-09-12T16:56:02.055683+0000","last_fullsized":"2024-09-12T16:56:02.055683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.055341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:23.968021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.860193+0000","last_change":"2024-09-12T16:55:50.859970+0000","last_active":"2024-09-12T16:55:50.860193+0000","last_peered":"2024-09-12T16:55:50.860193+0000","last_clean":"2024-09-12T16:55:50.860193+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:55:50.860193+0000","last_undegraded":"2024-09-12T16:55:50.860193+0000","last_fullsized":"2024-09-12T16:55:50.860193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.859731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:21.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.421319+0000","last_change":"2024-09-12T16:55:47.421094+0000","last_active":"2024-09-12T16:55:47.421319+0000","last_peered":"2024-09-12T16:55:47.421319+0000","last_clean":"2024-09-12T16:55:47.421319+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:55:47.421319+0000","last_undegraded":"2024-09-12T16:55:47.421319+0000","last_fullsized":"2024-09-12T16:55:47.421319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.420892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.729401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'7","reported_seq":242,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.362629+0000","last_change":"2024-09-12T16:56:16.362629+0000","last_active":"2024-09-12T16:56:16.362629+0000","last_peered":"2024-09-12T16:56:16.362629+0000","last_clean":"2024-09-12T16:56:16.362629+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:56:16.362629+0000","last_undegraded":"2024-09-12T16:56:16.362629+0000","last_fullsized":"2024-09-12T16:56:16.362629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T16:56:16.362444+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T16:56:16.362444+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.362444+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:59.250843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.396634+0000","last_change":"2024-09-12T16:56:25.396634+0000","last_active":"2024-09-12T16:56:25.396634+0000","last_peered":"2024-09-12T16:56:25.396634+0000","last_clean":"2024-09-12T16:56:25.396634+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:56:25.396634+0000","last_undegraded":"2024-09-12T16:56:25.396634+0000","last_fullsized":"2024-09-12T16:56:25.396634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-12T16:56:25.396434+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-12T16:56:25.396434+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.396434+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:15.354604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.993978+0000","last_change":"2024-09-12T16:56:29.993978+0000","last_active":"2024-09-12T16:56:29.993978+0000","last_peered":"2024-09-12T16:56:29.993978+0000","last_clean":"2024-09-12T16:56:29.993978+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:56:29.993978+0000","last_undegraded":"2024-09-12T16:56:29.993978+0000","last_fullsized":"2024-09-12T16:56:29.993978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:29.993783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:29.993783+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.993783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:34.283216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:24.021743+0000","last_change":"2024-09-12T16:52:06.230268+0000","last_active":"2024-09-12T16:54:24.021743+0000","last_peered":"2024-09-12T16:54:24.021743+0000","last_clean":"2024-09-12T16:54:24.021743+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:54:24.021743+0000","last_undegraded":"2024-09-12T16:54:24.021743+0000","last_fullsized":"2024-09-12T16:54:24.021743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.051578+0000","last_change":"2024-09-12T16:56:03.051439+0000","last_active":"2024-09-12T16:56:03.051578+0000","last_peered":"2024-09-12T16:56:03.051578+0000","last_clean":"2024-09-12T16:56:03.051578+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:56:03.051578+0000","last_undegraded":"2024-09-12T16:56:03.051578+0000","last_fullsized":"2024-09-12T16:56:03.051578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.051259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.473399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.402509+0000","last_change":"2024-09-12T16:55:50.402377+0000","last_active":"2024-09-12T16:55:50.402509+0000","last_peered":"2024-09-12T16:55:50.402509+0000","last_clean":"2024-09-12T16:55:50.402509+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:50.402509+0000","last_undegraded":"2024-09-12T16:55:50.402509+0000","last_fullsized":"2024-09-12T16:55:50.402509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.402205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:11.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.165501+0000","last_change":"2024-09-12T16:55:52.165355+0000","last_active":"2024-09-12T16:55:52.165501+0000","last_peered":"2024-09-12T16:55:52.165501+0000","last_clean":"2024-09-12T16:55:52.165501+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:55:52.165501+0000","last_undegraded":"2024-09-12T16:55:52.165501+0000","last_fullsized":"2024-09-12T16:55:52.165501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.165177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.307006+0000","last_change":"2024-09-12T16:56:37.307006+0000","last_active":"2024-09-12T16:56:37.307006+0000","last_peered":"2024-09-12T16:56:37.307006+0000","last_clean":"2024-09-12T16:56:37.307006+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:56:37.307006+0000","last_undegraded":"2024-09-12T16:56:37.307006+0000","last_fullsized":"2024-09-12T16:56:37.307006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:37.306800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:37.306800+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.306800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:53.598461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.430435+0000","last_change":"2024-09-12T16:56:30.430435+0000","last_active":"2024-09-12T16:56:30.430435+0000","last_peered":"2024-09-12T16:56:30.430435+0000","last_clean":"2024-09-12T16:56:30.430435+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:56:30.430435+0000","last_undegraded":"2024-09-12T16:56:30.430435+0000","last_fullsized":"2024-09-12T16:56:30.430435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T16:56:30.430136+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T16:56:30.430136+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.430136+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:30.221458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.510437+0000","last_change":"2024-09-12T16:56:36.510437+0000","last_active":"2024-09-12T16:56:36.510437+0000","last_peered":"2024-09-12T16:56:36.510437+0000","last_clean":"2024-09-12T16:56:36.510437+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:56:36.510437+0000","last_undegraded":"2024-09-12T16:56:36.510437+0000","last_fullsized":"2024-09-12T16:56:36.510437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.510254+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.510254+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.510254+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.362597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.026831+0000","last_change":"2024-09-12T16:52:06.215010+0000","last_active":"2024-09-12T16:54:21.026831+0000","last_peered":"2024-09-12T16:54:21.026831+0000","last_clean":"2024-09-12T16:54:21.026831+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:54:21.026831+0000","last_undegraded":"2024-09-12T16:54:21.026831+0000","last_fullsized":"2024-09-12T16:54:21.026831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.931993+0000","last_change":"2024-09-12T16:56:07.931844+0000","last_active":"2024-09-12T16:56:07.931993+0000","last_peered":"2024-09-12T16:56:07.931993+0000","last_clean":"2024-09-12T16:56:07.931993+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:56:07.931993+0000","last_undegraded":"2024-09-12T16:56:07.931993+0000","last_fullsized":"2024-09-12T16:56:07.931993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:07.931663+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:07.931663+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.931663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:16.321154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.157073+0000","last_change":"2024-09-12T16:55:55.156907+0000","last_active":"2024-09-12T16:55:55.157073+0000","last_peered":"2024-09-12T16:55:55.157073+0000","last_clean":"2024-09-12T16:55:55.157073+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:55:55.157073+0000","last_undegraded":"2024-09-12T16:55:55.157073+0000","last_fullsized":"2024-09-12T16:55:55.157073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.156716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:37.213650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.363365+0000","last_change":"2024-09-12T16:55:49.363167+0000","last_active":"2024-09-12T16:55:49.363365+0000","last_peered":"2024-09-12T16:55:49.363365+0000","last_clean":"2024-09-12T16:55:49.363365+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:55:49.363365+0000","last_undegraded":"2024-09-12T16:55:49.363365+0000","last_fullsized":"2024-09-12T16:55:49.363365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.362978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:34.316423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.355839+0000","last_change":"2024-09-12T16:56:36.355839+0000","last_active":"2024-09-12T16:56:36.355839+0000","last_peered":"2024-09-12T16:56:36.355839+0000","last_clean":"2024-09-12T16:56:36.355839+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:56:36.355839+0000","last_undegraded":"2024-09-12T16:56:36.355839+0000","last_fullsized":"2024-09-12T16:56:36.355839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:36.355657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:36.355657+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.355657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:06.072501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:44.224036+0000","last_change":"2024-09-12T16:56:44.224036+0000","last_active":"2024-09-12T16:56:44.224036+0000","last_peered":"2024-09-12T16:56:44.224036+0000","last_clean":"2024-09-12T16:56:44.224036+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:56:44.224036+0000","last_undegraded":"2024-09-12T16:56:44.224036+0000","last_fullsized":"2024-09-12T16:56:44.224036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:44.223806+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:44.223806+0000","last_clean_scrub_stamp":"2024-09-12T16:56:44.223806+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:26.413717+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.243543+0000","last_change":"2024-09-12T16:56:31.243543+0000","last_active":"2024-09-12T16:56:31.243543+0000","last_peered":"2024-09-12T16:56:31.243543+0000","last_clean":"2024-09-12T16:56:31.243543+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:56:31.243543+0000","last_undegraded":"2024-09-12T16:56:31.243543+0000","last_fullsized":"2024-09-12T16:56:31.243543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:31.243326+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:31.243326+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.243326+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:55.174015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.417319+0000","last_change":"2024-09-12T16:52:06.223608+0000","last_active":"2024-09-12T16:55:12.417319+0000","last_peered":"2024-09-12T16:55:12.417319+0000","last_clean":"2024-09-12T16:55:12.417319+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:55:12.417319+0000","last_undegraded":"2024-09-12T16:55:12.417319+0000","last_fullsized":"2024-09-12T16:55:12.417319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.012997+0000","last_change":"2024-09-12T16:56:01.012738+0000","last_active":"2024-09-12T16:56:01.012997+0000","last_peered":"2024-09-12T16:56:01.012997+0000","last_clean":"2024-09-12T16:56:01.012997+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:56:01.012997+0000","last_undegraded":"2024-09-12T16:56:01.012997+0000","last_fullsized":"2024-09-12T16:56:01.012997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.012476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.560043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.913060+0000","last_change":"2024-09-12T16:55:48.912884+0000","last_active":"2024-09-12T16:55:48.913060+0000","last_peered":"2024-09-12T16:55:48.913060+0000","last_clean":"2024-09-12T16:55:48.913060+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:48.913060+0000","last_undegraded":"2024-09-12T16:55:48.913060+0000","last_fullsized":"2024-09-12T16:55:48.913060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.912682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:36.759579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.203291+0000","last_change":"2024-09-12T16:55:53.203060+0000","last_active":"2024-09-12T16:55:53.203291+0000","last_peered":"2024-09-12T16:55:53.203291+0000","last_clean":"2024-09-12T16:55:53.203291+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:55:53.203291+0000","last_undegraded":"2024-09-12T16:55:53.203291+0000","last_fullsized":"2024-09-12T16:55:53.203291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.202860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:18.010245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.385039+0000","last_change":"2024-09-12T16:56:35.385039+0000","last_active":"2024-09-12T16:56:35.385039+0000","last_peered":"2024-09-12T16:56:35.385039+0000","last_clean":"2024-09-12T16:56:35.385039+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:56:35.385039+0000","last_undegraded":"2024-09-12T16:56:35.385039+0000","last_fullsized":"2024-09-12T16:56:35.385039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.384859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.384859+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.384859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.732353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'99","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.022342+0000","last_change":"2024-09-12T16:56:23.022342+0000","last_active":"2024-09-12T16:56:23.022342+0000","last_peered":"2024-09-12T16:56:23.022342+0000","last_clean":"2024-09-12T16:56:23.022342+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:56:23.022342+0000","last_undegraded":"2024-09-12T16:56:23.022342+0000","last_fullsized":"2024-09-12T16:56:23.022342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'99","last_scrub_stamp":"2024-09-12T16:56:23.022095+0000","last_deep_scrub":"34'99","last_deep_scrub_stamp":"2024-09-12T16:56:23.022095+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.022095+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:37.853754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.265791+0000","last_change":"2024-09-12T16:56:32.265791+0000","last_active":"2024-09-12T16:56:32.265791+0000","last_peered":"2024-09-12T16:56:32.265791+0000","last_clean":"2024-09-12T16:56:32.265791+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:56:32.265791+0000","last_undegraded":"2024-09-12T16:56:32.265791+0000","last_fullsized":"2024-09-12T16:56:32.265791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:32.265577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:32.265577+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.265577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:52.104440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.073334+0000","last_change":"2024-09-12T16:56:40.073334+0000","last_active":"2024-09-12T16:56:40.073334+0000","last_peered":"2024-09-12T16:56:40.073334+0000","last_clean":"2024-09-12T16:56:40.073334+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:56:40.073334+0000","last_undegraded":"2024-09-12T16:56:40.073334+0000","last_fullsized":"2024-09-12T16:56:40.073334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.073152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.073152+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.073152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:40.350196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.052871+0000","last_change":"2024-09-12T16:56:42.052871+0000","last_active":"2024-09-12T16:56:42.052871+0000","last_peered":"2024-09-12T16:56:42.052871+0000","last_clean":"2024-09-12T16:56:42.052871+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:56:42.052871+0000","last_undegraded":"2024-09-12T16:56:42.052871+0000","last_fullsized":"2024-09-12T16:56:42.052871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:42.052687+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:42.052687+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.052687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:08.274004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.951793+0000","last_change":"2024-09-12T16:56:08.951658+0000","last_active":"2024-09-12T16:56:08.951793+0000","last_peered":"2024-09-12T16:56:08.951793+0000","last_clean":"2024-09-12T16:56:08.951793+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:56:08.951793+0000","last_undegraded":"2024-09-12T16:56:08.951793+0000","last_fullsized":"2024-09-12T16:56:08.951793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:08.951469+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:08.951469+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.951469+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:13.785426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.017328+0000","last_change":"2024-09-12T16:56:03.017156+0000","last_active":"2024-09-12T16:56:03.017328+0000","last_peered":"2024-09-12T16:56:03.017328+0000","last_clean":"2024-09-12T16:56:03.017328+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:56:03.017328+0000","last_undegraded":"2024-09-12T16:56:03.017328+0000","last_fullsized":"2024-09-12T16:56:03.017328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.016945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:49.483897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.339227+0000","last_change":"2024-09-12T16:56:24.339081+0000","last_active":"2024-09-12T16:56:24.339227+0000","last_peered":"2024-09-12T16:56:24.339227+0000","last_clean":"2024-09-12T16:56:24.339227+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:56:24.339227+0000","last_undegraded":"2024-09-12T16:56:24.339227+0000","last_fullsized":"2024-09-12T16:56:24.339227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:24.338899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:24.338899+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.338899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:22.081195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.697897+0000","last_change":"2024-09-12T16:52:02.194377+0000","last_active":"2024-09-12T16:55:43.697897+0000","last_peered":"2024-09-12T16:55:43.697897+0000","last_clean":"2024-09-12T16:55:43.697897+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:55:43.697897+0000","last_undegraded":"2024-09-12T16:55:43.697897+0000","last_fullsized":"2024-09-12T16:55:43.697897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.027891+0000","last_change":"2024-09-12T16:52:04.215450+0000","last_active":"2024-09-12T16:54:26.027891+0000","last_peered":"2024-09-12T16:54:26.027891+0000","last_clean":"2024-09-12T16:54:26.027891+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:54:26.027891+0000","last_undegraded":"2024-09-12T16:54:26.027891+0000","last_fullsized":"2024-09-12T16:54:26.027891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:12.513358+0000","last_change":"2024-09-12T16:52:06.212418+0000","last_active":"2024-09-12T16:55:12.513358+0000","last_peered":"2024-09-12T16:55:12.513358+0000","last_clean":"2024-09-12T16:55:12.513358+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:55:12.513358+0000","last_undegraded":"2024-09-12T16:55:12.513358+0000","last_fullsized":"2024-09-12T16:55:12.513358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'28","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.066320+0000","last_change":"2024-09-12T16:56:07.066153+0000","last_active":"2024-09-12T16:56:07.066320+0000","last_peered":"2024-09-12T16:56:07.066320+0000","last_clean":"2024-09-12T16:56:07.066320+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:07.066320+0000","last_undegraded":"2024-09-12T16:56:07.066320+0000","last_fullsized":"2024-09-12T16:56:07.066320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-12T16:56:07.065953+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-12T16:56:07.065953+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.065953+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:47.680595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.909961+0000","last_change":"2024-09-12T16:55:52.909961+0000","last_active":"2024-09-12T16:55:52.909961+0000","last_peered":"2024-09-12T16:55:52.909961+0000","last_clean":"2024-09-12T16:55:52.909961+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:55:52.909961+0000","last_undegraded":"2024-09-12T16:55:52.909961+0000","last_fullsized":"2024-09-12T16:55:52.909961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.909777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:08.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.258683+0000","last_change":"2024-09-12T16:56:41.258683+0000","last_active":"2024-09-12T16:56:41.258683+0000","last_peered":"2024-09-12T16:56:41.258683+0000","last_clean":"2024-09-12T16:56:41.258683+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:56:41.258683+0000","last_undegraded":"2024-09-12T16:56:41.258683+0000","last_fullsized":"2024-09-12T16:56:41.258683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.258497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.258497+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.258497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:58.919770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.380532+0000","last_change":"2024-09-12T16:56:26.380375+0000","last_active":"2024-09-12T16:56:26.380532+0000","last_peered":"2024-09-12T16:56:26.380532+0000","last_clean":"2024-09-12T16:56:26.380532+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:56:26.380532+0000","last_undegraded":"2024-09-12T16:56:26.380532+0000","last_fullsized":"2024-09-12T16:56:26.380532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:26.380124+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:26.380124+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.380124+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:39.927808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.024043+0000","last_change":"2024-09-12T16:56:34.023907+0000","last_active":"2024-09-12T16:56:34.024043+0000","last_peered":"2024-09-12T16:56:34.024043+0000","last_clean":"2024-09-12T16:56:34.024043+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:56:34.024043+0000","last_undegraded":"2024-09-12T16:56:34.024043+0000","last_fullsized":"2024-09-12T16:56:34.024043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:34.023724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:34.023724+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.023724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:13.216005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022183+0000","last_change":"2024-09-12T16:52:06.225236+0000","last_active":"2024-09-12T16:52:35.022183+0000","last_peered":"2024-09-12T16:52:35.022183+0000","last_clean":"2024-09-12T16:52:35.022183+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:52:35.022183+0000","last_undegraded":"2024-09-12T16:52:35.022183+0000","last_fullsized":"2024-09-12T16:52:35.022183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:03.292498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.390725+0000","last_change":"2024-09-12T16:56:06.390574+0000","last_active":"2024-09-12T16:56:06.390725+0000","last_peered":"2024-09-12T16:56:06.390725+0000","last_clean":"2024-09-12T16:56:06.390725+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:56:06.390725+0000","last_undegraded":"2024-09-12T16:56:06.390725+0000","last_fullsized":"2024-09-12T16:56:06.390725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.390389+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.390389+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.390389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:52.854862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.924579+0000","last_change":"2024-09-12T16:55:55.924579+0000","last_active":"2024-09-12T16:55:55.924579+0000","last_peered":"2024-09-12T16:55:55.924579+0000","last_clean":"2024-09-12T16:55:55.924579+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:55:55.924579+0000","last_undegraded":"2024-09-12T16:55:55.924579+0000","last_fullsized":"2024-09-12T16:55:55.924579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.924395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.042073+0000","last_change":"2024-09-12T16:56:19.041934+0000","last_active":"2024-09-12T16:56:19.042073+0000","last_peered":"2024-09-12T16:56:19.042073+0000","last_clean":"2024-09-12T16:56:19.042073+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:56:19.042073+0000","last_undegraded":"2024-09-12T16:56:19.042073+0000","last_fullsized":"2024-09-12T16:56:19.042073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:19.041752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:19.041752+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.041752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:05.426092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.277112+0000","last_change":"2024-09-12T16:56:29.276893+0000","last_active":"2024-09-12T16:56:29.277112+0000","last_peered":"2024-09-12T16:56:29.277112+0000","last_clean":"2024-09-12T16:56:29.277112+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:56:29.277112+0000","last_undegraded":"2024-09-12T16:56:29.277112+0000","last_fullsized":"2024-09-12T16:56:29.277112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T16:56:29.276611+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T16:56:29.276611+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.276611+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:38.113558+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.564390+0000","last_change":"2024-09-12T16:56:38.564242+0000","last_active":"2024-09-12T16:56:38.564390+0000","last_peered":"2024-09-12T16:56:38.564390+0000","last_clean":"2024-09-12T16:56:38.564390+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:56:38.564390+0000","last_undegraded":"2024-09-12T16:56:38.564390+0000","last_fullsized":"2024-09-12T16:56:38.564390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:38.564057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:38.564057+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.564057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.113739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.039574+0000","last_change":"2024-09-12T16:52:06.236861+0000","last_active":"2024-09-12T16:52:35.039574+0000","last_peered":"2024-09-12T16:52:35.039574+0000","last_clean":"2024-09-12T16:52:35.039574+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:52:35.039574+0000","last_undegraded":"2024-09-12T16:52:35.039574+0000","last_fullsized":"2024-09-12T16:52:35.039574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:29.568087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.076128+0000","last_change":"2024-09-12T16:56:21.075950+0000","last_active":"2024-09-12T16:56:21.076128+0000","last_peered":"2024-09-12T16:56:21.076128+0000","last_clean":"2024-09-12T16:56:21.076128+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:56:21.076128+0000","last_undegraded":"2024-09-12T16:56:21.076128+0000","last_fullsized":"2024-09-12T16:56:21.076128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:21.075769+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:21.075769+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.075769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.894857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.912533+0000","last_change":"2024-09-12T16:55:50.912389+0000","last_active":"2024-09-12T16:55:50.912533+0000","last_peered":"2024-09-12T16:55:50.912533+0000","last_clean":"2024-09-12T16:55:50.912533+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:55:50.912533+0000","last_undegraded":"2024-09-12T16:55:50.912533+0000","last_fullsized":"2024-09-12T16:55:50.912533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.912183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:49.304999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.255997+0000","last_change":"2024-09-12T16:56:40.255860+0000","last_active":"2024-09-12T16:56:40.255997+0000","last_peered":"2024-09-12T16:56:40.255997+0000","last_clean":"2024-09-12T16:56:40.255997+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:56:40.255997+0000","last_undegraded":"2024-09-12T16:56:40.255997+0000","last_fullsized":"2024-09-12T16:56:40.255997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.255676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.255676+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.255676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:51.456310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.035064+0000","last_change":"2024-09-12T16:56:27.034927+0000","last_active":"2024-09-12T16:56:27.035064+0000","last_peered":"2024-09-12T16:56:27.035064+0000","last_clean":"2024-09-12T16:56:27.035064+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:56:27.035064+0000","last_undegraded":"2024-09-12T16:56:27.035064+0000","last_fullsized":"2024-09-12T16:56:27.035064+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:27.034727+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:27.034727+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.034727+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:37.482595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.001174+0000","last_change":"2024-09-12T16:56:33.000950+0000","last_active":"2024-09-12T16:56:33.001174+0000","last_peered":"2024-09-12T16:56:33.001174+0000","last_clean":"2024-09-12T16:56:33.001174+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:56:33.001174+0000","last_undegraded":"2024-09-12T16:56:33.001174+0000","last_fullsized":"2024-09-12T16:56:33.001174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:33.000688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:33.000688+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.000688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:33.437607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.140138+0000","last_change":"2024-09-12T16:56:26.140138+0000","last_active":"2024-09-12T16:56:26.140138+0000","last_peered":"2024-09-12T16:56:26.140138+0000","last_clean":"2024-09-12T16:56:26.140138+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:56:26.140138+0000","last_undegraded":"2024-09-12T16:56:26.140138+0000","last_fullsized":"2024-09-12T16:56:26.140138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:26.139956+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:26.139956+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.139956+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:20.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.984694+0000","last_change":"2024-09-12T16:56:03.984556+0000","last_active":"2024-09-12T16:56:03.984694+0000","last_peered":"2024-09-12T16:56:03.984694+0000","last_clean":"2024-09-12T16:56:03.984694+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:56:03.984694+0000","last_undegraded":"2024-09-12T16:56:03.984694+0000","last_fullsized":"2024-09-12T16:56:03.984694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.984372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:57.918312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.361837+0000","last_change":"2024-09-12T16:56:24.361837+0000","last_active":"2024-09-12T16:56:24.361837+0000","last_peered":"2024-09-12T16:56:24.361837+0000","last_clean":"2024-09-12T16:56:24.361837+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:56:24.361837+0000","last_undegraded":"2024-09-12T16:56:24.361837+0000","last_fullsized":"2024-09-12T16:56:24.361837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:24.361658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:24.361658+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.361658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:46.577163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.336690+0000","last_change":"2024-09-12T16:56:27.336690+0000","last_active":"2024-09-12T16:56:27.336690+0000","last_peered":"2024-09-12T16:56:27.336690+0000","last_clean":"2024-09-12T16:56:27.336690+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:56:27.336690+0000","last_undegraded":"2024-09-12T16:56:27.336690+0000","last_fullsized":"2024-09-12T16:56:27.336690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-12T16:56:27.336501+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-12T16:56:27.336501+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.336501+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:09.229151+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.048187+0000","last_change":"2024-09-12T16:56:35.048187+0000","last_active":"2024-09-12T16:56:35.048187+0000","last_peered":"2024-09-12T16:56:35.048187+0000","last_clean":"2024-09-12T16:56:35.048187+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:56:35.048187+0000","last_undegraded":"2024-09-12T16:56:35.048187+0000","last_fullsized":"2024-09-12T16:56:35.048187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.047935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.047935+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.047935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:45.923390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.284031+0000","last_change":"2024-09-12T16:52:06.224912+0000","last_active":"2024-09-12T16:54:11.284031+0000","last_peered":"2024-09-12T16:54:11.284031+0000","last_clean":"2024-09-12T16:54:11.284031+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:54:11.284031+0000","last_undegraded":"2024-09-12T16:54:11.284031+0000","last_fullsized":"2024-09-12T16:54:11.284031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:53.469591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.377076+0000","last_change":"2024-09-12T16:56:08.377076+0000","last_active":"2024-09-12T16:56:08.377076+0000","last_peered":"2024-09-12T16:56:08.377076+0000","last_clean":"2024-09-12T16:56:08.377076+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:56:08.377076+0000","last_undegraded":"2024-09-12T16:56:08.377076+0000","last_fullsized":"2024-09-12T16:56:08.377076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:08.376890+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:08.376890+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.376890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:31.874130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.952068+0000","last_change":"2024-09-12T16:55:51.951922+0000","last_active":"2024-09-12T16:55:51.952068+0000","last_peered":"2024-09-12T16:55:51.952068+0000","last_clean":"2024-09-12T16:55:51.952068+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:51.952068+0000","last_undegraded":"2024-09-12T16:55:51.952068+0000","last_fullsized":"2024-09-12T16:55:51.952068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.951717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.140563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.014305+0000","last_change":"2024-09-12T16:56:22.014305+0000","last_active":"2024-09-12T16:56:22.014305+0000","last_peered":"2024-09-12T16:56:22.014305+0000","last_clean":"2024-09-12T16:56:22.014305+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:56:22.014305+0000","last_undegraded":"2024-09-12T16:56:22.014305+0000","last_fullsized":"2024-09-12T16:56:22.014305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.014069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.014069+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.014069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:56.910230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.851345+0000","last_change":"2024-09-12T16:52:02.212469+0000","last_active":"2024-09-12T16:55:43.851345+0000","last_peered":"2024-09-12T16:55:43.851345+0000","last_clean":"2024-09-12T16:55:43.851345+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:55:43.851345+0000","last_undegraded":"2024-09-12T16:55:43.851345+0000","last_fullsized":"2024-09-12T16:55:43.851345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:32.385292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.502512+0000","last_change":"2024-09-12T16:56:40.502512+0000","last_active":"2024-09-12T16:56:40.502512+0000","last_peered":"2024-09-12T16:56:40.502512+0000","last_clean":"2024-09-12T16:56:40.502512+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:56:40.502512+0000","last_undegraded":"2024-09-12T16:56:40.502512+0000","last_fullsized":"2024-09-12T16:56:40.502512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.502328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.502328+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.502328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:48.888476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.028021+0000","last_change":"2024-09-12T16:52:06.224892+0000","last_active":"2024-09-12T16:54:26.028021+0000","last_peered":"2024-09-12T16:54:26.028021+0000","last_clean":"2024-09-12T16:54:26.028021+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:54:26.028021+0000","last_undegraded":"2024-09-12T16:54:26.028021+0000","last_fullsized":"2024-09-12T16:54:26.028021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.121052+0000","last_change":"2024-09-12T16:56:27.121052+0000","last_active":"2024-09-12T16:56:27.121052+0000","last_peered":"2024-09-12T16:56:27.121052+0000","last_clean":"2024-09-12T16:56:27.121052+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:56:27.121052+0000","last_undegraded":"2024-09-12T16:56:27.121052+0000","last_fullsized":"2024-09-12T16:56:27.121052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-12T16:56:27.120876+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-12T16:56:27.120876+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.120876+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:07.769135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.903403+0000","last_change":"2024-09-12T16:55:52.903403+0000","last_active":"2024-09-12T16:55:52.903403+0000","last_peered":"2024-09-12T16:55:52.903403+0000","last_clean":"2024-09-12T16:55:52.903403+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:55:52.903403+0000","last_undegraded":"2024-09-12T16:55:52.903403+0000","last_fullsized":"2024-09-12T16:55:52.903403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.903212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.981074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.057858+0000","last_change":"2024-09-12T16:56:21.057858+0000","last_active":"2024-09-12T16:56:21.057858+0000","last_peered":"2024-09-12T16:56:21.057858+0000","last_clean":"2024-09-12T16:56:21.057858+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:56:21.057858+0000","last_undegraded":"2024-09-12T16:56:21.057858+0000","last_fullsized":"2024-09-12T16:56:21.057858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:21.057647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:21.057647+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.057647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:19.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.256774+0000","last_change":"2024-09-12T16:56:30.256774+0000","last_active":"2024-09-12T16:56:30.256774+0000","last_peered":"2024-09-12T16:56:30.256774+0000","last_clean":"2024-09-12T16:56:30.256774+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:56:30.256774+0000","last_undegraded":"2024-09-12T16:56:30.256774+0000","last_fullsized":"2024-09-12T16:56:30.256774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T16:56:30.256585+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T16:56:30.256585+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.256585+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:29.647414+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.456090+0000","last_change":"2024-09-12T16:56:41.456090+0000","last_active":"2024-09-12T16:56:41.456090+0000","last_peered":"2024-09-12T16:56:41.456090+0000","last_clean":"2024-09-12T16:56:41.456090+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:56:41.456090+0000","last_undegraded":"2024-09-12T16:56:41.456090+0000","last_fullsized":"2024-09-12T16:56:41.456090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.455878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.455878+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.455878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:36.502621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.027996+0000","last_change":"2024-09-12T16:52:06.234025+0000","last_active":"2024-09-12T16:54:26.027996+0000","last_peered":"2024-09-12T16:54:26.027996+0000","last_clean":"2024-09-12T16:54:26.027996+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:54:26.027996+0000","last_undegraded":"2024-09-12T16:54:26.027996+0000","last_fullsized":"2024-09-12T16:54:26.027996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.425701+0000","last_change":"2024-09-12T16:56:07.425701+0000","last_active":"2024-09-12T16:56:07.425701+0000","last_peered":"2024-09-12T16:56:07.425701+0000","last_clean":"2024-09-12T16:56:07.425701+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:56:07.425701+0000","last_undegraded":"2024-09-12T16:56:07.425701+0000","last_fullsized":"2024-09-12T16:56:07.425701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:07.425524+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:07.425524+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.425524+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:11.714958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.025971+0000","last_change":"2024-09-12T16:56:06.025971+0000","last_active":"2024-09-12T16:56:06.025971+0000","last_peered":"2024-09-12T16:56:06.025971+0000","last_clean":"2024-09-12T16:56:06.025971+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:56:06.025971+0000","last_undegraded":"2024-09-12T16:56:06.025971+0000","last_fullsized":"2024-09-12T16:56:06.025971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.025789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:12.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.444127+0000","last_change":"2024-09-12T16:56:28.444127+0000","last_active":"2024-09-12T16:56:28.444127+0000","last_peered":"2024-09-12T16:56:28.444127+0000","last_clean":"2024-09-12T16:56:28.444127+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:56:28.444127+0000","last_undegraded":"2024-09-12T16:56:28.444127+0000","last_fullsized":"2024-09-12T16:56:28.444127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:28.443940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:28.443940+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.443940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:00.880623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:06.022048+0000","last_change":"2024-09-12T16:52:02.216308+0000","last_active":"2024-09-12T16:54:06.022048+0000","last_peered":"2024-09-12T16:54:06.022048+0000","last_clean":"2024-09-12T16:54:06.022048+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:54:06.022048+0000","last_undegraded":"2024-09-12T16:54:06.022048+0000","last_fullsized":"2024-09-12T16:54:06.022048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.065485+0000","last_change":"2024-09-12T16:56:36.065485+0000","last_active":"2024-09-12T16:56:36.065485+0000","last_peered":"2024-09-12T16:56:36.065485+0000","last_clean":"2024-09-12T16:56:36.065485+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:56:36.065485+0000","last_undegraded":"2024-09-12T16:56:36.065485+0000","last_fullsized":"2024-09-12T16:56:36.065485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.065307+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.065307+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.065307+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.905037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.027809+0000","last_change":"2024-09-12T16:52:06.232237+0000","last_active":"2024-09-12T16:54:26.027809+0000","last_peered":"2024-09-12T16:54:26.027809+0000","last_clean":"2024-09-12T16:54:26.027809+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:54:26.027809+0000","last_undegraded":"2024-09-12T16:54:26.027809+0000","last_fullsized":"2024-09-12T16:54:26.027809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.928072+0000","last_change":"2024-09-12T16:56:11.928072+0000","last_active":"2024-09-12T16:56:11.928072+0000","last_peered":"2024-09-12T16:56:11.928072+0000","last_clean":"2024-09-12T16:56:11.928072+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:56:11.928072+0000","last_undegraded":"2024-09-12T16:56:11.928072+0000","last_fullsized":"2024-09-12T16:56:11.928072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T16:56:11.927896+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T16:56:11.927896+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.927896+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:56.881341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.904704+0000","last_change":"2024-09-12T16:55:54.904704+0000","last_active":"2024-09-12T16:55:54.904704+0000","last_peered":"2024-09-12T16:55:54.904704+0000","last_clean":"2024-09-12T16:55:54.904704+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:55:54.904704+0000","last_undegraded":"2024-09-12T16:55:54.904704+0000","last_fullsized":"2024-09-12T16:55:54.904704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.302723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.410461+0000","last_change":"2024-09-12T16:56:29.410461+0000","last_active":"2024-09-12T16:56:29.410461+0000","last_peered":"2024-09-12T16:56:29.410461+0000","last_clean":"2024-09-12T16:56:29.410461+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:56:29.410461+0000","last_undegraded":"2024-09-12T16:56:29.410461+0000","last_fullsized":"2024-09-12T16:56:29.410461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:29.410268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:29.410268+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.410268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:13.860974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.509302+0000","last_change":"2024-09-12T16:56:35.509302+0000","last_active":"2024-09-12T16:56:35.509302+0000","last_peered":"2024-09-12T16:56:35.509302+0000","last_clean":"2024-09-12T16:56:35.509302+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:56:35.509302+0000","last_undegraded":"2024-09-12T16:56:35.509302+0000","last_fullsized":"2024-09-12T16:56:35.509302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T16:56:35.509101+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T16:56:35.509101+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.509101+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:54.351053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.377845+0000","last_change":"2024-09-12T16:56:39.377845+0000","last_active":"2024-09-12T16:56:39.377845+0000","last_peered":"2024-09-12T16:56:39.377845+0000","last_clean":"2024-09-12T16:56:39.377845+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:56:39.377845+0000","last_undegraded":"2024-09-12T16:56:39.377845+0000","last_fullsized":"2024-09-12T16:56:39.377845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.377663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.377663+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.377663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:57.967135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.047680+0000","last_change":"2024-09-12T16:52:06.224320+0000","last_active":"2024-09-12T16:52:35.047680+0000","last_peered":"2024-09-12T16:52:35.047680+0000","last_clean":"2024-09-12T16:52:35.047680+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:52:35.047680+0000","last_undegraded":"2024-09-12T16:52:35.047680+0000","last_fullsized":"2024-09-12T16:52:35.047680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:34.785095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.965285+0000","last_change":"2024-09-12T16:56:10.965285+0000","last_active":"2024-09-12T16:56:10.965285+0000","last_peered":"2024-09-12T16:56:10.965285+0000","last_clean":"2024-09-12T16:56:10.965285+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:56:10.965285+0000","last_undegraded":"2024-09-12T16:56:10.965285+0000","last_fullsized":"2024-09-12T16:56:10.965285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:10.965111+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:10.965111+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.965111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:11.089393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.994386+0000","last_change":"2024-09-12T16:56:04.994386+0000","last_active":"2024-09-12T16:56:04.994386+0000","last_peered":"2024-09-12T16:56:04.994386+0000","last_clean":"2024-09-12T16:56:04.994386+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:56:04.994386+0000","last_undegraded":"2024-09-12T16:56:04.994386+0000","last_fullsized":"2024-09-12T16:56:04.994386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.994131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:46.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.010216+0000","last_change":"2024-09-12T16:56:20.010216+0000","last_active":"2024-09-12T16:56:20.010216+0000","last_peered":"2024-09-12T16:56:20.010216+0000","last_clean":"2024-09-12T16:56:20.010216+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:56:20.010216+0000","last_undegraded":"2024-09-12T16:56:20.010216+0000","last_fullsized":"2024-09-12T16:56:20.010216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:20.009949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:20.009949+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.009949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:39.317042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.292551+0000","last_change":"2024-09-12T16:56:28.292551+0000","last_active":"2024-09-12T16:56:28.292551+0000","last_peered":"2024-09-12T16:56:28.292551+0000","last_clean":"2024-09-12T16:56:28.292551+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:56:28.292551+0000","last_undegraded":"2024-09-12T16:56:28.292551+0000","last_fullsized":"2024-09-12T16:56:28.292551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-12T16:56:28.292356+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-12T16:56:28.292356+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.292356+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:16.221439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.022138+0000","last_change":"2024-09-12T16:52:04.209135+0000","last_active":"2024-09-12T16:52:35.022138+0000","last_peered":"2024-09-12T16:52:35.022138+0000","last_clean":"2024-09-12T16:52:35.022138+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:52:35.022138+0000","last_undegraded":"2024-09-12T16:52:35.022138+0000","last_fullsized":"2024-09-12T16:52:35.022138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:49.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:11.442179+0000","last_change":"2024-09-12T16:52:06.237385+0000","last_active":"2024-09-12T16:54:11.442179+0000","last_peered":"2024-09-12T16:54:11.442179+0000","last_clean":"2024-09-12T16:54:11.442179+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:54:11.442179+0000","last_undegraded":"2024-09-12T16:54:11.442179+0000","last_fullsized":"2024-09-12T16:54:11.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:58.165732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.126036+0000","last_change":"2024-09-12T16:56:25.126036+0000","last_active":"2024-09-12T16:56:25.126036+0000","last_peered":"2024-09-12T16:56:25.126036+0000","last_clean":"2024-09-12T16:56:25.126036+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:56:25.126036+0000","last_undegraded":"2024-09-12T16:56:25.126036+0000","last_fullsized":"2024-09-12T16:56:25.126036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:25.125828+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:25.125828+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.125828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:17.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.393326+0000","last_change":"2024-09-12T16:55:53.393160+0000","last_active":"2024-09-12T16:55:53.393326+0000","last_peered":"2024-09-12T16:55:53.393326+0000","last_clean":"2024-09-12T16:55:53.393326+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:55:53.393326+0000","last_undegraded":"2024-09-12T16:55:53.393326+0000","last_fullsized":"2024-09-12T16:55:53.393326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.392972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.910111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.362805+0000","last_change":"2024-09-12T16:56:25.362805+0000","last_active":"2024-09-12T16:56:25.362805+0000","last_peered":"2024-09-12T16:56:25.362805+0000","last_clean":"2024-09-12T16:56:25.362805+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:56:25.362805+0000","last_undegraded":"2024-09-12T16:56:25.362805+0000","last_fullsized":"2024-09-12T16:56:25.362805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:25.362579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:25.362579+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.362579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:35.190759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'30","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.705579+0000","last_change":"2024-09-12T16:52:02.212684+0000","last_active":"2024-09-12T16:55:43.705579+0000","last_peered":"2024-09-12T16:55:43.705579+0000","last_clean":"2024-09-12T16:55:43.705579+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:55:43.705579+0000","last_undegraded":"2024-09-12T16:55:43.705579+0000","last_fullsized":"2024-09-12T16:55:43.705579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:00.299441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:52:35.032673+0000","last_change":"2024-09-12T16:52:04.209557+0000","last_active":"2024-09-12T16:52:35.032673+0000","last_peered":"2024-09-12T16:52:35.032673+0000","last_clean":"2024-09-12T16:52:35.032673+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:52:35.032673+0000","last_undegraded":"2024-09-12T16:52:35.032673+0000","last_fullsized":"2024-09-12T16:52:35.032673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:03.154833+0000","last_clean_scrub_stamp":"2024-09-12T16:52:03.154833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:33.026740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:09.024814+0000","last_change":"2024-09-12T16:52:06.234752+0000","last_active":"2024-09-12T16:54:09.024814+0000","last_peered":"2024-09-12T16:54:09.024814+0000","last_clean":"2024-09-12T16:54:09.024814+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:54:09.024814+0000","last_undegraded":"2024-09-12T16:54:09.024814+0000","last_fullsized":"2024-09-12T16:54:09.024814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:02.433924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.950692+0000","last_change":"2024-09-12T16:56:09.950692+0000","last_active":"2024-09-12T16:56:09.950692+0000","last_peered":"2024-09-12T16:56:09.950692+0000","last_clean":"2024-09-12T16:56:09.950692+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:56:09.950692+0000","last_undegraded":"2024-09-12T16:56:09.950692+0000","last_fullsized":"2024-09-12T16:56:09.950692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:09.950480+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:09.950480+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.950480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:09.258989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.860201+0000","last_change":"2024-09-12T16:55:53.860045+0000","last_active":"2024-09-12T16:55:53.860201+0000","last_peered":"2024-09-12T16:55:53.860201+0000","last_clean":"2024-09-12T16:55:53.860201+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:53.860201+0000","last_undegraded":"2024-09-12T16:55:53.860201+0000","last_fullsized":"2024-09-12T16:55:53.860201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.859853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:42.401708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.407033+0000","last_change":"2024-09-12T16:56:27.407033+0000","last_active":"2024-09-12T16:56:27.407033+0000","last_peered":"2024-09-12T16:56:27.407033+0000","last_clean":"2024-09-12T16:56:27.407033+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:56:27.407033+0000","last_undegraded":"2024-09-12T16:56:27.407033+0000","last_fullsized":"2024-09-12T16:56:27.407033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:27.406806+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:27.406806+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.406806+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:14.784367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:43.723783+0000","last_change":"2024-09-12T16:52:02.212039+0000","last_active":"2024-09-12T16:55:43.723783+0000","last_peered":"2024-09-12T16:55:43.723783+0000","last_clean":"2024-09-12T16:55:43.723783+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:55:43.723783+0000","last_undegraded":"2024-09-12T16:55:43.723783+0000","last_fullsized":"2024-09-12T16:55:43.723783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:01.138270+0000","last_clean_scrub_stamp":"2024-09-12T16:52:01.138270+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:30.940482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.446257+0000","last_change":"2024-09-12T16:56:42.446257+0000","last_active":"2024-09-12T16:56:42.446257+0000","last_peered":"2024-09-12T16:56:42.446257+0000","last_clean":"2024-09-12T16:56:42.446257+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:56:42.446257+0000","last_undegraded":"2024-09-12T16:56:42.446257+0000","last_fullsized":"2024-09-12T16:56:42.446257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:42.446055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:42.446055+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.446055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:53.995248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.028198+0000","last_change":"2024-09-12T16:52:06.237422+0000","last_active":"2024-09-12T16:54:26.028198+0000","last_peered":"2024-09-12T16:54:26.028198+0000","last_clean":"2024-09-12T16:54:26.028198+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:54:26.028198+0000","last_undegraded":"2024-09-12T16:54:26.028198+0000","last_fullsized":"2024-09-12T16:54:26.028198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.108738+0000","last_change":"2024-09-12T16:56:10.108586+0000","last_active":"2024-09-12T16:56:10.108738+0000","last_peered":"2024-09-12T16:56:10.108738+0000","last_clean":"2024-09-12T16:56:10.108738+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:56:10.108738+0000","last_undegraded":"2024-09-12T16:56:10.108738+0000","last_fullsized":"2024-09-12T16:56:10.108738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:10.108400+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:10.108400+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.108400+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:12.926248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.938046+0000","last_change":"2024-09-12T16:55:56.937794+0000","last_active":"2024-09-12T16:55:56.938046+0000","last_peered":"2024-09-12T16:55:56.938046+0000","last_clean":"2024-09-12T16:55:56.938046+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:55:56.938046+0000","last_undegraded":"2024-09-12T16:55:56.938046+0000","last_fullsized":"2024-09-12T16:55:56.938046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.937568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:32.183469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.333207+0000","last_change":"2024-09-12T16:56:12.333068+0000","last_active":"2024-09-12T16:56:12.333207+0000","last_peered":"2024-09-12T16:56:12.333207+0000","last_clean":"2024-09-12T16:56:12.333207+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:56:12.333207+0000","last_undegraded":"2024-09-12T16:56:12.333207+0000","last_fullsized":"2024-09-12T16:56:12.333207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:12.332887+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:12.332887+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.332887+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:01.522871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.401315+0000","last_change":"2024-09-12T16:55:56.401142+0000","last_active":"2024-09-12T16:55:56.401315+0000","last_peered":"2024-09-12T16:55:56.401315+0000","last_clean":"2024-09-12T16:55:56.401315+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:55:56.401315+0000","last_undegraded":"2024-09-12T16:55:56.401315+0000","last_fullsized":"2024-09-12T16:55:56.401315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.400960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:14.461538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.133193+0000","last_change":"2024-09-12T16:56:28.133193+0000","last_active":"2024-09-12T16:56:28.133193+0000","last_peered":"2024-09-12T16:56:28.133193+0000","last_clean":"2024-09-12T16:56:28.133193+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:56:28.133193+0000","last_undegraded":"2024-09-12T16:56:28.133193+0000","last_fullsized":"2024-09-12T16:56:28.133193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:28.133013+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:28.133013+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.133013+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:26.697952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.042238+0000","last_change":"2024-09-12T16:56:07.042238+0000","last_active":"2024-09-12T16:56:07.042238+0000","last_peered":"2024-09-12T16:56:07.042238+0000","last_clean":"2024-09-12T16:56:07.042238+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:56:07.042238+0000","last_undegraded":"2024-09-12T16:56:07.042238+0000","last_fullsized":"2024-09-12T16:56:07.042238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:07.042037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:07.042037+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.042037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.852652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.396791+0000","last_change":"2024-09-12T16:56:10.396647+0000","last_active":"2024-09-12T16:56:10.396791+0000","last_peered":"2024-09-12T16:56:10.396791+0000","last_clean":"2024-09-12T16:56:10.396791+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:56:10.396791+0000","last_undegraded":"2024-09-12T16:56:10.396791+0000","last_fullsized":"2024-09-12T16:56:10.396791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:10.396473+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:10.396473+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.396473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:10.833391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.440316+0000","last_change":"2024-09-12T16:55:54.440130+0000","last_active":"2024-09-12T16:55:54.440316+0000","last_peered":"2024-09-12T16:55:54.440316+0000","last_clean":"2024-09-12T16:55:54.440316+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:55:54.440316+0000","last_undegraded":"2024-09-12T16:55:54.440316+0000","last_fullsized":"2024-09-12T16:55:54.440316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.439958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:13.647744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.375456+0000","last_change":"2024-09-12T16:56:09.375456+0000","last_active":"2024-09-12T16:56:09.375456+0000","last_peered":"2024-09-12T16:56:09.375456+0000","last_clean":"2024-09-12T16:56:09.375456+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:56:09.375456+0000","last_undegraded":"2024-09-12T16:56:09.375456+0000","last_fullsized":"2024-09-12T16:56:09.375456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-12T16:56:09.375291+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-12T16:56:09.375291+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.375291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:02.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.406473+0000","last_change":"2024-09-12T16:55:57.406202+0000","last_active":"2024-09-12T16:55:57.406473+0000","last_peered":"2024-09-12T16:55:57.406473+0000","last_clean":"2024-09-12T16:55:57.406473+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:55:57.406473+0000","last_undegraded":"2024-09-12T16:55:57.406473+0000","last_fullsized":"2024-09-12T16:55:57.406473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.405992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:26.716714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.099350+0000","last_change":"2024-09-12T16:56:09.099205+0000","last_active":"2024-09-12T16:56:09.099350+0000","last_peered":"2024-09-12T16:56:09.099350+0000","last_clean":"2024-09-12T16:56:09.099350+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:56:09.099350+0000","last_undegraded":"2024-09-12T16:56:09.099350+0000","last_fullsized":"2024-09-12T16:56:09.099350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:09.099018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:09.099018+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.099018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:17.509989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.952554+0000","last_change":"2024-09-12T16:55:55.952358+0000","last_active":"2024-09-12T16:55:55.952554+0000","last_peered":"2024-09-12T16:55:55.952554+0000","last_clean":"2024-09-12T16:55:55.952554+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:55:55.952554+0000","last_undegraded":"2024-09-12T16:55:55.952554+0000","last_fullsized":"2024-09-12T16:55:55.952554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.952167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:25.813446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.362007+0000","last_change":"2024-09-12T16:56:11.362007+0000","last_active":"2024-09-12T16:56:11.362007+0000","last_peered":"2024-09-12T16:56:11.362007+0000","last_clean":"2024-09-12T16:56:11.362007+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:56:11.362007+0000","last_undegraded":"2024-09-12T16:56:11.362007+0000","last_fullsized":"2024-09-12T16:56:11.362007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:11.361791+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:11.361791+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.361791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:50.554072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.987602+0000","last_change":"2024-09-12T16:55:57.987345+0000","last_active":"2024-09-12T16:55:57.987602+0000","last_peered":"2024-09-12T16:55:57.987602+0000","last_clean":"2024-09-12T16:55:57.987602+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:55:57.987602+0000","last_undegraded":"2024-09-12T16:55:57.987602+0000","last_fullsized":"2024-09-12T16:55:57.987602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.987068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:06.950990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.106577+0000","last_change":"2024-09-12T16:56:08.106418+0000","last_active":"2024-09-12T16:56:08.106577+0000","last_peered":"2024-09-12T16:56:08.106577+0000","last_clean":"2024-09-12T16:56:08.106577+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:56:08.106577+0000","last_undegraded":"2024-09-12T16:56:08.106577+0000","last_fullsized":"2024-09-12T16:56:08.106577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:08.106230+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:08.106230+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.106230+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:35.973906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.433107+0000","last_change":"2024-09-12T16:55:55.432903+0000","last_active":"2024-09-12T16:55:55.433107+0000","last_peered":"2024-09-12T16:55:55.433107+0000","last_clean":"2024-09-12T16:55:55.433107+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:55:55.433107+0000","last_undegraded":"2024-09-12T16:55:55.433107+0000","last_fullsized":"2024-09-12T16:55:55.433107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.432712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.091150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.194277+0000","last_change":"2024-09-12T16:56:14.194089+0000","last_active":"2024-09-12T16:56:14.194277+0000","last_peered":"2024-09-12T16:56:14.194277+0000","last_clean":"2024-09-12T16:56:14.194277+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:56:14.194277+0000","last_undegraded":"2024-09-12T16:56:14.194277+0000","last_fullsized":"2024-09-12T16:56:14.194277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:14.193905+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:14.193905+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.193905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:20.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.030089+0000","last_change":"2024-09-12T16:56:09.029934+0000","last_active":"2024-09-12T16:56:09.030089+0000","last_peered":"2024-09-12T16:56:09.030089+0000","last_clean":"2024-09-12T16:56:09.030089+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:56:09.030089+0000","last_undegraded":"2024-09-12T16:56:09.030089+0000","last_fullsized":"2024-09-12T16:56:09.030089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:09.029746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:09.029746+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.029746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:03.041324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.147120+0000","last_change":"2024-09-12T16:56:29.146980+0000","last_active":"2024-09-12T16:56:29.147120+0000","last_peered":"2024-09-12T16:56:29.147120+0000","last_clean":"2024-09-12T16:56:29.147120+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:56:29.147120+0000","last_undegraded":"2024-09-12T16:56:29.147120+0000","last_fullsized":"2024-09-12T16:56:29.147120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:29.146778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:29.146778+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.146778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:19.977310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.392408+0000","last_change":"2024-09-12T16:56:00.392236+0000","last_active":"2024-09-12T16:56:00.392408+0000","last_peered":"2024-09-12T16:56:00.392408+0000","last_clean":"2024-09-12T16:56:00.392408+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:56:00.392408+0000","last_undegraded":"2024-09-12T16:56:00.392408+0000","last_fullsized":"2024-09-12T16:56:00.392408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.392055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:04.803837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.363927+0000","last_change":"2024-09-12T16:56:13.363788+0000","last_active":"2024-09-12T16:56:13.363927+0000","last_peered":"2024-09-12T16:56:13.363927+0000","last_clean":"2024-09-12T16:56:13.363927+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:56:13.363927+0000","last_undegraded":"2024-09-12T16:56:13.363927+0000","last_fullsized":"2024-09-12T16:56:13.363927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:13.363599+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:13.363599+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.363599+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.980599+0000","last_change":"2024-09-12T16:55:56.980434+0000","last_active":"2024-09-12T16:55:56.980599+0000","last_peered":"2024-09-12T16:55:56.980599+0000","last_clean":"2024-09-12T16:55:56.980599+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:55:56.980599+0000","last_undegraded":"2024-09-12T16:55:56.980599+0000","last_fullsized":"2024-09-12T16:55:56.980599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.980237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:15.364632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.210898+0000","last_change":"2024-09-12T16:56:17.210631+0000","last_active":"2024-09-12T16:56:17.210898+0000","last_peered":"2024-09-12T16:56:17.210898+0000","last_clean":"2024-09-12T16:56:17.210898+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:56:17.210898+0000","last_undegraded":"2024-09-12T16:56:17.210898+0000","last_fullsized":"2024-09-12T16:56:17.210898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:17.210420+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:17.210420+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.210420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:27.115703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.999627+0000","last_change":"2024-09-12T16:55:57.999462+0000","last_active":"2024-09-12T16:55:57.999627+0000","last_peered":"2024-09-12T16:55:57.999627+0000","last_clean":"2024-09-12T16:55:57.999627+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:55:57.999627+0000","last_undegraded":"2024-09-12T16:55:57.999627+0000","last_fullsized":"2024-09-12T16:55:57.999627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.999280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.958335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.119931+0000","last_change":"2024-09-12T16:56:12.119798+0000","last_active":"2024-09-12T16:56:12.119931+0000","last_peered":"2024-09-12T16:56:12.119931+0000","last_clean":"2024-09-12T16:56:12.119931+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:56:12.119931+0000","last_undegraded":"2024-09-12T16:56:12.119931+0000","last_fullsized":"2024-09-12T16:56:12.119931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:12.119628+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:12.119628+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.119628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.835640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.045599+0000","last_change":"2024-09-12T16:56:08.045457+0000","last_active":"2024-09-12T16:56:08.045599+0000","last_peered":"2024-09-12T16:56:08.045599+0000","last_clean":"2024-09-12T16:56:08.045599+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:56:08.045599+0000","last_undegraded":"2024-09-12T16:56:08.045599+0000","last_fullsized":"2024-09-12T16:56:08.045599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:08.045272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:08.045272+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.045272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.816254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.096674+0000","last_change":"2024-09-12T16:56:11.096441+0000","last_active":"2024-09-12T16:56:11.096674+0000","last_peered":"2024-09-12T16:56:11.096674+0000","last_clean":"2024-09-12T16:56:11.096674+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:56:11.096674+0000","last_undegraded":"2024-09-12T16:56:11.096674+0000","last_fullsized":"2024-09-12T16:56:11.096674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:11.096227+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:11.096227+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.096227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:02.873110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.073202+0000","last_change":"2024-09-12T16:56:10.073063+0000","last_active":"2024-09-12T16:56:10.073202+0000","last_peered":"2024-09-12T16:56:10.073202+0000","last_clean":"2024-09-12T16:56:10.073202+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:56:10.073202+0000","last_undegraded":"2024-09-12T16:56:10.073202+0000","last_fullsized":"2024-09-12T16:56:10.073202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:10.072860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:10.072860+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.072860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:55.441106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.911634+0000","last_change":"2024-09-12T16:56:13.911634+0000","last_active":"2024-09-12T16:56:13.911634+0000","last_peered":"2024-09-12T16:56:13.911634+0000","last_clean":"2024-09-12T16:56:13.911634+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:56:13.911634+0000","last_undegraded":"2024-09-12T16:56:13.911634+0000","last_fullsized":"2024-09-12T16:56:13.911634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:13.911459+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:13.911459+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.911459+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:23.988896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.983914+0000","last_change":"2024-09-12T16:55:59.983767+0000","last_active":"2024-09-12T16:55:59.983914+0000","last_peered":"2024-09-12T16:55:59.983914+0000","last_clean":"2024-09-12T16:55:59.983914+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:55:59.983914+0000","last_undegraded":"2024-09-12T16:55:59.983914+0000","last_fullsized":"2024-09-12T16:55:59.983914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.983590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:23.882360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.157609+0000","last_change":"2024-09-12T16:56:13.157345+0000","last_active":"2024-09-12T16:56:13.157609+0000","last_peered":"2024-09-12T16:56:13.157609+0000","last_clean":"2024-09-12T16:56:13.157609+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:56:13.157609+0000","last_undegraded":"2024-09-12T16:56:13.157609+0000","last_fullsized":"2024-09-12T16:56:13.157609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:13.157069+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:13.157069+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.157069+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:40.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.064636+0000","last_change":"2024-09-12T16:56:11.064485+0000","last_active":"2024-09-12T16:56:11.064636+0000","last_peered":"2024-09-12T16:56:11.064636+0000","last_clean":"2024-09-12T16:56:11.064636+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:56:11.064636+0000","last_undegraded":"2024-09-12T16:56:11.064636+0000","last_fullsized":"2024-09-12T16:56:11.064636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:11.064306+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:11.064306+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.064306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.818102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.073760+0000","last_change":"2024-09-12T16:56:12.073587+0000","last_active":"2024-09-12T16:56:12.073760+0000","last_peered":"2024-09-12T16:56:12.073760+0000","last_clean":"2024-09-12T16:56:12.073760+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:56:12.073760+0000","last_undegraded":"2024-09-12T16:56:12.073760+0000","last_fullsized":"2024-09-12T16:56:12.073760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:12.073409+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:12.073409+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.073409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:11.864469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.309025+0000","last_change":"2024-09-12T16:56:15.309025+0000","last_active":"2024-09-12T16:56:15.309025+0000","last_peered":"2024-09-12T16:56:15.309025+0000","last_clean":"2024-09-12T16:56:15.309025+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:56:15.309025+0000","last_undegraded":"2024-09-12T16:56:15.309025+0000","last_fullsized":"2024-09-12T16:56:15.309025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:15.308840+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:15.308840+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.308840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:26.096395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.428035+0000","last_change":"2024-09-12T16:56:01.427883+0000","last_active":"2024-09-12T16:56:01.428035+0000","last_peered":"2024-09-12T16:56:01.428035+0000","last_clean":"2024-09-12T16:56:01.428035+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:56:01.428035+0000","last_undegraded":"2024-09-12T16:56:01.428035+0000","last_fullsized":"2024-09-12T16:56:01.428035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.427706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:56.339223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.286721+0000","last_change":"2024-09-12T16:56:19.286721+0000","last_active":"2024-09-12T16:56:19.286721+0000","last_peered":"2024-09-12T16:56:19.286721+0000","last_clean":"2024-09-12T16:56:19.286721+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:56:19.286721+0000","last_undegraded":"2024-09-12T16:56:19.286721+0000","last_fullsized":"2024-09-12T16:56:19.286721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:19.286513+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:19.286513+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.286513+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:30.010412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1501,"ondisk_log_size":1501,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640321,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":740498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673025,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48884,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":47870,"kb_avail":94322956,"statfs":{"total":96636764160,"available":96586706944,"internally_reserved":0,"allocated":1019904,"data_stored":740621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":49019333},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39936,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331904,"statfs":{"total":96636764160,"available":96595869696,"internally_reserved":0,"allocated":442368,"data_stored":151866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:56:50.029 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.030 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.030 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.030 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.030 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.030 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.030 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.031 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.031 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.031 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.031 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.031 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.031 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.032 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.032 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.032 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.032 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.032 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.033 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.033 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.033 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.033 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.033 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.033 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.034 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.034 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.034 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.034 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.034 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.034 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.035 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.035 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.035 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.035 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.035 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.035 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T16:52:03.154833+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.035 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.036 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T16:52:01.138270+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.036 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:56:50.036 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T16:57:10.037 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:57:10.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 Processor -- start 2024-09-12T16:57:10.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- start start 2024-09-12T16:57:10.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff4a0110da0 0x7ff4a0111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:10.168 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a0073a90 con 0x7ff4a01116c0 2024-09-12T16:57:10.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a00696e0 con 0x7ff4a0110da0 2024-09-12T16:57:10.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff4a0110da0 0x7ff4a0111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:10.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49f7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff4a01116c0 0x7ff4a01231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:48038/0 (socket says 172.21.15.122:48038) 2024-09-12T16:57:10.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49f7fe640 1 -- 172.21.15.122:0/939689536 learned_addr learned my addr 172.21.15.122:0/939689536 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:57:10.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49ffff640 1 -- 172.21.15.122:0/939689536 >> v1:172.21.15.122:6789/0 conn(0x7ff4a01116c0 legacy=0x7ff4a01231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:10.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49ffff640 1 -- 172.21.15.122:0/939689536 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a006dd50 con 0x7ff4a0110da0 2024-09-12T16:57:10.169 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49effd640 1 -- 172.21.15.122:0/939689536 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758910925 0 0) 0x7ff4a0073a90 con 0x7ff4a01116c0 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49ffff640 1 --2- 172.21.15.122:0/939689536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a0111180 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff498009740 tx=0x7ff49801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325b7ba45eb7a201 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49effd640 1 -- 172.21.15.122:0/939689536 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4980b0070 con 0x7ff4a0110da0 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49effd640 1 -- 172.21.15.122:0/939689536 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4980ab530 con 0x7ff4a0110da0 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff49effd640 1 -- 172.21.15.122:0/939689536 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4980ab830 con 0x7ff4a0110da0 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- 172.21.15.122:0/939689536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 msgr2=0x7ff4a0111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 --2- 172.21.15.122:0/939689536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a0111180 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff498009740 tx=0x7ff49801c370 comp rx=0 tx=0).stop 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- 172.21.15.122:0/939689536 shutdown_connections 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 --2- 172.21.15.122:0/939689536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a0111180 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- 172.21.15.122:0/939689536 >> 172.21.15.122:0/939689536 conn(0x7ff4a0070900 msgr2=0x7ff4a0072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- 172.21.15.122:0/939689536 shutdown_connections 2024-09-12T16:57:10.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- 172.21.15.122:0/939689536 wait complete. 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 Processor -- start 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.164+0000 7ff4a64ac640 1 -- start start 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff4a64ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a01306c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff4a64ac640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a0135470 con 0x7ff4a0110da0 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a01306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a01306c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:48412/0 (socket says 172.21.15.122:48412) 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49ffff640 1 -- 172.21.15.122:0/2841859651 learned_addr learned my addr 172.21.15.122:0/2841859651 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:57:10.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49ffff640 1 -- 172.21.15.122:0/2841859651 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a01155f0 con 0x7ff4a0110da0 2024-09-12T16:57:10.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49ffff640 1 --2- 172.21.15.122:0/2841859651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a01306c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff4980ae040 tx=0x7ff498019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:10.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49cff9640 1 -- 172.21.15.122:0/2841859651 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4980b8020 con 0x7ff4a0110da0 2024-09-12T16:57:10.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49cff9640 1 -- 172.21.15.122:0/2841859651 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4980b4600 con 0x7ff4a0110da0 2024-09-12T16:57:10.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a0132a00 con 0x7ff4a0110da0 2024-09-12T16:57:10.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49cff9640 1 -- 172.21.15.122:0/2841859651 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4980b0040 con 0x7ff4a0110da0 2024-09-12T16:57:10.174 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a0130c00 con 0x7ff4a0110da0 2024-09-12T16:57:10.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a0131d70 con 0x7ff4a0110da0 2024-09-12T16:57:10.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49cff9640 1 -- 172.21.15.122:0/2841859651 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff4980bb020 con 0x7ff4a0110da0 2024-09-12T16:57:10.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49cff9640 1 --2- 172.21.15.122:0/2841859651 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff48c03b1d0 0x7ff48c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:10.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49cff9640 1 -- 172.21.15.122:0/2841859651 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff4980e96a0 con 0x7ff4a0110da0 2024-09-12T16:57:10.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49f7fe640 1 --2- 172.21.15.122:0/2841859651 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff48c03b1d0 0x7ff48c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:10.175 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.168+0000 7ff49f7fe640 1 --2- 172.21.15.122:0/2841859651 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff48c03b1d0 0x7ff48c03d690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff494007fd0 tx=0x7ff4940078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:10.178 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.172+0000 7ff49cff9640 1 -- 172.21.15.122:0/2841859651 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff4980c2030 con 0x7ff4a0110da0 2024-09-12T16:57:10.347 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.344+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4a0132e00 con 0x7ff48c03b1d0 2024-09-12T16:57:10.377 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.376+0000 7ff49cff9640 1 -- 172.21.15.122:0/2841859651 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666174 (secure 0 0 0) 0x7ff4940070d0 con 0x7ff48c03b1d0 2024-09-12T16:57:10.383 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:57:10.389 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:57:10.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff48c03b1d0 msgr2=0x7ff48c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:10.391 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 --2- 172.21.15.122:0/2841859651 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff48c03b1d0 0x7ff48c03d690 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff494007fd0 tx=0x7ff4940078e0 comp rx=0 tx=0).stop 2024-09-12T16:57:10.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 msgr2=0x7ff4a01306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:10.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 --2- 172.21.15.122:0/2841859651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a01306c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff4980ae040 tx=0x7ff498019110 comp rx=0 tx=0).stop 2024-09-12T16:57:10.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 shutdown_connections 2024-09-12T16:57:10.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 --2- 172.21.15.122:0/2841859651 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7ff48c03b1d0 0x7ff48c03d690 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:10.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 --2- 172.21.15.122:0/2841859651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4a0110da0 0x7ff4a01306c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:10.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 >> 172.21.15.122:0/2841859651 conn(0x7ff4a0070900 msgr2=0x7ff4a012ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:57:10.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 shutdown_connections 2024-09-12T16:57:10.392 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:10.380+0000 7ff4a64ac640 1 -- 172.21.15.122:0/2841859651 wait complete. 2024-09-12T16:57:10.400 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-12T16:57:10.092350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5138,"num_read_kb":4724,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1785572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006057"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.961212+0000","last_change":"2024-09-12T16:56:03.961062+0000","last_active":"2024-09-12T16:56:03.961212+0000","last_peered":"2024-09-12T16:56:03.961212+0000","last_clean":"2024-09-12T16:56:03.961212+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:56:03.961212+0000","last_undegraded":"2024-09-12T16:56:03.961212+0000","last_fullsized":"2024-09-12T16:56:03.961212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.960834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:37.770581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.300653+0000","last_change":"2024-09-12T16:56:20.300472+0000","last_active":"2024-09-12T16:56:20.300653+0000","last_peered":"2024-09-12T16:56:20.300653+0000","last_clean":"2024-09-12T16:56:20.300653+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:56:20.300653+0000","last_undegraded":"2024-09-12T16:56:20.300653+0000","last_fullsized":"2024-09-12T16:56:20.300653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:20.300256+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:20.300256+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.300256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:32.742102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.441857+0000","last_change":"2024-09-12T16:56:02.441693+0000","last_active":"2024-09-12T16:56:02.441857+0000","last_peered":"2024-09-12T16:56:02.441857+0000","last_clean":"2024-09-12T16:56:02.441857+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:56:02.441857+0000","last_undegraded":"2024-09-12T16:56:02.441857+0000","last_fullsized":"2024-09-12T16:56:02.441857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.441477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:15.024861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.240155+0000","last_change":"2024-09-12T16:56:31.240000+0000","last_active":"2024-09-12T16:56:31.240155+0000","last_peered":"2024-09-12T16:56:31.240155+0000","last_clean":"2024-09-12T16:56:31.240155+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:56:31.240155+0000","last_undegraded":"2024-09-12T16:56:31.240155+0000","last_fullsized":"2024-09-12T16:56:31.240155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:31.239807+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:31.239807+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.239807+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.495353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.033441+0000","last_change":"2024-09-12T16:56:16.033441+0000","last_active":"2024-09-12T16:56:16.033441+0000","last_peered":"2024-09-12T16:56:16.033441+0000","last_clean":"2024-09-12T16:56:16.033441+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:56:16.033441+0000","last_undegraded":"2024-09-12T16:56:16.033441+0000","last_fullsized":"2024-09-12T16:56:16.033441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:16.033239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:16.033239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.033239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:59.167081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.269489+0000","last_change":"2024-09-12T16:56:32.269328+0000","last_active":"2024-09-12T16:56:32.269489+0000","last_peered":"2024-09-12T16:56:32.269489+0000","last_clean":"2024-09-12T16:56:32.269489+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:56:32.269489+0000","last_undegraded":"2024-09-12T16:56:32.269489+0000","last_fullsized":"2024-09-12T16:56:32.269489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:32.269147+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:32.269147+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.269147+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:37.703397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.000241+0000","last_change":"2024-09-12T16:55:59.000089+0000","last_active":"2024-09-12T16:55:59.000241+0000","last_peered":"2024-09-12T16:55:59.000241+0000","last_clean":"2024-09-12T16:55:59.000241+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:55:59.000241+0000","last_undegraded":"2024-09-12T16:55:59.000241+0000","last_fullsized":"2024-09-12T16:55:59.000241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.999904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.689260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.304736+0000","last_change":"2024-09-12T16:56:33.304553+0000","last_active":"2024-09-12T16:56:33.304736+0000","last_peered":"2024-09-12T16:56:33.304736+0000","last_clean":"2024-09-12T16:56:33.304736+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:56:33.304736+0000","last_undegraded":"2024-09-12T16:56:33.304736+0000","last_fullsized":"2024-09-12T16:56:33.304736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:33.304373+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:33.304373+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.304373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:42.426109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.054350+0000","last_change":"2024-09-12T16:56:15.054183+0000","last_active":"2024-09-12T16:56:15.054350+0000","last_peered":"2024-09-12T16:56:15.054350+0000","last_clean":"2024-09-12T16:56:15.054350+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:56:15.054350+0000","last_undegraded":"2024-09-12T16:56:15.054350+0000","last_fullsized":"2024-09-12T16:56:15.054350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:15.053960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:15.053960+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.053960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:40.643203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.330004+0000","last_change":"2024-09-12T16:56:21.330004+0000","last_active":"2024-09-12T16:56:21.330004+0000","last_peered":"2024-09-12T16:56:21.330004+0000","last_clean":"2024-09-12T16:56:21.330004+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:56:21.330004+0000","last_undegraded":"2024-09-12T16:56:21.330004+0000","last_fullsized":"2024-09-12T16:56:21.330004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:21.329825+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:21.329825+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.329825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:52.622109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.923883+0000","last_change":"2024-09-12T16:56:06.923745+0000","last_active":"2024-09-12T16:56:06.923883+0000","last_peered":"2024-09-12T16:56:06.923883+0000","last_clean":"2024-09-12T16:56:06.923883+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:56:06.923883+0000","last_undegraded":"2024-09-12T16:56:06.923883+0000","last_fullsized":"2024-09-12T16:56:06.923883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.923558+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.923558+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.923558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:45.607137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.344087+0000","last_change":"2024-09-12T16:56:34.344087+0000","last_active":"2024-09-12T16:56:34.344087+0000","last_peered":"2024-09-12T16:56:34.344087+0000","last_clean":"2024-09-12T16:56:34.344087+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:56:34.344087+0000","last_undegraded":"2024-09-12T16:56:34.344087+0000","last_fullsized":"2024-09-12T16:56:34.344087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:34.343897+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:34.343897+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.343897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:18.965351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.073285+0000","last_change":"2024-09-12T16:56:14.073104+0000","last_active":"2024-09-12T16:56:14.073285+0000","last_peered":"2024-09-12T16:56:14.073285+0000","last_clean":"2024-09-12T16:56:14.073285+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:56:14.073285+0000","last_undegraded":"2024-09-12T16:56:14.073285+0000","last_fullsized":"2024-09-12T16:56:14.073285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:14.072890+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:14.072890+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.072890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:52.398439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.924366+0000","last_change":"2024-09-12T16:56:14.924366+0000","last_active":"2024-09-12T16:56:14.924366+0000","last_peered":"2024-09-12T16:56:14.924366+0000","last_clean":"2024-09-12T16:56:14.924366+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:56:14.924366+0000","last_undegraded":"2024-09-12T16:56:14.924366+0000","last_fullsized":"2024-09-12T16:56:14.924366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:14.924132+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:14.924132+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.924132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:01.248598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.411760+0000","last_change":"2024-09-12T16:55:59.411580+0000","last_active":"2024-09-12T16:55:59.411760+0000","last_peered":"2024-09-12T16:55:59.411760+0000","last_clean":"2024-09-12T16:55:59.411760+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:55:59.411760+0000","last_undegraded":"2024-09-12T16:55:59.411760+0000","last_fullsized":"2024-09-12T16:55:59.411760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.411390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:57.337645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.969122+0000","last_change":"2024-09-12T16:56:15.969122+0000","last_active":"2024-09-12T16:56:15.969122+0000","last_peered":"2024-09-12T16:56:15.969122+0000","last_clean":"2024-09-12T16:56:15.969122+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:56:15.969122+0000","last_undegraded":"2024-09-12T16:56:15.969122+0000","last_fullsized":"2024-09-12T16:56:15.969122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:15.968939+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:15.968939+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.968939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:23.486079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.198469+0000","last_change":"2024-09-12T16:56:30.198297+0000","last_active":"2024-09-12T16:56:30.198469+0000","last_peered":"2024-09-12T16:56:30.198469+0000","last_clean":"2024-09-12T16:56:30.198469+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:56:30.198469+0000","last_undegraded":"2024-09-12T16:56:30.198469+0000","last_fullsized":"2024-09-12T16:56:30.198469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:30.198091+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:30.198091+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.198091+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:32.759529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.020318+0000","last_change":"2024-09-12T16:56:01.020166+0000","last_active":"2024-09-12T16:56:01.020318+0000","last_peered":"2024-09-12T16:56:01.020318+0000","last_clean":"2024-09-12T16:56:01.020318+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:56:01.020318+0000","last_undegraded":"2024-09-12T16:56:01.020318+0000","last_fullsized":"2024-09-12T16:56:01.020318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.019981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:17.549962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.228861+0000","last_change":"2024-09-12T16:56:15.228716+0000","last_active":"2024-09-12T16:56:15.228861+0000","last_peered":"2024-09-12T16:56:15.228861+0000","last_clean":"2024-09-12T16:56:15.228861+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:56:15.228861+0000","last_undegraded":"2024-09-12T16:56:15.228861+0000","last_fullsized":"2024-09-12T16:56:15.228861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:15.228531+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:15.228531+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.228531+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:17.677439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.978681+0000","last_change":"2024-09-12T16:56:01.978515+0000","last_active":"2024-09-12T16:56:01.978681+0000","last_peered":"2024-09-12T16:56:01.978681+0000","last_clean":"2024-09-12T16:56:01.978681+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:56:01.978681+0000","last_undegraded":"2024-09-12T16:56:01.978681+0000","last_fullsized":"2024-09-12T16:56:01.978681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.978300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:23.170955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.200170+0000","last_change":"2024-09-12T16:56:16.200016+0000","last_active":"2024-09-12T16:56:16.200170+0000","last_peered":"2024-09-12T16:56:16.200170+0000","last_clean":"2024-09-12T16:56:16.200170+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:56:16.200170+0000","last_undegraded":"2024-09-12T16:56:16.200170+0000","last_fullsized":"2024-09-12T16:56:16.200170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:16.199840+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:16.199840+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.199840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:41.217788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.024798+0000","last_change":"2024-09-12T16:56:00.024742+0000","last_active":"2024-09-12T16:56:00.024798+0000","last_peered":"2024-09-12T16:56:00.024798+0000","last_clean":"2024-09-12T16:56:00.024798+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:56:00.024798+0000","last_undegraded":"2024-09-12T16:56:00.024798+0000","last_fullsized":"2024-09-12T16:56:00.024798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.024672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:03.497187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.360216+0000","last_change":"2024-09-12T16:56:14.360052+0000","last_active":"2024-09-12T16:56:14.360216+0000","last_peered":"2024-09-12T16:56:14.360216+0000","last_clean":"2024-09-12T16:56:14.360216+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:56:14.360216+0000","last_undegraded":"2024-09-12T16:56:14.360216+0000","last_fullsized":"2024-09-12T16:56:14.360216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:14.359876+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:14.359876+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.359876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:20.611388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.029962+0000","last_change":"2024-09-12T16:55:59.029695+0000","last_active":"2024-09-12T16:55:59.029962+0000","last_peered":"2024-09-12T16:55:59.029962+0000","last_clean":"2024-09-12T16:55:59.029962+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:55:59.029962+0000","last_undegraded":"2024-09-12T16:55:59.029962+0000","last_fullsized":"2024-09-12T16:55:59.029962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.029505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.968614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.919699+0000","last_change":"2024-09-12T16:56:12.919566+0000","last_active":"2024-09-12T16:56:12.919699+0000","last_peered":"2024-09-12T16:56:12.919699+0000","last_clean":"2024-09-12T16:56:12.919699+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:56:12.919699+0000","last_undegraded":"2024-09-12T16:56:12.919699+0000","last_fullsized":"2024-09-12T16:56:12.919699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:12.919380+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:12.919380+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.919380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:01.652496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.453323+0000","last_change":"2024-09-12T16:55:58.453187+0000","last_active":"2024-09-12T16:55:58.453323+0000","last_peered":"2024-09-12T16:55:58.453323+0000","last_clean":"2024-09-12T16:55:58.453323+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:55:58.453323+0000","last_undegraded":"2024-09-12T16:55:58.453323+0000","last_fullsized":"2024-09-12T16:55:58.453323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.452993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.443665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.259870+0000","last_change":"2024-09-12T16:56:18.259709+0000","last_active":"2024-09-12T16:56:18.259870+0000","last_peered":"2024-09-12T16:56:18.259870+0000","last_clean":"2024-09-12T16:56:18.259870+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:56:18.259870+0000","last_undegraded":"2024-09-12T16:56:18.259870+0000","last_fullsized":"2024-09-12T16:56:18.259870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:18.259509+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:18.259509+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.259509+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:11.920537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.033140+0000","last_change":"2024-09-12T16:56:13.032967+0000","last_active":"2024-09-12T16:56:13.033140+0000","last_peered":"2024-09-12T16:56:13.033140+0000","last_clean":"2024-09-12T16:56:13.033140+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:56:13.033140+0000","last_undegraded":"2024-09-12T16:56:13.033140+0000","last_fullsized":"2024-09-12T16:56:13.033140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:13.032745+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:13.032745+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.032745+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:11.625172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:48.557026+0000","last_change":"2024-09-12T16:56:48.556888+0000","last_active":"2024-09-12T16:56:48.557026+0000","last_peered":"2024-09-12T16:56:48.557026+0000","last_clean":"2024-09-12T16:56:48.557026+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:56:48.557026+0000","last_undegraded":"2024-09-12T16:56:48.557026+0000","last_fullsized":"2024-09-12T16:56:48.557026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-12T16:56:48.556695+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-12T16:56:48.556695+0000","last_clean_scrub_stamp":"2024-09-12T16:56:48.556695+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:30.519898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.053860+0000","last_change":"2024-09-12T16:56:22.053711+0000","last_active":"2024-09-12T16:56:22.053860+0000","last_peered":"2024-09-12T16:56:22.053860+0000","last_clean":"2024-09-12T16:56:22.053860+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:56:22.053860+0000","last_undegraded":"2024-09-12T16:56:22.053860+0000","last_fullsized":"2024-09-12T16:56:22.053860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:22.053522+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:22.053522+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.053522+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:59.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.009540+0000","last_change":"2024-09-12T16:56:02.009398+0000","last_active":"2024-09-12T16:56:02.009540+0000","last_peered":"2024-09-12T16:56:02.009540+0000","last_clean":"2024-09-12T16:56:02.009540+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:56:02.009540+0000","last_undegraded":"2024-09-12T16:56:02.009540+0000","last_fullsized":"2024-09-12T16:56:02.009540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.009210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:18.094619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.221600+0000","last_change":"2024-09-12T16:56:42.221372+0000","last_active":"2024-09-12T16:56:42.221600+0000","last_peered":"2024-09-12T16:56:42.221600+0000","last_clean":"2024-09-12T16:56:42.221600+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:56:42.221600+0000","last_undegraded":"2024-09-12T16:56:42.221600+0000","last_fullsized":"2024-09-12T16:56:42.221600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:42.221088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:42.221088+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.221088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:08.414428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:51.366515+0000","last_change":"2024-09-12T16:56:51.366390+0000","last_active":"2024-09-12T16:56:51.366515+0000","last_peered":"2024-09-12T16:56:51.366515+0000","last_clean":"2024-09-12T16:56:51.366515+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:56:51.366515+0000","last_undegraded":"2024-09-12T16:56:51.366515+0000","last_fullsized":"2024-09-12T16:56:51.366515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:51.366239+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:51.366239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:51.366239+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:51.267974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.522958+0000","last_change":"2024-09-12T16:56:41.522766+0000","last_active":"2024-09-12T16:56:41.522958+0000","last_peered":"2024-09-12T16:56:41.522958+0000","last_clean":"2024-09-12T16:56:41.522958+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:56:41.522958+0000","last_undegraded":"2024-09-12T16:56:41.522958+0000","last_fullsized":"2024-09-12T16:56:41.522958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.522584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.522584+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.522584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:22.233238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:49.552362+0000","last_change":"2024-09-12T16:56:49.552233+0000","last_active":"2024-09-12T16:56:49.552362+0000","last_peered":"2024-09-12T16:56:49.552362+0000","last_clean":"2024-09-12T16:56:49.552362+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:56:49.552362+0000","last_undegraded":"2024-09-12T16:56:49.552362+0000","last_fullsized":"2024-09-12T16:56:49.552362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-12T16:56:49.552031+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-12T16:56:49.552031+0000","last_clean_scrub_stamp":"2024-09-12T16:56:49.552031+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:56.313686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.075691+0000","last_change":"2024-09-12T16:56:23.075544+0000","last_active":"2024-09-12T16:56:23.075691+0000","last_peered":"2024-09-12T16:56:23.075691+0000","last_clean":"2024-09-12T16:56:23.075691+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:56:23.075691+0000","last_undegraded":"2024-09-12T16:56:23.075691+0000","last_fullsized":"2024-09-12T16:56:23.075691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:23.075361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:23.075361+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.075361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:19.899752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.866594+0000","last_change":"2024-09-12T16:55:53.866458+0000","last_active":"2024-09-12T16:55:53.866594+0000","last_peered":"2024-09-12T16:55:53.866594+0000","last_clean":"2024-09-12T16:55:53.866594+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:53.866594+0000","last_undegraded":"2024-09-12T16:55:53.866594+0000","last_fullsized":"2024-09-12T16:55:53.866594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.866257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:36.901200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.358444+0000","last_change":"2024-09-12T16:56:21.358299+0000","last_active":"2024-09-12T16:56:21.358444+0000","last_peered":"2024-09-12T16:56:21.358444+0000","last_clean":"2024-09-12T16:56:21.358444+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:56:21.358444+0000","last_undegraded":"2024-09-12T16:56:21.358444+0000","last_fullsized":"2024-09-12T16:56:21.358444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:21.358117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:21.358117+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.358117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:01.559420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.493738+0000","last_change":"2024-09-12T16:56:34.493576+0000","last_active":"2024-09-12T16:56:34.493738+0000","last_peered":"2024-09-12T16:56:34.493738+0000","last_clean":"2024-09-12T16:56:34.493738+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:56:34.493738+0000","last_undegraded":"2024-09-12T16:56:34.493738+0000","last_fullsized":"2024-09-12T16:56:34.493738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-12T16:56:34.493374+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-12T16:56:34.493374+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.493374+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:50.187740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.544670+0000","last_change":"2024-09-12T16:56:39.544537+0000","last_active":"2024-09-12T16:56:39.544670+0000","last_peered":"2024-09-12T16:56:39.544670+0000","last_clean":"2024-09-12T16:56:39.544670+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:56:39.544670+0000","last_undegraded":"2024-09-12T16:56:39.544670+0000","last_fullsized":"2024-09-12T16:56:39.544670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.544357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.544357+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.544357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:36.508956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:47.453357+0000","last_change":"2024-09-12T16:56:47.453204+0000","last_active":"2024-09-12T16:56:47.453357+0000","last_peered":"2024-09-12T16:56:47.453357+0000","last_clean":"2024-09-12T16:56:47.453357+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:56:47.453357+0000","last_undegraded":"2024-09-12T16:56:47.453357+0000","last_fullsized":"2024-09-12T16:56:47.453357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:47.453015+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:47.453015+0000","last_clean_scrub_stamp":"2024-09-12T16:56:47.453015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.827858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.123394+0000","last_change":"2024-09-12T16:56:24.123242+0000","last_active":"2024-09-12T16:56:24.123394+0000","last_peered":"2024-09-12T16:56:24.123394+0000","last_clean":"2024-09-12T16:56:24.123394+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:56:24.123394+0000","last_undegraded":"2024-09-12T16:56:24.123394+0000","last_fullsized":"2024-09-12T16:56:24.123394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:24.123050+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:24.123050+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.123050+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:32.942821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.057505+0000","last_change":"2024-09-12T16:56:01.057358+0000","last_active":"2024-09-12T16:56:01.057505+0000","last_peered":"2024-09-12T16:56:01.057505+0000","last_clean":"2024-09-12T16:56:01.057505+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:56:01.057505+0000","last_undegraded":"2024-09-12T16:56:01.057505+0000","last_fullsized":"2024-09-12T16:56:01.057505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.057181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:48.320895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.372021+0000","last_change":"2024-09-12T16:56:23.371894+0000","last_active":"2024-09-12T16:56:23.372021+0000","last_peered":"2024-09-12T16:56:23.372021+0000","last_clean":"2024-09-12T16:56:23.372021+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:56:23.372021+0000","last_undegraded":"2024-09-12T16:56:23.372021+0000","last_fullsized":"2024-09-12T16:56:23.372021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:23.371722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:23.371722+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.371722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:32.702443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.005898+0000","last_change":"2024-09-12T16:56:28.005734+0000","last_active":"2024-09-12T16:56:28.005898+0000","last_peered":"2024-09-12T16:56:28.005898+0000","last_clean":"2024-09-12T16:56:28.005898+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:56:28.005898+0000","last_undegraded":"2024-09-12T16:56:28.005898+0000","last_fullsized":"2024-09-12T16:56:28.005898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:28.005551+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:28.005551+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.005551+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:32.321067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":396,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:00.374904+0000","last_change":"2024-09-12T16:57:00.374904+0000","last_active":"2024-09-12T16:57:00.374904+0000","last_peered":"2024-09-12T16:57:00.374904+0000","last_clean":"2024-09-12T16:57:00.374904+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:57:00.374904+0000","last_undegraded":"2024-09-12T16:57:00.374904+0000","last_fullsized":"2024-09-12T16:57:00.374904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:57:00.374735+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:57:00.374735+0000","last_clean_scrub_stamp":"2024-09-12T16:57:00.374735+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:32.508636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.064556+0000","last_change":"2024-09-12T16:56:41.064316+0000","last_active":"2024-09-12T16:56:41.064556+0000","last_peered":"2024-09-12T16:56:41.064556+0000","last_clean":"2024-09-12T16:56:41.064556+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:56:41.064556+0000","last_undegraded":"2024-09-12T16:56:41.064556+0000","last_fullsized":"2024-09-12T16:56:41.064556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.064050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.064050+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.064050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:56.640802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.409980+0000","last_change":"2024-09-12T16:56:05.409809+0000","last_active":"2024-09-12T16:56:05.409980+0000","last_peered":"2024-09-12T16:56:05.409980+0000","last_clean":"2024-09-12T16:56:05.409980+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:56:05.409980+0000","last_undegraded":"2024-09-12T16:56:05.409980+0000","last_fullsized":"2024-09-12T16:56:05.409980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:05.409623+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:05.409623+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.409623+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:09.725138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.883001+0000","last_change":"2024-09-12T16:55:49.882861+0000","last_active":"2024-09-12T16:55:49.883001+0000","last_peered":"2024-09-12T16:55:49.883001+0000","last_clean":"2024-09-12T16:55:49.883001+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:55:49.883001+0000","last_undegraded":"2024-09-12T16:55:49.883001+0000","last_fullsized":"2024-09-12T16:55:49.883001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.882666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:15.998089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.205111+0000","last_change":"2024-09-12T16:56:43.204889+0000","last_active":"2024-09-12T16:56:43.205111+0000","last_peered":"2024-09-12T16:56:43.205111+0000","last_clean":"2024-09-12T16:56:43.205111+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:56:43.205111+0000","last_undegraded":"2024-09-12T16:56:43.205111+0000","last_fullsized":"2024-09-12T16:56:43.205111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:43.204616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:43.204616+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.204616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:44.818830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.990339+0000","last_change":"2024-09-12T16:56:28.990167+0000","last_active":"2024-09-12T16:56:28.990339+0000","last_peered":"2024-09-12T16:56:28.990339+0000","last_clean":"2024-09-12T16:56:28.990339+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:56:28.990339+0000","last_undegraded":"2024-09-12T16:56:28.990339+0000","last_fullsized":"2024-09-12T16:56:28.990339+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:28.989951+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:28.989951+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.989951+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:15.454424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.374347+0000","last_change":"2024-09-12T16:56:38.374212+0000","last_active":"2024-09-12T16:56:38.374347+0000","last_peered":"2024-09-12T16:56:38.374347+0000","last_clean":"2024-09-12T16:56:38.374347+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:56:38.374347+0000","last_undegraded":"2024-09-12T16:56:38.374347+0000","last_fullsized":"2024-09-12T16:56:38.374347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:38.374018+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:38.374018+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.374018+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.005339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.050560+0000","last_change":"2024-09-12T16:56:20.050421+0000","last_active":"2024-09-12T16:56:20.050560+0000","last_peered":"2024-09-12T16:56:20.050560+0000","last_clean":"2024-09-12T16:56:20.050560+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:56:20.050560+0000","last_undegraded":"2024-09-12T16:56:20.050560+0000","last_fullsized":"2024-09-12T16:56:20.050560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:20.050239+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:20.050239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.050239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:20.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.907472+0000","last_change":"2024-09-12T16:55:51.907335+0000","last_active":"2024-09-12T16:55:51.907472+0000","last_peered":"2024-09-12T16:55:51.907472+0000","last_clean":"2024-09-12T16:55:51.907472+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:55:51.907472+0000","last_undegraded":"2024-09-12T16:55:51.907472+0000","last_fullsized":"2024-09-12T16:55:51.907472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.907142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:07.393009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.349322+0000","last_change":"2024-09-12T16:56:23.349322+0000","last_active":"2024-09-12T16:56:23.349322+0000","last_peered":"2024-09-12T16:56:23.349322+0000","last_clean":"2024-09-12T16:56:23.349322+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:56:23.349322+0000","last_undegraded":"2024-09-12T16:56:23.349322+0000","last_fullsized":"2024-09-12T16:56:23.349322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:23.349052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:23.349052+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.349052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:29.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'53","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.006089+0000","last_change":"2024-09-12T16:56:25.005947+0000","last_active":"2024-09-12T16:56:25.006089+0000","last_peered":"2024-09-12T16:56:25.006089+0000","last_clean":"2024-09-12T16:56:25.006089+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:56:25.006089+0000","last_undegraded":"2024-09-12T16:56:25.006089+0000","last_fullsized":"2024-09-12T16:56:25.006089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'53","last_scrub_stamp":"2024-09-12T16:56:25.005701+0000","last_deep_scrub":"34'53","last_deep_scrub_stamp":"2024-09-12T16:56:25.005701+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.005701+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:29.541745+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.409384+0000","last_change":"2024-09-12T16:56:40.409384+0000","last_active":"2024-09-12T16:56:40.409384+0000","last_peered":"2024-09-12T16:56:40.409384+0000","last_clean":"2024-09-12T16:56:40.409384+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:56:40.409384+0000","last_undegraded":"2024-09-12T16:56:40.409384+0000","last_fullsized":"2024-09-12T16:56:40.409384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.409170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.409170+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.409170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:50.796522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.053635+0000","last_change":"2024-09-12T16:56:38.053635+0000","last_active":"2024-09-12T16:56:38.053635+0000","last_peered":"2024-09-12T16:56:38.053635+0000","last_clean":"2024-09-12T16:56:38.053635+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:56:38.053635+0000","last_undegraded":"2024-09-12T16:56:38.053635+0000","last_fullsized":"2024-09-12T16:56:38.053635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:38.053453+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:38.053453+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.053453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.986575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.051166+0000","last_change":"2024-09-12T16:56:05.051013+0000","last_active":"2024-09-12T16:56:05.051166+0000","last_peered":"2024-09-12T16:56:05.051166+0000","last_clean":"2024-09-12T16:56:05.051166+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:56:05.051166+0000","last_undegraded":"2024-09-12T16:56:05.051166+0000","last_fullsized":"2024-09-12T16:56:05.051166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.050827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:50.475409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.905402+0000","last_change":"2024-09-12T16:55:54.905168+0000","last_active":"2024-09-12T16:55:54.905402+0000","last_peered":"2024-09-12T16:55:54.905402+0000","last_clean":"2024-09-12T16:55:54.905402+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:55:54.905402+0000","last_undegraded":"2024-09-12T16:55:54.905402+0000","last_fullsized":"2024-09-12T16:55:54.905402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:54.848288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.337432+0000","last_change":"2024-09-12T16:56:18.337308+0000","last_active":"2024-09-12T16:56:18.337432+0000","last_peered":"2024-09-12T16:56:18.337432+0000","last_clean":"2024-09-12T16:56:18.337432+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:56:18.337432+0000","last_undegraded":"2024-09-12T16:56:18.337432+0000","last_fullsized":"2024-09-12T16:56:18.337432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:18.337128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:18.337128+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.337128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:29.062021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:49.287543+0000","last_change":"2024-09-12T16:56:49.287543+0000","last_active":"2024-09-12T16:56:49.287543+0000","last_peered":"2024-09-12T16:56:49.287543+0000","last_clean":"2024-09-12T16:56:49.287543+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:56:49.287543+0000","last_undegraded":"2024-09-12T16:56:49.287543+0000","last_fullsized":"2024-09-12T16:56:49.287543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:49.287325+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:49.287325+0000","last_clean_scrub_stamp":"2024-09-12T16:56:49.287325+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:46.334963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.365019+0000","last_change":"2024-09-12T16:56:37.365019+0000","last_active":"2024-09-12T16:56:37.365019+0000","last_peered":"2024-09-12T16:56:37.365019+0000","last_clean":"2024-09-12T16:56:37.365019+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:56:37.365019+0000","last_undegraded":"2024-09-12T16:56:37.365019+0000","last_fullsized":"2024-09-12T16:56:37.365019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:37.364847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:37.364847+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.364847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:23.142205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.526572+0000","last_change":"2024-09-12T16:56:43.526572+0000","last_active":"2024-09-12T16:56:43.526572+0000","last_peered":"2024-09-12T16:56:43.526572+0000","last_clean":"2024-09-12T16:56:43.526572+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:56:43.526572+0000","last_undegraded":"2024-09-12T16:56:43.526572+0000","last_fullsized":"2024-09-12T16:56:43.526572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:43.526380+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:43.526380+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.526380+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.801749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.904512+0000","last_change":"2024-09-12T16:56:05.904375+0000","last_active":"2024-09-12T16:56:05.904512+0000","last_peered":"2024-09-12T16:56:05.904512+0000","last_clean":"2024-09-12T16:56:05.904512+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:56:05.904512+0000","last_undegraded":"2024-09-12T16:56:05.904512+0000","last_fullsized":"2024-09-12T16:56:05.904512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:05.904173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:05.904173+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.904173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:01.552829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.069390+0000","last_change":"2024-09-12T16:55:59.069150+0000","last_active":"2024-09-12T16:55:59.069390+0000","last_peered":"2024-09-12T16:55:59.069390+0000","last_clean":"2024-09-12T16:55:59.069390+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:55:59.069390+0000","last_undegraded":"2024-09-12T16:55:59.069390+0000","last_fullsized":"2024-09-12T16:55:59.069390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.068940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:14.552968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.380181+0000","last_change":"2024-09-12T16:56:22.380045+0000","last_active":"2024-09-12T16:56:22.380181+0000","last_peered":"2024-09-12T16:56:22.380181+0000","last_clean":"2024-09-12T16:56:22.380181+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:56:22.380181+0000","last_undegraded":"2024-09-12T16:56:22.380181+0000","last_fullsized":"2024-09-12T16:56:22.380181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.379868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.379868+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.379868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:57.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'47","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:46.245164+0000","last_change":"2024-09-12T16:56:46.245164+0000","last_active":"2024-09-12T16:56:46.245164+0000","last_peered":"2024-09-12T16:56:46.245164+0000","last_clean":"2024-09-12T16:56:46.245164+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:56:46.245164+0000","last_undegraded":"2024-09-12T16:56:46.245164+0000","last_fullsized":"2024-09-12T16:56:46.245164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-12T16:56:46.244958+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-12T16:56:46.244958+0000","last_clean_scrub_stamp":"2024-09-12T16:56:46.244958+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:21.422041+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.317532+0000","last_change":"2024-09-12T16:56:36.317532+0000","last_active":"2024-09-12T16:56:36.317532+0000","last_peered":"2024-09-12T16:56:36.317532+0000","last_clean":"2024-09-12T16:56:36.317532+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:56:36.317532+0000","last_undegraded":"2024-09-12T16:56:36.317532+0000","last_fullsized":"2024-09-12T16:56:36.317532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.317357+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.317357+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.317357+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:50.723946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:44.490003+0000","last_change":"2024-09-12T16:56:44.490003+0000","last_active":"2024-09-12T16:56:44.490003+0000","last_peered":"2024-09-12T16:56:44.490003+0000","last_clean":"2024-09-12T16:56:44.490003+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:56:44.490003+0000","last_undegraded":"2024-09-12T16:56:44.490003+0000","last_fullsized":"2024-09-12T16:56:44.490003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:44.489803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:44.489803+0000","last_clean_scrub_stamp":"2024-09-12T16:56:44.489803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:10.877423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.925722+0000","last_change":"2024-09-12T16:56:04.925571+0000","last_active":"2024-09-12T16:56:04.925722+0000","last_peered":"2024-09-12T16:56:04.925722+0000","last_clean":"2024-09-12T16:56:04.925722+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:56:04.925722+0000","last_undegraded":"2024-09-12T16:56:04.925722+0000","last_fullsized":"2024-09-12T16:56:04.925722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.925364+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:32.101898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.090663+0000","last_change":"2024-09-12T16:56:00.090533+0000","last_active":"2024-09-12T16:56:00.090663+0000","last_peered":"2024-09-12T16:56:00.090663+0000","last_clean":"2024-09-12T16:56:00.090663+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:56:00.090663+0000","last_undegraded":"2024-09-12T16:56:00.090663+0000","last_fullsized":"2024-09-12T16:56:00.090663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.090336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:15.365705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.382408+0000","last_change":"2024-09-12T16:56:19.382163+0000","last_active":"2024-09-12T16:56:19.382408+0000","last_peered":"2024-09-12T16:56:19.382408+0000","last_clean":"2024-09-12T16:56:19.382408+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:56:19.382408+0000","last_undegraded":"2024-09-12T16:56:19.382408+0000","last_fullsized":"2024-09-12T16:56:19.382408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:19.381897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:19.381897+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.381897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:39.274144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'65","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:48.249523+0000","last_change":"2024-09-12T16:56:48.249523+0000","last_active":"2024-09-12T16:56:48.249523+0000","last_peered":"2024-09-12T16:56:48.249523+0000","last_clean":"2024-09-12T16:56:48.249523+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:56:48.249523+0000","last_undegraded":"2024-09-12T16:56:48.249523+0000","last_fullsized":"2024-09-12T16:56:48.249523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-12T16:56:48.249409+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-12T16:56:48.249409+0000","last_clean_scrub_stamp":"2024-09-12T16:56:48.249409+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.125924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.317586+0000","last_change":"2024-09-12T16:56:35.317586+0000","last_active":"2024-09-12T16:56:35.317586+0000","last_peered":"2024-09-12T16:56:35.317586+0000","last_clean":"2024-09-12T16:56:35.317586+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:56:35.317586+0000","last_undegraded":"2024-09-12T16:56:35.317586+0000","last_fullsized":"2024-09-12T16:56:35.317586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.317410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.317410+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.317410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:18.356487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:45.454932+0000","last_change":"2024-09-12T16:56:45.454932+0000","last_active":"2024-09-12T16:56:45.454932+0000","last_peered":"2024-09-12T16:56:45.454932+0000","last_clean":"2024-09-12T16:56:45.454932+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:56:45.454932+0000","last_undegraded":"2024-09-12T16:56:45.454932+0000","last_fullsized":"2024-09-12T16:56:45.454932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T16:56:45.454725+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T16:56:45.454725+0000","last_clean_scrub_stamp":"2024-09-12T16:56:45.454725+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:11.362289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.020950+0000","last_change":"2024-09-12T16:56:04.020804+0000","last_active":"2024-09-12T16:56:04.020950+0000","last_peered":"2024-09-12T16:56:04.020950+0000","last_clean":"2024-09-12T16:56:04.020950+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:56:04.020950+0000","last_undegraded":"2024-09-12T16:56:04.020950+0000","last_fullsized":"2024-09-12T16:56:04.020950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.020617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:53.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.431669+0000","last_change":"2024-09-12T16:55:52.431517+0000","last_active":"2024-09-12T16:55:52.431669+0000","last_peered":"2024-09-12T16:55:52.431669+0000","last_clean":"2024-09-12T16:55:52.431669+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:55:52.431669+0000","last_undegraded":"2024-09-12T16:55:52.431669+0000","last_fullsized":"2024-09-12T16:55:52.431669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.431331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:30.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.008607+0000","last_change":"2024-09-12T16:56:18.008472+0000","last_active":"2024-09-12T16:56:18.008607+0000","last_peered":"2024-09-12T16:56:18.008607+0000","last_clean":"2024-09-12T16:56:18.008607+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:56:18.008607+0000","last_undegraded":"2024-09-12T16:56:18.008607+0000","last_fullsized":"2024-09-12T16:56:18.008607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:18.008262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:18.008262+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.008262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:32.869069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'44","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.455387+0000","last_change":"2024-09-12T16:56:33.455122+0000","last_active":"2024-09-12T16:56:33.455387+0000","last_peered":"2024-09-12T16:56:33.455387+0000","last_clean":"2024-09-12T16:56:33.455387+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:56:33.455387+0000","last_undegraded":"2024-09-12T16:56:33.455387+0000","last_fullsized":"2024-09-12T16:56:33.455387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-12T16:56:33.454879+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-12T16:56:33.454879+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.454879+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:45.966553+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:03.462548+0000","last_change":"2024-09-12T16:57:03.462548+0000","last_active":"2024-09-12T16:57:03.462548+0000","last_peered":"2024-09-12T16:57:03.462548+0000","last_clean":"2024-09-12T16:57:03.462548+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:57:03.462548+0000","last_undegraded":"2024-09-12T16:57:03.462548+0000","last_fullsized":"2024-09-12T16:57:03.462548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:03.462366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:03.462366+0000","last_clean_scrub_stamp":"2024-09-12T16:57:03.462366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:25.098343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'8","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:04.421427+0000","last_change":"2024-09-12T16:57:04.421427+0000","last_active":"2024-09-12T16:57:04.421427+0000","last_peered":"2024-09-12T16:57:04.421427+0000","last_clean":"2024-09-12T16:57:04.421427+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:57:04.421427+0000","last_undegraded":"2024-09-12T16:57:04.421427+0000","last_fullsized":"2024-09-12T16:57:04.421427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:57:04.421198+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:57:04.421198+0000","last_clean_scrub_stamp":"2024-09-12T16:57:04.421198+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:18.067383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.007311+0000","last_change":"2024-09-12T16:56:19.007071+0000","last_active":"2024-09-12T16:56:19.007311+0000","last_peered":"2024-09-12T16:56:19.007311+0000","last_clean":"2024-09-12T16:56:19.007311+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:56:19.007311+0000","last_undegraded":"2024-09-12T16:56:19.007311+0000","last_fullsized":"2024-09-12T16:56:19.007311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:19.006789+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:19.006789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.006789+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:57.690077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.103221+0000","last_change":"2024-09-12T16:55:58.103087+0000","last_active":"2024-09-12T16:55:58.103221+0000","last_peered":"2024-09-12T16:55:58.103221+0000","last_clean":"2024-09-12T16:55:58.103221+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:55:58.103221+0000","last_undegraded":"2024-09-12T16:55:58.103221+0000","last_fullsized":"2024-09-12T16:55:58.103221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.102908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:04.349009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.386158+0000","last_change":"2024-09-12T16:56:20.386007+0000","last_active":"2024-09-12T16:56:20.386158+0000","last_peered":"2024-09-12T16:56:20.386158+0000","last_clean":"2024-09-12T16:56:20.386158+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:56:20.386158+0000","last_undegraded":"2024-09-12T16:56:20.386158+0000","last_fullsized":"2024-09-12T16:56:20.386158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:20.385826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:20.385826+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.385826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:33.071596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.998018+0000","last_change":"2024-09-12T16:56:25.997882+0000","last_active":"2024-09-12T16:56:25.998018+0000","last_peered":"2024-09-12T16:56:25.998018+0000","last_clean":"2024-09-12T16:56:25.998018+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:56:25.998018+0000","last_undegraded":"2024-09-12T16:56:25.998018+0000","last_fullsized":"2024-09-12T16:56:25.998018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T16:56:25.997691+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T16:56:25.997691+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.997691+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:15.487181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.986764+0000","last_change":"2024-09-12T16:56:31.986615+0000","last_active":"2024-09-12T16:56:31.986764+0000","last_peered":"2024-09-12T16:56:31.986764+0000","last_clean":"2024-09-12T16:56:31.986764+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:56:31.986764+0000","last_undegraded":"2024-09-12T16:56:31.986764+0000","last_fullsized":"2024-09-12T16:56:31.986764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:31.986435+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:31.986435+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.986435+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:25.564125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'22","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.443777+0000","last_change":"2024-09-12T16:56:43.443777+0000","last_active":"2024-09-12T16:56:43.443777+0000","last_peered":"2024-09-12T16:56:43.443777+0000","last_clean":"2024-09-12T16:56:43.443777+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:56:43.443777+0000","last_undegraded":"2024-09-12T16:56:43.443777+0000","last_fullsized":"2024-09-12T16:56:43.443777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-12T16:56:43.443561+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-12T16:56:43.443561+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.443561+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:00.897956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.985410+0000","last_change":"2024-09-12T16:56:02.985161+0000","last_active":"2024-09-12T16:56:02.985410+0000","last_peered":"2024-09-12T16:56:02.985410+0000","last_clean":"2024-09-12T16:56:02.985410+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:56:02.985410+0000","last_undegraded":"2024-09-12T16:56:02.985410+0000","last_fullsized":"2024-09-12T16:56:02.985410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.984950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:45.336637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.105792+0000","last_change":"2024-09-12T16:55:57.105529+0000","last_active":"2024-09-12T16:55:57.105792+0000","last_peered":"2024-09-12T16:55:57.105792+0000","last_clean":"2024-09-12T16:55:57.105792+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:55:57.105792+0000","last_undegraded":"2024-09-12T16:55:57.105792+0000","last_fullsized":"2024-09-12T16:55:57.105792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.105307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'7","reported_seq":635,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.390694+0000","last_change":"2024-09-12T16:56:26.390535+0000","last_active":"2024-09-12T16:56:26.390694+0000","last_peered":"2024-09-12T16:56:26.390694+0000","last_clean":"2024-09-12T16:56:26.390694+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:56:26.390694+0000","last_undegraded":"2024-09-12T16:56:26.390694+0000","last_fullsized":"2024-09-12T16:56:26.390694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T16:56:26.390345+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T16:56:26.390345+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.390345+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:52.719580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:50.330572+0000","last_change":"2024-09-12T16:56:50.330572+0000","last_active":"2024-09-12T16:56:50.330572+0000","last_peered":"2024-09-12T16:56:50.330572+0000","last_clean":"2024-09-12T16:56:50.330572+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:56:50.330572+0000","last_undegraded":"2024-09-12T16:56:50.330572+0000","last_fullsized":"2024-09-12T16:56:50.330572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T16:56:50.330396+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T16:56:50.330396+0000","last_clean_scrub_stamp":"2024-09-12T16:56:50.330396+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:33.940470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.521793+0000","last_change":"2024-09-12T16:56:37.521793+0000","last_active":"2024-09-12T16:56:37.521793+0000","last_peered":"2024-09-12T16:56:37.521793+0000","last_clean":"2024-09-12T16:56:37.521793+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:56:37.521793+0000","last_undegraded":"2024-09-12T16:56:37.521793+0000","last_fullsized":"2024-09-12T16:56:37.521793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:37.521618+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:37.521618+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.521618+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:42.714606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.054825+0000","last_change":"2024-09-12T16:56:37.054825+0000","last_active":"2024-09-12T16:56:37.054825+0000","last_peered":"2024-09-12T16:56:37.054825+0000","last_clean":"2024-09-12T16:56:37.054825+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:56:37.054825+0000","last_undegraded":"2024-09-12T16:56:37.054825+0000","last_fullsized":"2024-09-12T16:56:37.054825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:37.054637+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:37.054637+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.054637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:41.076261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.019783+0000","last_change":"2024-09-12T16:56:06.019629+0000","last_active":"2024-09-12T16:56:06.019783+0000","last_peered":"2024-09-12T16:56:06.019783+0000","last_clean":"2024-09-12T16:56:06.019783+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:06.019783+0000","last_undegraded":"2024-09-12T16:56:06.019783+0000","last_fullsized":"2024-09-12T16:56:06.019783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.019448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.300837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.145123+0000","last_change":"2024-09-12T16:55:56.144883+0000","last_active":"2024-09-12T16:55:56.145123+0000","last_peered":"2024-09-12T16:55:56.145123+0000","last_clean":"2024-09-12T16:55:56.145123+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:55:56.145123+0000","last_undegraded":"2024-09-12T16:55:56.145123+0000","last_fullsized":"2024-09-12T16:55:56.145123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.144656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:33.152646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.228993+0000","last_change":"2024-09-12T16:56:39.228993+0000","last_active":"2024-09-12T16:56:39.228993+0000","last_peered":"2024-09-12T16:56:39.228993+0000","last_clean":"2024-09-12T16:56:39.228993+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:56:39.228993+0000","last_undegraded":"2024-09-12T16:56:39.228993+0000","last_fullsized":"2024-09-12T16:56:39.228993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.228794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.228794+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.228794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:39.754327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.426959+0000","last_change":"2024-09-12T16:56:32.426735+0000","last_active":"2024-09-12T16:56:32.426959+0000","last_peered":"2024-09-12T16:56:32.426959+0000","last_clean":"2024-09-12T16:56:32.426959+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:56:32.426959+0000","last_undegraded":"2024-09-12T16:56:32.426959+0000","last_fullsized":"2024-09-12T16:56:32.426959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T16:56:32.426491+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T16:56:32.426491+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.426491+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:29.540681+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.953447+0000","last_change":"2024-09-12T16:56:30.953290+0000","last_active":"2024-09-12T16:56:30.953447+0000","last_peered":"2024-09-12T16:56:30.953447+0000","last_clean":"2024-09-12T16:56:30.953447+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:56:30.953447+0000","last_undegraded":"2024-09-12T16:56:30.953447+0000","last_fullsized":"2024-09-12T16:56:30.953447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:30.953116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:30.953116+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.953116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:00.872368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.528323+0000","last_change":"2024-09-12T16:56:42.528323+0000","last_active":"2024-09-12T16:56:42.528323+0000","last_peered":"2024-09-12T16:56:42.528323+0000","last_clean":"2024-09-12T16:56:42.528323+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:56:42.528323+0000","last_undegraded":"2024-09-12T16:56:42.528323+0000","last_fullsized":"2024-09-12T16:56:42.528323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-12T16:56:42.528129+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-12T16:56:42.528129+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.528129+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:58.012156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.048143+0000","last_change":"2024-09-12T16:56:17.048143+0000","last_active":"2024-09-12T16:56:17.048143+0000","last_peered":"2024-09-12T16:56:17.048143+0000","last_clean":"2024-09-12T16:56:17.048143+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:56:17.048143+0000","last_undegraded":"2024-09-12T16:56:17.048143+0000","last_fullsized":"2024-09-12T16:56:17.048143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:17.047963+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:17.047963+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.047963+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:42.891911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.965741+0000","last_change":"2024-09-12T16:55:47.965741+0000","last_active":"2024-09-12T16:55:47.965741+0000","last_peered":"2024-09-12T16:55:47.965741+0000","last_clean":"2024-09-12T16:55:47.965741+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:55:47.965741+0000","last_undegraded":"2024-09-12T16:55:47.965741+0000","last_fullsized":"2024-09-12T16:55:47.965741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.965477+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:53.674876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.217462+0000","last_change":"2024-09-12T16:55:51.217300+0000","last_active":"2024-09-12T16:55:51.217462+0000","last_peered":"2024-09-12T16:55:51.217462+0000","last_clean":"2024-09-12T16:55:51.217462+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:55:51.217462+0000","last_undegraded":"2024-09-12T16:55:51.217462+0000","last_fullsized":"2024-09-12T16:55:51.217462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.217110+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:04.583269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.156907+0000","last_change":"2024-09-12T16:55:54.156773+0000","last_active":"2024-09-12T16:55:54.156907+0000","last_peered":"2024-09-12T16:55:54.156907+0000","last_clean":"2024-09-12T16:55:54.156907+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:55:54.156907+0000","last_undegraded":"2024-09-12T16:55:54.156907+0000","last_fullsized":"2024-09-12T16:55:54.156907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.156592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:41.292991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.301262+0000","last_change":"2024-09-12T16:56:22.301262+0000","last_active":"2024-09-12T16:56:22.301262+0000","last_peered":"2024-09-12T16:56:22.301262+0000","last_clean":"2024-09-12T16:56:22.301262+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:56:22.301262+0000","last_undegraded":"2024-09-12T16:56:22.301262+0000","last_fullsized":"2024-09-12T16:56:22.301262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.301082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.301082+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.301082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:33.733394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:45.213649+0000","last_change":"2024-09-12T16:56:45.213649+0000","last_active":"2024-09-12T16:56:45.213649+0000","last_peered":"2024-09-12T16:56:45.213649+0000","last_clean":"2024-09-12T16:56:45.213649+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:56:45.213649+0000","last_undegraded":"2024-09-12T16:56:45.213649+0000","last_fullsized":"2024-09-12T16:56:45.213649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-12T16:56:45.213465+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-12T16:56:45.213465+0000","last_clean_scrub_stamp":"2024-09-12T16:56:45.213465+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.026418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.310119+0000","last_change":"2024-09-12T16:56:34.310119+0000","last_active":"2024-09-12T16:56:34.310119+0000","last_peered":"2024-09-12T16:56:34.310119+0000","last_clean":"2024-09-12T16:56:34.310119+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:56:34.310119+0000","last_undegraded":"2024-09-12T16:56:34.310119+0000","last_fullsized":"2024-09-12T16:56:34.310119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:34.309932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:34.309932+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.309932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:55.003538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.077725+0000","last_change":"2024-09-12T16:56:39.077725+0000","last_active":"2024-09-12T16:56:39.077725+0000","last_peered":"2024-09-12T16:56:39.077725+0000","last_clean":"2024-09-12T16:56:39.077725+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:56:39.077725+0000","last_undegraded":"2024-09-12T16:56:39.077725+0000","last_fullsized":"2024-09-12T16:56:39.077725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-09-12T16:56:39.077541+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-09-12T16:56:39.077541+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.077541+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:57.697338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.003628+0000","last_change":"2024-09-12T16:56:18.003458+0000","last_active":"2024-09-12T16:56:18.003628+0000","last_peered":"2024-09-12T16:56:18.003628+0000","last_clean":"2024-09-12T16:56:18.003628+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:56:18.003628+0000","last_undegraded":"2024-09-12T16:56:18.003628+0000","last_fullsized":"2024-09-12T16:56:18.003628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:18.003280+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:18.003280+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.003280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:21.904327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.222007+0000","last_change":"2024-09-12T16:55:49.222007+0000","last_active":"2024-09-12T16:55:49.222007+0000","last_peered":"2024-09-12T16:55:49.222007+0000","last_clean":"2024-09-12T16:55:49.222007+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:55:49.222007+0000","last_undegraded":"2024-09-12T16:55:49.222007+0000","last_fullsized":"2024-09-12T16:55:49.222007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.221820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:10.179551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.395547+0000","last_change":"2024-09-12T16:55:51.395398+0000","last_active":"2024-09-12T16:55:51.395547+0000","last_peered":"2024-09-12T16:55:51.395547+0000","last_clean":"2024-09-12T16:55:51.395547+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:51.395547+0000","last_undegraded":"2024-09-12T16:55:51.395547+0000","last_fullsized":"2024-09-12T16:55:51.395547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.395218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:23.022360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.277660+0000","last_change":"2024-09-12T16:56:38.277660+0000","last_active":"2024-09-12T16:56:38.277660+0000","last_peered":"2024-09-12T16:56:38.277660+0000","last_clean":"2024-09-12T16:56:38.277660+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:56:38.277660+0000","last_undegraded":"2024-09-12T16:56:38.277660+0000","last_fullsized":"2024-09-12T16:56:38.277660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:38.277489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:38.277489+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.277489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:24.398107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'296","reported_seq":523,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.435580+0000","last_change":"2024-09-12T16:56:31.435580+0000","last_active":"2024-09-12T16:56:31.435580+0000","last_peered":"2024-09-12T16:56:31.435580+0000","last_clean":"2024-09-12T16:56:31.435580+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:56:31.435580+0000","last_undegraded":"2024-09-12T16:56:31.435580+0000","last_fullsized":"2024-09-12T16:56:31.435580+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'296","last_scrub_stamp":"2024-09-12T16:56:31.435371+0000","last_deep_scrub":"34'296","last_deep_scrub_stamp":"2024-09-12T16:56:31.435371+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.435371+0000","objects_scrubbed":10,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:56.722358+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:56.366893+0000","last_change":"2024-09-12T16:56:56.366893+0000","last_active":"2024-09-12T16:56:56.366893+0000","last_peered":"2024-09-12T16:56:56.366893+0000","last_clean":"2024-09-12T16:56:56.366893+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:56:56.366893+0000","last_undegraded":"2024-09-12T16:56:56.366893+0000","last_fullsized":"2024-09-12T16:56:56.366893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:56.366715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:56.366715+0000","last_clean_scrub_stamp":"2024-09-12T16:56:56.366715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:44.954289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:45.534988+0000","last_change":"2024-09-12T16:56:45.534988+0000","last_active":"2024-09-12T16:56:45.534988+0000","last_peered":"2024-09-12T16:56:45.534988+0000","last_clean":"2024-09-12T16:56:45.534988+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:56:45.534988+0000","last_undegraded":"2024-09-12T16:56:45.534988+0000","last_fullsized":"2024-09-12T16:56:45.534988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T16:56:45.534804+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T16:56:45.534804+0000","last_clean_scrub_stamp":"2024-09-12T16:56:45.534804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:01.620213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.416324+0000","last_change":"2024-09-12T16:56:04.416157+0000","last_active":"2024-09-12T16:56:04.416324+0000","last_peered":"2024-09-12T16:56:04.416324+0000","last_clean":"2024-09-12T16:56:04.416324+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:56:04.416324+0000","last_undegraded":"2024-09-12T16:56:04.416324+0000","last_fullsized":"2024-09-12T16:56:04.416324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:04.415977+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:04.415977+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.415977+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:37.104330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.862977+0000","last_change":"2024-09-12T16:55:48.862720+0000","last_active":"2024-09-12T16:55:48.862977+0000","last_peered":"2024-09-12T16:55:48.862977+0000","last_clean":"2024-09-12T16:55:48.862977+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:55:48.862977+0000","last_undegraded":"2024-09-12T16:55:48.862977+0000","last_fullsized":"2024-09-12T16:55:48.862977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.862498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:44.689046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.400482+0000","last_change":"2024-09-12T16:55:48.400348+0000","last_active":"2024-09-12T16:55:48.400482+0000","last_peered":"2024-09-12T16:55:48.400482+0000","last_clean":"2024-09-12T16:55:48.400482+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:55:48.400482+0000","last_undegraded":"2024-09-12T16:55:48.400482+0000","last_fullsized":"2024-09-12T16:55:48.400482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.400137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.977807+0000","last_change":"2024-09-12T16:56:16.977655+0000","last_active":"2024-09-12T16:56:16.977807+0000","last_peered":"2024-09-12T16:56:16.977807+0000","last_clean":"2024-09-12T16:56:16.977807+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:56:16.977807+0000","last_undegraded":"2024-09-12T16:56:16.977807+0000","last_fullsized":"2024-09-12T16:56:16.977807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:16.977493+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:16.977493+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.977493+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.955215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.977261+0000","last_change":"2024-09-12T16:56:23.977261+0000","last_active":"2024-09-12T16:56:23.977261+0000","last_peered":"2024-09-12T16:56:23.977261+0000","last_clean":"2024-09-12T16:56:23.977261+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:56:23.977261+0000","last_undegraded":"2024-09-12T16:56:23.977261+0000","last_fullsized":"2024-09-12T16:56:23.977261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-12T16:56:23.977064+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-12T16:56:23.977064+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.977064+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:21.211807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.304696+0000","last_change":"2024-09-12T16:56:33.304696+0000","last_active":"2024-09-12T16:56:33.304696+0000","last_peered":"2024-09-12T16:56:33.304696+0000","last_clean":"2024-09-12T16:56:33.304696+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:56:33.304696+0000","last_undegraded":"2024-09-12T16:56:33.304696+0000","last_fullsized":"2024-09-12T16:56:33.304696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:33.304516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:33.304516+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.304516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:08.164344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.026464+0000","last_change":"2024-09-12T16:52:06.229164+0000","last_active":"2024-09-12T16:54:21.026464+0000","last_peered":"2024-09-12T16:54:21.026464+0000","last_clean":"2024-09-12T16:54:21.026464+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:54:21.026464+0000","last_undegraded":"2024-09-12T16:54:21.026464+0000","last_fullsized":"2024-09-12T16:54:21.026464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.425100+0000","last_change":"2024-09-12T16:56:03.424942+0000","last_active":"2024-09-12T16:56:03.425100+0000","last_peered":"2024-09-12T16:56:03.425100+0000","last_clean":"2024-09-12T16:56:03.425100+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:56:03.425100+0000","last_undegraded":"2024-09-12T16:56:03.425100+0000","last_fullsized":"2024-09-12T16:56:03.425100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.424770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:52.914259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.245625+0000","last_change":"2024-09-12T16:55:50.245475+0000","last_active":"2024-09-12T16:55:50.245625+0000","last_peered":"2024-09-12T16:55:50.245625+0000","last_clean":"2024-09-12T16:55:50.245625+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:55:50.245625+0000","last_undegraded":"2024-09-12T16:55:50.245625+0000","last_fullsized":"2024-09-12T16:55:50.245625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.245287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:59.801323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.874234+0000","last_change":"2024-09-12T16:55:49.874078+0000","last_active":"2024-09-12T16:55:49.874234+0000","last_peered":"2024-09-12T16:55:49.874234+0000","last_clean":"2024-09-12T16:55:49.874234+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:55:49.874234+0000","last_undegraded":"2024-09-12T16:55:49.874234+0000","last_fullsized":"2024-09-12T16:55:49.874234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.873862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:42.226676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.331395+0000","last_change":"2024-09-12T16:56:17.331395+0000","last_active":"2024-09-12T16:56:17.331395+0000","last_peered":"2024-09-12T16:56:17.331395+0000","last_clean":"2024-09-12T16:56:17.331395+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:56:17.331395+0000","last_undegraded":"2024-09-12T16:56:17.331395+0000","last_fullsized":"2024-09-12T16:56:17.331395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:17.331215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:17.331215+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.331215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:34.713043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:47.273253+0000","last_change":"2024-09-12T16:56:47.273253+0000","last_active":"2024-09-12T16:56:47.273253+0000","last_peered":"2024-09-12T16:56:47.273253+0000","last_clean":"2024-09-12T16:56:47.273253+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:56:47.273253+0000","last_undegraded":"2024-09-12T16:56:47.273253+0000","last_fullsized":"2024-09-12T16:56:47.273253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T16:56:47.273061+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T16:56:47.273061+0000","last_clean_scrub_stamp":"2024-09-12T16:56:47.273061+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:50.975865+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:59.411343+0000","last_change":"2024-09-12T16:56:59.411343+0000","last_active":"2024-09-12T16:56:59.411343+0000","last_peered":"2024-09-12T16:56:59.411343+0000","last_clean":"2024-09-12T16:56:59.411343+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:56:59.411343+0000","last_undegraded":"2024-09-12T16:56:59.411343+0000","last_fullsized":"2024-09-12T16:56:59.411343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:59.411149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:59.411149+0000","last_clean_scrub_stamp":"2024-09-12T16:56:59.411149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:56.367968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:44.503552+0000","last_change":"2024-09-12T16:56:44.503552+0000","last_active":"2024-09-12T16:56:44.503552+0000","last_peered":"2024-09-12T16:56:44.503552+0000","last_clean":"2024-09-12T16:56:44.503552+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:56:44.503552+0000","last_undegraded":"2024-09-12T16:56:44.503552+0000","last_fullsized":"2024-09-12T16:56:44.503552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:44.503362+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:44.503362+0000","last_clean_scrub_stamp":"2024-09-12T16:56:44.503362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:31.767076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.055683+0000","last_change":"2024-09-12T16:56:02.055532+0000","last_active":"2024-09-12T16:56:02.055683+0000","last_peered":"2024-09-12T16:56:02.055683+0000","last_clean":"2024-09-12T16:56:02.055683+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:56:02.055683+0000","last_undegraded":"2024-09-12T16:56:02.055683+0000","last_fullsized":"2024-09-12T16:56:02.055683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.055341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:23.968021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.860193+0000","last_change":"2024-09-12T16:55:50.859970+0000","last_active":"2024-09-12T16:55:50.860193+0000","last_peered":"2024-09-12T16:55:50.860193+0000","last_clean":"2024-09-12T16:55:50.860193+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:55:50.860193+0000","last_undegraded":"2024-09-12T16:55:50.860193+0000","last_fullsized":"2024-09-12T16:55:50.860193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.859731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:21.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.421319+0000","last_change":"2024-09-12T16:55:47.421094+0000","last_active":"2024-09-12T16:55:47.421319+0000","last_peered":"2024-09-12T16:55:47.421319+0000","last_clean":"2024-09-12T16:55:47.421319+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:55:47.421319+0000","last_undegraded":"2024-09-12T16:55:47.421319+0000","last_fullsized":"2024-09-12T16:55:47.421319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.420892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.729401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'7","reported_seq":242,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.362629+0000","last_change":"2024-09-12T16:56:16.362629+0000","last_active":"2024-09-12T16:56:16.362629+0000","last_peered":"2024-09-12T16:56:16.362629+0000","last_clean":"2024-09-12T16:56:16.362629+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:56:16.362629+0000","last_undegraded":"2024-09-12T16:56:16.362629+0000","last_fullsized":"2024-09-12T16:56:16.362629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T16:56:16.362444+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T16:56:16.362444+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.362444+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:59.250843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.396634+0000","last_change":"2024-09-12T16:56:25.396634+0000","last_active":"2024-09-12T16:56:25.396634+0000","last_peered":"2024-09-12T16:56:25.396634+0000","last_clean":"2024-09-12T16:56:25.396634+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:56:25.396634+0000","last_undegraded":"2024-09-12T16:56:25.396634+0000","last_fullsized":"2024-09-12T16:56:25.396634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-12T16:56:25.396434+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-12T16:56:25.396434+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.396434+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:15.354604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.993978+0000","last_change":"2024-09-12T16:56:29.993978+0000","last_active":"2024-09-12T16:56:29.993978+0000","last_peered":"2024-09-12T16:56:29.993978+0000","last_clean":"2024-09-12T16:56:29.993978+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:56:29.993978+0000","last_undegraded":"2024-09-12T16:56:29.993978+0000","last_fullsized":"2024-09-12T16:56:29.993978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:29.993783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:29.993783+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.993783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:34.283216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:46.442460+0000","last_change":"2024-09-12T16:56:46.442460+0000","last_active":"2024-09-12T16:56:46.442460+0000","last_peered":"2024-09-12T16:56:46.442460+0000","last_clean":"2024-09-12T16:56:46.442460+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:56:46.442460+0000","last_undegraded":"2024-09-12T16:56:46.442460+0000","last_fullsized":"2024-09-12T16:56:46.442460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-12T16:56:46.442284+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-12T16:56:46.442284+0000","last_clean_scrub_stamp":"2024-09-12T16:56:46.442284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:47.209656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.051578+0000","last_change":"2024-09-12T16:56:03.051439+0000","last_active":"2024-09-12T16:56:03.051578+0000","last_peered":"2024-09-12T16:56:03.051578+0000","last_clean":"2024-09-12T16:56:03.051578+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:56:03.051578+0000","last_undegraded":"2024-09-12T16:56:03.051578+0000","last_fullsized":"2024-09-12T16:56:03.051578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.051259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.473399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.402509+0000","last_change":"2024-09-12T16:55:50.402377+0000","last_active":"2024-09-12T16:55:50.402509+0000","last_peered":"2024-09-12T16:55:50.402509+0000","last_clean":"2024-09-12T16:55:50.402509+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:50.402509+0000","last_undegraded":"2024-09-12T16:55:50.402509+0000","last_fullsized":"2024-09-12T16:55:50.402509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.402205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:11.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.165501+0000","last_change":"2024-09-12T16:55:52.165355+0000","last_active":"2024-09-12T16:55:52.165501+0000","last_peered":"2024-09-12T16:55:52.165501+0000","last_clean":"2024-09-12T16:55:52.165501+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:55:52.165501+0000","last_undegraded":"2024-09-12T16:55:52.165501+0000","last_fullsized":"2024-09-12T16:55:52.165501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.165177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.307006+0000","last_change":"2024-09-12T16:56:37.307006+0000","last_active":"2024-09-12T16:56:37.307006+0000","last_peered":"2024-09-12T16:56:37.307006+0000","last_clean":"2024-09-12T16:56:37.307006+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:56:37.307006+0000","last_undegraded":"2024-09-12T16:56:37.307006+0000","last_fullsized":"2024-09-12T16:56:37.307006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:37.306800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:37.306800+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.306800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:53.598461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.430435+0000","last_change":"2024-09-12T16:56:30.430435+0000","last_active":"2024-09-12T16:56:30.430435+0000","last_peered":"2024-09-12T16:56:30.430435+0000","last_clean":"2024-09-12T16:56:30.430435+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:56:30.430435+0000","last_undegraded":"2024-09-12T16:56:30.430435+0000","last_fullsized":"2024-09-12T16:56:30.430435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T16:56:30.430136+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T16:56:30.430136+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.430136+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:30.221458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.510437+0000","last_change":"2024-09-12T16:56:36.510437+0000","last_active":"2024-09-12T16:56:36.510437+0000","last_peered":"2024-09-12T16:56:36.510437+0000","last_clean":"2024-09-12T16:56:36.510437+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:56:36.510437+0000","last_undegraded":"2024-09-12T16:56:36.510437+0000","last_fullsized":"2024-09-12T16:56:36.510437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.510254+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.510254+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.510254+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.362597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:21.026831+0000","last_change":"2024-09-12T16:52:06.215010+0000","last_active":"2024-09-12T16:54:21.026831+0000","last_peered":"2024-09-12T16:54:21.026831+0000","last_clean":"2024-09-12T16:54:21.026831+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:54:21.026831+0000","last_undegraded":"2024-09-12T16:54:21.026831+0000","last_fullsized":"2024-09-12T16:54:21.026831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.931993+0000","last_change":"2024-09-12T16:56:07.931844+0000","last_active":"2024-09-12T16:56:07.931993+0000","last_peered":"2024-09-12T16:56:07.931993+0000","last_clean":"2024-09-12T16:56:07.931993+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:56:07.931993+0000","last_undegraded":"2024-09-12T16:56:07.931993+0000","last_fullsized":"2024-09-12T16:56:07.931993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:07.931663+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:07.931663+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.931663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:16.321154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.157073+0000","last_change":"2024-09-12T16:55:55.156907+0000","last_active":"2024-09-12T16:55:55.157073+0000","last_peered":"2024-09-12T16:55:55.157073+0000","last_clean":"2024-09-12T16:55:55.157073+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:55:55.157073+0000","last_undegraded":"2024-09-12T16:55:55.157073+0000","last_fullsized":"2024-09-12T16:55:55.157073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.156716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:37.213650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.363365+0000","last_change":"2024-09-12T16:55:49.363167+0000","last_active":"2024-09-12T16:55:49.363365+0000","last_peered":"2024-09-12T16:55:49.363365+0000","last_clean":"2024-09-12T16:55:49.363365+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:55:49.363365+0000","last_undegraded":"2024-09-12T16:55:49.363365+0000","last_fullsized":"2024-09-12T16:55:49.363365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.362978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:34.316423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.355839+0000","last_change":"2024-09-12T16:56:36.355839+0000","last_active":"2024-09-12T16:56:36.355839+0000","last_peered":"2024-09-12T16:56:36.355839+0000","last_clean":"2024-09-12T16:56:36.355839+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:56:36.355839+0000","last_undegraded":"2024-09-12T16:56:36.355839+0000","last_fullsized":"2024-09-12T16:56:36.355839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:36.355657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:36.355657+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.355657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:06.072501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:44.224036+0000","last_change":"2024-09-12T16:56:44.224036+0000","last_active":"2024-09-12T16:56:44.224036+0000","last_peered":"2024-09-12T16:56:44.224036+0000","last_clean":"2024-09-12T16:56:44.224036+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:56:44.224036+0000","last_undegraded":"2024-09-12T16:56:44.224036+0000","last_fullsized":"2024-09-12T16:56:44.224036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:44.223806+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:44.223806+0000","last_clean_scrub_stamp":"2024-09-12T16:56:44.223806+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:26.413717+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.243543+0000","last_change":"2024-09-12T16:56:31.243543+0000","last_active":"2024-09-12T16:56:31.243543+0000","last_peered":"2024-09-12T16:56:31.243543+0000","last_clean":"2024-09-12T16:56:31.243543+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:56:31.243543+0000","last_undegraded":"2024-09-12T16:56:31.243543+0000","last_fullsized":"2024-09-12T16:56:31.243543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:31.243326+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:31.243326+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.243326+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:55.174015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:46.571321+0000","last_change":"2024-09-12T16:56:46.571321+0000","last_active":"2024-09-12T16:56:46.571321+0000","last_peered":"2024-09-12T16:56:46.571321+0000","last_clean":"2024-09-12T16:56:46.571321+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:56:46.571321+0000","last_undegraded":"2024-09-12T16:56:46.571321+0000","last_fullsized":"2024-09-12T16:56:46.571321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T16:56:46.571141+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T16:56:46.571141+0000","last_clean_scrub_stamp":"2024-09-12T16:56:46.571141+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:33.038093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.012997+0000","last_change":"2024-09-12T16:56:01.012738+0000","last_active":"2024-09-12T16:56:01.012997+0000","last_peered":"2024-09-12T16:56:01.012997+0000","last_clean":"2024-09-12T16:56:01.012997+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:56:01.012997+0000","last_undegraded":"2024-09-12T16:56:01.012997+0000","last_fullsized":"2024-09-12T16:56:01.012997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.012476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.560043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.913060+0000","last_change":"2024-09-12T16:55:48.912884+0000","last_active":"2024-09-12T16:55:48.913060+0000","last_peered":"2024-09-12T16:55:48.913060+0000","last_clean":"2024-09-12T16:55:48.913060+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:48.913060+0000","last_undegraded":"2024-09-12T16:55:48.913060+0000","last_fullsized":"2024-09-12T16:55:48.913060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.912682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:36.759579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.203291+0000","last_change":"2024-09-12T16:55:53.203060+0000","last_active":"2024-09-12T16:55:53.203291+0000","last_peered":"2024-09-12T16:55:53.203291+0000","last_clean":"2024-09-12T16:55:53.203291+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:55:53.203291+0000","last_undegraded":"2024-09-12T16:55:53.203291+0000","last_fullsized":"2024-09-12T16:55:53.203291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.202860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:18.010245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.385039+0000","last_change":"2024-09-12T16:56:35.385039+0000","last_active":"2024-09-12T16:56:35.385039+0000","last_peered":"2024-09-12T16:56:35.385039+0000","last_clean":"2024-09-12T16:56:35.385039+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:56:35.385039+0000","last_undegraded":"2024-09-12T16:56:35.385039+0000","last_fullsized":"2024-09-12T16:56:35.385039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.384859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.384859+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.384859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.732353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'99","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.022342+0000","last_change":"2024-09-12T16:56:23.022342+0000","last_active":"2024-09-12T16:56:23.022342+0000","last_peered":"2024-09-12T16:56:23.022342+0000","last_clean":"2024-09-12T16:56:23.022342+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:56:23.022342+0000","last_undegraded":"2024-09-12T16:56:23.022342+0000","last_fullsized":"2024-09-12T16:56:23.022342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'99","last_scrub_stamp":"2024-09-12T16:56:23.022095+0000","last_deep_scrub":"34'99","last_deep_scrub_stamp":"2024-09-12T16:56:23.022095+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.022095+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:37.853754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.265791+0000","last_change":"2024-09-12T16:56:32.265791+0000","last_active":"2024-09-12T16:56:32.265791+0000","last_peered":"2024-09-12T16:56:32.265791+0000","last_clean":"2024-09-12T16:56:32.265791+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:56:32.265791+0000","last_undegraded":"2024-09-12T16:56:32.265791+0000","last_fullsized":"2024-09-12T16:56:32.265791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:32.265577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:32.265577+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.265577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:52.104440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.073334+0000","last_change":"2024-09-12T16:56:40.073334+0000","last_active":"2024-09-12T16:56:40.073334+0000","last_peered":"2024-09-12T16:56:40.073334+0000","last_clean":"2024-09-12T16:56:40.073334+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:56:40.073334+0000","last_undegraded":"2024-09-12T16:56:40.073334+0000","last_fullsized":"2024-09-12T16:56:40.073334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.073152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.073152+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.073152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:40.350196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.052871+0000","last_change":"2024-09-12T16:56:42.052871+0000","last_active":"2024-09-12T16:56:42.052871+0000","last_peered":"2024-09-12T16:56:42.052871+0000","last_clean":"2024-09-12T16:56:42.052871+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:56:42.052871+0000","last_undegraded":"2024-09-12T16:56:42.052871+0000","last_fullsized":"2024-09-12T16:56:42.052871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:42.052687+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:42.052687+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.052687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:08.274004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.951793+0000","last_change":"2024-09-12T16:56:08.951658+0000","last_active":"2024-09-12T16:56:08.951793+0000","last_peered":"2024-09-12T16:56:08.951793+0000","last_clean":"2024-09-12T16:56:08.951793+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:56:08.951793+0000","last_undegraded":"2024-09-12T16:56:08.951793+0000","last_fullsized":"2024-09-12T16:56:08.951793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:08.951469+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:08.951469+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.951469+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:13.785426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.017328+0000","last_change":"2024-09-12T16:56:03.017156+0000","last_active":"2024-09-12T16:56:03.017328+0000","last_peered":"2024-09-12T16:56:03.017328+0000","last_clean":"2024-09-12T16:56:03.017328+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:56:03.017328+0000","last_undegraded":"2024-09-12T16:56:03.017328+0000","last_fullsized":"2024-09-12T16:56:03.017328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.016945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:49.483897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.339227+0000","last_change":"2024-09-12T16:56:24.339081+0000","last_active":"2024-09-12T16:56:24.339227+0000","last_peered":"2024-09-12T16:56:24.339227+0000","last_clean":"2024-09-12T16:56:24.339227+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:56:24.339227+0000","last_undegraded":"2024-09-12T16:56:24.339227+0000","last_fullsized":"2024-09-12T16:56:24.339227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:24.338899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:24.338899+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.338899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:22.081195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:52.329349+0000","last_change":"2024-09-12T16:56:52.329349+0000","last_active":"2024-09-12T16:56:52.329349+0000","last_peered":"2024-09-12T16:56:52.329349+0000","last_clean":"2024-09-12T16:56:52.329349+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:56:52.329349+0000","last_undegraded":"2024-09-12T16:56:52.329349+0000","last_fullsized":"2024-09-12T16:56:52.329349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T16:56:52.329138+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T16:56:52.329138+0000","last_clean_scrub_stamp":"2024-09-12T16:56:52.329138+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:37.965766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:58.364848+0000","last_change":"2024-09-12T16:56:58.364848+0000","last_active":"2024-09-12T16:56:58.364848+0000","last_peered":"2024-09-12T16:56:58.364848+0000","last_clean":"2024-09-12T16:56:58.364848+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:56:58.364848+0000","last_undegraded":"2024-09-12T16:56:58.364848+0000","last_fullsized":"2024-09-12T16:56:58.364848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:58.364669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:58.364669+0000","last_clean_scrub_stamp":"2024-09-12T16:56:58.364669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:58.010538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:50.392251+0000","last_change":"2024-09-12T16:56:50.392251+0000","last_active":"2024-09-12T16:56:50.392251+0000","last_peered":"2024-09-12T16:56:50.392251+0000","last_clean":"2024-09-12T16:56:50.392251+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:56:50.392251+0000","last_undegraded":"2024-09-12T16:56:50.392251+0000","last_fullsized":"2024-09-12T16:56:50.392251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:50.392063+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:50.392063+0000","last_clean_scrub_stamp":"2024-09-12T16:56:50.392063+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:34.077035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'28","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.066320+0000","last_change":"2024-09-12T16:56:07.066153+0000","last_active":"2024-09-12T16:56:07.066320+0000","last_peered":"2024-09-12T16:56:07.066320+0000","last_clean":"2024-09-12T16:56:07.066320+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:07.066320+0000","last_undegraded":"2024-09-12T16:56:07.066320+0000","last_fullsized":"2024-09-12T16:56:07.066320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-12T16:56:07.065953+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-12T16:56:07.065953+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.065953+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:47.680595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.910089+0000","last_change":"2024-09-12T16:55:52.909961+0000","last_active":"2024-09-12T16:55:52.910089+0000","last_peered":"2024-09-12T16:55:52.910089+0000","last_clean":"2024-09-12T16:55:52.910089+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:55:52.910089+0000","last_undegraded":"2024-09-12T16:55:52.910089+0000","last_fullsized":"2024-09-12T16:55:52.910089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.909777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:08.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.258683+0000","last_change":"2024-09-12T16:56:41.258683+0000","last_active":"2024-09-12T16:56:41.258683+0000","last_peered":"2024-09-12T16:56:41.258683+0000","last_clean":"2024-09-12T16:56:41.258683+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:56:41.258683+0000","last_undegraded":"2024-09-12T16:56:41.258683+0000","last_fullsized":"2024-09-12T16:56:41.258683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.258497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.258497+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.258497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:58.919770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.380532+0000","last_change":"2024-09-12T16:56:26.380375+0000","last_active":"2024-09-12T16:56:26.380532+0000","last_peered":"2024-09-12T16:56:26.380532+0000","last_clean":"2024-09-12T16:56:26.380532+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:56:26.380532+0000","last_undegraded":"2024-09-12T16:56:26.380532+0000","last_fullsized":"2024-09-12T16:56:26.380532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:26.380124+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:26.380124+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.380124+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:39.927808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.024043+0000","last_change":"2024-09-12T16:56:34.023907+0000","last_active":"2024-09-12T16:56:34.024043+0000","last_peered":"2024-09-12T16:56:34.024043+0000","last_clean":"2024-09-12T16:56:34.024043+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:56:34.024043+0000","last_undegraded":"2024-09-12T16:56:34.024043+0000","last_fullsized":"2024-09-12T16:56:34.024043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:34.023724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:34.023724+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.023724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:13.216005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:49.410253+0000","last_change":"2024-09-12T16:56:49.410016+0000","last_active":"2024-09-12T16:56:49.410253+0000","last_peered":"2024-09-12T16:56:49.410253+0000","last_clean":"2024-09-12T16:56:49.410253+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:56:49.410253+0000","last_undegraded":"2024-09-12T16:56:49.410253+0000","last_fullsized":"2024-09-12T16:56:49.410253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:49.409804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:49.409804+0000","last_clean_scrub_stamp":"2024-09-12T16:56:49.409804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:56.501617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.390725+0000","last_change":"2024-09-12T16:56:06.390574+0000","last_active":"2024-09-12T16:56:06.390725+0000","last_peered":"2024-09-12T16:56:06.390725+0000","last_clean":"2024-09-12T16:56:06.390725+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:56:06.390725+0000","last_undegraded":"2024-09-12T16:56:06.390725+0000","last_fullsized":"2024-09-12T16:56:06.390725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.390389+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.390389+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.390389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:52.854862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.924715+0000","last_change":"2024-09-12T16:55:55.924579+0000","last_active":"2024-09-12T16:55:55.924715+0000","last_peered":"2024-09-12T16:55:55.924715+0000","last_clean":"2024-09-12T16:55:55.924715+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:55:55.924715+0000","last_undegraded":"2024-09-12T16:55:55.924715+0000","last_fullsized":"2024-09-12T16:55:55.924715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.924395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.042073+0000","last_change":"2024-09-12T16:56:19.041934+0000","last_active":"2024-09-12T16:56:19.042073+0000","last_peered":"2024-09-12T16:56:19.042073+0000","last_clean":"2024-09-12T16:56:19.042073+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:56:19.042073+0000","last_undegraded":"2024-09-12T16:56:19.042073+0000","last_fullsized":"2024-09-12T16:56:19.042073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:19.041752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:19.041752+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.041752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:05.426092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.277112+0000","last_change":"2024-09-12T16:56:29.276893+0000","last_active":"2024-09-12T16:56:29.277112+0000","last_peered":"2024-09-12T16:56:29.277112+0000","last_clean":"2024-09-12T16:56:29.277112+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:56:29.277112+0000","last_undegraded":"2024-09-12T16:56:29.277112+0000","last_fullsized":"2024-09-12T16:56:29.277112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T16:56:29.276611+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T16:56:29.276611+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.276611+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:38.113558+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.564390+0000","last_change":"2024-09-12T16:56:38.564242+0000","last_active":"2024-09-12T16:56:38.564390+0000","last_peered":"2024-09-12T16:56:38.564390+0000","last_clean":"2024-09-12T16:56:38.564390+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:56:38.564390+0000","last_undegraded":"2024-09-12T16:56:38.564390+0000","last_fullsized":"2024-09-12T16:56:38.564390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:38.564057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:38.564057+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.564057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.113739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:36.031214+0000","last_change":"2024-09-12T16:52:06.236861+0000","last_active":"2024-09-12T16:54:36.031214+0000","last_peered":"2024-09-12T16:54:36.031214+0000","last_clean":"2024-09-12T16:54:36.031214+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:54:36.031214+0000","last_undegraded":"2024-09-12T16:54:36.031214+0000","last_fullsized":"2024-09-12T16:54:36.031214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.076128+0000","last_change":"2024-09-12T16:56:21.075950+0000","last_active":"2024-09-12T16:56:21.076128+0000","last_peered":"2024-09-12T16:56:21.076128+0000","last_clean":"2024-09-12T16:56:21.076128+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:56:21.076128+0000","last_undegraded":"2024-09-12T16:56:21.076128+0000","last_fullsized":"2024-09-12T16:56:21.076128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:21.075769+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:21.075769+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.075769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.894857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.912533+0000","last_change":"2024-09-12T16:55:50.912389+0000","last_active":"2024-09-12T16:55:50.912533+0000","last_peered":"2024-09-12T16:55:50.912533+0000","last_clean":"2024-09-12T16:55:50.912533+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:55:50.912533+0000","last_undegraded":"2024-09-12T16:55:50.912533+0000","last_fullsized":"2024-09-12T16:55:50.912533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.912183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:49.304999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.255997+0000","last_change":"2024-09-12T16:56:40.255860+0000","last_active":"2024-09-12T16:56:40.255997+0000","last_peered":"2024-09-12T16:56:40.255997+0000","last_clean":"2024-09-12T16:56:40.255997+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:56:40.255997+0000","last_undegraded":"2024-09-12T16:56:40.255997+0000","last_fullsized":"2024-09-12T16:56:40.255997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.255676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.255676+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.255676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:51.456310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.035064+0000","last_change":"2024-09-12T16:56:27.034927+0000","last_active":"2024-09-12T16:56:27.035064+0000","last_peered":"2024-09-12T16:56:27.035064+0000","last_clean":"2024-09-12T16:56:27.035064+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:56:27.035064+0000","last_undegraded":"2024-09-12T16:56:27.035064+0000","last_fullsized":"2024-09-12T16:56:27.035064+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:27.034727+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:27.034727+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.034727+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:37.482595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.001174+0000","last_change":"2024-09-12T16:56:33.000950+0000","last_active":"2024-09-12T16:56:33.001174+0000","last_peered":"2024-09-12T16:56:33.001174+0000","last_clean":"2024-09-12T16:56:33.001174+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:56:33.001174+0000","last_undegraded":"2024-09-12T16:56:33.001174+0000","last_fullsized":"2024-09-12T16:56:33.001174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:33.000688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:33.000688+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.000688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:33.437607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.140138+0000","last_change":"2024-09-12T16:56:26.140138+0000","last_active":"2024-09-12T16:56:26.140138+0000","last_peered":"2024-09-12T16:56:26.140138+0000","last_clean":"2024-09-12T16:56:26.140138+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:56:26.140138+0000","last_undegraded":"2024-09-12T16:56:26.140138+0000","last_fullsized":"2024-09-12T16:56:26.140138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:26.139956+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:26.139956+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.139956+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:20.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.984694+0000","last_change":"2024-09-12T16:56:03.984556+0000","last_active":"2024-09-12T16:56:03.984694+0000","last_peered":"2024-09-12T16:56:03.984694+0000","last_clean":"2024-09-12T16:56:03.984694+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:56:03.984694+0000","last_undegraded":"2024-09-12T16:56:03.984694+0000","last_fullsized":"2024-09-12T16:56:03.984694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.984372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:57.918312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.361837+0000","last_change":"2024-09-12T16:56:24.361837+0000","last_active":"2024-09-12T16:56:24.361837+0000","last_peered":"2024-09-12T16:56:24.361837+0000","last_clean":"2024-09-12T16:56:24.361837+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:56:24.361837+0000","last_undegraded":"2024-09-12T16:56:24.361837+0000","last_fullsized":"2024-09-12T16:56:24.361837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:24.361658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:24.361658+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.361658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:46.577163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":141,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.336833+0000","last_change":"2024-09-12T16:56:27.336690+0000","last_active":"2024-09-12T16:56:27.336833+0000","last_peered":"2024-09-12T16:56:27.336833+0000","last_clean":"2024-09-12T16:56:27.336833+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:56:27.336833+0000","last_undegraded":"2024-09-12T16:56:27.336833+0000","last_fullsized":"2024-09-12T16:56:27.336833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-12T16:56:27.336501+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-12T16:56:27.336501+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.336501+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:09.229151+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.048187+0000","last_change":"2024-09-12T16:56:35.048187+0000","last_active":"2024-09-12T16:56:35.048187+0000","last_peered":"2024-09-12T16:56:35.048187+0000","last_clean":"2024-09-12T16:56:35.048187+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:56:35.048187+0000","last_undegraded":"2024-09-12T16:56:35.048187+0000","last_fullsized":"2024-09-12T16:56:35.048187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.047935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.047935+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.047935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:45.923390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:48.407217+0000","last_change":"2024-09-12T16:56:48.407070+0000","last_active":"2024-09-12T16:56:48.407217+0000","last_peered":"2024-09-12T16:56:48.407217+0000","last_clean":"2024-09-12T16:56:48.407217+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:56:48.407217+0000","last_undegraded":"2024-09-12T16:56:48.407217+0000","last_fullsized":"2024-09-12T16:56:48.407217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:48.406885+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:48.406885+0000","last_clean_scrub_stamp":"2024-09-12T16:56:48.406885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.820825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.377076+0000","last_change":"2024-09-12T16:56:08.377076+0000","last_active":"2024-09-12T16:56:08.377076+0000","last_peered":"2024-09-12T16:56:08.377076+0000","last_clean":"2024-09-12T16:56:08.377076+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:56:08.377076+0000","last_undegraded":"2024-09-12T16:56:08.377076+0000","last_fullsized":"2024-09-12T16:56:08.377076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:08.376890+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:08.376890+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.376890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:31.874130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.952068+0000","last_change":"2024-09-12T16:55:51.951922+0000","last_active":"2024-09-12T16:55:51.952068+0000","last_peered":"2024-09-12T16:55:51.952068+0000","last_clean":"2024-09-12T16:55:51.952068+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:51.952068+0000","last_undegraded":"2024-09-12T16:55:51.952068+0000","last_fullsized":"2024-09-12T16:55:51.952068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.951717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.140563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.014305+0000","last_change":"2024-09-12T16:56:22.014305+0000","last_active":"2024-09-12T16:56:22.014305+0000","last_peered":"2024-09-12T16:56:22.014305+0000","last_clean":"2024-09-12T16:56:22.014305+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:56:22.014305+0000","last_undegraded":"2024-09-12T16:56:22.014305+0000","last_fullsized":"2024-09-12T16:56:22.014305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.014069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.014069+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.014069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:56.910230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:54.392515+0000","last_change":"2024-09-12T16:56:54.392367+0000","last_active":"2024-09-12T16:56:54.392515+0000","last_peered":"2024-09-12T16:56:54.392515+0000","last_clean":"2024-09-12T16:56:54.392515+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:56:54.392515+0000","last_undegraded":"2024-09-12T16:56:54.392515+0000","last_fullsized":"2024-09-12T16:56:54.392515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T16:56:54.392165+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T16:56:54.392165+0000","last_clean_scrub_stamp":"2024-09-12T16:56:54.392165+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:12.306772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.502642+0000","last_change":"2024-09-12T16:56:40.502512+0000","last_active":"2024-09-12T16:56:40.502642+0000","last_peered":"2024-09-12T16:56:40.502642+0000","last_clean":"2024-09-12T16:56:40.502642+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:56:40.502642+0000","last_undegraded":"2024-09-12T16:56:40.502642+0000","last_fullsized":"2024-09-12T16:56:40.502642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.502328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.502328+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.502328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:48.888476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.028021+0000","last_change":"2024-09-12T16:52:06.224892+0000","last_active":"2024-09-12T16:54:26.028021+0000","last_peered":"2024-09-12T16:54:26.028021+0000","last_clean":"2024-09-12T16:54:26.028021+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:54:26.028021+0000","last_undegraded":"2024-09-12T16:54:26.028021+0000","last_fullsized":"2024-09-12T16:54:26.028021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.121223+0000","last_change":"2024-09-12T16:56:27.121052+0000","last_active":"2024-09-12T16:56:27.121223+0000","last_peered":"2024-09-12T16:56:27.121223+0000","last_clean":"2024-09-12T16:56:27.121223+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:56:27.121223+0000","last_undegraded":"2024-09-12T16:56:27.121223+0000","last_fullsized":"2024-09-12T16:56:27.121223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-12T16:56:27.120876+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-12T16:56:27.120876+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.120876+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:07.769135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.903588+0000","last_change":"2024-09-12T16:55:52.903403+0000","last_active":"2024-09-12T16:55:52.903588+0000","last_peered":"2024-09-12T16:55:52.903588+0000","last_clean":"2024-09-12T16:55:52.903588+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:55:52.903588+0000","last_undegraded":"2024-09-12T16:55:52.903588+0000","last_fullsized":"2024-09-12T16:55:52.903588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.903212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.981074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.058002+0000","last_change":"2024-09-12T16:56:21.057858+0000","last_active":"2024-09-12T16:56:21.058002+0000","last_peered":"2024-09-12T16:56:21.058002+0000","last_clean":"2024-09-12T16:56:21.058002+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:56:21.058002+0000","last_undegraded":"2024-09-12T16:56:21.058002+0000","last_fullsized":"2024-09-12T16:56:21.058002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:21.057647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:21.057647+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.057647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:19.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.256774+0000","last_change":"2024-09-12T16:56:30.256774+0000","last_active":"2024-09-12T16:56:30.256774+0000","last_peered":"2024-09-12T16:56:30.256774+0000","last_clean":"2024-09-12T16:56:30.256774+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:56:30.256774+0000","last_undegraded":"2024-09-12T16:56:30.256774+0000","last_fullsized":"2024-09-12T16:56:30.256774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T16:56:30.256585+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T16:56:30.256585+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.256585+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:29.647414+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.456090+0000","last_change":"2024-09-12T16:56:41.456090+0000","last_active":"2024-09-12T16:56:41.456090+0000","last_peered":"2024-09-12T16:56:41.456090+0000","last_clean":"2024-09-12T16:56:41.456090+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:56:41.456090+0000","last_undegraded":"2024-09-12T16:56:41.456090+0000","last_fullsized":"2024-09-12T16:56:41.456090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.455878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.455878+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.455878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:36.502621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:05.444004+0000","last_change":"2024-09-12T16:57:05.444004+0000","last_active":"2024-09-12T16:57:05.444004+0000","last_peered":"2024-09-12T16:57:05.444004+0000","last_clean":"2024-09-12T16:57:05.444004+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:57:05.444004+0000","last_undegraded":"2024-09-12T16:57:05.444004+0000","last_fullsized":"2024-09-12T16:57:05.444004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T16:57:05.443833+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T16:57:05.443833+0000","last_clean_scrub_stamp":"2024-09-12T16:57:05.443833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:00.412257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.425872+0000","last_change":"2024-09-12T16:56:07.425701+0000","last_active":"2024-09-12T16:56:07.425872+0000","last_peered":"2024-09-12T16:56:07.425872+0000","last_clean":"2024-09-12T16:56:07.425872+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:56:07.425872+0000","last_undegraded":"2024-09-12T16:56:07.425872+0000","last_fullsized":"2024-09-12T16:56:07.425872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:07.425524+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:07.425524+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.425524+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:11.714958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.026138+0000","last_change":"2024-09-12T16:56:06.025971+0000","last_active":"2024-09-12T16:56:06.026138+0000","last_peered":"2024-09-12T16:56:06.026138+0000","last_clean":"2024-09-12T16:56:06.026138+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:56:06.026138+0000","last_undegraded":"2024-09-12T16:56:06.026138+0000","last_fullsized":"2024-09-12T16:56:06.026138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.025789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:12.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.444267+0000","last_change":"2024-09-12T16:56:28.444127+0000","last_active":"2024-09-12T16:56:28.444267+0000","last_peered":"2024-09-12T16:56:28.444267+0000","last_clean":"2024-09-12T16:56:28.444267+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:56:28.444267+0000","last_undegraded":"2024-09-12T16:56:28.444267+0000","last_fullsized":"2024-09-12T16:56:28.444267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:28.443940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:28.443940+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.443940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:00.880623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:57.334551+0000","last_change":"2024-09-12T16:56:57.334551+0000","last_active":"2024-09-12T16:56:57.334551+0000","last_peered":"2024-09-12T16:56:57.334551+0000","last_clean":"2024-09-12T16:56:57.334551+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:56:57.334551+0000","last_undegraded":"2024-09-12T16:56:57.334551+0000","last_fullsized":"2024-09-12T16:56:57.334551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:57.334357+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:57.334357+0000","last_clean_scrub_stamp":"2024-09-12T16:56:57.334357+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:53.390858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.065485+0000","last_change":"2024-09-12T16:56:36.065485+0000","last_active":"2024-09-12T16:56:36.065485+0000","last_peered":"2024-09-12T16:56:36.065485+0000","last_clean":"2024-09-12T16:56:36.065485+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:56:36.065485+0000","last_undegraded":"2024-09-12T16:56:36.065485+0000","last_fullsized":"2024-09-12T16:56:36.065485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.065307+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.065307+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.065307+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.905037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.027809+0000","last_change":"2024-09-12T16:52:06.232237+0000","last_active":"2024-09-12T16:54:26.027809+0000","last_peered":"2024-09-12T16:54:26.027809+0000","last_clean":"2024-09-12T16:54:26.027809+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:54:26.027809+0000","last_undegraded":"2024-09-12T16:54:26.027809+0000","last_fullsized":"2024-09-12T16:54:26.027809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.928200+0000","last_change":"2024-09-12T16:56:11.928072+0000","last_active":"2024-09-12T16:56:11.928200+0000","last_peered":"2024-09-12T16:56:11.928200+0000","last_clean":"2024-09-12T16:56:11.928200+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:56:11.928200+0000","last_undegraded":"2024-09-12T16:56:11.928200+0000","last_fullsized":"2024-09-12T16:56:11.928200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T16:56:11.927896+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T16:56:11.927896+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.927896+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:56.881341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.904845+0000","last_change":"2024-09-12T16:55:54.904704+0000","last_active":"2024-09-12T16:55:54.904845+0000","last_peered":"2024-09-12T16:55:54.904845+0000","last_clean":"2024-09-12T16:55:54.904845+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:55:54.904845+0000","last_undegraded":"2024-09-12T16:55:54.904845+0000","last_fullsized":"2024-09-12T16:55:54.904845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.302723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.410597+0000","last_change":"2024-09-12T16:56:29.410461+0000","last_active":"2024-09-12T16:56:29.410597+0000","last_peered":"2024-09-12T16:56:29.410597+0000","last_clean":"2024-09-12T16:56:29.410597+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:56:29.410597+0000","last_undegraded":"2024-09-12T16:56:29.410597+0000","last_fullsized":"2024-09-12T16:56:29.410597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:29.410268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:29.410268+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.410268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:13.860974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.509454+0000","last_change":"2024-09-12T16:56:35.509302+0000","last_active":"2024-09-12T16:56:35.509454+0000","last_peered":"2024-09-12T16:56:35.509454+0000","last_clean":"2024-09-12T16:56:35.509454+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:56:35.509454+0000","last_undegraded":"2024-09-12T16:56:35.509454+0000","last_fullsized":"2024-09-12T16:56:35.509454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T16:56:35.509101+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T16:56:35.509101+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.509101+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:54.351053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.377966+0000","last_change":"2024-09-12T16:56:39.377845+0000","last_active":"2024-09-12T16:56:39.377966+0000","last_peered":"2024-09-12T16:56:39.377966+0000","last_clean":"2024-09-12T16:56:39.377966+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:56:39.377966+0000","last_undegraded":"2024-09-12T16:56:39.377966+0000","last_fullsized":"2024-09-12T16:56:39.377966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.377663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.377663+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.377663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:57.967135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:47.538116+0000","last_change":"2024-09-12T16:56:47.537884+0000","last_active":"2024-09-12T16:56:47.538116+0000","last_peered":"2024-09-12T16:56:47.538116+0000","last_clean":"2024-09-12T16:56:47.538116+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:56:47.538116+0000","last_undegraded":"2024-09-12T16:56:47.538116+0000","last_fullsized":"2024-09-12T16:56:47.538116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:47.537669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:47.537669+0000","last_clean_scrub_stamp":"2024-09-12T16:56:47.537669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:41.471609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.965417+0000","last_change":"2024-09-12T16:56:10.965285+0000","last_active":"2024-09-12T16:56:10.965417+0000","last_peered":"2024-09-12T16:56:10.965417+0000","last_clean":"2024-09-12T16:56:10.965417+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:56:10.965417+0000","last_undegraded":"2024-09-12T16:56:10.965417+0000","last_fullsized":"2024-09-12T16:56:10.965417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:10.965111+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:10.965111+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.965111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:11.089393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.994635+0000","last_change":"2024-09-12T16:56:04.994386+0000","last_active":"2024-09-12T16:56:04.994635+0000","last_peered":"2024-09-12T16:56:04.994635+0000","last_clean":"2024-09-12T16:56:04.994635+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:56:04.994635+0000","last_undegraded":"2024-09-12T16:56:04.994635+0000","last_fullsized":"2024-09-12T16:56:04.994635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.994131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:46.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.010466+0000","last_change":"2024-09-12T16:56:20.010216+0000","last_active":"2024-09-12T16:56:20.010466+0000","last_peered":"2024-09-12T16:56:20.010466+0000","last_clean":"2024-09-12T16:56:20.010466+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:56:20.010466+0000","last_undegraded":"2024-09-12T16:56:20.010466+0000","last_fullsized":"2024-09-12T16:56:20.010466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:20.009949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:20.009949+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.009949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:39.317042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.292694+0000","last_change":"2024-09-12T16:56:28.292551+0000","last_active":"2024-09-12T16:56:28.292694+0000","last_peered":"2024-09-12T16:56:28.292694+0000","last_clean":"2024-09-12T16:56:28.292694+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:56:28.292694+0000","last_undegraded":"2024-09-12T16:56:28.292694+0000","last_fullsized":"2024-09-12T16:56:28.292694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-12T16:56:28.292356+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-12T16:56:28.292356+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.292356+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:16.221439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:01.418470+0000","last_change":"2024-09-12T16:57:01.418470+0000","last_active":"2024-09-12T16:57:01.418470+0000","last_peered":"2024-09-12T16:57:01.418470+0000","last_clean":"2024-09-12T16:57:01.418470+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:57:01.418470+0000","last_undegraded":"2024-09-12T16:57:01.418470+0000","last_fullsized":"2024-09-12T16:57:01.418470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:01.418286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:01.418286+0000","last_clean_scrub_stamp":"2024-09-12T16:57:01.418286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:51.252332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:31.029910+0000","last_change":"2024-09-12T16:52:06.237385+0000","last_active":"2024-09-12T16:54:31.029910+0000","last_peered":"2024-09-12T16:54:31.029910+0000","last_clean":"2024-09-12T16:54:31.029910+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:54:31.029910+0000","last_undegraded":"2024-09-12T16:54:31.029910+0000","last_fullsized":"2024-09-12T16:54:31.029910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.126200+0000","last_change":"2024-09-12T16:56:25.126036+0000","last_active":"2024-09-12T16:56:25.126200+0000","last_peered":"2024-09-12T16:56:25.126200+0000","last_clean":"2024-09-12T16:56:25.126200+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:56:25.126200+0000","last_undegraded":"2024-09-12T16:56:25.126200+0000","last_fullsized":"2024-09-12T16:56:25.126200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:25.125828+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:25.125828+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.125828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:17.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.393326+0000","last_change":"2024-09-12T16:55:53.393160+0000","last_active":"2024-09-12T16:55:53.393326+0000","last_peered":"2024-09-12T16:55:53.393326+0000","last_clean":"2024-09-12T16:55:53.393326+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:55:53.393326+0000","last_undegraded":"2024-09-12T16:55:53.393326+0000","last_fullsized":"2024-09-12T16:55:53.393326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.392972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.910111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.363034+0000","last_change":"2024-09-12T16:56:25.362805+0000","last_active":"2024-09-12T16:56:25.363034+0000","last_peered":"2024-09-12T16:56:25.363034+0000","last_clean":"2024-09-12T16:56:25.363034+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:56:25.363034+0000","last_undegraded":"2024-09-12T16:56:25.363034+0000","last_fullsized":"2024-09-12T16:56:25.363034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:25.362579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:25.362579+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.362579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:35.190759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:55.413603+0000","last_change":"2024-09-12T16:56:55.413461+0000","last_active":"2024-09-12T16:56:55.413603+0000","last_peered":"2024-09-12T16:56:55.413603+0000","last_clean":"2024-09-12T16:56:55.413603+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:56:55.413603+0000","last_undegraded":"2024-09-12T16:56:55.413603+0000","last_fullsized":"2024-09-12T16:56:55.413603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'32","last_scrub_stamp":"2024-09-12T16:56:55.413257+0000","last_deep_scrub":"34'32","last_deep_scrub_stamp":"2024-09-12T16:56:55.413257+0000","last_clean_scrub_stamp":"2024-09-12T16:56:55.413257+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:17.807492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:02.449660+0000","last_change":"2024-09-12T16:57:02.449405+0000","last_active":"2024-09-12T16:57:02.449660+0000","last_peered":"2024-09-12T16:57:02.449660+0000","last_clean":"2024-09-12T16:57:02.449660+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:57:02.449660+0000","last_undegraded":"2024-09-12T16:57:02.449660+0000","last_fullsized":"2024-09-12T16:57:02.449660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:02.449199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:02.449199+0000","last_clean_scrub_stamp":"2024-09-12T16:57:02.449199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:13.905834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:31.029693+0000","last_change":"2024-09-12T16:52:06.234752+0000","last_active":"2024-09-12T16:54:31.029693+0000","last_peered":"2024-09-12T16:54:31.029693+0000","last_clean":"2024-09-12T16:54:31.029693+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:54:31.029693+0000","last_undegraded":"2024-09-12T16:54:31.029693+0000","last_fullsized":"2024-09-12T16:54:31.029693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.950854+0000","last_change":"2024-09-12T16:56:09.950692+0000","last_active":"2024-09-12T16:56:09.950854+0000","last_peered":"2024-09-12T16:56:09.950854+0000","last_clean":"2024-09-12T16:56:09.950854+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:56:09.950854+0000","last_undegraded":"2024-09-12T16:56:09.950854+0000","last_fullsized":"2024-09-12T16:56:09.950854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:09.950480+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:09.950480+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.950480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:09.258989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.860201+0000","last_change":"2024-09-12T16:55:53.860045+0000","last_active":"2024-09-12T16:55:53.860201+0000","last_peered":"2024-09-12T16:55:53.860201+0000","last_clean":"2024-09-12T16:55:53.860201+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:53.860201+0000","last_undegraded":"2024-09-12T16:55:53.860201+0000","last_fullsized":"2024-09-12T16:55:53.860201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.859853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:42.401708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.407283+0000","last_change":"2024-09-12T16:56:27.407033+0000","last_active":"2024-09-12T16:56:27.407283+0000","last_peered":"2024-09-12T16:56:27.407283+0000","last_clean":"2024-09-12T16:56:27.407283+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:56:27.407283+0000","last_undegraded":"2024-09-12T16:56:27.407283+0000","last_fullsized":"2024-09-12T16:56:27.407283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:27.406806+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:27.406806+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.406806+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:14.784367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'40","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:53.347422+0000","last_change":"2024-09-12T16:56:53.347247+0000","last_active":"2024-09-12T16:56:53.347422+0000","last_peered":"2024-09-12T16:56:53.347422+0000","last_clean":"2024-09-12T16:56:53.347422+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:56:53.347422+0000","last_undegraded":"2024-09-12T16:56:53.347422+0000","last_fullsized":"2024-09-12T16:56:53.347422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T16:56:53.347046+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T16:56:53.347046+0000","last_clean_scrub_stamp":"2024-09-12T16:56:53.347046+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:40.514354+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.446485+0000","last_change":"2024-09-12T16:56:42.446257+0000","last_active":"2024-09-12T16:56:42.446485+0000","last_peered":"2024-09-12T16:56:42.446485+0000","last_clean":"2024-09-12T16:56:42.446485+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:56:42.446485+0000","last_undegraded":"2024-09-12T16:56:42.446485+0000","last_fullsized":"2024-09-12T16:56:42.446485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:42.446055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:42.446055+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.446055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:53.995248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:54:26.028198+0000","last_change":"2024-09-12T16:52:06.237422+0000","last_active":"2024-09-12T16:54:26.028198+0000","last_peered":"2024-09-12T16:54:26.028198+0000","last_clean":"2024-09-12T16:54:26.028198+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:54:26.028198+0000","last_undegraded":"2024-09-12T16:54:26.028198+0000","last_fullsized":"2024-09-12T16:54:26.028198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:52:05.169852+0000","last_clean_scrub_stamp":"2024-09-12T16:52:05.169852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.108738+0000","last_change":"2024-09-12T16:56:10.108586+0000","last_active":"2024-09-12T16:56:10.108738+0000","last_peered":"2024-09-12T16:56:10.108738+0000","last_clean":"2024-09-12T16:56:10.108738+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:56:10.108738+0000","last_undegraded":"2024-09-12T16:56:10.108738+0000","last_fullsized":"2024-09-12T16:56:10.108738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:10.108400+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:10.108400+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.108400+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:12.926248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.938046+0000","last_change":"2024-09-12T16:55:56.937794+0000","last_active":"2024-09-12T16:55:56.938046+0000","last_peered":"2024-09-12T16:55:56.938046+0000","last_clean":"2024-09-12T16:55:56.938046+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:55:56.938046+0000","last_undegraded":"2024-09-12T16:55:56.938046+0000","last_fullsized":"2024-09-12T16:55:56.938046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.937568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:32.183469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.333207+0000","last_change":"2024-09-12T16:56:12.333068+0000","last_active":"2024-09-12T16:56:12.333207+0000","last_peered":"2024-09-12T16:56:12.333207+0000","last_clean":"2024-09-12T16:56:12.333207+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:56:12.333207+0000","last_undegraded":"2024-09-12T16:56:12.333207+0000","last_fullsized":"2024-09-12T16:56:12.333207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:12.332887+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:12.332887+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.332887+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:01.522871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.401315+0000","last_change":"2024-09-12T16:55:56.401142+0000","last_active":"2024-09-12T16:55:56.401315+0000","last_peered":"2024-09-12T16:55:56.401315+0000","last_clean":"2024-09-12T16:55:56.401315+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:55:56.401315+0000","last_undegraded":"2024-09-12T16:55:56.401315+0000","last_fullsized":"2024-09-12T16:55:56.401315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.400960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:14.461538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.133193+0000","last_change":"2024-09-12T16:56:28.133193+0000","last_active":"2024-09-12T16:56:28.133193+0000","last_peered":"2024-09-12T16:56:28.133193+0000","last_clean":"2024-09-12T16:56:28.133193+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:56:28.133193+0000","last_undegraded":"2024-09-12T16:56:28.133193+0000","last_fullsized":"2024-09-12T16:56:28.133193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:28.133013+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:28.133013+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.133013+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:26.697952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.042238+0000","last_change":"2024-09-12T16:56:07.042238+0000","last_active":"2024-09-12T16:56:07.042238+0000","last_peered":"2024-09-12T16:56:07.042238+0000","last_clean":"2024-09-12T16:56:07.042238+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:56:07.042238+0000","last_undegraded":"2024-09-12T16:56:07.042238+0000","last_fullsized":"2024-09-12T16:56:07.042238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:07.042037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:07.042037+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.042037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.852652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.396791+0000","last_change":"2024-09-12T16:56:10.396647+0000","last_active":"2024-09-12T16:56:10.396791+0000","last_peered":"2024-09-12T16:56:10.396791+0000","last_clean":"2024-09-12T16:56:10.396791+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:56:10.396791+0000","last_undegraded":"2024-09-12T16:56:10.396791+0000","last_fullsized":"2024-09-12T16:56:10.396791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:10.396473+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:10.396473+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.396473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:10.833391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.440316+0000","last_change":"2024-09-12T16:55:54.440130+0000","last_active":"2024-09-12T16:55:54.440316+0000","last_peered":"2024-09-12T16:55:54.440316+0000","last_clean":"2024-09-12T16:55:54.440316+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:55:54.440316+0000","last_undegraded":"2024-09-12T16:55:54.440316+0000","last_fullsized":"2024-09-12T16:55:54.440316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.439958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:13.647744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.375456+0000","last_change":"2024-09-12T16:56:09.375456+0000","last_active":"2024-09-12T16:56:09.375456+0000","last_peered":"2024-09-12T16:56:09.375456+0000","last_clean":"2024-09-12T16:56:09.375456+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:56:09.375456+0000","last_undegraded":"2024-09-12T16:56:09.375456+0000","last_fullsized":"2024-09-12T16:56:09.375456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-12T16:56:09.375291+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-12T16:56:09.375291+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.375291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:02.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.406473+0000","last_change":"2024-09-12T16:55:57.406202+0000","last_active":"2024-09-12T16:55:57.406473+0000","last_peered":"2024-09-12T16:55:57.406473+0000","last_clean":"2024-09-12T16:55:57.406473+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:55:57.406473+0000","last_undegraded":"2024-09-12T16:55:57.406473+0000","last_fullsized":"2024-09-12T16:55:57.406473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.405992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:26.716714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.099350+0000","last_change":"2024-09-12T16:56:09.099205+0000","last_active":"2024-09-12T16:56:09.099350+0000","last_peered":"2024-09-12T16:56:09.099350+0000","last_clean":"2024-09-12T16:56:09.099350+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:56:09.099350+0000","last_undegraded":"2024-09-12T16:56:09.099350+0000","last_fullsized":"2024-09-12T16:56:09.099350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:09.099018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:09.099018+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.099018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:17.509989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.952554+0000","last_change":"2024-09-12T16:55:55.952358+0000","last_active":"2024-09-12T16:55:55.952554+0000","last_peered":"2024-09-12T16:55:55.952554+0000","last_clean":"2024-09-12T16:55:55.952554+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:55:55.952554+0000","last_undegraded":"2024-09-12T16:55:55.952554+0000","last_fullsized":"2024-09-12T16:55:55.952554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.952167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:25.813446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.362007+0000","last_change":"2024-09-12T16:56:11.362007+0000","last_active":"2024-09-12T16:56:11.362007+0000","last_peered":"2024-09-12T16:56:11.362007+0000","last_clean":"2024-09-12T16:56:11.362007+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:56:11.362007+0000","last_undegraded":"2024-09-12T16:56:11.362007+0000","last_fullsized":"2024-09-12T16:56:11.362007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:11.361791+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:11.361791+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.361791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:50.554072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.987602+0000","last_change":"2024-09-12T16:55:57.987345+0000","last_active":"2024-09-12T16:55:57.987602+0000","last_peered":"2024-09-12T16:55:57.987602+0000","last_clean":"2024-09-12T16:55:57.987602+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:55:57.987602+0000","last_undegraded":"2024-09-12T16:55:57.987602+0000","last_fullsized":"2024-09-12T16:55:57.987602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.987068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:06.950990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.106577+0000","last_change":"2024-09-12T16:56:08.106418+0000","last_active":"2024-09-12T16:56:08.106577+0000","last_peered":"2024-09-12T16:56:08.106577+0000","last_clean":"2024-09-12T16:56:08.106577+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:56:08.106577+0000","last_undegraded":"2024-09-12T16:56:08.106577+0000","last_fullsized":"2024-09-12T16:56:08.106577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:08.106230+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:08.106230+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.106230+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:35.973906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.433107+0000","last_change":"2024-09-12T16:55:55.432903+0000","last_active":"2024-09-12T16:55:55.433107+0000","last_peered":"2024-09-12T16:55:55.433107+0000","last_clean":"2024-09-12T16:55:55.433107+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:55:55.433107+0000","last_undegraded":"2024-09-12T16:55:55.433107+0000","last_fullsized":"2024-09-12T16:55:55.433107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.432712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.091150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.194277+0000","last_change":"2024-09-12T16:56:14.194089+0000","last_active":"2024-09-12T16:56:14.194277+0000","last_peered":"2024-09-12T16:56:14.194277+0000","last_clean":"2024-09-12T16:56:14.194277+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:56:14.194277+0000","last_undegraded":"2024-09-12T16:56:14.194277+0000","last_fullsized":"2024-09-12T16:56:14.194277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:14.193905+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:14.193905+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.193905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:20.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.030089+0000","last_change":"2024-09-12T16:56:09.029934+0000","last_active":"2024-09-12T16:56:09.030089+0000","last_peered":"2024-09-12T16:56:09.030089+0000","last_clean":"2024-09-12T16:56:09.030089+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:56:09.030089+0000","last_undegraded":"2024-09-12T16:56:09.030089+0000","last_fullsized":"2024-09-12T16:56:09.030089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:09.029746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:09.029746+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.029746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:03.041324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.147120+0000","last_change":"2024-09-12T16:56:29.146980+0000","last_active":"2024-09-12T16:56:29.147120+0000","last_peered":"2024-09-12T16:56:29.147120+0000","last_clean":"2024-09-12T16:56:29.147120+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:56:29.147120+0000","last_undegraded":"2024-09-12T16:56:29.147120+0000","last_fullsized":"2024-09-12T16:56:29.147120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:29.146778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:29.146778+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.146778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:19.977310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.392408+0000","last_change":"2024-09-12T16:56:00.392236+0000","last_active":"2024-09-12T16:56:00.392408+0000","last_peered":"2024-09-12T16:56:00.392408+0000","last_clean":"2024-09-12T16:56:00.392408+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:56:00.392408+0000","last_undegraded":"2024-09-12T16:56:00.392408+0000","last_fullsized":"2024-09-12T16:56:00.392408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.392055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:04.803837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.363927+0000","last_change":"2024-09-12T16:56:13.363788+0000","last_active":"2024-09-12T16:56:13.363927+0000","last_peered":"2024-09-12T16:56:13.363927+0000","last_clean":"2024-09-12T16:56:13.363927+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:56:13.363927+0000","last_undegraded":"2024-09-12T16:56:13.363927+0000","last_fullsized":"2024-09-12T16:56:13.363927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:13.363599+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:13.363599+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.363599+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.980599+0000","last_change":"2024-09-12T16:55:56.980434+0000","last_active":"2024-09-12T16:55:56.980599+0000","last_peered":"2024-09-12T16:55:56.980599+0000","last_clean":"2024-09-12T16:55:56.980599+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:55:56.980599+0000","last_undegraded":"2024-09-12T16:55:56.980599+0000","last_fullsized":"2024-09-12T16:55:56.980599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.980237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:15.364632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.210898+0000","last_change":"2024-09-12T16:56:17.210631+0000","last_active":"2024-09-12T16:56:17.210898+0000","last_peered":"2024-09-12T16:56:17.210898+0000","last_clean":"2024-09-12T16:56:17.210898+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:56:17.210898+0000","last_undegraded":"2024-09-12T16:56:17.210898+0000","last_fullsized":"2024-09-12T16:56:17.210898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:17.210420+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:17.210420+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.210420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:27.115703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.999627+0000","last_change":"2024-09-12T16:55:57.999462+0000","last_active":"2024-09-12T16:55:57.999627+0000","last_peered":"2024-09-12T16:55:57.999627+0000","last_clean":"2024-09-12T16:55:57.999627+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:55:57.999627+0000","last_undegraded":"2024-09-12T16:55:57.999627+0000","last_fullsized":"2024-09-12T16:55:57.999627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.999280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.958335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.119931+0000","last_change":"2024-09-12T16:56:12.119798+0000","last_active":"2024-09-12T16:56:12.119931+0000","last_peered":"2024-09-12T16:56:12.119931+0000","last_clean":"2024-09-12T16:56:12.119931+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:56:12.119931+0000","last_undegraded":"2024-09-12T16:56:12.119931+0000","last_fullsized":"2024-09-12T16:56:12.119931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:12.119628+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:12.119628+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.119628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.835640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.045599+0000","last_change":"2024-09-12T16:56:08.045457+0000","last_active":"2024-09-12T16:56:08.045599+0000","last_peered":"2024-09-12T16:56:08.045599+0000","last_clean":"2024-09-12T16:56:08.045599+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:56:08.045599+0000","last_undegraded":"2024-09-12T16:56:08.045599+0000","last_fullsized":"2024-09-12T16:56:08.045599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:08.045272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:08.045272+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.045272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.816254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.096674+0000","last_change":"2024-09-12T16:56:11.096441+0000","last_active":"2024-09-12T16:56:11.096674+0000","last_peered":"2024-09-12T16:56:11.096674+0000","last_clean":"2024-09-12T16:56:11.096674+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:56:11.096674+0000","last_undegraded":"2024-09-12T16:56:11.096674+0000","last_fullsized":"2024-09-12T16:56:11.096674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:11.096227+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:11.096227+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.096227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:02.873110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.073202+0000","last_change":"2024-09-12T16:56:10.073063+0000","last_active":"2024-09-12T16:56:10.073202+0000","last_peered":"2024-09-12T16:56:10.073202+0000","last_clean":"2024-09-12T16:56:10.073202+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:56:10.073202+0000","last_undegraded":"2024-09-12T16:56:10.073202+0000","last_fullsized":"2024-09-12T16:56:10.073202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:10.072860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:10.072860+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.072860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:55.441106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.911761+0000","last_change":"2024-09-12T16:56:13.911634+0000","last_active":"2024-09-12T16:56:13.911761+0000","last_peered":"2024-09-12T16:56:13.911761+0000","last_clean":"2024-09-12T16:56:13.911761+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:56:13.911761+0000","last_undegraded":"2024-09-12T16:56:13.911761+0000","last_fullsized":"2024-09-12T16:56:13.911761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:13.911459+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:13.911459+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.911459+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:23.988896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.983914+0000","last_change":"2024-09-12T16:55:59.983767+0000","last_active":"2024-09-12T16:55:59.983914+0000","last_peered":"2024-09-12T16:55:59.983914+0000","last_clean":"2024-09-12T16:55:59.983914+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:55:59.983914+0000","last_undegraded":"2024-09-12T16:55:59.983914+0000","last_fullsized":"2024-09-12T16:55:59.983914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.983590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:23.882360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.157609+0000","last_change":"2024-09-12T16:56:13.157345+0000","last_active":"2024-09-12T16:56:13.157609+0000","last_peered":"2024-09-12T16:56:13.157609+0000","last_clean":"2024-09-12T16:56:13.157609+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:56:13.157609+0000","last_undegraded":"2024-09-12T16:56:13.157609+0000","last_fullsized":"2024-09-12T16:56:13.157609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:13.157069+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:13.157069+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.157069+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:40.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.064636+0000","last_change":"2024-09-12T16:56:11.064485+0000","last_active":"2024-09-12T16:56:11.064636+0000","last_peered":"2024-09-12T16:56:11.064636+0000","last_clean":"2024-09-12T16:56:11.064636+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:56:11.064636+0000","last_undegraded":"2024-09-12T16:56:11.064636+0000","last_fullsized":"2024-09-12T16:56:11.064636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:11.064306+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:11.064306+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.064306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.818102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.073760+0000","last_change":"2024-09-12T16:56:12.073587+0000","last_active":"2024-09-12T16:56:12.073760+0000","last_peered":"2024-09-12T16:56:12.073760+0000","last_clean":"2024-09-12T16:56:12.073760+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:56:12.073760+0000","last_undegraded":"2024-09-12T16:56:12.073760+0000","last_fullsized":"2024-09-12T16:56:12.073760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:12.073409+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:12.073409+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.073409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:11.864469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.309178+0000","last_change":"2024-09-12T16:56:15.309025+0000","last_active":"2024-09-12T16:56:15.309178+0000","last_peered":"2024-09-12T16:56:15.309178+0000","last_clean":"2024-09-12T16:56:15.309178+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:56:15.309178+0000","last_undegraded":"2024-09-12T16:56:15.309178+0000","last_fullsized":"2024-09-12T16:56:15.309178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:15.308840+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:15.308840+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.308840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:26.096395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.428035+0000","last_change":"2024-09-12T16:56:01.427883+0000","last_active":"2024-09-12T16:56:01.428035+0000","last_peered":"2024-09-12T16:56:01.428035+0000","last_clean":"2024-09-12T16:56:01.428035+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:56:01.428035+0000","last_undegraded":"2024-09-12T16:56:01.428035+0000","last_fullsized":"2024-09-12T16:56:01.428035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.427706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:56.339223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.286850+0000","last_change":"2024-09-12T16:56:19.286721+0000","last_active":"2024-09-12T16:56:19.286850+0000","last_peered":"2024-09-12T16:56:19.286850+0000","last_clean":"2024-09-12T16:56:19.286850+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:56:19.286850+0000","last_undegraded":"2024-09-12T16:56:19.286850+0000","last_fullsized":"2024-09-12T16:56:19.286850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:19.286513+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:19.286513+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.286513+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:30.010412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640324,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640325,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":740498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673030,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":740621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44096,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327744,"statfs":{"total":96636764160,"available":96591609856,"internally_reserved":0,"allocated":442368,"data_stored":151866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:57:10.415 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:57:10.415 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:57:10.416 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:57:10.416 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:57:10.417 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:57:10.417 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:57:10.417 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:57:10.417 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T16:52:05.169852+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=52, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=55, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T16:57:10.418 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T16:57:30.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:57:30.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7c4e6640 1 Processor -- start 2024-09-12T16:57:30.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7c4e6640 1 -- start start 2024-09-12T16:57:30.549 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7c4e6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7c74128c60 0x7f7c74129040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7c4e6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c7406dcb0 con 0x7f7c74129580 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7c4e6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f7c74075000 con 0x7f7c74128c60 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c79a81640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f7c74129580 0x7f7c74112740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:39190/0 (socket says 172.21.15.122:39190) 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c79a81640 1 -- 172.21.15.122:0/1198592753 learned_addr learned my addr 172.21.15.122:0/1198592753 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7a282640 1 --2- 172.21.15.122:0/1198592753 >> v2:172.21.15.122:3300/0 conn(0x7f7c74128c60 0x7f7c74129040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c79280640 1 -- 172.21.15.122:0/1198592753 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888747704 0 0) 0x7f7c7406dcb0 con 0x7f7c74129580 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c79280640 1 -- 172.21.15.122:0/1198592753 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c60003530 con 0x7f7c74129580 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7a282640 1 -- 172.21.15.122:0/1198592753 >> v1:172.21.15.122:6789/0 conn(0x7f7c74129580 legacy=0x7f7c74112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:30.550 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7a282640 1 -- 172.21.15.122:0/1198592753 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c74073a90 con 0x7f7c74128c60 2024-09-12T16:57:30.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c7a282640 1 --2- 172.21.15.122:0/1198592753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c74129040 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009740 tx=0x7f7c6801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18cabf1aeaa01cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:30.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c79280640 1 -- 172.21.15.122:0/1198592753 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c680b0070 con 0x7f7c74128c60 2024-09-12T16:57:30.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c79280640 1 -- 172.21.15.122:0/1198592753 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c680ab530 con 0x7f7c74128c60 2024-09-12T16:57:30.552 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.547+0000 7f7c79280640 1 -- 172.21.15.122:0/1198592753 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c680ab830 con 0x7f7c74128c60 2024-09-12T16:57:30.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/1198592753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 msgr2=0x7f7c74129040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:30.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 --2- 172.21.15.122:0/1198592753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c74129040 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009740 tx=0x7f7c6801c370 comp rx=0 tx=0).stop 2024-09-12T16:57:30.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/1198592753 shutdown_connections 2024-09-12T16:57:30.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 --2- 172.21.15.122:0/1198592753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c74129040 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:30.554 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/1198592753 >> 172.21.15.122:0/1198592753 conn(0x7f7c74070900 msgr2=0x7f7c74072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/1198592753 shutdown_connections 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/1198592753 wait complete. 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 Processor -- start 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- start start 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c741c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74134d20 con 0x7f7c74128c60 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7a282640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c741c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7a282640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c741c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38326/0 (socket says 172.21.15.122:38326) 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7a282640 1 -- 172.21.15.122:0/95307297 learned_addr learned my addr 172.21.15.122:0/95307297 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7a282640 1 -- 172.21.15.122:0/95307297 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c74117b00 con 0x7f7c74128c60 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7a282640 1 --2- 172.21.15.122:0/95307297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c741c70d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7c680ae040 tx=0x7f7c68019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c66ffd640 1 -- 172.21.15.122:0/95307297 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c680b8020 con 0x7f7c74128c60 2024-09-12T16:57:30.555 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c66ffd640 1 -- 172.21.15.122:0/95307297 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c680b4410 con 0x7f7c74128c60 2024-09-12T16:57:30.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c66ffd640 1 -- 172.21.15.122:0/95307297 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c680b0040 con 0x7f7c74128c60 2024-09-12T16:57:30.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c74117f90 con 0x7f7c74128c60 2024-09-12T16:57:30.556 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c741c77e0 con 0x7f7c74128c60 2024-09-12T16:57:30.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c66ffd640 1 -- 172.21.15.122:0/95307297 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7c680bb020 con 0x7f7c74128c60 2024-09-12T16:57:30.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c74129040 con 0x7f7c74128c60 2024-09-12T16:57:30.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.551+0000 7f7c66ffd640 1 --2- 172.21.15.122:0/95307297 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7c5803b1d0 0x7f7c5803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:30.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.555+0000 7f7c66ffd640 1 -- 172.21.15.122:0/95307297 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7c680e96a0 con 0x7f7c74128c60 2024-09-12T16:57:30.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.555+0000 7f7c79a81640 1 --2- 172.21.15.122:0/95307297 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7c5803b1d0 0x7f7c5803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:30.557 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.555+0000 7f7c79a81640 1 --2- 172.21.15.122:0/95307297 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7c5803b1d0 0x7f7c5803d690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0020b0 tx=0x7f7c6c0016a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:30.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.559+0000 7f7c66ffd640 1 -- 172.21.15.122:0/95307297 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7c680c2030 con 0x7f7c74128c60 2024-09-12T16:57:30.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.715+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 --> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c741265d0 con 0x7f7c5803b1d0 2024-09-12T16:57:30.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.743+0000 7f7c66ffd640 1 -- 172.21.15.122:0/95307297 <== mgr.4100 v2:172.21.15.151:6824/919571907 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666476 (secure 0 0 0) 0x7f7c6c00cb50 con 0x7f7c5803b1d0 2024-09-12T16:57:30.754 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-12T16:57:30.760 INFO:teuthology.orchestra.run.smithi122.stderr:dumped all 2024-09-12T16:57:30.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7c5803b1d0 msgr2=0x7f7c5803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:30.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 --2- 172.21.15.122:0/95307297 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7c5803b1d0 0x7f7c5803d690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0020b0 tx=0x7f7c6c0016a0 comp rx=0 tx=0).stop 2024-09-12T16:57:30.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 msgr2=0x7f7c741c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:30.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 --2- 172.21.15.122:0/95307297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c741c70d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7c680ae040 tx=0x7f7c68019110 comp rx=0 tx=0).stop 2024-09-12T16:57:30.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 shutdown_connections 2024-09-12T16:57:30.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 --2- 172.21.15.122:0/95307297 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f7c5803b1d0 0x7f7c5803d690 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:30.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 --2- 172.21.15.122:0/95307297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c74128c60 0x7f7c741c70d0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:30.761 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 >> 172.21.15.122:0/95307297 conn(0x7f7c74070900 msgr2=0x7f7c74071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:57:30.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 shutdown_connections 2024-09-12T16:57:30.762 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.751+0000 7f7c7c4e6640 1 -- 172.21.15.122:0/95307297 wait complete. 2024-09-12T16:57:30.773 INFO:teuthology.orchestra.run.smithi122.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-09-12T16:57:30.103925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5138,"num_read_kb":4724,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1785572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006470"},"pg_stats":[{"pgid":"3.3f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.961212+0000","last_change":"2024-09-12T16:56:03.961062+0000","last_active":"2024-09-12T16:56:03.961212+0000","last_peered":"2024-09-12T16:56:03.961212+0000","last_clean":"2024-09-12T16:56:03.961212+0000","last_became_active":"2024-09-12T16:51:56.151469+0000","last_became_peered":"2024-09-12T16:51:56.151469+0000","last_unstale":"2024-09-12T16:56:03.961212+0000","last_undegraded":"2024-09-12T16:56:03.961212+0000","last_fullsized":"2024-09-12T16:56:03.961212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.960834+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.960834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:37.770581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.300653+0000","last_change":"2024-09-12T16:56:20.300472+0000","last_active":"2024-09-12T16:56:20.300653+0000","last_peered":"2024-09-12T16:56:20.300653+0000","last_clean":"2024-09-12T16:56:20.300653+0000","last_became_active":"2024-09-12T16:51:58.149838+0000","last_became_peered":"2024-09-12T16:51:58.149838+0000","last_unstale":"2024-09-12T16:56:20.300653+0000","last_undegraded":"2024-09-12T16:56:20.300653+0000","last_fullsized":"2024-09-12T16:56:20.300653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:20.300256+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:20.300256+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.300256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:32.742102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.441857+0000","last_change":"2024-09-12T16:56:02.441693+0000","last_active":"2024-09-12T16:56:02.441857+0000","last_peered":"2024-09-12T16:56:02.441857+0000","last_clean":"2024-09-12T16:56:02.441857+0000","last_became_active":"2024-09-12T16:51:56.159784+0000","last_became_peered":"2024-09-12T16:51:56.159784+0000","last_unstale":"2024-09-12T16:56:02.441857+0000","last_undegraded":"2024-09-12T16:56:02.441857+0000","last_fullsized":"2024-09-12T16:56:02.441857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.441477+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.441477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:15.024861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.240155+0000","last_change":"2024-09-12T16:56:31.240000+0000","last_active":"2024-09-12T16:56:31.240155+0000","last_peered":"2024-09-12T16:56:31.240155+0000","last_clean":"2024-09-12T16:56:31.240155+0000","last_became_active":"2024-09-12T16:51:58.163488+0000","last_became_peered":"2024-09-12T16:51:58.163488+0000","last_unstale":"2024-09-12T16:56:31.240155+0000","last_undegraded":"2024-09-12T16:56:31.240155+0000","last_fullsized":"2024-09-12T16:56:31.240155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:31.239807+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:31.239807+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.239807+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.495353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.033441+0000","last_change":"2024-09-12T16:56:16.033441+0000","last_active":"2024-09-12T16:56:16.033441+0000","last_peered":"2024-09-12T16:56:16.033441+0000","last_clean":"2024-09-12T16:56:16.033441+0000","last_became_active":"2024-09-12T16:51:56.164077+0000","last_became_peered":"2024-09-12T16:51:56.164077+0000","last_unstale":"2024-09-12T16:56:16.033441+0000","last_undegraded":"2024-09-12T16:56:16.033441+0000","last_fullsized":"2024-09-12T16:56:16.033441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:16.033239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:16.033239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.033239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:59.167081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'18","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.269489+0000","last_change":"2024-09-12T16:56:32.269328+0000","last_active":"2024-09-12T16:56:32.269489+0000","last_peered":"2024-09-12T16:56:32.269489+0000","last_clean":"2024-09-12T16:56:32.269489+0000","last_became_active":"2024-09-12T16:51:58.162946+0000","last_became_peered":"2024-09-12T16:51:58.162946+0000","last_unstale":"2024-09-12T16:56:32.269489+0000","last_undegraded":"2024-09-12T16:56:32.269489+0000","last_fullsized":"2024-09-12T16:56:32.269489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:32.269147+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:32.269147+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.269147+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:37.703397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":81,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.000241+0000","last_change":"2024-09-12T16:55:59.000089+0000","last_active":"2024-09-12T16:55:59.000241+0000","last_peered":"2024-09-12T16:55:59.000241+0000","last_clean":"2024-09-12T16:55:59.000241+0000","last_became_active":"2024-09-12T16:51:56.149732+0000","last_became_peered":"2024-09-12T16:51:56.149732+0000","last_unstale":"2024-09-12T16:55:59.000241+0000","last_undegraded":"2024-09-12T16:55:59.000241+0000","last_fullsized":"2024-09-12T16:55:59.000241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.999904+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.999904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.689260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'12","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.304736+0000","last_change":"2024-09-12T16:56:33.304553+0000","last_active":"2024-09-12T16:56:33.304736+0000","last_peered":"2024-09-12T16:56:33.304736+0000","last_clean":"2024-09-12T16:56:33.304736+0000","last_became_active":"2024-09-12T16:51:58.163218+0000","last_became_peered":"2024-09-12T16:51:58.163218+0000","last_unstale":"2024-09-12T16:56:33.304736+0000","last_undegraded":"2024-09-12T16:56:33.304736+0000","last_fullsized":"2024-09-12T16:56:33.304736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:33.304373+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:33.304373+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.304373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:42.426109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.054350+0000","last_change":"2024-09-12T16:56:15.054183+0000","last_active":"2024-09-12T16:56:15.054350+0000","last_peered":"2024-09-12T16:56:15.054350+0000","last_clean":"2024-09-12T16:56:15.054350+0000","last_became_active":"2024-09-12T16:51:56.154923+0000","last_became_peered":"2024-09-12T16:51:56.154923+0000","last_unstale":"2024-09-12T16:56:15.054350+0000","last_undegraded":"2024-09-12T16:56:15.054350+0000","last_fullsized":"2024-09-12T16:56:15.054350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:15.053960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:15.053960+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.053960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:40.643203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.330004+0000","last_change":"2024-09-12T16:56:21.330004+0000","last_active":"2024-09-12T16:56:21.330004+0000","last_peered":"2024-09-12T16:56:21.330004+0000","last_clean":"2024-09-12T16:56:21.330004+0000","last_became_active":"2024-09-12T16:51:58.147846+0000","last_became_peered":"2024-09-12T16:51:58.147846+0000","last_unstale":"2024-09-12T16:56:21.330004+0000","last_undegraded":"2024-09-12T16:56:21.330004+0000","last_fullsized":"2024-09-12T16:56:21.330004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:21.329825+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:21.329825+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.329825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:52.622109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.923883+0000","last_change":"2024-09-12T16:56:06.923745+0000","last_active":"2024-09-12T16:56:06.923883+0000","last_peered":"2024-09-12T16:56:06.923883+0000","last_clean":"2024-09-12T16:56:06.923883+0000","last_became_active":"2024-09-12T16:51:56.148728+0000","last_became_peered":"2024-09-12T16:51:56.148728+0000","last_unstale":"2024-09-12T16:56:06.923883+0000","last_undegraded":"2024-09-12T16:56:06.923883+0000","last_fullsized":"2024-09-12T16:56:06.923883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.923558+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.923558+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.923558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:45.607137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.344087+0000","last_change":"2024-09-12T16:56:34.344087+0000","last_active":"2024-09-12T16:56:34.344087+0000","last_peered":"2024-09-12T16:56:34.344087+0000","last_clean":"2024-09-12T16:56:34.344087+0000","last_became_active":"2024-09-12T16:51:58.159358+0000","last_became_peered":"2024-09-12T16:51:58.159358+0000","last_unstale":"2024-09-12T16:56:34.344087+0000","last_undegraded":"2024-09-12T16:56:34.344087+0000","last_fullsized":"2024-09-12T16:56:34.344087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:34.343897+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:34.343897+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.343897+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:18.965351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.073285+0000","last_change":"2024-09-12T16:56:14.073104+0000","last_active":"2024-09-12T16:56:14.073285+0000","last_peered":"2024-09-12T16:56:14.073285+0000","last_clean":"2024-09-12T16:56:14.073285+0000","last_became_active":"2024-09-12T16:51:56.152137+0000","last_became_peered":"2024-09-12T16:51:56.152137+0000","last_unstale":"2024-09-12T16:56:14.073285+0000","last_undegraded":"2024-09-12T16:56:14.073285+0000","last_fullsized":"2024-09-12T16:56:14.073285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:14.072890+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:14.072890+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.072890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:52.398439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.924366+0000","last_change":"2024-09-12T16:56:14.924366+0000","last_active":"2024-09-12T16:56:14.924366+0000","last_peered":"2024-09-12T16:56:14.924366+0000","last_clean":"2024-09-12T16:56:14.924366+0000","last_became_active":"2024-09-12T16:51:58.156431+0000","last_became_peered":"2024-09-12T16:51:58.156431+0000","last_unstale":"2024-09-12T16:56:14.924366+0000","last_undegraded":"2024-09-12T16:56:14.924366+0000","last_fullsized":"2024-09-12T16:56:14.924366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:14.924132+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:14.924132+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.924132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:01.248598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.411760+0000","last_change":"2024-09-12T16:55:59.411580+0000","last_active":"2024-09-12T16:55:59.411760+0000","last_peered":"2024-09-12T16:55:59.411760+0000","last_clean":"2024-09-12T16:55:59.411760+0000","last_became_active":"2024-09-12T16:51:56.159654+0000","last_became_peered":"2024-09-12T16:51:56.159654+0000","last_unstale":"2024-09-12T16:55:59.411760+0000","last_undegraded":"2024-09-12T16:55:59.411760+0000","last_fullsized":"2024-09-12T16:55:59.411760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.411390+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.411390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:57.337645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.969122+0000","last_change":"2024-09-12T16:56:15.969122+0000","last_active":"2024-09-12T16:56:15.969122+0000","last_peered":"2024-09-12T16:56:15.969122+0000","last_clean":"2024-09-12T16:56:15.969122+0000","last_became_active":"2024-09-12T16:52:35.036999+0000","last_became_peered":"2024-09-12T16:52:35.036999+0000","last_unstale":"2024-09-12T16:56:15.969122+0000","last_undegraded":"2024-09-12T16:56:15.969122+0000","last_fullsized":"2024-09-12T16:56:15.969122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:15.968939+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:15.968939+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.968939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:23.486079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.198469+0000","last_change":"2024-09-12T16:56:30.198297+0000","last_active":"2024-09-12T16:56:30.198469+0000","last_peered":"2024-09-12T16:56:30.198469+0000","last_clean":"2024-09-12T16:56:30.198469+0000","last_became_active":"2024-09-12T16:51:58.152036+0000","last_became_peered":"2024-09-12T16:51:58.152036+0000","last_unstale":"2024-09-12T16:56:30.198469+0000","last_undegraded":"2024-09-12T16:56:30.198469+0000","last_fullsized":"2024-09-12T16:56:30.198469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:30.198091+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:30.198091+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.198091+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:32.759529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.020318+0000","last_change":"2024-09-12T16:56:01.020166+0000","last_active":"2024-09-12T16:56:01.020318+0000","last_peered":"2024-09-12T16:56:01.020318+0000","last_clean":"2024-09-12T16:56:01.020318+0000","last_became_active":"2024-09-12T16:51:56.156031+0000","last_became_peered":"2024-09-12T16:51:56.156031+0000","last_unstale":"2024-09-12T16:56:01.020318+0000","last_undegraded":"2024-09-12T16:56:01.020318+0000","last_fullsized":"2024-09-12T16:56:01.020318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.019981+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.019981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:17.549962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'18","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.228861+0000","last_change":"2024-09-12T16:56:15.228716+0000","last_active":"2024-09-12T16:56:15.228861+0000","last_peered":"2024-09-12T16:56:15.228861+0000","last_clean":"2024-09-12T16:56:15.228861+0000","last_became_active":"2024-09-12T16:51:58.145084+0000","last_became_peered":"2024-09-12T16:51:58.145084+0000","last_unstale":"2024-09-12T16:56:15.228861+0000","last_undegraded":"2024-09-12T16:56:15.228861+0000","last_fullsized":"2024-09-12T16:56:15.228861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:15.228531+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:15.228531+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.228531+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:17.677439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.978681+0000","last_change":"2024-09-12T16:56:01.978515+0000","last_active":"2024-09-12T16:56:01.978681+0000","last_peered":"2024-09-12T16:56:01.978681+0000","last_clean":"2024-09-12T16:56:01.978681+0000","last_became_active":"2024-09-12T16:51:56.149711+0000","last_became_peered":"2024-09-12T16:51:56.149711+0000","last_unstale":"2024-09-12T16:56:01.978681+0000","last_undegraded":"2024-09-12T16:56:01.978681+0000","last_fullsized":"2024-09-12T16:56:01.978681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:01.978300+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.978300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:23.170955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.200170+0000","last_change":"2024-09-12T16:56:16.200016+0000","last_active":"2024-09-12T16:56:16.200170+0000","last_peered":"2024-09-12T16:56:16.200170+0000","last_clean":"2024-09-12T16:56:16.200170+0000","last_became_active":"2024-09-12T16:51:58.146855+0000","last_became_peered":"2024-09-12T16:51:58.146855+0000","last_unstale":"2024-09-12T16:56:16.200170+0000","last_undegraded":"2024-09-12T16:56:16.200170+0000","last_fullsized":"2024-09-12T16:56:16.200170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:16.199840+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:16.199840+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.199840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:41.217788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.024798+0000","last_change":"2024-09-12T16:56:00.024742+0000","last_active":"2024-09-12T16:56:00.024798+0000","last_peered":"2024-09-12T16:56:00.024798+0000","last_clean":"2024-09-12T16:56:00.024798+0000","last_became_active":"2024-09-12T16:51:56.164093+0000","last_became_peered":"2024-09-12T16:51:56.164093+0000","last_unstale":"2024-09-12T16:56:00.024798+0000","last_undegraded":"2024-09-12T16:56:00.024798+0000","last_fullsized":"2024-09-12T16:56:00.024798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.024672+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.024672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:03.497187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.360216+0000","last_change":"2024-09-12T16:56:14.360052+0000","last_active":"2024-09-12T16:56:14.360216+0000","last_peered":"2024-09-12T16:56:14.360216+0000","last_clean":"2024-09-12T16:56:14.360216+0000","last_became_active":"2024-09-12T16:51:58.170845+0000","last_became_peered":"2024-09-12T16:51:58.170845+0000","last_unstale":"2024-09-12T16:56:14.360216+0000","last_undegraded":"2024-09-12T16:56:14.360216+0000","last_fullsized":"2024-09-12T16:56:14.360216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:14.359876+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:14.359876+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.359876+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:20.611388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.029962+0000","last_change":"2024-09-12T16:55:59.029695+0000","last_active":"2024-09-12T16:55:59.029962+0000","last_peered":"2024-09-12T16:55:59.029962+0000","last_clean":"2024-09-12T16:55:59.029962+0000","last_became_active":"2024-09-12T16:51:56.164110+0000","last_became_peered":"2024-09-12T16:51:56.164110+0000","last_unstale":"2024-09-12T16:55:59.029962+0000","last_undegraded":"2024-09-12T16:55:59.029962+0000","last_fullsized":"2024-09-12T16:55:59.029962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.029505+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.029505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:23.968614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.919699+0000","last_change":"2024-09-12T16:56:12.919566+0000","last_active":"2024-09-12T16:56:12.919699+0000","last_peered":"2024-09-12T16:56:12.919699+0000","last_clean":"2024-09-12T16:56:12.919699+0000","last_became_active":"2024-09-12T16:51:58.169752+0000","last_became_peered":"2024-09-12T16:51:58.169752+0000","last_unstale":"2024-09-12T16:56:12.919699+0000","last_undegraded":"2024-09-12T16:56:12.919699+0000","last_fullsized":"2024-09-12T16:56:12.919699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:12.919380+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:12.919380+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.919380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:01.652496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.453323+0000","last_change":"2024-09-12T16:55:58.453187+0000","last_active":"2024-09-12T16:55:58.453323+0000","last_peered":"2024-09-12T16:55:58.453323+0000","last_clean":"2024-09-12T16:55:58.453323+0000","last_became_active":"2024-09-12T16:51:56.169125+0000","last_became_peered":"2024-09-12T16:51:56.169125+0000","last_unstale":"2024-09-12T16:55:58.453323+0000","last_undegraded":"2024-09-12T16:55:58.453323+0000","last_fullsized":"2024-09-12T16:55:58.453323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:58.452993+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.452993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:56.443665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.259870+0000","last_change":"2024-09-12T16:56:18.259709+0000","last_active":"2024-09-12T16:56:18.259870+0000","last_peered":"2024-09-12T16:56:18.259870+0000","last_clean":"2024-09-12T16:56:18.259870+0000","last_became_active":"2024-09-12T16:51:58.153480+0000","last_became_peered":"2024-09-12T16:51:58.153480+0000","last_unstale":"2024-09-12T16:56:18.259870+0000","last_undegraded":"2024-09-12T16:56:18.259870+0000","last_fullsized":"2024-09-12T16:56:18.259870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:18.259509+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:18.259509+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.259509+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:11.920537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.033140+0000","last_change":"2024-09-12T16:56:13.032967+0000","last_active":"2024-09-12T16:56:13.033140+0000","last_peered":"2024-09-12T16:56:13.033140+0000","last_clean":"2024-09-12T16:56:13.033140+0000","last_became_active":"2024-09-12T16:51:56.149851+0000","last_became_peered":"2024-09-12T16:51:56.149851+0000","last_unstale":"2024-09-12T16:56:13.033140+0000","last_undegraded":"2024-09-12T16:56:13.033140+0000","last_fullsized":"2024-09-12T16:56:13.033140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:13.032745+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:13.032745+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.032745+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:11.625172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:48.557026+0000","last_change":"2024-09-12T16:56:48.556888+0000","last_active":"2024-09-12T16:56:48.557026+0000","last_peered":"2024-09-12T16:56:48.557026+0000","last_clean":"2024-09-12T16:56:48.557026+0000","last_became_active":"2024-09-12T16:52:06.227146+0000","last_became_peered":"2024-09-12T16:52:06.227146+0000","last_unstale":"2024-09-12T16:56:48.557026+0000","last_undegraded":"2024-09-12T16:56:48.557026+0000","last_fullsized":"2024-09-12T16:56:48.557026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-12T16:56:48.556695+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-12T16:56:48.556695+0000","last_clean_scrub_stamp":"2024-09-12T16:56:48.556695+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:30.519898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'14","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.053860+0000","last_change":"2024-09-12T16:56:22.053711+0000","last_active":"2024-09-12T16:56:22.053860+0000","last_peered":"2024-09-12T16:56:22.053860+0000","last_clean":"2024-09-12T16:56:22.053860+0000","last_became_active":"2024-09-12T16:51:58.158477+0000","last_became_peered":"2024-09-12T16:51:58.158477+0000","last_unstale":"2024-09-12T16:56:22.053860+0000","last_undegraded":"2024-09-12T16:56:22.053860+0000","last_fullsized":"2024-09-12T16:56:22.053860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:22.053522+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:22.053522+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.053522+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:59.142373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.009540+0000","last_change":"2024-09-12T16:56:02.009398+0000","last_active":"2024-09-12T16:56:02.009540+0000","last_peered":"2024-09-12T16:56:02.009540+0000","last_clean":"2024-09-12T16:56:02.009540+0000","last_became_active":"2024-09-12T16:51:56.163704+0000","last_became_peered":"2024-09-12T16:51:56.163704+0000","last_unstale":"2024-09-12T16:56:02.009540+0000","last_undegraded":"2024-09-12T16:56:02.009540+0000","last_fullsized":"2024-09-12T16:56:02.009540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.009210+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.009210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:18.094619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.221600+0000","last_change":"2024-09-12T16:56:42.221372+0000","last_active":"2024-09-12T16:56:42.221600+0000","last_peered":"2024-09-12T16:56:42.221600+0000","last_clean":"2024-09-12T16:56:42.221600+0000","last_became_active":"2024-09-12T16:52:00.186132+0000","last_became_peered":"2024-09-12T16:52:00.186132+0000","last_unstale":"2024-09-12T16:56:42.221600+0000","last_undegraded":"2024-09-12T16:56:42.221600+0000","last_fullsized":"2024-09-12T16:56:42.221600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:42.221088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:42.221088+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.221088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:08.414428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:51.366515+0000","last_change":"2024-09-12T16:56:51.366390+0000","last_active":"2024-09-12T16:56:51.366515+0000","last_peered":"2024-09-12T16:56:51.366515+0000","last_clean":"2024-09-12T16:56:51.366515+0000","last_became_active":"2024-09-12T16:52:02.209194+0000","last_became_peered":"2024-09-12T16:52:02.209194+0000","last_unstale":"2024-09-12T16:56:51.366515+0000","last_undegraded":"2024-09-12T16:56:51.366515+0000","last_fullsized":"2024-09-12T16:56:51.366515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:51.366239+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:51.366239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:51.366239+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:51.267974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.522958+0000","last_change":"2024-09-12T16:56:41.522766+0000","last_active":"2024-09-12T16:56:41.522958+0000","last_peered":"2024-09-12T16:56:41.522958+0000","last_clean":"2024-09-12T16:56:41.522958+0000","last_became_active":"2024-09-12T16:52:04.215400+0000","last_became_peered":"2024-09-12T16:52:04.215400+0000","last_unstale":"2024-09-12T16:56:41.522958+0000","last_undegraded":"2024-09-12T16:56:41.522958+0000","last_fullsized":"2024-09-12T16:56:41.522958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.522584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.522584+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.522584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:22.233238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:49.552362+0000","last_change":"2024-09-12T16:56:49.552233+0000","last_active":"2024-09-12T16:56:49.552362+0000","last_peered":"2024-09-12T16:56:49.552362+0000","last_clean":"2024-09-12T16:56:49.552362+0000","last_became_active":"2024-09-12T16:52:06.220172+0000","last_became_peered":"2024-09-12T16:52:06.220172+0000","last_unstale":"2024-09-12T16:56:49.552362+0000","last_undegraded":"2024-09-12T16:56:49.552362+0000","last_fullsized":"2024-09-12T16:56:49.552362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-12T16:56:49.552031+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-12T16:56:49.552031+0000","last_clean_scrub_stamp":"2024-09-12T16:56:49.552031+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:56.313686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.075691+0000","last_change":"2024-09-12T16:56:23.075544+0000","last_active":"2024-09-12T16:56:23.075691+0000","last_peered":"2024-09-12T16:56:23.075691+0000","last_clean":"2024-09-12T16:56:23.075691+0000","last_became_active":"2024-09-12T16:51:58.171066+0000","last_became_peered":"2024-09-12T16:51:58.171066+0000","last_unstale":"2024-09-12T16:56:23.075691+0000","last_undegraded":"2024-09-12T16:56:23.075691+0000","last_fullsized":"2024-09-12T16:56:23.075691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:23.075361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:23.075361+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.075361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:19.899752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.866594+0000","last_change":"2024-09-12T16:55:53.866458+0000","last_active":"2024-09-12T16:55:53.866594+0000","last_peered":"2024-09-12T16:55:53.866594+0000","last_clean":"2024-09-12T16:55:53.866594+0000","last_became_active":"2024-09-12T16:51:56.148510+0000","last_became_peered":"2024-09-12T16:51:56.148510+0000","last_unstale":"2024-09-12T16:55:53.866594+0000","last_undegraded":"2024-09-12T16:55:53.866594+0000","last_fullsized":"2024-09-12T16:55:53.866594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.866257+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.866257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:36.901200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.358444+0000","last_change":"2024-09-12T16:56:21.358299+0000","last_active":"2024-09-12T16:56:21.358444+0000","last_peered":"2024-09-12T16:56:21.358444+0000","last_clean":"2024-09-12T16:56:21.358444+0000","last_became_active":"2024-09-12T16:52:00.172575+0000","last_became_peered":"2024-09-12T16:52:00.172575+0000","last_unstale":"2024-09-12T16:56:21.358444+0000","last_undegraded":"2024-09-12T16:56:21.358444+0000","last_fullsized":"2024-09-12T16:56:21.358444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:21.358117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:21.358117+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.358117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:01.559420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.493738+0000","last_change":"2024-09-12T16:56:34.493576+0000","last_active":"2024-09-12T16:56:34.493738+0000","last_peered":"2024-09-12T16:56:34.493738+0000","last_clean":"2024-09-12T16:56:34.493738+0000","last_became_active":"2024-09-12T16:52:02.181804+0000","last_became_peered":"2024-09-12T16:52:02.181804+0000","last_unstale":"2024-09-12T16:56:34.493738+0000","last_undegraded":"2024-09-12T16:56:34.493738+0000","last_fullsized":"2024-09-12T16:56:34.493738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-12T16:56:34.493374+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-12T16:56:34.493374+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.493374+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:50.187740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.544670+0000","last_change":"2024-09-12T16:56:39.544537+0000","last_active":"2024-09-12T16:56:39.544670+0000","last_peered":"2024-09-12T16:56:39.544670+0000","last_clean":"2024-09-12T16:56:39.544670+0000","last_became_active":"2024-09-12T16:52:04.210377+0000","last_became_peered":"2024-09-12T16:52:04.210377+0000","last_unstale":"2024-09-12T16:56:39.544670+0000","last_undegraded":"2024-09-12T16:56:39.544670+0000","last_fullsized":"2024-09-12T16:56:39.544670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.544357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.544357+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.544357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:36.508956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:47.453357+0000","last_change":"2024-09-12T16:56:47.453204+0000","last_active":"2024-09-12T16:56:47.453357+0000","last_peered":"2024-09-12T16:56:47.453357+0000","last_clean":"2024-09-12T16:56:47.453357+0000","last_became_active":"2024-09-12T16:52:06.224146+0000","last_became_peered":"2024-09-12T16:52:06.224146+0000","last_unstale":"2024-09-12T16:56:47.453357+0000","last_undegraded":"2024-09-12T16:56:47.453357+0000","last_fullsized":"2024-09-12T16:56:47.453357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:47.453015+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:47.453015+0000","last_clean_scrub_stamp":"2024-09-12T16:56:47.453015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.827858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.123394+0000","last_change":"2024-09-12T16:56:24.123242+0000","last_active":"2024-09-12T16:56:24.123394+0000","last_peered":"2024-09-12T16:56:24.123394+0000","last_clean":"2024-09-12T16:56:24.123394+0000","last_became_active":"2024-09-12T16:51:58.165551+0000","last_became_peered":"2024-09-12T16:51:58.165551+0000","last_unstale":"2024-09-12T16:56:24.123394+0000","last_undegraded":"2024-09-12T16:56:24.123394+0000","last_fullsized":"2024-09-12T16:56:24.123394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:24.123050+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:24.123050+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.123050+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:32.942821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.057505+0000","last_change":"2024-09-12T16:56:01.057358+0000","last_active":"2024-09-12T16:56:01.057505+0000","last_peered":"2024-09-12T16:56:01.057505+0000","last_clean":"2024-09-12T16:56:01.057505+0000","last_became_active":"2024-09-12T16:51:56.152782+0000","last_became_peered":"2024-09-12T16:51:56.152782+0000","last_unstale":"2024-09-12T16:56:01.057505+0000","last_undegraded":"2024-09-12T16:56:01.057505+0000","last_fullsized":"2024-09-12T16:56:01.057505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.057181+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.057181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:48.320895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.372021+0000","last_change":"2024-09-12T16:56:23.371894+0000","last_active":"2024-09-12T16:56:23.372021+0000","last_peered":"2024-09-12T16:56:23.372021+0000","last_clean":"2024-09-12T16:56:23.372021+0000","last_became_active":"2024-09-12T16:52:00.165650+0000","last_became_peered":"2024-09-12T16:52:00.165650+0000","last_unstale":"2024-09-12T16:56:23.372021+0000","last_undegraded":"2024-09-12T16:56:23.372021+0000","last_fullsized":"2024-09-12T16:56:23.372021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:23.371722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:23.371722+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.371722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:32.702443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.005898+0000","last_change":"2024-09-12T16:56:28.005734+0000","last_active":"2024-09-12T16:56:28.005898+0000","last_peered":"2024-09-12T16:56:28.005898+0000","last_clean":"2024-09-12T16:56:28.005898+0000","last_became_active":"2024-09-12T16:52:02.201786+0000","last_became_peered":"2024-09-12T16:52:02.201786+0000","last_unstale":"2024-09-12T16:56:28.005898+0000","last_undegraded":"2024-09-12T16:56:28.005898+0000","last_fullsized":"2024-09-12T16:56:28.005898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:28.005551+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:28.005551+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.005551+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:32.321067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":396,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:00.374904+0000","last_change":"2024-09-12T16:57:00.374904+0000","last_active":"2024-09-12T16:57:00.374904+0000","last_peered":"2024-09-12T16:57:00.374904+0000","last_clean":"2024-09-12T16:57:00.374904+0000","last_became_active":"2024-09-12T16:52:04.214269+0000","last_became_peered":"2024-09-12T16:52:04.214269+0000","last_unstale":"2024-09-12T16:57:00.374904+0000","last_undegraded":"2024-09-12T16:57:00.374904+0000","last_fullsized":"2024-09-12T16:57:00.374904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:57:00.374735+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:57:00.374735+0000","last_clean_scrub_stamp":"2024-09-12T16:57:00.374735+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:32.508636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.064556+0000","last_change":"2024-09-12T16:56:41.064316+0000","last_active":"2024-09-12T16:56:41.064556+0000","last_peered":"2024-09-12T16:56:41.064556+0000","last_clean":"2024-09-12T16:56:41.064556+0000","last_became_active":"2024-09-12T16:52:06.233191+0000","last_became_peered":"2024-09-12T16:52:06.233191+0000","last_unstale":"2024-09-12T16:56:41.064556+0000","last_undegraded":"2024-09-12T16:56:41.064556+0000","last_fullsized":"2024-09-12T16:56:41.064556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.064050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.064050+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.064050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:56.640802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.409980+0000","last_change":"2024-09-12T16:56:05.409809+0000","last_active":"2024-09-12T16:56:05.409980+0000","last_peered":"2024-09-12T16:56:05.409980+0000","last_clean":"2024-09-12T16:56:05.409980+0000","last_became_active":"2024-09-12T16:51:58.157117+0000","last_became_peered":"2024-09-12T16:51:58.157117+0000","last_unstale":"2024-09-12T16:56:05.409980+0000","last_undegraded":"2024-09-12T16:56:05.409980+0000","last_fullsized":"2024-09-12T16:56:05.409980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:05.409623+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:05.409623+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.409623+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:09.725138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.883001+0000","last_change":"2024-09-12T16:55:49.882861+0000","last_active":"2024-09-12T16:55:49.883001+0000","last_peered":"2024-09-12T16:55:49.883001+0000","last_clean":"2024-09-12T16:55:49.883001+0000","last_became_active":"2024-09-12T16:51:56.156091+0000","last_became_peered":"2024-09-12T16:51:56.156091+0000","last_unstale":"2024-09-12T16:55:49.883001+0000","last_undegraded":"2024-09-12T16:55:49.883001+0000","last_fullsized":"2024-09-12T16:55:49.883001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.882666+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.882666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:15.998089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.205111+0000","last_change":"2024-09-12T16:56:43.204889+0000","last_active":"2024-09-12T16:56:43.205111+0000","last_peered":"2024-09-12T16:56:43.205111+0000","last_clean":"2024-09-12T16:56:43.205111+0000","last_became_active":"2024-09-12T16:52:00.185994+0000","last_became_peered":"2024-09-12T16:52:00.185994+0000","last_unstale":"2024-09-12T16:56:43.205111+0000","last_undegraded":"2024-09-12T16:56:43.205111+0000","last_fullsized":"2024-09-12T16:56:43.205111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:43.204616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:43.204616+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.204616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:44.818830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.990339+0000","last_change":"2024-09-12T16:56:28.990167+0000","last_active":"2024-09-12T16:56:28.990339+0000","last_peered":"2024-09-12T16:56:28.990339+0000","last_clean":"2024-09-12T16:56:28.990339+0000","last_became_active":"2024-09-12T16:52:02.200745+0000","last_became_peered":"2024-09-12T16:52:02.200745+0000","last_unstale":"2024-09-12T16:56:28.990339+0000","last_undegraded":"2024-09-12T16:56:28.990339+0000","last_fullsized":"2024-09-12T16:56:28.990339+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:28.989951+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:28.989951+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.989951+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:15.454424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.374347+0000","last_change":"2024-09-12T16:56:38.374212+0000","last_active":"2024-09-12T16:56:38.374347+0000","last_peered":"2024-09-12T16:56:38.374347+0000","last_clean":"2024-09-12T16:56:38.374347+0000","last_became_active":"2024-09-12T16:52:04.219528+0000","last_became_peered":"2024-09-12T16:52:04.219528+0000","last_unstale":"2024-09-12T16:56:38.374347+0000","last_undegraded":"2024-09-12T16:56:38.374347+0000","last_fullsized":"2024-09-12T16:56:38.374347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:38.374018+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:38.374018+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.374018+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.005339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.050560+0000","last_change":"2024-09-12T16:56:20.050421+0000","last_active":"2024-09-12T16:56:20.050560+0000","last_peered":"2024-09-12T16:56:20.050560+0000","last_clean":"2024-09-12T16:56:20.050560+0000","last_became_active":"2024-09-12T16:51:58.166109+0000","last_became_peered":"2024-09-12T16:51:58.166109+0000","last_unstale":"2024-09-12T16:56:20.050560+0000","last_undegraded":"2024-09-12T16:56:20.050560+0000","last_fullsized":"2024-09-12T16:56:20.050560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:20.050239+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:20.050239+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.050239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:20.506022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.907472+0000","last_change":"2024-09-12T16:55:51.907335+0000","last_active":"2024-09-12T16:55:51.907472+0000","last_peered":"2024-09-12T16:55:51.907472+0000","last_clean":"2024-09-12T16:55:51.907472+0000","last_became_active":"2024-09-12T16:51:56.151595+0000","last_became_peered":"2024-09-12T16:51:56.151595+0000","last_unstale":"2024-09-12T16:55:51.907472+0000","last_undegraded":"2024-09-12T16:55:51.907472+0000","last_fullsized":"2024-09-12T16:55:51.907472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:51.907142+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.907142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:07.393009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.349322+0000","last_change":"2024-09-12T16:56:23.349322+0000","last_active":"2024-09-12T16:56:23.349322+0000","last_peered":"2024-09-12T16:56:23.349322+0000","last_clean":"2024-09-12T16:56:23.349322+0000","last_became_active":"2024-09-12T16:52:00.157400+0000","last_became_peered":"2024-09-12T16:52:00.157400+0000","last_unstale":"2024-09-12T16:56:23.349322+0000","last_undegraded":"2024-09-12T16:56:23.349322+0000","last_fullsized":"2024-09-12T16:56:23.349322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:23.349052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:23.349052+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.349052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:29.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'53","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.006089+0000","last_change":"2024-09-12T16:56:25.005947+0000","last_active":"2024-09-12T16:56:25.006089+0000","last_peered":"2024-09-12T16:56:25.006089+0000","last_clean":"2024-09-12T16:56:25.006089+0000","last_became_active":"2024-09-12T16:52:02.184499+0000","last_became_peered":"2024-09-12T16:52:02.184499+0000","last_unstale":"2024-09-12T16:56:25.006089+0000","last_undegraded":"2024-09-12T16:56:25.006089+0000","last_fullsized":"2024-09-12T16:56:25.006089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'53","last_scrub_stamp":"2024-09-12T16:56:25.005701+0000","last_deep_scrub":"34'53","last_deep_scrub_stamp":"2024-09-12T16:56:25.005701+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.005701+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:29.541745+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.409384+0000","last_change":"2024-09-12T16:56:40.409384+0000","last_active":"2024-09-12T16:56:40.409384+0000","last_peered":"2024-09-12T16:56:40.409384+0000","last_clean":"2024-09-12T16:56:40.409384+0000","last_became_active":"2024-09-12T16:52:04.215427+0000","last_became_peered":"2024-09-12T16:52:04.215427+0000","last_unstale":"2024-09-12T16:56:40.409384+0000","last_undegraded":"2024-09-12T16:56:40.409384+0000","last_fullsized":"2024-09-12T16:56:40.409384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.409170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.409170+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.409170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:50.796522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.053635+0000","last_change":"2024-09-12T16:56:38.053635+0000","last_active":"2024-09-12T16:56:38.053635+0000","last_peered":"2024-09-12T16:56:38.053635+0000","last_clean":"2024-09-12T16:56:38.053635+0000","last_became_active":"2024-09-12T16:52:06.226022+0000","last_became_peered":"2024-09-12T16:52:06.226022+0000","last_unstale":"2024-09-12T16:56:38.053635+0000","last_undegraded":"2024-09-12T16:56:38.053635+0000","last_fullsized":"2024-09-12T16:56:38.053635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:38.053453+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:38.053453+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.053453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.986575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.051166+0000","last_change":"2024-09-12T16:56:05.051013+0000","last_active":"2024-09-12T16:56:05.051166+0000","last_peered":"2024-09-12T16:56:05.051166+0000","last_clean":"2024-09-12T16:56:05.051166+0000","last_became_active":"2024-09-12T16:51:58.154089+0000","last_became_peered":"2024-09-12T16:51:58.154089+0000","last_unstale":"2024-09-12T16:56:05.051166+0000","last_undegraded":"2024-09-12T16:56:05.051166+0000","last_fullsized":"2024-09-12T16:56:05.051166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:05.050827+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.050827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:50.475409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.905402+0000","last_change":"2024-09-12T16:55:54.905168+0000","last_active":"2024-09-12T16:55:54.905402+0000","last_peered":"2024-09-12T16:55:54.905402+0000","last_clean":"2024-09-12T16:55:54.905402+0000","last_became_active":"2024-09-12T16:51:56.152161+0000","last_became_peered":"2024-09-12T16:51:56.152161+0000","last_unstale":"2024-09-12T16:55:54.905402+0000","last_undegraded":"2024-09-12T16:55:54.905402+0000","last_fullsized":"2024-09-12T16:55:54.905402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:54.904889+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:54.848288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.337432+0000","last_change":"2024-09-12T16:56:18.337308+0000","last_active":"2024-09-12T16:56:18.337432+0000","last_peered":"2024-09-12T16:56:18.337432+0000","last_clean":"2024-09-12T16:56:18.337432+0000","last_became_active":"2024-09-12T16:52:00.155289+0000","last_became_peered":"2024-09-12T16:52:00.155289+0000","last_unstale":"2024-09-12T16:56:18.337432+0000","last_undegraded":"2024-09-12T16:56:18.337432+0000","last_fullsized":"2024-09-12T16:56:18.337432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:18.337128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:18.337128+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.337128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:29.062021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:49.287543+0000","last_change":"2024-09-12T16:56:49.287543+0000","last_active":"2024-09-12T16:56:49.287543+0000","last_peered":"2024-09-12T16:56:49.287543+0000","last_clean":"2024-09-12T16:56:49.287543+0000","last_became_active":"2024-09-12T16:52:02.208937+0000","last_became_peered":"2024-09-12T16:52:02.208937+0000","last_unstale":"2024-09-12T16:56:49.287543+0000","last_undegraded":"2024-09-12T16:56:49.287543+0000","last_fullsized":"2024-09-12T16:56:49.287543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:49.287325+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:49.287325+0000","last_clean_scrub_stamp":"2024-09-12T16:56:49.287325+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:46.334963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.365019+0000","last_change":"2024-09-12T16:56:37.365019+0000","last_active":"2024-09-12T16:56:37.365019+0000","last_peered":"2024-09-12T16:56:37.365019+0000","last_clean":"2024-09-12T16:56:37.365019+0000","last_became_active":"2024-09-12T16:52:04.193944+0000","last_became_peered":"2024-09-12T16:52:04.193944+0000","last_unstale":"2024-09-12T16:56:37.365019+0000","last_undegraded":"2024-09-12T16:56:37.365019+0000","last_fullsized":"2024-09-12T16:56:37.365019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:37.364847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:37.364847+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.364847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:23.142205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.526572+0000","last_change":"2024-09-12T16:56:43.526572+0000","last_active":"2024-09-12T16:56:43.526572+0000","last_peered":"2024-09-12T16:56:43.526572+0000","last_clean":"2024-09-12T16:56:43.526572+0000","last_became_active":"2024-09-12T16:52:06.230416+0000","last_became_peered":"2024-09-12T16:52:06.230416+0000","last_unstale":"2024-09-12T16:56:43.526572+0000","last_undegraded":"2024-09-12T16:56:43.526572+0000","last_fullsized":"2024-09-12T16:56:43.526572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:43.526380+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:43.526380+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.526380+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:58.801749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:05.904512+0000","last_change":"2024-09-12T16:56:05.904375+0000","last_active":"2024-09-12T16:56:05.904512+0000","last_peered":"2024-09-12T16:56:05.904512+0000","last_clean":"2024-09-12T16:56:05.904512+0000","last_became_active":"2024-09-12T16:51:58.169430+0000","last_became_peered":"2024-09-12T16:51:58.169430+0000","last_unstale":"2024-09-12T16:56:05.904512+0000","last_undegraded":"2024-09-12T16:56:05.904512+0000","last_fullsized":"2024-09-12T16:56:05.904512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:05.904173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:05.904173+0000","last_clean_scrub_stamp":"2024-09-12T16:56:05.904173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:01.552829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.069390+0000","last_change":"2024-09-12T16:55:59.069150+0000","last_active":"2024-09-12T16:55:59.069390+0000","last_peered":"2024-09-12T16:55:59.069390+0000","last_clean":"2024-09-12T16:55:59.069390+0000","last_became_active":"2024-09-12T16:51:56.167789+0000","last_became_peered":"2024-09-12T16:51:56.167789+0000","last_unstale":"2024-09-12T16:55:59.069390+0000","last_undegraded":"2024-09-12T16:55:59.069390+0000","last_fullsized":"2024-09-12T16:55:59.069390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:59.068940+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.068940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:14.552968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.380181+0000","last_change":"2024-09-12T16:56:22.380045+0000","last_active":"2024-09-12T16:56:22.380181+0000","last_peered":"2024-09-12T16:56:22.380181+0000","last_clean":"2024-09-12T16:56:22.380181+0000","last_became_active":"2024-09-12T16:52:00.155204+0000","last_became_peered":"2024-09-12T16:52:00.155204+0000","last_unstale":"2024-09-12T16:56:22.380181+0000","last_undegraded":"2024-09-12T16:56:22.380181+0000","last_fullsized":"2024-09-12T16:56:22.380181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.379868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.379868+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.379868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:57.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'47","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:46.245164+0000","last_change":"2024-09-12T16:56:46.245164+0000","last_active":"2024-09-12T16:56:46.245164+0000","last_peered":"2024-09-12T16:56:46.245164+0000","last_clean":"2024-09-12T16:56:46.245164+0000","last_became_active":"2024-09-12T16:52:02.202317+0000","last_became_peered":"2024-09-12T16:52:02.202317+0000","last_unstale":"2024-09-12T16:56:46.245164+0000","last_undegraded":"2024-09-12T16:56:46.245164+0000","last_fullsized":"2024-09-12T16:56:46.245164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-12T16:56:46.244958+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-12T16:56:46.244958+0000","last_clean_scrub_stamp":"2024-09-12T16:56:46.244958+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:21.422041+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.317532+0000","last_change":"2024-09-12T16:56:36.317532+0000","last_active":"2024-09-12T16:56:36.317532+0000","last_peered":"2024-09-12T16:56:36.317532+0000","last_clean":"2024-09-12T16:56:36.317532+0000","last_became_active":"2024-09-12T16:52:04.193875+0000","last_became_peered":"2024-09-12T16:52:04.193875+0000","last_unstale":"2024-09-12T16:56:36.317532+0000","last_undegraded":"2024-09-12T16:56:36.317532+0000","last_fullsized":"2024-09-12T16:56:36.317532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.317357+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.317357+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.317357+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:50.723946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:44.490003+0000","last_change":"2024-09-12T16:56:44.490003+0000","last_active":"2024-09-12T16:56:44.490003+0000","last_peered":"2024-09-12T16:56:44.490003+0000","last_clean":"2024-09-12T16:56:44.490003+0000","last_became_active":"2024-09-12T16:52:06.235817+0000","last_became_peered":"2024-09-12T16:52:06.235817+0000","last_unstale":"2024-09-12T16:56:44.490003+0000","last_undegraded":"2024-09-12T16:56:44.490003+0000","last_fullsized":"2024-09-12T16:56:44.490003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:44.489803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:44.489803+0000","last_clean_scrub_stamp":"2024-09-12T16:56:44.489803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:10.877423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.925722+0000","last_change":"2024-09-12T16:56:04.925571+0000","last_active":"2024-09-12T16:56:04.925722+0000","last_peered":"2024-09-12T16:56:04.925722+0000","last_clean":"2024-09-12T16:56:04.925722+0000","last_became_active":"2024-09-12T16:51:58.140827+0000","last_became_peered":"2024-09-12T16:51:58.140827+0000","last_unstale":"2024-09-12T16:56:04.925722+0000","last_undegraded":"2024-09-12T16:56:04.925722+0000","last_fullsized":"2024-09-12T16:56:04.925722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:04.925364+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.925364+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:32.101898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.090663+0000","last_change":"2024-09-12T16:56:00.090533+0000","last_active":"2024-09-12T16:56:00.090663+0000","last_peered":"2024-09-12T16:56:00.090663+0000","last_clean":"2024-09-12T16:56:00.090663+0000","last_became_active":"2024-09-12T16:51:56.168775+0000","last_became_peered":"2024-09-12T16:51:56.168775+0000","last_unstale":"2024-09-12T16:56:00.090663+0000","last_undegraded":"2024-09-12T16:56:00.090663+0000","last_fullsized":"2024-09-12T16:56:00.090663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.090336+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.090336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:15.365705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.382408+0000","last_change":"2024-09-12T16:56:19.382163+0000","last_active":"2024-09-12T16:56:19.382408+0000","last_peered":"2024-09-12T16:56:19.382408+0000","last_clean":"2024-09-12T16:56:19.382408+0000","last_became_active":"2024-09-12T16:52:00.177446+0000","last_became_peered":"2024-09-12T16:52:00.177446+0000","last_unstale":"2024-09-12T16:56:19.382408+0000","last_undegraded":"2024-09-12T16:56:19.382408+0000","last_fullsized":"2024-09-12T16:56:19.382408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:19.381897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:19.381897+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.381897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:39.274144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'65","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:48.249523+0000","last_change":"2024-09-12T16:56:48.249523+0000","last_active":"2024-09-12T16:56:48.249523+0000","last_peered":"2024-09-12T16:56:48.249523+0000","last_clean":"2024-09-12T16:56:48.249523+0000","last_became_active":"2024-09-12T16:52:02.199556+0000","last_became_peered":"2024-09-12T16:52:02.199556+0000","last_unstale":"2024-09-12T16:56:48.249523+0000","last_undegraded":"2024-09-12T16:56:48.249523+0000","last_fullsized":"2024-09-12T16:56:48.249523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-12T16:56:48.249409+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-12T16:56:48.249409+0000","last_clean_scrub_stamp":"2024-09-12T16:56:48.249409+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:43.125924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.317586+0000","last_change":"2024-09-12T16:56:35.317586+0000","last_active":"2024-09-12T16:56:35.317586+0000","last_peered":"2024-09-12T16:56:35.317586+0000","last_clean":"2024-09-12T16:56:35.317586+0000","last_became_active":"2024-09-12T16:52:04.198214+0000","last_became_peered":"2024-09-12T16:52:04.198214+0000","last_unstale":"2024-09-12T16:56:35.317586+0000","last_undegraded":"2024-09-12T16:56:35.317586+0000","last_fullsized":"2024-09-12T16:56:35.317586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.317410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.317410+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.317410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:18.356487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:45.454932+0000","last_change":"2024-09-12T16:56:45.454932+0000","last_active":"2024-09-12T16:56:45.454932+0000","last_peered":"2024-09-12T16:56:45.454932+0000","last_clean":"2024-09-12T16:56:45.454932+0000","last_became_active":"2024-09-12T16:52:06.211401+0000","last_became_peered":"2024-09-12T16:52:06.211401+0000","last_unstale":"2024-09-12T16:56:45.454932+0000","last_undegraded":"2024-09-12T16:56:45.454932+0000","last_fullsized":"2024-09-12T16:56:45.454932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T16:56:45.454725+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T16:56:45.454725+0000","last_clean_scrub_stamp":"2024-09-12T16:56:45.454725+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:11.362289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.020950+0000","last_change":"2024-09-12T16:56:04.020804+0000","last_active":"2024-09-12T16:56:04.020950+0000","last_peered":"2024-09-12T16:56:04.020950+0000","last_clean":"2024-09-12T16:56:04.020950+0000","last_became_active":"2024-09-12T16:51:58.170824+0000","last_became_peered":"2024-09-12T16:51:58.170824+0000","last_unstale":"2024-09-12T16:56:04.020950+0000","last_undegraded":"2024-09-12T16:56:04.020950+0000","last_fullsized":"2024-09-12T16:56:04.020950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:04.020617+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.020617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:53.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.431669+0000","last_change":"2024-09-12T16:55:52.431517+0000","last_active":"2024-09-12T16:55:52.431669+0000","last_peered":"2024-09-12T16:55:52.431669+0000","last_clean":"2024-09-12T16:55:52.431669+0000","last_became_active":"2024-09-12T16:51:56.163295+0000","last_became_peered":"2024-09-12T16:51:56.163295+0000","last_unstale":"2024-09-12T16:55:52.431669+0000","last_undegraded":"2024-09-12T16:55:52.431669+0000","last_fullsized":"2024-09-12T16:55:52.431669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.431331+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.431331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:30.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.008607+0000","last_change":"2024-09-12T16:56:18.008472+0000","last_active":"2024-09-12T16:56:18.008607+0000","last_peered":"2024-09-12T16:56:18.008607+0000","last_clean":"2024-09-12T16:56:18.008607+0000","last_became_active":"2024-09-12T16:52:00.186494+0000","last_became_peered":"2024-09-12T16:52:00.186494+0000","last_unstale":"2024-09-12T16:56:18.008607+0000","last_undegraded":"2024-09-12T16:56:18.008607+0000","last_fullsized":"2024-09-12T16:56:18.008607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:18.008262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:18.008262+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.008262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:32.869069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'44","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.455387+0000","last_change":"2024-09-12T16:56:33.455122+0000","last_active":"2024-09-12T16:56:33.455387+0000","last_peered":"2024-09-12T16:56:33.455387+0000","last_clean":"2024-09-12T16:56:33.455387+0000","last_became_active":"2024-09-12T16:52:02.180632+0000","last_became_peered":"2024-09-12T16:52:02.180632+0000","last_unstale":"2024-09-12T16:56:33.455387+0000","last_undegraded":"2024-09-12T16:56:33.455387+0000","last_fullsized":"2024-09-12T16:56:33.455387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-09-12T16:56:33.454879+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-09-12T16:56:33.454879+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.454879+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:45.966553+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:03.462548+0000","last_change":"2024-09-12T16:57:03.462548+0000","last_active":"2024-09-12T16:57:03.462548+0000","last_peered":"2024-09-12T16:57:03.462548+0000","last_clean":"2024-09-12T16:57:03.462548+0000","last_became_active":"2024-09-12T16:52:04.213541+0000","last_became_peered":"2024-09-12T16:52:04.213541+0000","last_unstale":"2024-09-12T16:57:03.462548+0000","last_undegraded":"2024-09-12T16:57:03.462548+0000","last_fullsized":"2024-09-12T16:57:03.462548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:03.462366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:03.462366+0000","last_clean_scrub_stamp":"2024-09-12T16:57:03.462366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:25.098343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'8","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:04.421427+0000","last_change":"2024-09-12T16:57:04.421427+0000","last_active":"2024-09-12T16:57:04.421427+0000","last_peered":"2024-09-12T16:57:04.421427+0000","last_clean":"2024-09-12T16:57:04.421427+0000","last_became_active":"2024-09-12T16:52:06.231196+0000","last_became_peered":"2024-09-12T16:52:06.231196+0000","last_unstale":"2024-09-12T16:57:04.421427+0000","last_undegraded":"2024-09-12T16:57:04.421427+0000","last_fullsized":"2024-09-12T16:57:04.421427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:57:04.421198+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:57:04.421198+0000","last_clean_scrub_stamp":"2024-09-12T16:57:04.421198+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:18.067383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.007311+0000","last_change":"2024-09-12T16:56:19.007071+0000","last_active":"2024-09-12T16:56:19.007311+0000","last_peered":"2024-09-12T16:56:19.007311+0000","last_clean":"2024-09-12T16:56:19.007311+0000","last_became_active":"2024-09-12T16:51:58.172062+0000","last_became_peered":"2024-09-12T16:51:58.172062+0000","last_unstale":"2024-09-12T16:56:19.007311+0000","last_undegraded":"2024-09-12T16:56:19.007311+0000","last_fullsized":"2024-09-12T16:56:19.007311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:19.006789+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:19.006789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.006789+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:57.690077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:58.103221+0000","last_change":"2024-09-12T16:55:58.103087+0000","last_active":"2024-09-12T16:55:58.103221+0000","last_peered":"2024-09-12T16:55:58.103221+0000","last_clean":"2024-09-12T16:55:58.103221+0000","last_became_active":"2024-09-12T16:51:56.157813+0000","last_became_peered":"2024-09-12T16:51:56.157813+0000","last_unstale":"2024-09-12T16:55:58.103221+0000","last_undegraded":"2024-09-12T16:55:58.103221+0000","last_fullsized":"2024-09-12T16:55:58.103221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:58.102908+0000","last_clean_scrub_stamp":"2024-09-12T16:55:58.102908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:04.349009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.386158+0000","last_change":"2024-09-12T16:56:20.386007+0000","last_active":"2024-09-12T16:56:20.386158+0000","last_peered":"2024-09-12T16:56:20.386158+0000","last_clean":"2024-09-12T16:56:20.386158+0000","last_became_active":"2024-09-12T16:52:00.167282+0000","last_became_peered":"2024-09-12T16:52:00.167282+0000","last_unstale":"2024-09-12T16:56:20.386158+0000","last_undegraded":"2024-09-12T16:56:20.386158+0000","last_fullsized":"2024-09-12T16:56:20.386158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:20.385826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:20.385826+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.385826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:33.071596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.998018+0000","last_change":"2024-09-12T16:56:25.997882+0000","last_active":"2024-09-12T16:56:25.998018+0000","last_peered":"2024-09-12T16:56:25.998018+0000","last_clean":"2024-09-12T16:56:25.998018+0000","last_became_active":"2024-09-12T16:52:02.180683+0000","last_became_peered":"2024-09-12T16:52:02.180683+0000","last_unstale":"2024-09-12T16:56:25.998018+0000","last_undegraded":"2024-09-12T16:56:25.998018+0000","last_fullsized":"2024-09-12T16:56:25.998018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T16:56:25.997691+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T16:56:25.997691+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.997691+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:15.487181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.986764+0000","last_change":"2024-09-12T16:56:31.986615+0000","last_active":"2024-09-12T16:56:31.986764+0000","last_peered":"2024-09-12T16:56:31.986764+0000","last_clean":"2024-09-12T16:56:31.986764+0000","last_became_active":"2024-09-12T16:52:04.196932+0000","last_became_peered":"2024-09-12T16:52:04.196932+0000","last_unstale":"2024-09-12T16:56:31.986764+0000","last_undegraded":"2024-09-12T16:56:31.986764+0000","last_fullsized":"2024-09-12T16:56:31.986764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:31.986435+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:31.986435+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.986435+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:25.564125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'22","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:43.443777+0000","last_change":"2024-09-12T16:56:43.443777+0000","last_active":"2024-09-12T16:56:43.443777+0000","last_peered":"2024-09-12T16:56:43.443777+0000","last_clean":"2024-09-12T16:56:43.443777+0000","last_became_active":"2024-09-12T16:52:06.218957+0000","last_became_peered":"2024-09-12T16:52:06.218957+0000","last_unstale":"2024-09-12T16:56:43.443777+0000","last_undegraded":"2024-09-12T16:56:43.443777+0000","last_fullsized":"2024-09-12T16:56:43.443777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-12T16:56:43.443561+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-12T16:56:43.443561+0000","last_clean_scrub_stamp":"2024-09-12T16:56:43.443561+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:00.897956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.985410+0000","last_change":"2024-09-12T16:56:02.985161+0000","last_active":"2024-09-12T16:56:02.985410+0000","last_peered":"2024-09-12T16:56:02.985410+0000","last_clean":"2024-09-12T16:56:02.985410+0000","last_became_active":"2024-09-12T16:51:58.168518+0000","last_became_peered":"2024-09-12T16:51:58.168518+0000","last_unstale":"2024-09-12T16:56:02.985410+0000","last_undegraded":"2024-09-12T16:56:02.985410+0000","last_fullsized":"2024-09-12T16:56:02.985410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:02.984950+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.984950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:45.336637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.105792+0000","last_change":"2024-09-12T16:55:57.105529+0000","last_active":"2024-09-12T16:55:57.105792+0000","last_peered":"2024-09-12T16:55:57.105792+0000","last_clean":"2024-09-12T16:55:57.105792+0000","last_became_active":"2024-09-12T16:51:56.162876+0000","last_became_peered":"2024-09-12T16:51:56.162876+0000","last_unstale":"2024-09-12T16:55:57.105792+0000","last_undegraded":"2024-09-12T16:55:57.105792+0000","last_fullsized":"2024-09-12T16:55:57.105792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.105307+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.105307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:21.490837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'7","reported_seq":635,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.390694+0000","last_change":"2024-09-12T16:56:26.390535+0000","last_active":"2024-09-12T16:56:26.390694+0000","last_peered":"2024-09-12T16:56:26.390694+0000","last_clean":"2024-09-12T16:56:26.390694+0000","last_became_active":"2024-09-12T16:52:35.040673+0000","last_became_peered":"2024-09-12T16:52:35.040673+0000","last_unstale":"2024-09-12T16:56:26.390694+0000","last_undegraded":"2024-09-12T16:56:26.390694+0000","last_fullsized":"2024-09-12T16:56:26.390694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T16:56:26.390345+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T16:56:26.390345+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.390345+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:52.719580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":670,"num_read_kb":670,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:50.330572+0000","last_change":"2024-09-12T16:56:50.330572+0000","last_active":"2024-09-12T16:56:50.330572+0000","last_peered":"2024-09-12T16:56:50.330572+0000","last_clean":"2024-09-12T16:56:50.330572+0000","last_became_active":"2024-09-12T16:52:02.209231+0000","last_became_peered":"2024-09-12T16:52:02.209231+0000","last_unstale":"2024-09-12T16:56:50.330572+0000","last_undegraded":"2024-09-12T16:56:50.330572+0000","last_fullsized":"2024-09-12T16:56:50.330572+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T16:56:50.330396+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T16:56:50.330396+0000","last_clean_scrub_stamp":"2024-09-12T16:56:50.330396+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:33.940470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.521793+0000","last_change":"2024-09-12T16:56:37.521793+0000","last_active":"2024-09-12T16:56:37.521793+0000","last_peered":"2024-09-12T16:56:37.521793+0000","last_clean":"2024-09-12T16:56:37.521793+0000","last_became_active":"2024-09-12T16:52:04.199602+0000","last_became_peered":"2024-09-12T16:52:04.199602+0000","last_unstale":"2024-09-12T16:56:37.521793+0000","last_undegraded":"2024-09-12T16:56:37.521793+0000","last_fullsized":"2024-09-12T16:56:37.521793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:37.521618+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:37.521618+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.521618+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:42.714606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.054825+0000","last_change":"2024-09-12T16:56:37.054825+0000","last_active":"2024-09-12T16:56:37.054825+0000","last_peered":"2024-09-12T16:56:37.054825+0000","last_clean":"2024-09-12T16:56:37.054825+0000","last_became_active":"2024-09-12T16:52:06.221078+0000","last_became_peered":"2024-09-12T16:52:06.221078+0000","last_unstale":"2024-09-12T16:56:37.054825+0000","last_undegraded":"2024-09-12T16:56:37.054825+0000","last_fullsized":"2024-09-12T16:56:37.054825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:37.054637+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:37.054637+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.054637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:41.076261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.019783+0000","last_change":"2024-09-12T16:56:06.019629+0000","last_active":"2024-09-12T16:56:06.019783+0000","last_peered":"2024-09-12T16:56:06.019783+0000","last_clean":"2024-09-12T16:56:06.019783+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:06.019783+0000","last_undegraded":"2024-09-12T16:56:06.019783+0000","last_fullsized":"2024-09-12T16:56:06.019783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:06.019448+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.019448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:06.300837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.145123+0000","last_change":"2024-09-12T16:55:56.144883+0000","last_active":"2024-09-12T16:55:56.145123+0000","last_peered":"2024-09-12T16:55:56.145123+0000","last_clean":"2024-09-12T16:55:56.145123+0000","last_became_active":"2024-09-12T16:51:56.163464+0000","last_became_peered":"2024-09-12T16:51:56.163464+0000","last_unstale":"2024-09-12T16:55:56.145123+0000","last_undegraded":"2024-09-12T16:55:56.145123+0000","last_fullsized":"2024-09-12T16:55:56.145123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.144656+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.144656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:33.152646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.228993+0000","last_change":"2024-09-12T16:56:39.228993+0000","last_active":"2024-09-12T16:56:39.228993+0000","last_peered":"2024-09-12T16:56:39.228993+0000","last_clean":"2024-09-12T16:56:39.228993+0000","last_became_active":"2024-09-12T16:52:00.188643+0000","last_became_peered":"2024-09-12T16:52:00.188643+0000","last_unstale":"2024-09-12T16:56:39.228993+0000","last_undegraded":"2024-09-12T16:56:39.228993+0000","last_fullsized":"2024-09-12T16:56:39.228993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.228794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.228794+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.228794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:39.754327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.426959+0000","last_change":"2024-09-12T16:56:32.426735+0000","last_active":"2024-09-12T16:56:32.426959+0000","last_peered":"2024-09-12T16:56:32.426959+0000","last_clean":"2024-09-12T16:56:32.426959+0000","last_became_active":"2024-09-12T16:52:02.178652+0000","last_became_peered":"2024-09-12T16:52:02.178652+0000","last_unstale":"2024-09-12T16:56:32.426959+0000","last_undegraded":"2024-09-12T16:56:32.426959+0000","last_fullsized":"2024-09-12T16:56:32.426959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T16:56:32.426491+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T16:56:32.426491+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.426491+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:29.540681+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.953447+0000","last_change":"2024-09-12T16:56:30.953290+0000","last_active":"2024-09-12T16:56:30.953447+0000","last_peered":"2024-09-12T16:56:30.953447+0000","last_clean":"2024-09-12T16:56:30.953447+0000","last_became_active":"2024-09-12T16:52:04.211350+0000","last_became_peered":"2024-09-12T16:52:04.211350+0000","last_unstale":"2024-09-12T16:56:30.953447+0000","last_undegraded":"2024-09-12T16:56:30.953447+0000","last_fullsized":"2024-09-12T16:56:30.953447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:30.953116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:30.953116+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.953116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:00.872368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.528323+0000","last_change":"2024-09-12T16:56:42.528323+0000","last_active":"2024-09-12T16:56:42.528323+0000","last_peered":"2024-09-12T16:56:42.528323+0000","last_clean":"2024-09-12T16:56:42.528323+0000","last_became_active":"2024-09-12T16:52:06.227073+0000","last_became_peered":"2024-09-12T16:52:06.227073+0000","last_unstale":"2024-09-12T16:56:42.528323+0000","last_undegraded":"2024-09-12T16:56:42.528323+0000","last_fullsized":"2024-09-12T16:56:42.528323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-12T16:56:42.528129+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-12T16:56:42.528129+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.528129+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:58.012156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.048143+0000","last_change":"2024-09-12T16:56:17.048143+0000","last_active":"2024-09-12T16:56:17.048143+0000","last_peered":"2024-09-12T16:56:17.048143+0000","last_clean":"2024-09-12T16:56:17.048143+0000","last_became_active":"2024-09-12T16:51:58.171797+0000","last_became_peered":"2024-09-12T16:51:58.171797+0000","last_unstale":"2024-09-12T16:56:17.048143+0000","last_undegraded":"2024-09-12T16:56:17.048143+0000","last_fullsized":"2024-09-12T16:56:17.048143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:17.047963+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:17.047963+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.047963+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:42.891911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.965741+0000","last_change":"2024-09-12T16:55:47.965741+0000","last_active":"2024-09-12T16:55:47.965741+0000","last_peered":"2024-09-12T16:55:47.965741+0000","last_clean":"2024-09-12T16:55:47.965741+0000","last_became_active":"2024-09-12T16:51:41.679235+0000","last_became_peered":"2024-09-12T16:51:41.679235+0000","last_unstale":"2024-09-12T16:55:47.965741+0000","last_undegraded":"2024-09-12T16:55:47.965741+0000","last_fullsized":"2024-09-12T16:55:47.965741+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T16:55:47.965477+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.965477+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:53.674876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.217462+0000","last_change":"2024-09-12T16:55:51.217300+0000","last_active":"2024-09-12T16:55:51.217462+0000","last_peered":"2024-09-12T16:55:51.217462+0000","last_clean":"2024-09-12T16:55:51.217462+0000","last_became_active":"2024-09-12T16:51:46.388903+0000","last_became_peered":"2024-09-12T16:51:46.388903+0000","last_unstale":"2024-09-12T16:55:51.217462+0000","last_undegraded":"2024-09-12T16:55:51.217462+0000","last_fullsized":"2024-09-12T16:55:51.217462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.217110+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.217110+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:04.583269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001772673,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.156907+0000","last_change":"2024-09-12T16:55:54.156773+0000","last_active":"2024-09-12T16:55:54.156907+0000","last_peered":"2024-09-12T16:55:54.156907+0000","last_clean":"2024-09-12T16:55:54.156907+0000","last_became_active":"2024-09-12T16:51:56.167781+0000","last_became_peered":"2024-09-12T16:51:56.167781+0000","last_unstale":"2024-09-12T16:55:54.156907+0000","last_undegraded":"2024-09-12T16:55:54.156907+0000","last_fullsized":"2024-09-12T16:55:54.156907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:54.156592+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.156592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:41.292991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.301262+0000","last_change":"2024-09-12T16:56:22.301262+0000","last_active":"2024-09-12T16:56:22.301262+0000","last_peered":"2024-09-12T16:56:22.301262+0000","last_clean":"2024-09-12T16:56:22.301262+0000","last_became_active":"2024-09-12T16:52:00.164610+0000","last_became_peered":"2024-09-12T16:52:00.164610+0000","last_unstale":"2024-09-12T16:56:22.301262+0000","last_undegraded":"2024-09-12T16:56:22.301262+0000","last_fullsized":"2024-09-12T16:56:22.301262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.301082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.301082+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.301082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:33.733394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:45.213649+0000","last_change":"2024-09-12T16:56:45.213649+0000","last_active":"2024-09-12T16:56:45.213649+0000","last_peered":"2024-09-12T16:56:45.213649+0000","last_clean":"2024-09-12T16:56:45.213649+0000","last_became_active":"2024-09-12T16:52:02.208059+0000","last_became_peered":"2024-09-12T16:52:02.208059+0000","last_unstale":"2024-09-12T16:56:45.213649+0000","last_undegraded":"2024-09-12T16:56:45.213649+0000","last_fullsized":"2024-09-12T16:56:45.213649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-12T16:56:45.213465+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-12T16:56:45.213465+0000","last_clean_scrub_stamp":"2024-09-12T16:56:45.213465+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.026418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.310119+0000","last_change":"2024-09-12T16:56:34.310119+0000","last_active":"2024-09-12T16:56:34.310119+0000","last_peered":"2024-09-12T16:56:34.310119+0000","last_clean":"2024-09-12T16:56:34.310119+0000","last_became_active":"2024-09-12T16:52:04.189742+0000","last_became_peered":"2024-09-12T16:52:04.189742+0000","last_unstale":"2024-09-12T16:56:34.310119+0000","last_undegraded":"2024-09-12T16:56:34.310119+0000","last_fullsized":"2024-09-12T16:56:34.310119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:34.309932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:34.309932+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.309932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:55.003538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.077725+0000","last_change":"2024-09-12T16:56:39.077725+0000","last_active":"2024-09-12T16:56:39.077725+0000","last_peered":"2024-09-12T16:56:39.077725+0000","last_clean":"2024-09-12T16:56:39.077725+0000","last_became_active":"2024-09-12T16:52:06.215653+0000","last_became_peered":"2024-09-12T16:52:06.215653+0000","last_unstale":"2024-09-12T16:56:39.077725+0000","last_undegraded":"2024-09-12T16:56:39.077725+0000","last_fullsized":"2024-09-12T16:56:39.077725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-09-12T16:56:39.077541+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-09-12T16:56:39.077541+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.077541+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:57.697338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:18.003628+0000","last_change":"2024-09-12T16:56:18.003458+0000","last_active":"2024-09-12T16:56:18.003628+0000","last_peered":"2024-09-12T16:56:18.003628+0000","last_clean":"2024-09-12T16:56:18.003628+0000","last_became_active":"2024-09-12T16:51:58.163133+0000","last_became_peered":"2024-09-12T16:51:58.163133+0000","last_unstale":"2024-09-12T16:56:18.003628+0000","last_undegraded":"2024-09-12T16:56:18.003628+0000","last_fullsized":"2024-09-12T16:56:18.003628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:18.003280+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:18.003280+0000","last_clean_scrub_stamp":"2024-09-12T16:56:18.003280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:21.904327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.222007+0000","last_change":"2024-09-12T16:55:49.222007+0000","last_active":"2024-09-12T16:55:49.222007+0000","last_peered":"2024-09-12T16:55:49.222007+0000","last_clean":"2024-09-12T16:55:49.222007+0000","last_became_active":"2024-09-12T16:51:46.386925+0000","last_became_peered":"2024-09-12T16:51:46.386925+0000","last_unstale":"2024-09-12T16:55:49.222007+0000","last_undegraded":"2024-09-12T16:55:49.222007+0000","last_fullsized":"2024-09-12T16:55:49.222007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.221820+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.221820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:10.179551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012370599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.395547+0000","last_change":"2024-09-12T16:55:51.395398+0000","last_active":"2024-09-12T16:55:51.395547+0000","last_peered":"2024-09-12T16:55:51.395547+0000","last_clean":"2024-09-12T16:55:51.395547+0000","last_became_active":"2024-09-12T16:51:56.163619+0000","last_became_peered":"2024-09-12T16:51:56.163619+0000","last_unstale":"2024-09-12T16:55:51.395547+0000","last_undegraded":"2024-09-12T16:55:51.395547+0000","last_fullsized":"2024-09-12T16:55:51.395547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:51.395218+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.395218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:23.022360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.277660+0000","last_change":"2024-09-12T16:56:38.277660+0000","last_active":"2024-09-12T16:56:38.277660+0000","last_peered":"2024-09-12T16:56:38.277660+0000","last_clean":"2024-09-12T16:56:38.277660+0000","last_became_active":"2024-09-12T16:52:35.039913+0000","last_became_peered":"2024-09-12T16:52:35.039913+0000","last_unstale":"2024-09-12T16:56:38.277660+0000","last_undegraded":"2024-09-12T16:56:38.277660+0000","last_fullsized":"2024-09-12T16:56:38.277660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:38.277489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:38.277489+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.277489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:24.398107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'296","reported_seq":523,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.435580+0000","last_change":"2024-09-12T16:56:31.435580+0000","last_active":"2024-09-12T16:56:31.435580+0000","last_peered":"2024-09-12T16:56:31.435580+0000","last_clean":"2024-09-12T16:56:31.435580+0000","last_became_active":"2024-09-12T16:52:02.205731+0000","last_became_peered":"2024-09-12T16:52:02.205731+0000","last_unstale":"2024-09-12T16:56:31.435580+0000","last_undegraded":"2024-09-12T16:56:31.435580+0000","last_fullsized":"2024-09-12T16:56:31.435580+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'296","last_scrub_stamp":"2024-09-12T16:56:31.435371+0000","last_deep_scrub":"34'296","last_deep_scrub_stamp":"2024-09-12T16:56:31.435371+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.435371+0000","objects_scrubbed":10,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:56.722358+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:56.366893+0000","last_change":"2024-09-12T16:56:56.366893+0000","last_active":"2024-09-12T16:56:56.366893+0000","last_peered":"2024-09-12T16:56:56.366893+0000","last_clean":"2024-09-12T16:56:56.366893+0000","last_became_active":"2024-09-12T16:52:04.208094+0000","last_became_peered":"2024-09-12T16:52:04.208094+0000","last_unstale":"2024-09-12T16:56:56.366893+0000","last_undegraded":"2024-09-12T16:56:56.366893+0000","last_fullsized":"2024-09-12T16:56:56.366893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:56.366715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:56.366715+0000","last_clean_scrub_stamp":"2024-09-12T16:56:56.366715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:44.954289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:45.534988+0000","last_change":"2024-09-12T16:56:45.534988+0000","last_active":"2024-09-12T16:56:45.534988+0000","last_peered":"2024-09-12T16:56:45.534988+0000","last_clean":"2024-09-12T16:56:45.534988+0000","last_became_active":"2024-09-12T16:52:06.227027+0000","last_became_peered":"2024-09-12T16:52:06.227027+0000","last_unstale":"2024-09-12T16:56:45.534988+0000","last_undegraded":"2024-09-12T16:56:45.534988+0000","last_fullsized":"2024-09-12T16:56:45.534988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T16:56:45.534804+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T16:56:45.534804+0000","last_clean_scrub_stamp":"2024-09-12T16:56:45.534804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:01.620213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'18","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.416324+0000","last_change":"2024-09-12T16:56:04.416157+0000","last_active":"2024-09-12T16:56:04.416324+0000","last_peered":"2024-09-12T16:56:04.416324+0000","last_clean":"2024-09-12T16:56:04.416324+0000","last_became_active":"2024-09-12T16:51:58.157802+0000","last_became_peered":"2024-09-12T16:51:58.157802+0000","last_unstale":"2024-09-12T16:56:04.416324+0000","last_undegraded":"2024-09-12T16:56:04.416324+0000","last_fullsized":"2024-09-12T16:56:04.416324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T16:56:04.415977+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T16:56:04.415977+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.415977+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:37.104330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.862977+0000","last_change":"2024-09-12T16:55:48.862720+0000","last_active":"2024-09-12T16:55:48.862977+0000","last_peered":"2024-09-12T16:55:48.862977+0000","last_clean":"2024-09-12T16:55:48.862977+0000","last_became_active":"2024-09-12T16:51:46.385747+0000","last_became_peered":"2024-09-12T16:51:46.385747+0000","last_unstale":"2024-09-12T16:55:48.862977+0000","last_undegraded":"2024-09-12T16:55:48.862977+0000","last_fullsized":"2024-09-12T16:55:48.862977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.862498+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.862498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:44.689046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00087427000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.400482+0000","last_change":"2024-09-12T16:55:48.400348+0000","last_active":"2024-09-12T16:55:48.400482+0000","last_peered":"2024-09-12T16:55:48.400482+0000","last_clean":"2024-09-12T16:55:48.400482+0000","last_became_active":"2024-09-12T16:51:56.165711+0000","last_became_peered":"2024-09-12T16:51:56.165711+0000","last_unstale":"2024-09-12T16:55:48.400482+0000","last_undegraded":"2024-09-12T16:55:48.400482+0000","last_fullsized":"2024-09-12T16:55:48.400482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:48.400137+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.400137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:03.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.977807+0000","last_change":"2024-09-12T16:56:16.977655+0000","last_active":"2024-09-12T16:56:16.977807+0000","last_peered":"2024-09-12T16:56:16.977807+0000","last_clean":"2024-09-12T16:56:16.977807+0000","last_became_active":"2024-09-12T16:52:35.036150+0000","last_became_peered":"2024-09-12T16:52:35.036150+0000","last_unstale":"2024-09-12T16:56:16.977807+0000","last_undegraded":"2024-09-12T16:56:16.977807+0000","last_fullsized":"2024-09-12T16:56:16.977807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:16.977493+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:16.977493+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.977493+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.955215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.977261+0000","last_change":"2024-09-12T16:56:23.977261+0000","last_active":"2024-09-12T16:56:23.977261+0000","last_peered":"2024-09-12T16:56:23.977261+0000","last_clean":"2024-09-12T16:56:23.977261+0000","last_became_active":"2024-09-12T16:52:02.182384+0000","last_became_peered":"2024-09-12T16:52:02.182384+0000","last_unstale":"2024-09-12T16:56:23.977261+0000","last_undegraded":"2024-09-12T16:56:23.977261+0000","last_fullsized":"2024-09-12T16:56:23.977261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-12T16:56:23.977064+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-12T16:56:23.977064+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.977064+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:21.211807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.304696+0000","last_change":"2024-09-12T16:56:33.304696+0000","last_active":"2024-09-12T16:56:33.304696+0000","last_peered":"2024-09-12T16:56:33.304696+0000","last_clean":"2024-09-12T16:56:33.304696+0000","last_became_active":"2024-09-12T16:52:04.189178+0000","last_became_peered":"2024-09-12T16:52:04.189178+0000","last_unstale":"2024-09-12T16:56:33.304696+0000","last_undegraded":"2024-09-12T16:56:33.304696+0000","last_fullsized":"2024-09-12T16:56:33.304696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:33.304516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:33.304516+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.304516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:08.164344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:12.485657+0000","last_change":"2024-09-12T16:57:12.485657+0000","last_active":"2024-09-12T16:57:12.485657+0000","last_peered":"2024-09-12T16:57:12.485657+0000","last_clean":"2024-09-12T16:57:12.485657+0000","last_became_active":"2024-09-12T16:52:06.228494+0000","last_became_peered":"2024-09-12T16:52:06.228494+0000","last_unstale":"2024-09-12T16:57:12.485657+0000","last_undegraded":"2024-09-12T16:57:12.485657+0000","last_fullsized":"2024-09-12T16:57:12.485657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:12.485422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:12.485422+0000","last_clean_scrub_stamp":"2024-09-12T16:57:12.485422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:28.262514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.425100+0000","last_change":"2024-09-12T16:56:03.424942+0000","last_active":"2024-09-12T16:56:03.425100+0000","last_peered":"2024-09-12T16:56:03.425100+0000","last_clean":"2024-09-12T16:56:03.425100+0000","last_became_active":"2024-09-12T16:51:58.151295+0000","last_became_peered":"2024-09-12T16:51:58.151295+0000","last_unstale":"2024-09-12T16:56:03.425100+0000","last_undegraded":"2024-09-12T16:56:03.425100+0000","last_fullsized":"2024-09-12T16:56:03.425100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.424770+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.424770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:52.914259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.245625+0000","last_change":"2024-09-12T16:55:50.245475+0000","last_active":"2024-09-12T16:55:50.245625+0000","last_peered":"2024-09-12T16:55:50.245625+0000","last_clean":"2024-09-12T16:55:50.245625+0000","last_became_active":"2024-09-12T16:51:46.387116+0000","last_became_peered":"2024-09-12T16:51:46.387116+0000","last_unstale":"2024-09-12T16:55:50.245625+0000","last_undegraded":"2024-09-12T16:55:50.245625+0000","last_fullsized":"2024-09-12T16:55:50.245625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:55:50.245287+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.245287+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:59.801323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024236079999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.874234+0000","last_change":"2024-09-12T16:55:49.874078+0000","last_active":"2024-09-12T16:55:49.874234+0000","last_peered":"2024-09-12T16:55:49.874234+0000","last_clean":"2024-09-12T16:55:49.874234+0000","last_became_active":"2024-09-12T16:51:56.148558+0000","last_became_peered":"2024-09-12T16:51:56.148558+0000","last_unstale":"2024-09-12T16:55:49.874234+0000","last_undegraded":"2024-09-12T16:55:49.874234+0000","last_fullsized":"2024-09-12T16:55:49.874234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.873862+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.873862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:42.226676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.331395+0000","last_change":"2024-09-12T16:56:17.331395+0000","last_active":"2024-09-12T16:56:17.331395+0000","last_peered":"2024-09-12T16:56:17.331395+0000","last_clean":"2024-09-12T16:56:17.331395+0000","last_became_active":"2024-09-12T16:52:00.188352+0000","last_became_peered":"2024-09-12T16:52:00.188352+0000","last_unstale":"2024-09-12T16:56:17.331395+0000","last_undegraded":"2024-09-12T16:56:17.331395+0000","last_fullsized":"2024-09-12T16:56:17.331395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:17.331215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:17.331215+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.331215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:34.713043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:47.273253+0000","last_change":"2024-09-12T16:56:47.273253+0000","last_active":"2024-09-12T16:56:47.273253+0000","last_peered":"2024-09-12T16:56:47.273253+0000","last_clean":"2024-09-12T16:56:47.273253+0000","last_became_active":"2024-09-12T16:52:02.206381+0000","last_became_peered":"2024-09-12T16:52:02.206381+0000","last_unstale":"2024-09-12T16:56:47.273253+0000","last_undegraded":"2024-09-12T16:56:47.273253+0000","last_fullsized":"2024-09-12T16:56:47.273253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T16:56:47.273061+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T16:56:47.273061+0000","last_clean_scrub_stamp":"2024-09-12T16:56:47.273061+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:50.975865+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:59.411343+0000","last_change":"2024-09-12T16:56:59.411343+0000","last_active":"2024-09-12T16:56:59.411343+0000","last_peered":"2024-09-12T16:56:59.411343+0000","last_clean":"2024-09-12T16:56:59.411343+0000","last_became_active":"2024-09-12T16:52:04.214339+0000","last_became_peered":"2024-09-12T16:52:04.214339+0000","last_unstale":"2024-09-12T16:56:59.411343+0000","last_undegraded":"2024-09-12T16:56:59.411343+0000","last_fullsized":"2024-09-12T16:56:59.411343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:59.411149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:59.411149+0000","last_clean_scrub_stamp":"2024-09-12T16:56:59.411149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:56.367968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:44.503552+0000","last_change":"2024-09-12T16:56:44.503552+0000","last_active":"2024-09-12T16:56:44.503552+0000","last_peered":"2024-09-12T16:56:44.503552+0000","last_clean":"2024-09-12T16:56:44.503552+0000","last_became_active":"2024-09-12T16:52:06.227907+0000","last_became_peered":"2024-09-12T16:52:06.227907+0000","last_unstale":"2024-09-12T16:56:44.503552+0000","last_undegraded":"2024-09-12T16:56:44.503552+0000","last_fullsized":"2024-09-12T16:56:44.503552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:44.503362+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:44.503362+0000","last_clean_scrub_stamp":"2024-09-12T16:56:44.503362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:31.767076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:02.055683+0000","last_change":"2024-09-12T16:56:02.055532+0000","last_active":"2024-09-12T16:56:02.055683+0000","last_peered":"2024-09-12T16:56:02.055683+0000","last_clean":"2024-09-12T16:56:02.055683+0000","last_became_active":"2024-09-12T16:51:58.172498+0000","last_became_peered":"2024-09-12T16:51:58.172498+0000","last_unstale":"2024-09-12T16:56:02.055683+0000","last_undegraded":"2024-09-12T16:56:02.055683+0000","last_fullsized":"2024-09-12T16:56:02.055683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:02.055341+0000","last_clean_scrub_stamp":"2024-09-12T16:56:02.055341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:23.968021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.860193+0000","last_change":"2024-09-12T16:55:50.859970+0000","last_active":"2024-09-12T16:55:50.860193+0000","last_peered":"2024-09-12T16:55:50.860193+0000","last_clean":"2024-09-12T16:55:50.860193+0000","last_became_active":"2024-09-12T16:51:56.146756+0000","last_became_peered":"2024-09-12T16:51:56.146756+0000","last_unstale":"2024-09-12T16:55:50.860193+0000","last_undegraded":"2024-09-12T16:55:50.860193+0000","last_fullsized":"2024-09-12T16:55:50.860193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.859731+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.859731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:21.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:47.421319+0000","last_change":"2024-09-12T16:55:47.421094+0000","last_active":"2024-09-12T16:55:47.421319+0000","last_peered":"2024-09-12T16:55:47.421319+0000","last_clean":"2024-09-12T16:55:47.421319+0000","last_became_active":"2024-09-12T16:51:46.390844+0000","last_became_peered":"2024-09-12T16:51:46.390844+0000","last_unstale":"2024-09-12T16:55:47.421319+0000","last_undegraded":"2024-09-12T16:55:47.421319+0000","last_fullsized":"2024-09-12T16:55:47.421319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:47.420892+0000","last_clean_scrub_stamp":"2024-09-12T16:55:47.420892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.729401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090498300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'7","reported_seq":242,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:16.362629+0000","last_change":"2024-09-12T16:56:16.362629+0000","last_active":"2024-09-12T16:56:16.362629+0000","last_peered":"2024-09-12T16:56:16.362629+0000","last_clean":"2024-09-12T16:56:16.362629+0000","last_became_active":"2024-09-12T16:52:00.159295+0000","last_became_peered":"2024-09-12T16:52:00.159295+0000","last_unstale":"2024-09-12T16:56:16.362629+0000","last_undegraded":"2024-09-12T16:56:16.362629+0000","last_fullsized":"2024-09-12T16:56:16.362629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T16:56:16.362444+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T16:56:16.362444+0000","last_clean_scrub_stamp":"2024-09-12T16:56:16.362444+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:59.250843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.396634+0000","last_change":"2024-09-12T16:56:25.396634+0000","last_active":"2024-09-12T16:56:25.396634+0000","last_peered":"2024-09-12T16:56:25.396634+0000","last_clean":"2024-09-12T16:56:25.396634+0000","last_became_active":"2024-09-12T16:52:02.174639+0000","last_became_peered":"2024-09-12T16:52:02.174639+0000","last_unstale":"2024-09-12T16:56:25.396634+0000","last_undegraded":"2024-09-12T16:56:25.396634+0000","last_fullsized":"2024-09-12T16:56:25.396634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-12T16:56:25.396434+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-12T16:56:25.396434+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.396434+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:15.354604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.993978+0000","last_change":"2024-09-12T16:56:29.993978+0000","last_active":"2024-09-12T16:56:29.993978+0000","last_peered":"2024-09-12T16:56:29.993978+0000","last_clean":"2024-09-12T16:56:29.993978+0000","last_became_active":"2024-09-12T16:52:04.201337+0000","last_became_peered":"2024-09-12T16:52:04.201337+0000","last_unstale":"2024-09-12T16:56:29.993978+0000","last_undegraded":"2024-09-12T16:56:29.993978+0000","last_fullsized":"2024-09-12T16:56:29.993978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:29.993783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:29.993783+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.993783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:34.283216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:46.442460+0000","last_change":"2024-09-12T16:56:46.442460+0000","last_active":"2024-09-12T16:56:46.442460+0000","last_peered":"2024-09-12T16:56:46.442460+0000","last_clean":"2024-09-12T16:56:46.442460+0000","last_became_active":"2024-09-12T16:52:06.229614+0000","last_became_peered":"2024-09-12T16:52:06.229614+0000","last_unstale":"2024-09-12T16:56:46.442460+0000","last_undegraded":"2024-09-12T16:56:46.442460+0000","last_fullsized":"2024-09-12T16:56:46.442460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-12T16:56:46.442284+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-12T16:56:46.442284+0000","last_clean_scrub_stamp":"2024-09-12T16:56:46.442284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:47.209656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.051578+0000","last_change":"2024-09-12T16:56:03.051439+0000","last_active":"2024-09-12T16:56:03.051578+0000","last_peered":"2024-09-12T16:56:03.051578+0000","last_clean":"2024-09-12T16:56:03.051578+0000","last_became_active":"2024-09-12T16:51:58.171099+0000","last_became_peered":"2024-09-12T16:51:58.171099+0000","last_unstale":"2024-09-12T16:56:03.051578+0000","last_undegraded":"2024-09-12T16:56:03.051578+0000","last_fullsized":"2024-09-12T16:56:03.051578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:03.051259+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.051259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.473399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.402509+0000","last_change":"2024-09-12T16:55:50.402377+0000","last_active":"2024-09-12T16:55:50.402509+0000","last_peered":"2024-09-12T16:55:50.402509+0000","last_clean":"2024-09-12T16:55:50.402509+0000","last_became_active":"2024-09-12T16:51:56.160103+0000","last_became_peered":"2024-09-12T16:51:56.160103+0000","last_unstale":"2024-09-12T16:55:50.402509+0000","last_undegraded":"2024-09-12T16:55:50.402509+0000","last_fullsized":"2024-09-12T16:55:50.402509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:50.402205+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.402205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:11.360564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.165501+0000","last_change":"2024-09-12T16:55:52.165355+0000","last_active":"2024-09-12T16:55:52.165501+0000","last_peered":"2024-09-12T16:55:52.165501+0000","last_clean":"2024-09-12T16:55:52.165501+0000","last_became_active":"2024-09-12T16:51:46.385853+0000","last_became_peered":"2024-09-12T16:51:46.385853+0000","last_unstale":"2024-09-12T16:55:52.165501+0000","last_undegraded":"2024-09-12T16:55:52.165501+0000","last_fullsized":"2024-09-12T16:55:52.165501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.165177+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.165177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:16.963650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001258987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:37.307006+0000","last_change":"2024-09-12T16:56:37.307006+0000","last_active":"2024-09-12T16:56:37.307006+0000","last_peered":"2024-09-12T16:56:37.307006+0000","last_clean":"2024-09-12T16:56:37.307006+0000","last_became_active":"2024-09-12T16:52:00.172816+0000","last_became_peered":"2024-09-12T16:52:00.172816+0000","last_unstale":"2024-09-12T16:56:37.307006+0000","last_undegraded":"2024-09-12T16:56:37.307006+0000","last_fullsized":"2024-09-12T16:56:37.307006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:37.306800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:37.306800+0000","last_clean_scrub_stamp":"2024-09-12T16:56:37.306800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:53.598461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.430435+0000","last_change":"2024-09-12T16:56:30.430435+0000","last_active":"2024-09-12T16:56:30.430435+0000","last_peered":"2024-09-12T16:56:30.430435+0000","last_clean":"2024-09-12T16:56:30.430435+0000","last_became_active":"2024-09-12T16:52:02.193320+0000","last_became_peered":"2024-09-12T16:52:02.193320+0000","last_unstale":"2024-09-12T16:56:30.430435+0000","last_undegraded":"2024-09-12T16:56:30.430435+0000","last_fullsized":"2024-09-12T16:56:30.430435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T16:56:30.430136+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T16:56:30.430136+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.430136+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:30.221458+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.510437+0000","last_change":"2024-09-12T16:56:36.510437+0000","last_active":"2024-09-12T16:56:36.510437+0000","last_peered":"2024-09-12T16:56:36.510437+0000","last_clean":"2024-09-12T16:56:36.510437+0000","last_became_active":"2024-09-12T16:52:04.191400+0000","last_became_peered":"2024-09-12T16:52:04.191400+0000","last_unstale":"2024-09-12T16:56:36.510437+0000","last_undegraded":"2024-09-12T16:56:36.510437+0000","last_fullsized":"2024-09-12T16:56:36.510437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.510254+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.510254+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.510254+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.362597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:06.431482+0000","last_change":"2024-09-12T16:57:06.431482+0000","last_active":"2024-09-12T16:57:06.431482+0000","last_peered":"2024-09-12T16:57:06.431482+0000","last_clean":"2024-09-12T16:57:06.431482+0000","last_became_active":"2024-09-12T16:52:06.214286+0000","last_became_peered":"2024-09-12T16:52:06.214286+0000","last_unstale":"2024-09-12T16:57:06.431482+0000","last_undegraded":"2024-09-12T16:57:06.431482+0000","last_fullsized":"2024-09-12T16:57:06.431482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:06.431301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:06.431301+0000","last_clean_scrub_stamp":"2024-09-12T16:57:06.431301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:08.113719+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.931993+0000","last_change":"2024-09-12T16:56:07.931844+0000","last_active":"2024-09-12T16:56:07.931993+0000","last_peered":"2024-09-12T16:56:07.931993+0000","last_clean":"2024-09-12T16:56:07.931993+0000","last_became_active":"2024-09-12T16:52:35.024296+0000","last_became_peered":"2024-09-12T16:52:35.024296+0000","last_unstale":"2024-09-12T16:56:07.931993+0000","last_undegraded":"2024-09-12T16:56:07.931993+0000","last_fullsized":"2024-09-12T16:56:07.931993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:07.931663+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:07.931663+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.931663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:16.321154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.157073+0000","last_change":"2024-09-12T16:55:55.156907+0000","last_active":"2024-09-12T16:55:55.157073+0000","last_peered":"2024-09-12T16:55:55.157073+0000","last_clean":"2024-09-12T16:55:55.157073+0000","last_became_active":"2024-09-12T16:51:56.168558+0000","last_became_peered":"2024-09-12T16:51:56.168558+0000","last_unstale":"2024-09-12T16:55:55.157073+0000","last_undegraded":"2024-09-12T16:55:55.157073+0000","last_fullsized":"2024-09-12T16:55:55.157073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.156716+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.156716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:37.213650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:49.363365+0000","last_change":"2024-09-12T16:55:49.363167+0000","last_active":"2024-09-12T16:55:49.363365+0000","last_peered":"2024-09-12T16:55:49.363365+0000","last_clean":"2024-09-12T16:55:49.363365+0000","last_became_active":"2024-09-12T16:51:46.390349+0000","last_became_peered":"2024-09-12T16:51:46.390349+0000","last_unstale":"2024-09-12T16:55:49.363365+0000","last_undegraded":"2024-09-12T16:55:49.363365+0000","last_fullsized":"2024-09-12T16:55:49.363365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:49.362978+0000","last_clean_scrub_stamp":"2024-09-12T16:55:49.362978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:34.316423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093050100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.355839+0000","last_change":"2024-09-12T16:56:36.355839+0000","last_active":"2024-09-12T16:56:36.355839+0000","last_peered":"2024-09-12T16:56:36.355839+0000","last_clean":"2024-09-12T16:56:36.355839+0000","last_became_active":"2024-09-12T16:52:00.161322+0000","last_became_peered":"2024-09-12T16:52:00.161322+0000","last_unstale":"2024-09-12T16:56:36.355839+0000","last_undegraded":"2024-09-12T16:56:36.355839+0000","last_fullsized":"2024-09-12T16:56:36.355839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:36.355657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:36.355657+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.355657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:06.072501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:44.224036+0000","last_change":"2024-09-12T16:56:44.224036+0000","last_active":"2024-09-12T16:56:44.224036+0000","last_peered":"2024-09-12T16:56:44.224036+0000","last_clean":"2024-09-12T16:56:44.224036+0000","last_became_active":"2024-09-12T16:52:02.212974+0000","last_became_peered":"2024-09-12T16:52:02.212974+0000","last_unstale":"2024-09-12T16:56:44.224036+0000","last_undegraded":"2024-09-12T16:56:44.224036+0000","last_fullsized":"2024-09-12T16:56:44.224036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:44.223806+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:44.223806+0000","last_clean_scrub_stamp":"2024-09-12T16:56:44.223806+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:26.413717+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:31.243543+0000","last_change":"2024-09-12T16:56:31.243543+0000","last_active":"2024-09-12T16:56:31.243543+0000","last_peered":"2024-09-12T16:56:31.243543+0000","last_clean":"2024-09-12T16:56:31.243543+0000","last_became_active":"2024-09-12T16:52:04.213004+0000","last_became_peered":"2024-09-12T16:52:04.213004+0000","last_unstale":"2024-09-12T16:56:31.243543+0000","last_undegraded":"2024-09-12T16:56:31.243543+0000","last_fullsized":"2024-09-12T16:56:31.243543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:31.243326+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:31.243326+0000","last_clean_scrub_stamp":"2024-09-12T16:56:31.243326+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:55.174015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:46.571321+0000","last_change":"2024-09-12T16:56:46.571321+0000","last_active":"2024-09-12T16:56:46.571321+0000","last_peered":"2024-09-12T16:56:46.571321+0000","last_clean":"2024-09-12T16:56:46.571321+0000","last_became_active":"2024-09-12T16:52:06.222774+0000","last_became_peered":"2024-09-12T16:52:06.222774+0000","last_unstale":"2024-09-12T16:56:46.571321+0000","last_undegraded":"2024-09-12T16:56:46.571321+0000","last_fullsized":"2024-09-12T16:56:46.571321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T16:56:46.571141+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T16:56:46.571141+0000","last_clean_scrub_stamp":"2024-09-12T16:56:46.571141+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:33.038093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.012997+0000","last_change":"2024-09-12T16:56:01.012738+0000","last_active":"2024-09-12T16:56:01.012997+0000","last_peered":"2024-09-12T16:56:01.012997+0000","last_clean":"2024-09-12T16:56:01.012997+0000","last_became_active":"2024-09-12T16:51:58.169296+0000","last_became_peered":"2024-09-12T16:51:58.169296+0000","last_unstale":"2024-09-12T16:56:01.012997+0000","last_undegraded":"2024-09-12T16:56:01.012997+0000","last_fullsized":"2024-09-12T16:56:01.012997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:01.012476+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.012476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:28.560043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:48.913060+0000","last_change":"2024-09-12T16:55:48.912884+0000","last_active":"2024-09-12T16:55:48.913060+0000","last_peered":"2024-09-12T16:55:48.913060+0000","last_clean":"2024-09-12T16:55:48.913060+0000","last_became_active":"2024-09-12T16:51:56.155872+0000","last_became_peered":"2024-09-12T16:51:56.155872+0000","last_unstale":"2024-09-12T16:55:48.913060+0000","last_undegraded":"2024-09-12T16:55:48.913060+0000","last_fullsized":"2024-09-12T16:55:48.913060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:48.912682+0000","last_clean_scrub_stamp":"2024-09-12T16:55:48.912682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:36.759579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.203291+0000","last_change":"2024-09-12T16:55:53.203060+0000","last_active":"2024-09-12T16:55:53.203291+0000","last_peered":"2024-09-12T16:55:53.203291+0000","last_clean":"2024-09-12T16:55:53.203291+0000","last_became_active":"2024-09-12T16:51:46.498264+0000","last_became_peered":"2024-09-12T16:51:46.498264+0000","last_unstale":"2024-09-12T16:55:53.203291+0000","last_undegraded":"2024-09-12T16:55:53.203291+0000","last_fullsized":"2024-09-12T16:55:53.203291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:53.202860+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.202860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:18.010245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024007680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.385039+0000","last_change":"2024-09-12T16:56:35.385039+0000","last_active":"2024-09-12T16:56:35.385039+0000","last_peered":"2024-09-12T16:56:35.385039+0000","last_clean":"2024-09-12T16:56:35.385039+0000","last_became_active":"2024-09-12T16:52:00.173271+0000","last_became_peered":"2024-09-12T16:52:00.173271+0000","last_unstale":"2024-09-12T16:56:35.385039+0000","last_undegraded":"2024-09-12T16:56:35.385039+0000","last_fullsized":"2024-09-12T16:56:35.385039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.384859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.384859+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.384859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:14.732353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'99","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:23.022342+0000","last_change":"2024-09-12T16:56:23.022342+0000","last_active":"2024-09-12T16:56:23.022342+0000","last_peered":"2024-09-12T16:56:23.022342+0000","last_clean":"2024-09-12T16:56:23.022342+0000","last_became_active":"2024-09-12T16:52:02.186738+0000","last_became_peered":"2024-09-12T16:52:02.186738+0000","last_unstale":"2024-09-12T16:56:23.022342+0000","last_undegraded":"2024-09-12T16:56:23.022342+0000","last_fullsized":"2024-09-12T16:56:23.022342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'99","last_scrub_stamp":"2024-09-12T16:56:23.022095+0000","last_deep_scrub":"34'99","last_deep_scrub_stamp":"2024-09-12T16:56:23.022095+0000","last_clean_scrub_stamp":"2024-09-12T16:56:23.022095+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:37.853754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:32.265791+0000","last_change":"2024-09-12T16:56:32.265791+0000","last_active":"2024-09-12T16:56:32.265791+0000","last_peered":"2024-09-12T16:56:32.265791+0000","last_clean":"2024-09-12T16:56:32.265791+0000","last_became_active":"2024-09-12T16:52:04.205270+0000","last_became_peered":"2024-09-12T16:52:04.205270+0000","last_unstale":"2024-09-12T16:56:32.265791+0000","last_undegraded":"2024-09-12T16:56:32.265791+0000","last_fullsized":"2024-09-12T16:56:32.265791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:32.265577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:32.265577+0000","last_clean_scrub_stamp":"2024-09-12T16:56:32.265577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:52.104440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.073334+0000","last_change":"2024-09-12T16:56:40.073334+0000","last_active":"2024-09-12T16:56:40.073334+0000","last_peered":"2024-09-12T16:56:40.073334+0000","last_clean":"2024-09-12T16:56:40.073334+0000","last_became_active":"2024-09-12T16:52:06.225484+0000","last_became_peered":"2024-09-12T16:52:06.225484+0000","last_unstale":"2024-09-12T16:56:40.073334+0000","last_undegraded":"2024-09-12T16:56:40.073334+0000","last_fullsized":"2024-09-12T16:56:40.073334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.073152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.073152+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.073152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:40.350196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.052871+0000","last_change":"2024-09-12T16:56:42.052871+0000","last_active":"2024-09-12T16:56:42.052871+0000","last_peered":"2024-09-12T16:56:42.052871+0000","last_clean":"2024-09-12T16:56:42.052871+0000","last_became_active":"2024-09-12T16:52:06.233041+0000","last_became_peered":"2024-09-12T16:52:06.233041+0000","last_unstale":"2024-09-12T16:56:42.052871+0000","last_undegraded":"2024-09-12T16:56:42.052871+0000","last_fullsized":"2024-09-12T16:56:42.052871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:42.052687+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:42.052687+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.052687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:08.274004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.951793+0000","last_change":"2024-09-12T16:56:08.951658+0000","last_active":"2024-09-12T16:56:08.951793+0000","last_peered":"2024-09-12T16:56:08.951793+0000","last_clean":"2024-09-12T16:56:08.951793+0000","last_became_active":"2024-09-12T16:51:58.168373+0000","last_became_peered":"2024-09-12T16:51:58.168373+0000","last_unstale":"2024-09-12T16:56:08.951793+0000","last_undegraded":"2024-09-12T16:56:08.951793+0000","last_fullsized":"2024-09-12T16:56:08.951793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:08.951469+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:08.951469+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.951469+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:13.785426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.017328+0000","last_change":"2024-09-12T16:56:03.017156+0000","last_active":"2024-09-12T16:56:03.017328+0000","last_peered":"2024-09-12T16:56:03.017328+0000","last_clean":"2024-09-12T16:56:03.017328+0000","last_became_active":"2024-09-12T16:51:56.162939+0000","last_became_peered":"2024-09-12T16:51:56.162939+0000","last_unstale":"2024-09-12T16:56:03.017328+0000","last_undegraded":"2024-09-12T16:56:03.017328+0000","last_fullsized":"2024-09-12T16:56:03.017328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:03.016945+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.016945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:49.483897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.339227+0000","last_change":"2024-09-12T16:56:24.339081+0000","last_active":"2024-09-12T16:56:24.339227+0000","last_peered":"2024-09-12T16:56:24.339227+0000","last_clean":"2024-09-12T16:56:24.339227+0000","last_became_active":"2024-09-12T16:52:00.175235+0000","last_became_peered":"2024-09-12T16:52:00.175235+0000","last_unstale":"2024-09-12T16:56:24.339227+0000","last_undegraded":"2024-09-12T16:56:24.339227+0000","last_fullsized":"2024-09-12T16:56:24.339227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:24.338899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:24.338899+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.338899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:22.081195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:52.329349+0000","last_change":"2024-09-12T16:56:52.329349+0000","last_active":"2024-09-12T16:56:52.329349+0000","last_peered":"2024-09-12T16:56:52.329349+0000","last_clean":"2024-09-12T16:56:52.329349+0000","last_became_active":"2024-09-12T16:52:02.193375+0000","last_became_peered":"2024-09-12T16:52:02.193375+0000","last_unstale":"2024-09-12T16:56:52.329349+0000","last_undegraded":"2024-09-12T16:56:52.329349+0000","last_fullsized":"2024-09-12T16:56:52.329349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T16:56:52.329138+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T16:56:52.329138+0000","last_clean_scrub_stamp":"2024-09-12T16:56:52.329138+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:37.965766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:58.364848+0000","last_change":"2024-09-12T16:56:58.364848+0000","last_active":"2024-09-12T16:56:58.364848+0000","last_peered":"2024-09-12T16:56:58.364848+0000","last_clean":"2024-09-12T16:56:58.364848+0000","last_became_active":"2024-09-12T16:52:04.214721+0000","last_became_peered":"2024-09-12T16:52:04.214721+0000","last_unstale":"2024-09-12T16:56:58.364848+0000","last_undegraded":"2024-09-12T16:56:58.364848+0000","last_fullsized":"2024-09-12T16:56:58.364848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:58.364669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:58.364669+0000","last_clean_scrub_stamp":"2024-09-12T16:56:58.364669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:58.010538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'15","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:50.392251+0000","last_change":"2024-09-12T16:56:50.392251+0000","last_active":"2024-09-12T16:56:50.392251+0000","last_peered":"2024-09-12T16:56:50.392251+0000","last_clean":"2024-09-12T16:56:50.392251+0000","last_became_active":"2024-09-12T16:52:06.211718+0000","last_became_peered":"2024-09-12T16:52:06.211718+0000","last_unstale":"2024-09-12T16:56:50.392251+0000","last_undegraded":"2024-09-12T16:56:50.392251+0000","last_fullsized":"2024-09-12T16:56:50.392251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:50.392063+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:50.392063+0000","last_clean_scrub_stamp":"2024-09-12T16:56:50.392063+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:34.077035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":71,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'28","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.066320+0000","last_change":"2024-09-12T16:56:07.066153+0000","last_active":"2024-09-12T16:56:07.066320+0000","last_peered":"2024-09-12T16:56:07.066320+0000","last_clean":"2024-09-12T16:56:07.066320+0000","last_became_active":"2024-09-12T16:51:58.172074+0000","last_became_peered":"2024-09-12T16:51:58.172074+0000","last_unstale":"2024-09-12T16:56:07.066320+0000","last_undegraded":"2024-09-12T16:56:07.066320+0000","last_fullsized":"2024-09-12T16:56:07.066320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-12T16:56:07.065953+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-12T16:56:07.065953+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.065953+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:47.680595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.910089+0000","last_change":"2024-09-12T16:55:52.909961+0000","last_active":"2024-09-12T16:55:52.910089+0000","last_peered":"2024-09-12T16:55:52.910089+0000","last_clean":"2024-09-12T16:55:52.910089+0000","last_became_active":"2024-09-12T16:51:56.151612+0000","last_became_peered":"2024-09-12T16:51:56.151612+0000","last_unstale":"2024-09-12T16:55:52.910089+0000","last_undegraded":"2024-09-12T16:55:52.910089+0000","last_fullsized":"2024-09-12T16:55:52.910089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.909777+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.909777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:08.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.258683+0000","last_change":"2024-09-12T16:56:41.258683+0000","last_active":"2024-09-12T16:56:41.258683+0000","last_peered":"2024-09-12T16:56:41.258683+0000","last_clean":"2024-09-12T16:56:41.258683+0000","last_became_active":"2024-09-12T16:52:00.182725+0000","last_became_peered":"2024-09-12T16:52:00.182725+0000","last_unstale":"2024-09-12T16:56:41.258683+0000","last_undegraded":"2024-09-12T16:56:41.258683+0000","last_fullsized":"2024-09-12T16:56:41.258683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.258497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.258497+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.258497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:58.919770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.380532+0000","last_change":"2024-09-12T16:56:26.380375+0000","last_active":"2024-09-12T16:56:26.380532+0000","last_peered":"2024-09-12T16:56:26.380532+0000","last_clean":"2024-09-12T16:56:26.380532+0000","last_became_active":"2024-09-12T16:52:02.183529+0000","last_became_peered":"2024-09-12T16:52:02.183529+0000","last_unstale":"2024-09-12T16:56:26.380532+0000","last_undegraded":"2024-09-12T16:56:26.380532+0000","last_fullsized":"2024-09-12T16:56:26.380532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:26.380124+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:26.380124+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.380124+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:39.927808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:34.024043+0000","last_change":"2024-09-12T16:56:34.023907+0000","last_active":"2024-09-12T16:56:34.024043+0000","last_peered":"2024-09-12T16:56:34.024043+0000","last_clean":"2024-09-12T16:56:34.024043+0000","last_became_active":"2024-09-12T16:52:04.216114+0000","last_became_peered":"2024-09-12T16:52:04.216114+0000","last_unstale":"2024-09-12T16:56:34.024043+0000","last_undegraded":"2024-09-12T16:56:34.024043+0000","last_fullsized":"2024-09-12T16:56:34.024043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:34.023724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:34.023724+0000","last_clean_scrub_stamp":"2024-09-12T16:56:34.023724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:13.216005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:49.410253+0000","last_change":"2024-09-12T16:56:49.410016+0000","last_active":"2024-09-12T16:56:49.410253+0000","last_peered":"2024-09-12T16:56:49.410253+0000","last_clean":"2024-09-12T16:56:49.410253+0000","last_became_active":"2024-09-12T16:52:06.224514+0000","last_became_peered":"2024-09-12T16:52:06.224514+0000","last_unstale":"2024-09-12T16:56:49.410253+0000","last_undegraded":"2024-09-12T16:56:49.410253+0000","last_fullsized":"2024-09-12T16:56:49.410253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:49.409804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:49.409804+0000","last_clean_scrub_stamp":"2024-09-12T16:56:49.409804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:56.501617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.390725+0000","last_change":"2024-09-12T16:56:06.390574+0000","last_active":"2024-09-12T16:56:06.390725+0000","last_peered":"2024-09-12T16:56:06.390725+0000","last_clean":"2024-09-12T16:56:06.390725+0000","last_became_active":"2024-09-12T16:51:58.171151+0000","last_became_peered":"2024-09-12T16:51:58.171151+0000","last_unstale":"2024-09-12T16:56:06.390725+0000","last_undegraded":"2024-09-12T16:56:06.390725+0000","last_fullsized":"2024-09-12T16:56:06.390725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.390389+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.390389+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.390389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:52.854862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.924715+0000","last_change":"2024-09-12T16:55:55.924579+0000","last_active":"2024-09-12T16:55:55.924715+0000","last_peered":"2024-09-12T16:55:55.924715+0000","last_clean":"2024-09-12T16:55:55.924715+0000","last_became_active":"2024-09-12T16:51:56.151946+0000","last_became_peered":"2024-09-12T16:51:56.151946+0000","last_unstale":"2024-09-12T16:55:55.924715+0000","last_undegraded":"2024-09-12T16:55:55.924715+0000","last_fullsized":"2024-09-12T16:55:55.924715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:55.924395+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.924395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:20.071350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.042073+0000","last_change":"2024-09-12T16:56:19.041934+0000","last_active":"2024-09-12T16:56:19.042073+0000","last_peered":"2024-09-12T16:56:19.042073+0000","last_clean":"2024-09-12T16:56:19.042073+0000","last_became_active":"2024-09-12T16:52:00.162912+0000","last_became_peered":"2024-09-12T16:52:00.162912+0000","last_unstale":"2024-09-12T16:56:19.042073+0000","last_undegraded":"2024-09-12T16:56:19.042073+0000","last_fullsized":"2024-09-12T16:56:19.042073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:19.041752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:19.041752+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.041752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:05.426092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.277112+0000","last_change":"2024-09-12T16:56:29.276893+0000","last_active":"2024-09-12T16:56:29.277112+0000","last_peered":"2024-09-12T16:56:29.277112+0000","last_clean":"2024-09-12T16:56:29.277112+0000","last_became_active":"2024-09-12T16:52:02.179955+0000","last_became_peered":"2024-09-12T16:52:02.179955+0000","last_unstale":"2024-09-12T16:56:29.277112+0000","last_undegraded":"2024-09-12T16:56:29.277112+0000","last_fullsized":"2024-09-12T16:56:29.277112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T16:56:29.276611+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T16:56:29.276611+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.276611+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:38.113558+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:38.564390+0000","last_change":"2024-09-12T16:56:38.564242+0000","last_active":"2024-09-12T16:56:38.564390+0000","last_peered":"2024-09-12T16:56:38.564390+0000","last_clean":"2024-09-12T16:56:38.564390+0000","last_became_active":"2024-09-12T16:52:04.199896+0000","last_became_peered":"2024-09-12T16:52:04.199896+0000","last_unstale":"2024-09-12T16:56:38.564390+0000","last_undegraded":"2024-09-12T16:56:38.564390+0000","last_fullsized":"2024-09-12T16:56:38.564390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:38.564057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:38.564057+0000","last_clean_scrub_stamp":"2024-09-12T16:56:38.564057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.113739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:13.526123+0000","last_change":"2024-09-12T16:57:13.526123+0000","last_active":"2024-09-12T16:57:13.526123+0000","last_peered":"2024-09-12T16:57:13.526123+0000","last_clean":"2024-09-12T16:57:13.526123+0000","last_became_active":"2024-09-12T16:52:06.235993+0000","last_became_peered":"2024-09-12T16:52:06.235993+0000","last_unstale":"2024-09-12T16:57:13.526123+0000","last_undegraded":"2024-09-12T16:57:13.526123+0000","last_fullsized":"2024-09-12T16:57:13.526123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:13.525929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:13.525929+0000","last_clean_scrub_stamp":"2024-09-12T16:57:13.525929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:30.278056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.076128+0000","last_change":"2024-09-12T16:56:21.075950+0000","last_active":"2024-09-12T16:56:21.076128+0000","last_peered":"2024-09-12T16:56:21.076128+0000","last_clean":"2024-09-12T16:56:21.076128+0000","last_became_active":"2024-09-12T16:51:58.167659+0000","last_became_peered":"2024-09-12T16:51:58.167659+0000","last_unstale":"2024-09-12T16:56:21.076128+0000","last_undegraded":"2024-09-12T16:56:21.076128+0000","last_fullsized":"2024-09-12T16:56:21.076128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:21.075769+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:21.075769+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.075769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.894857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:50.912533+0000","last_change":"2024-09-12T16:55:50.912389+0000","last_active":"2024-09-12T16:55:50.912533+0000","last_peered":"2024-09-12T16:55:50.912533+0000","last_clean":"2024-09-12T16:55:50.912533+0000","last_became_active":"2024-09-12T16:51:56.155984+0000","last_became_peered":"2024-09-12T16:51:56.155984+0000","last_unstale":"2024-09-12T16:55:50.912533+0000","last_undegraded":"2024-09-12T16:55:50.912533+0000","last_fullsized":"2024-09-12T16:55:50.912533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:50.912183+0000","last_clean_scrub_stamp":"2024-09-12T16:55:50.912183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:49.304999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.255997+0000","last_change":"2024-09-12T16:56:40.255860+0000","last_active":"2024-09-12T16:56:40.255997+0000","last_peered":"2024-09-12T16:56:40.255997+0000","last_clean":"2024-09-12T16:56:40.255997+0000","last_became_active":"2024-09-12T16:52:00.176575+0000","last_became_peered":"2024-09-12T16:52:00.176575+0000","last_unstale":"2024-09-12T16:56:40.255997+0000","last_undegraded":"2024-09-12T16:56:40.255997+0000","last_fullsized":"2024-09-12T16:56:40.255997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.255676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.255676+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.255676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:51.456310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.035064+0000","last_change":"2024-09-12T16:56:27.034927+0000","last_active":"2024-09-12T16:56:27.035064+0000","last_peered":"2024-09-12T16:56:27.035064+0000","last_clean":"2024-09-12T16:56:27.035064+0000","last_became_active":"2024-09-12T16:52:02.179684+0000","last_became_peered":"2024-09-12T16:52:02.179684+0000","last_unstale":"2024-09-12T16:56:27.035064+0000","last_undegraded":"2024-09-12T16:56:27.035064+0000","last_fullsized":"2024-09-12T16:56:27.035064+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T16:56:27.034727+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T16:56:27.034727+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.034727+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:37.482595+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:33.001174+0000","last_change":"2024-09-12T16:56:33.000950+0000","last_active":"2024-09-12T16:56:33.001174+0000","last_peered":"2024-09-12T16:56:33.001174+0000","last_clean":"2024-09-12T16:56:33.001174+0000","last_became_active":"2024-09-12T16:52:04.211240+0000","last_became_peered":"2024-09-12T16:52:04.211240+0000","last_unstale":"2024-09-12T16:56:33.001174+0000","last_undegraded":"2024-09-12T16:56:33.001174+0000","last_fullsized":"2024-09-12T16:56:33.001174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:33.000688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:33.000688+0000","last_clean_scrub_stamp":"2024-09-12T16:56:33.000688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:33.437607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:26.140138+0000","last_change":"2024-09-12T16:56:26.140138+0000","last_active":"2024-09-12T16:56:26.140138+0000","last_peered":"2024-09-12T16:56:26.140138+0000","last_clean":"2024-09-12T16:56:26.140138+0000","last_became_active":"2024-09-12T16:51:58.158598+0000","last_became_peered":"2024-09-12T16:51:58.158598+0000","last_unstale":"2024-09-12T16:56:26.140138+0000","last_undegraded":"2024-09-12T16:56:26.140138+0000","last_fullsized":"2024-09-12T16:56:26.140138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:26.139956+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:26.139956+0000","last_clean_scrub_stamp":"2024-09-12T16:56:26.139956+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:20.790144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:03.984694+0000","last_change":"2024-09-12T16:56:03.984556+0000","last_active":"2024-09-12T16:56:03.984694+0000","last_peered":"2024-09-12T16:56:03.984694+0000","last_clean":"2024-09-12T16:56:03.984694+0000","last_became_active":"2024-09-12T16:51:56.155460+0000","last_became_peered":"2024-09-12T16:51:56.155460+0000","last_unstale":"2024-09-12T16:56:03.984694+0000","last_undegraded":"2024-09-12T16:56:03.984694+0000","last_fullsized":"2024-09-12T16:56:03.984694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:03.984372+0000","last_clean_scrub_stamp":"2024-09-12T16:56:03.984372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:57.918312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:24.361837+0000","last_change":"2024-09-12T16:56:24.361837+0000","last_active":"2024-09-12T16:56:24.361837+0000","last_peered":"2024-09-12T16:56:24.361837+0000","last_clean":"2024-09-12T16:56:24.361837+0000","last_became_active":"2024-09-12T16:52:00.158799+0000","last_became_peered":"2024-09-12T16:52:00.158799+0000","last_unstale":"2024-09-12T16:56:24.361837+0000","last_undegraded":"2024-09-12T16:56:24.361837+0000","last_fullsized":"2024-09-12T16:56:24.361837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:24.361658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:24.361658+0000","last_clean_scrub_stamp":"2024-09-12T16:56:24.361658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:46.577163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":141,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.336833+0000","last_change":"2024-09-12T16:56:27.336690+0000","last_active":"2024-09-12T16:56:27.336833+0000","last_peered":"2024-09-12T16:56:27.336833+0000","last_clean":"2024-09-12T16:56:27.336833+0000","last_became_active":"2024-09-12T16:52:02.183171+0000","last_became_peered":"2024-09-12T16:52:02.183171+0000","last_unstale":"2024-09-12T16:56:27.336833+0000","last_undegraded":"2024-09-12T16:56:27.336833+0000","last_fullsized":"2024-09-12T16:56:27.336833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-12T16:56:27.336501+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-12T16:56:27.336501+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.336501+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:09.229151+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.048187+0000","last_change":"2024-09-12T16:56:35.048187+0000","last_active":"2024-09-12T16:56:35.048187+0000","last_peered":"2024-09-12T16:56:35.048187+0000","last_clean":"2024-09-12T16:56:35.048187+0000","last_became_active":"2024-09-12T16:52:04.212066+0000","last_became_peered":"2024-09-12T16:52:04.212066+0000","last_unstale":"2024-09-12T16:56:35.048187+0000","last_undegraded":"2024-09-12T16:56:35.048187+0000","last_fullsized":"2024-09-12T16:56:35.048187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:35.047935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:35.047935+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.047935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:45.923390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:48.407217+0000","last_change":"2024-09-12T16:56:48.407070+0000","last_active":"2024-09-12T16:56:48.407217+0000","last_peered":"2024-09-12T16:56:48.407217+0000","last_clean":"2024-09-12T16:56:48.407217+0000","last_became_active":"2024-09-12T16:52:06.224113+0000","last_became_peered":"2024-09-12T16:52:06.224113+0000","last_unstale":"2024-09-12T16:56:48.407217+0000","last_undegraded":"2024-09-12T16:56:48.407217+0000","last_fullsized":"2024-09-12T16:56:48.407217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:48.406885+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:48.406885+0000","last_clean_scrub_stamp":"2024-09-12T16:56:48.406885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:05.820825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.377076+0000","last_change":"2024-09-12T16:56:08.377076+0000","last_active":"2024-09-12T16:56:08.377076+0000","last_peered":"2024-09-12T16:56:08.377076+0000","last_clean":"2024-09-12T16:56:08.377076+0000","last_became_active":"2024-09-12T16:51:58.156639+0000","last_became_peered":"2024-09-12T16:51:58.156639+0000","last_unstale":"2024-09-12T16:56:08.377076+0000","last_undegraded":"2024-09-12T16:56:08.377076+0000","last_fullsized":"2024-09-12T16:56:08.377076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:08.376890+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:08.376890+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.376890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:31.874130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:51.952068+0000","last_change":"2024-09-12T16:55:51.951922+0000","last_active":"2024-09-12T16:55:51.952068+0000","last_peered":"2024-09-12T16:55:51.952068+0000","last_clean":"2024-09-12T16:55:51.952068+0000","last_became_active":"2024-09-12T16:51:56.144765+0000","last_became_peered":"2024-09-12T16:51:56.144765+0000","last_unstale":"2024-09-12T16:55:51.952068+0000","last_undegraded":"2024-09-12T16:55:51.952068+0000","last_fullsized":"2024-09-12T16:55:51.952068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:55:51.951717+0000","last_clean_scrub_stamp":"2024-09-12T16:55:51.951717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.140563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:22.014305+0000","last_change":"2024-09-12T16:56:22.014305+0000","last_active":"2024-09-12T16:56:22.014305+0000","last_peered":"2024-09-12T16:56:22.014305+0000","last_clean":"2024-09-12T16:56:22.014305+0000","last_became_active":"2024-09-12T16:52:00.163330+0000","last_became_peered":"2024-09-12T16:52:00.163330+0000","last_unstale":"2024-09-12T16:56:22.014305+0000","last_undegraded":"2024-09-12T16:56:22.014305+0000","last_fullsized":"2024-09-12T16:56:22.014305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:22.014069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:22.014069+0000","last_clean_scrub_stamp":"2024-09-12T16:56:22.014069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:56.910230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:54.392515+0000","last_change":"2024-09-12T16:56:54.392367+0000","last_active":"2024-09-12T16:56:54.392515+0000","last_peered":"2024-09-12T16:56:54.392515+0000","last_clean":"2024-09-12T16:56:54.392515+0000","last_became_active":"2024-09-12T16:52:02.211827+0000","last_became_peered":"2024-09-12T16:52:02.211827+0000","last_unstale":"2024-09-12T16:56:54.392515+0000","last_undegraded":"2024-09-12T16:56:54.392515+0000","last_fullsized":"2024-09-12T16:56:54.392515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T16:56:54.392165+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T16:56:54.392165+0000","last_clean_scrub_stamp":"2024-09-12T16:56:54.392165+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:12.306772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:40.502642+0000","last_change":"2024-09-12T16:56:40.502512+0000","last_active":"2024-09-12T16:56:40.502642+0000","last_peered":"2024-09-12T16:56:40.502642+0000","last_clean":"2024-09-12T16:56:40.502642+0000","last_became_active":"2024-09-12T16:52:04.210038+0000","last_became_peered":"2024-09-12T16:52:04.210038+0000","last_unstale":"2024-09-12T16:56:40.502642+0000","last_undegraded":"2024-09-12T16:56:40.502642+0000","last_fullsized":"2024-09-12T16:56:40.502642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:40.502328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:40.502328+0000","last_clean_scrub_stamp":"2024-09-12T16:56:40.502328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:48.888476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:08.424519+0000","last_change":"2024-09-12T16:57:08.424519+0000","last_active":"2024-09-12T16:57:08.424519+0000","last_peered":"2024-09-12T16:57:08.424519+0000","last_clean":"2024-09-12T16:57:08.424519+0000","last_became_active":"2024-09-12T16:52:06.223903+0000","last_became_peered":"2024-09-12T16:52:06.223903+0000","last_unstale":"2024-09-12T16:57:08.424519+0000","last_undegraded":"2024-09-12T16:57:08.424519+0000","last_fullsized":"2024-09-12T16:57:08.424519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:08.424233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:08.424233+0000","last_clean_scrub_stamp":"2024-09-12T16:57:08.424233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:51.269010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'28","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.121223+0000","last_change":"2024-09-12T16:56:27.121052+0000","last_active":"2024-09-12T16:56:27.121223+0000","last_peered":"2024-09-12T16:56:27.121223+0000","last_clean":"2024-09-12T16:56:27.121223+0000","last_became_active":"2024-09-12T16:51:58.172129+0000","last_became_peered":"2024-09-12T16:51:58.172129+0000","last_unstale":"2024-09-12T16:56:27.121223+0000","last_undegraded":"2024-09-12T16:56:27.121223+0000","last_fullsized":"2024-09-12T16:56:27.121223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'28","last_scrub_stamp":"2024-09-12T16:56:27.120876+0000","last_deep_scrub":"34'28","last_deep_scrub_stamp":"2024-09-12T16:56:27.120876+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.120876+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:07.769135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":99,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:52.903588+0000","last_change":"2024-09-12T16:55:52.903403+0000","last_active":"2024-09-12T16:55:52.903588+0000","last_peered":"2024-09-12T16:55:52.903588+0000","last_clean":"2024-09-12T16:55:52.903588+0000","last_became_active":"2024-09-12T16:51:56.165535+0000","last_became_peered":"2024-09-12T16:51:56.165535+0000","last_unstale":"2024-09-12T16:55:52.903588+0000","last_undegraded":"2024-09-12T16:55:52.903588+0000","last_fullsized":"2024-09-12T16:55:52.903588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:52.903212+0000","last_clean_scrub_stamp":"2024-09-12T16:55:52.903212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.981074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:21.058002+0000","last_change":"2024-09-12T16:56:21.057858+0000","last_active":"2024-09-12T16:56:21.058002+0000","last_peered":"2024-09-12T16:56:21.058002+0000","last_clean":"2024-09-12T16:56:21.058002+0000","last_became_active":"2024-09-12T16:52:00.167603+0000","last_became_peered":"2024-09-12T16:52:00.167603+0000","last_unstale":"2024-09-12T16:56:21.058002+0000","last_undegraded":"2024-09-12T16:56:21.058002+0000","last_fullsized":"2024-09-12T16:56:21.058002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:21.057647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:21.057647+0000","last_clean_scrub_stamp":"2024-09-12T16:56:21.057647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:19.048318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:30.256774+0000","last_change":"2024-09-12T16:56:30.256774+0000","last_active":"2024-09-12T16:56:30.256774+0000","last_peered":"2024-09-12T16:56:30.256774+0000","last_clean":"2024-09-12T16:56:30.256774+0000","last_became_active":"2024-09-12T16:52:02.195469+0000","last_became_peered":"2024-09-12T16:52:02.195469+0000","last_unstale":"2024-09-12T16:56:30.256774+0000","last_undegraded":"2024-09-12T16:56:30.256774+0000","last_fullsized":"2024-09-12T16:56:30.256774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T16:56:30.256585+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T16:56:30.256585+0000","last_clean_scrub_stamp":"2024-09-12T16:56:30.256585+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:29.647414+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:41.456090+0000","last_change":"2024-09-12T16:56:41.456090+0000","last_active":"2024-09-12T16:56:41.456090+0000","last_peered":"2024-09-12T16:56:41.456090+0000","last_clean":"2024-09-12T16:56:41.456090+0000","last_became_active":"2024-09-12T16:52:04.214480+0000","last_became_peered":"2024-09-12T16:52:04.214480+0000","last_unstale":"2024-09-12T16:56:41.456090+0000","last_undegraded":"2024-09-12T16:56:41.456090+0000","last_fullsized":"2024-09-12T16:56:41.456090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:41.455878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:41.455878+0000","last_clean_scrub_stamp":"2024-09-12T16:56:41.455878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:36.502621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:05.444004+0000","last_change":"2024-09-12T16:57:05.444004+0000","last_active":"2024-09-12T16:57:05.444004+0000","last_peered":"2024-09-12T16:57:05.444004+0000","last_clean":"2024-09-12T16:57:05.444004+0000","last_became_active":"2024-09-12T16:52:06.233715+0000","last_became_peered":"2024-09-12T16:52:06.233715+0000","last_unstale":"2024-09-12T16:57:05.444004+0000","last_undegraded":"2024-09-12T16:57:05.444004+0000","last_fullsized":"2024-09-12T16:57:05.444004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T16:57:05.443833+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T16:57:05.443833+0000","last_clean_scrub_stamp":"2024-09-12T16:57:05.443833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:00.412257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.425872+0000","last_change":"2024-09-12T16:56:07.425701+0000","last_active":"2024-09-12T16:56:07.425872+0000","last_peered":"2024-09-12T16:56:07.425872+0000","last_clean":"2024-09-12T16:56:07.425872+0000","last_became_active":"2024-09-12T16:51:58.152637+0000","last_became_peered":"2024-09-12T16:51:58.152637+0000","last_unstale":"2024-09-12T16:56:07.425872+0000","last_undegraded":"2024-09-12T16:56:07.425872+0000","last_fullsized":"2024-09-12T16:56:07.425872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:07.425524+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:07.425524+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.425524+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:11.714958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:06.026138+0000","last_change":"2024-09-12T16:56:06.025971+0000","last_active":"2024-09-12T16:56:06.026138+0000","last_peered":"2024-09-12T16:56:06.026138+0000","last_clean":"2024-09-12T16:56:06.026138+0000","last_became_active":"2024-09-12T16:51:56.162910+0000","last_became_peered":"2024-09-12T16:51:56.162910+0000","last_unstale":"2024-09-12T16:56:06.026138+0000","last_undegraded":"2024-09-12T16:56:06.026138+0000","last_fullsized":"2024-09-12T16:56:06.026138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:06.025789+0000","last_clean_scrub_stamp":"2024-09-12T16:56:06.025789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:12.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.444267+0000","last_change":"2024-09-12T16:56:28.444127+0000","last_active":"2024-09-12T16:56:28.444267+0000","last_peered":"2024-09-12T16:56:28.444267+0000","last_clean":"2024-09-12T16:56:28.444267+0000","last_became_active":"2024-09-12T16:52:00.161851+0000","last_became_peered":"2024-09-12T16:52:00.161851+0000","last_unstale":"2024-09-12T16:56:28.444267+0000","last_undegraded":"2024-09-12T16:56:28.444267+0000","last_fullsized":"2024-09-12T16:56:28.444267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:28.443940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:28.443940+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.443940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:00.880623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:57.334551+0000","last_change":"2024-09-12T16:56:57.334551+0000","last_active":"2024-09-12T16:56:57.334551+0000","last_peered":"2024-09-12T16:56:57.334551+0000","last_clean":"2024-09-12T16:56:57.334551+0000","last_became_active":"2024-09-12T16:52:02.215890+0000","last_became_peered":"2024-09-12T16:52:02.215890+0000","last_unstale":"2024-09-12T16:56:57.334551+0000","last_undegraded":"2024-09-12T16:56:57.334551+0000","last_fullsized":"2024-09-12T16:56:57.334551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T16:56:57.334357+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T16:56:57.334357+0000","last_clean_scrub_stamp":"2024-09-12T16:56:57.334357+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:53.390858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:36.065485+0000","last_change":"2024-09-12T16:56:36.065485+0000","last_active":"2024-09-12T16:56:36.065485+0000","last_peered":"2024-09-12T16:56:36.065485+0000","last_clean":"2024-09-12T16:56:36.065485+0000","last_became_active":"2024-09-12T16:52:04.217523+0000","last_became_peered":"2024-09-12T16:52:04.217523+0000","last_unstale":"2024-09-12T16:56:36.065485+0000","last_undegraded":"2024-09-12T16:56:36.065485+0000","last_fullsized":"2024-09-12T16:56:36.065485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T16:56:36.065307+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T16:56:36.065307+0000","last_clean_scrub_stamp":"2024-09-12T16:56:36.065307+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:37.905037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:07.453976+0000","last_change":"2024-09-12T16:57:07.453976+0000","last_active":"2024-09-12T16:57:07.453976+0000","last_peered":"2024-09-12T16:57:07.453976+0000","last_clean":"2024-09-12T16:57:07.453976+0000","last_became_active":"2024-09-12T16:52:06.231500+0000","last_became_peered":"2024-09-12T16:52:06.231500+0000","last_unstale":"2024-09-12T16:57:07.453976+0000","last_undegraded":"2024-09-12T16:57:07.453976+0000","last_fullsized":"2024-09-12T16:57:07.453976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:07.453734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:07.453734+0000","last_clean_scrub_stamp":"2024-09-12T16:57:07.453734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:18.975289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.928200+0000","last_change":"2024-09-12T16:56:11.928072+0000","last_active":"2024-09-12T16:56:11.928200+0000","last_peered":"2024-09-12T16:56:11.928200+0000","last_clean":"2024-09-12T16:56:11.928200+0000","last_became_active":"2024-09-12T16:51:58.142501+0000","last_became_peered":"2024-09-12T16:51:58.142501+0000","last_unstale":"2024-09-12T16:56:11.928200+0000","last_undegraded":"2024-09-12T16:56:11.928200+0000","last_fullsized":"2024-09-12T16:56:11.928200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T16:56:11.927896+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T16:56:11.927896+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.927896+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:56.881341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.904845+0000","last_change":"2024-09-12T16:55:54.904704+0000","last_active":"2024-09-12T16:55:54.904845+0000","last_peered":"2024-09-12T16:55:54.904845+0000","last_clean":"2024-09-12T16:55:54.904845+0000","last_became_active":"2024-09-12T16:51:56.145489+0000","last_became_peered":"2024-09-12T16:51:56.145489+0000","last_unstale":"2024-09-12T16:55:54.904845+0000","last_undegraded":"2024-09-12T16:55:54.904845+0000","last_fullsized":"2024-09-12T16:55:54.904845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.904488+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.904488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:19.302723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.410597+0000","last_change":"2024-09-12T16:56:29.410461+0000","last_active":"2024-09-12T16:56:29.410597+0000","last_peered":"2024-09-12T16:56:29.410597+0000","last_clean":"2024-09-12T16:56:29.410597+0000","last_became_active":"2024-09-12T16:52:00.178836+0000","last_became_peered":"2024-09-12T16:52:00.178836+0000","last_unstale":"2024-09-12T16:56:29.410597+0000","last_undegraded":"2024-09-12T16:56:29.410597+0000","last_fullsized":"2024-09-12T16:56:29.410597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:29.410268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:29.410268+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.410268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:13.860974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:35.509454+0000","last_change":"2024-09-12T16:56:35.509302+0000","last_active":"2024-09-12T16:56:35.509454+0000","last_peered":"2024-09-12T16:56:35.509454+0000","last_clean":"2024-09-12T16:56:35.509454+0000","last_became_active":"2024-09-12T16:52:02.181146+0000","last_became_peered":"2024-09-12T16:52:02.181146+0000","last_unstale":"2024-09-12T16:56:35.509454+0000","last_undegraded":"2024-09-12T16:56:35.509454+0000","last_fullsized":"2024-09-12T16:56:35.509454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T16:56:35.509101+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T16:56:35.509101+0000","last_clean_scrub_stamp":"2024-09-12T16:56:35.509101+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:54.351053+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:39.377966+0000","last_change":"2024-09-12T16:56:39.377845+0000","last_active":"2024-09-12T16:56:39.377966+0000","last_peered":"2024-09-12T16:56:39.377966+0000","last_clean":"2024-09-12T16:56:39.377966+0000","last_became_active":"2024-09-12T16:52:04.205891+0000","last_became_peered":"2024-09-12T16:52:04.205891+0000","last_unstale":"2024-09-12T16:56:39.377966+0000","last_undegraded":"2024-09-12T16:56:39.377966+0000","last_fullsized":"2024-09-12T16:56:39.377966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:39.377663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:39.377663+0000","last_clean_scrub_stamp":"2024-09-12T16:56:39.377663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:57.967135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:47.538116+0000","last_change":"2024-09-12T16:56:47.537884+0000","last_active":"2024-09-12T16:56:47.538116+0000","last_peered":"2024-09-12T16:56:47.538116+0000","last_clean":"2024-09-12T16:56:47.538116+0000","last_became_active":"2024-09-12T16:52:06.223414+0000","last_became_peered":"2024-09-12T16:52:06.223414+0000","last_unstale":"2024-09-12T16:56:47.538116+0000","last_undegraded":"2024-09-12T16:56:47.538116+0000","last_fullsized":"2024-09-12T16:56:47.538116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:47.537669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:47.537669+0000","last_clean_scrub_stamp":"2024-09-12T16:56:47.537669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:41.471609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.965417+0000","last_change":"2024-09-12T16:56:10.965285+0000","last_active":"2024-09-12T16:56:10.965417+0000","last_peered":"2024-09-12T16:56:10.965417+0000","last_clean":"2024-09-12T16:56:10.965417+0000","last_became_active":"2024-09-12T16:51:58.141212+0000","last_became_peered":"2024-09-12T16:51:58.141212+0000","last_unstale":"2024-09-12T16:56:10.965417+0000","last_undegraded":"2024-09-12T16:56:10.965417+0000","last_fullsized":"2024-09-12T16:56:10.965417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:10.965111+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:10.965111+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.965111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:11.089393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:04.994635+0000","last_change":"2024-09-12T16:56:04.994386+0000","last_active":"2024-09-12T16:56:04.994635+0000","last_peered":"2024-09-12T16:56:04.994635+0000","last_clean":"2024-09-12T16:56:04.994635+0000","last_became_active":"2024-09-12T16:51:56.168847+0000","last_became_peered":"2024-09-12T16:51:56.168847+0000","last_unstale":"2024-09-12T16:56:04.994635+0000","last_undegraded":"2024-09-12T16:56:04.994635+0000","last_fullsized":"2024-09-12T16:56:04.994635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:04.994131+0000","last_clean_scrub_stamp":"2024-09-12T16:56:04.994131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:46.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:20.010466+0000","last_change":"2024-09-12T16:56:20.010216+0000","last_active":"2024-09-12T16:56:20.010466+0000","last_peered":"2024-09-12T16:56:20.010466+0000","last_clean":"2024-09-12T16:56:20.010466+0000","last_became_active":"2024-09-12T16:52:00.182867+0000","last_became_peered":"2024-09-12T16:52:00.182867+0000","last_unstale":"2024-09-12T16:56:20.010466+0000","last_undegraded":"2024-09-12T16:56:20.010466+0000","last_fullsized":"2024-09-12T16:56:20.010466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:20.009949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:20.009949+0000","last_clean_scrub_stamp":"2024-09-12T16:56:20.009949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:39.317042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.292694+0000","last_change":"2024-09-12T16:56:28.292551+0000","last_active":"2024-09-12T16:56:28.292694+0000","last_peered":"2024-09-12T16:56:28.292694+0000","last_clean":"2024-09-12T16:56:28.292694+0000","last_became_active":"2024-09-12T16:52:02.174646+0000","last_became_peered":"2024-09-12T16:52:02.174646+0000","last_unstale":"2024-09-12T16:56:28.292694+0000","last_undegraded":"2024-09-12T16:56:28.292694+0000","last_fullsized":"2024-09-12T16:56:28.292694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-12T16:56:28.292356+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-12T16:56:28.292356+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.292356+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:16.221439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:01.418470+0000","last_change":"2024-09-12T16:57:01.418470+0000","last_active":"2024-09-12T16:57:01.418470+0000","last_peered":"2024-09-12T16:57:01.418470+0000","last_clean":"2024-09-12T16:57:01.418470+0000","last_became_active":"2024-09-12T16:52:04.208544+0000","last_became_peered":"2024-09-12T16:52:04.208544+0000","last_unstale":"2024-09-12T16:57:01.418470+0000","last_undegraded":"2024-09-12T16:57:01.418470+0000","last_fullsized":"2024-09-12T16:57:01.418470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:01.418286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:01.418286+0000","last_clean_scrub_stamp":"2024-09-12T16:57:01.418286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:51.252332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:11.447477+0000","last_change":"2024-09-12T16:57:11.447477+0000","last_active":"2024-09-12T16:57:11.447477+0000","last_peered":"2024-09-12T16:57:11.447477+0000","last_clean":"2024-09-12T16:57:11.447477+0000","last_became_active":"2024-09-12T16:52:06.236840+0000","last_became_peered":"2024-09-12T16:52:06.236840+0000","last_unstale":"2024-09-12T16:57:11.447477+0000","last_undegraded":"2024-09-12T16:57:11.447477+0000","last_fullsized":"2024-09-12T16:57:11.447477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:57:11.447298+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:57:11.447298+0000","last_clean_scrub_stamp":"2024-09-12T16:57:11.447298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:01.026741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.126200+0000","last_change":"2024-09-12T16:56:25.126036+0000","last_active":"2024-09-12T16:56:25.126200+0000","last_peered":"2024-09-12T16:56:25.126200+0000","last_clean":"2024-09-12T16:56:25.126200+0000","last_became_active":"2024-09-12T16:51:58.166722+0000","last_became_peered":"2024-09-12T16:51:58.166722+0000","last_unstale":"2024-09-12T16:56:25.126200+0000","last_undegraded":"2024-09-12T16:56:25.126200+0000","last_fullsized":"2024-09-12T16:56:25.126200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:25.125828+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:25.125828+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.125828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:17.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.393326+0000","last_change":"2024-09-12T16:55:53.393160+0000","last_active":"2024-09-12T16:55:53.393326+0000","last_peered":"2024-09-12T16:55:53.393326+0000","last_clean":"2024-09-12T16:55:53.393326+0000","last_became_active":"2024-09-12T16:51:56.157085+0000","last_became_peered":"2024-09-12T16:51:56.157085+0000","last_unstale":"2024-09-12T16:55:53.393326+0000","last_undegraded":"2024-09-12T16:55:53.393326+0000","last_fullsized":"2024-09-12T16:55:53.393326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.392972+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.392972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.910111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:25.363034+0000","last_change":"2024-09-12T16:56:25.362805+0000","last_active":"2024-09-12T16:56:25.363034+0000","last_peered":"2024-09-12T16:56:25.363034+0000","last_clean":"2024-09-12T16:56:25.363034+0000","last_became_active":"2024-09-12T16:52:00.158857+0000","last_became_peered":"2024-09-12T16:52:00.158857+0000","last_unstale":"2024-09-12T16:56:25.363034+0000","last_undegraded":"2024-09-12T16:56:25.363034+0000","last_fullsized":"2024-09-12T16:56:25.363034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:25.362579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:25.362579+0000","last_clean_scrub_stamp":"2024-09-12T16:56:25.362579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:35.190759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:55.413603+0000","last_change":"2024-09-12T16:56:55.413461+0000","last_active":"2024-09-12T16:56:55.413603+0000","last_peered":"2024-09-12T16:56:55.413603+0000","last_clean":"2024-09-12T16:56:55.413603+0000","last_became_active":"2024-09-12T16:52:02.211951+0000","last_became_peered":"2024-09-12T16:52:02.211951+0000","last_unstale":"2024-09-12T16:56:55.413603+0000","last_undegraded":"2024-09-12T16:56:55.413603+0000","last_fullsized":"2024-09-12T16:56:55.413603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'32","last_scrub_stamp":"2024-09-12T16:56:55.413257+0000","last_deep_scrub":"34'32","last_deep_scrub_stamp":"2024-09-12T16:56:55.413257+0000","last_clean_scrub_stamp":"2024-09-12T16:56:55.413257+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:17.807492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:02.449660+0000","last_change":"2024-09-12T16:57:02.449405+0000","last_active":"2024-09-12T16:57:02.449660+0000","last_peered":"2024-09-12T16:57:02.449660+0000","last_clean":"2024-09-12T16:57:02.449660+0000","last_became_active":"2024-09-12T16:52:04.208731+0000","last_became_peered":"2024-09-12T16:52:04.208731+0000","last_unstale":"2024-09-12T16:57:02.449660+0000","last_undegraded":"2024-09-12T16:57:02.449660+0000","last_fullsized":"2024-09-12T16:57:02.449660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:57:02.449199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:57:02.449199+0000","last_clean_scrub_stamp":"2024-09-12T16:57:02.449199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:13.905834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:10.421058+0000","last_change":"2024-09-12T16:57:10.421058+0000","last_active":"2024-09-12T16:57:10.421058+0000","last_peered":"2024-09-12T16:57:10.421058+0000","last_clean":"2024-09-12T16:57:10.421058+0000","last_became_active":"2024-09-12T16:52:06.234021+0000","last_became_peered":"2024-09-12T16:52:06.234021+0000","last_unstale":"2024-09-12T16:57:10.421058+0000","last_undegraded":"2024-09-12T16:57:10.421058+0000","last_fullsized":"2024-09-12T16:57:10.421058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:57:10.420869+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:57:10.420869+0000","last_clean_scrub_stamp":"2024-09-12T16:57:10.420869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:00.354443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.950854+0000","last_change":"2024-09-12T16:56:09.950692+0000","last_active":"2024-09-12T16:56:09.950854+0000","last_peered":"2024-09-12T16:56:09.950854+0000","last_clean":"2024-09-12T16:56:09.950854+0000","last_became_active":"2024-09-12T16:51:58.141226+0000","last_became_peered":"2024-09-12T16:51:58.141226+0000","last_unstale":"2024-09-12T16:56:09.950854+0000","last_undegraded":"2024-09-12T16:56:09.950854+0000","last_fullsized":"2024-09-12T16:56:09.950854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:09.950480+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:09.950480+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.950480+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:09.258989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:53.860201+0000","last_change":"2024-09-12T16:55:53.860045+0000","last_active":"2024-09-12T16:55:53.860201+0000","last_peered":"2024-09-12T16:55:53.860201+0000","last_clean":"2024-09-12T16:55:53.860201+0000","last_became_active":"2024-09-12T16:51:56.155387+0000","last_became_peered":"2024-09-12T16:51:56.155387+0000","last_unstale":"2024-09-12T16:55:53.860201+0000","last_undegraded":"2024-09-12T16:55:53.860201+0000","last_fullsized":"2024-09-12T16:55:53.860201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:53.859853+0000","last_clean_scrub_stamp":"2024-09-12T16:55:53.859853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:42.401708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:27.407283+0000","last_change":"2024-09-12T16:56:27.407033+0000","last_active":"2024-09-12T16:56:27.407283+0000","last_peered":"2024-09-12T16:56:27.407283+0000","last_clean":"2024-09-12T16:56:27.407283+0000","last_became_active":"2024-09-12T16:52:00.162839+0000","last_became_peered":"2024-09-12T16:52:00.162839+0000","last_unstale":"2024-09-12T16:56:27.407283+0000","last_undegraded":"2024-09-12T16:56:27.407283+0000","last_fullsized":"2024-09-12T16:56:27.407283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T16:56:27.406806+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T16:56:27.406806+0000","last_clean_scrub_stamp":"2024-09-12T16:56:27.406806+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:14.784367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'40","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:53.347422+0000","last_change":"2024-09-12T16:56:53.347247+0000","last_active":"2024-09-12T16:56:53.347422+0000","last_peered":"2024-09-12T16:56:53.347422+0000","last_clean":"2024-09-12T16:56:53.347422+0000","last_became_active":"2024-09-12T16:52:02.211107+0000","last_became_peered":"2024-09-12T16:52:02.211107+0000","last_unstale":"2024-09-12T16:56:53.347422+0000","last_undegraded":"2024-09-12T16:56:53.347422+0000","last_fullsized":"2024-09-12T16:56:53.347422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T16:56:53.347046+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T16:56:53.347046+0000","last_clean_scrub_stamp":"2024-09-12T16:56:53.347046+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:40.514354+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:42.446485+0000","last_change":"2024-09-12T16:56:42.446257+0000","last_active":"2024-09-12T16:56:42.446485+0000","last_peered":"2024-09-12T16:56:42.446485+0000","last_clean":"2024-09-12T16:56:42.446485+0000","last_became_active":"2024-09-12T16:52:04.193893+0000","last_became_peered":"2024-09-12T16:52:04.193893+0000","last_unstale":"2024-09-12T16:56:42.446485+0000","last_undegraded":"2024-09-12T16:56:42.446485+0000","last_fullsized":"2024-09-12T16:56:42.446485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:42.446055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:42.446055+0000","last_clean_scrub_stamp":"2024-09-12T16:56:42.446055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:53.995248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:57:09.413306+0000","last_change":"2024-09-12T16:57:09.413306+0000","last_active":"2024-09-12T16:57:09.413306+0000","last_peered":"2024-09-12T16:57:09.413306+0000","last_clean":"2024-09-12T16:57:09.413306+0000","last_became_active":"2024-09-12T16:52:06.236706+0000","last_became_peered":"2024-09-12T16:52:06.236706+0000","last_unstale":"2024-09-12T16:57:09.413306+0000","last_undegraded":"2024-09-12T16:57:09.413306+0000","last_fullsized":"2024-09-12T16:57:09.413306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:57:09.413119+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:57:09.413119+0000","last_clean_scrub_stamp":"2024-09-12T16:57:09.413119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:41.890735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.108738+0000","last_change":"2024-09-12T16:56:10.108586+0000","last_active":"2024-09-12T16:56:10.108738+0000","last_peered":"2024-09-12T16:56:10.108738+0000","last_clean":"2024-09-12T16:56:10.108738+0000","last_became_active":"2024-09-12T16:51:58.170880+0000","last_became_peered":"2024-09-12T16:51:58.170880+0000","last_unstale":"2024-09-12T16:56:10.108738+0000","last_undegraded":"2024-09-12T16:56:10.108738+0000","last_fullsized":"2024-09-12T16:56:10.108738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:10.108400+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:10.108400+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.108400+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:12.926248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.938046+0000","last_change":"2024-09-12T16:55:56.937794+0000","last_active":"2024-09-12T16:55:56.938046+0000","last_peered":"2024-09-12T16:55:56.938046+0000","last_clean":"2024-09-12T16:55:56.938046+0000","last_became_active":"2024-09-12T16:51:56.152642+0000","last_became_peered":"2024-09-12T16:51:56.152642+0000","last_unstale":"2024-09-12T16:55:56.938046+0000","last_undegraded":"2024-09-12T16:55:56.938046+0000","last_fullsized":"2024-09-12T16:55:56.938046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.937568+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.937568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:32.183469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'14","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.333207+0000","last_change":"2024-09-12T16:56:12.333068+0000","last_active":"2024-09-12T16:56:12.333207+0000","last_peered":"2024-09-12T16:56:12.333207+0000","last_clean":"2024-09-12T16:56:12.333207+0000","last_became_active":"2024-09-12T16:51:58.149315+0000","last_became_peered":"2024-09-12T16:51:58.149315+0000","last_unstale":"2024-09-12T16:56:12.333207+0000","last_undegraded":"2024-09-12T16:56:12.333207+0000","last_fullsized":"2024-09-12T16:56:12.333207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T16:56:12.332887+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T16:56:12.332887+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.332887+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:01.522871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.401315+0000","last_change":"2024-09-12T16:55:56.401142+0000","last_active":"2024-09-12T16:55:56.401315+0000","last_peered":"2024-09-12T16:55:56.401315+0000","last_clean":"2024-09-12T16:55:56.401315+0000","last_became_active":"2024-09-12T16:51:56.159142+0000","last_became_peered":"2024-09-12T16:51:56.159142+0000","last_unstale":"2024-09-12T16:55:56.401315+0000","last_undegraded":"2024-09-12T16:55:56.401315+0000","last_fullsized":"2024-09-12T16:55:56.401315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:56.400960+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.400960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:14.461538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:28.133193+0000","last_change":"2024-09-12T16:56:28.133193+0000","last_active":"2024-09-12T16:56:28.133193+0000","last_peered":"2024-09-12T16:56:28.133193+0000","last_clean":"2024-09-12T16:56:28.133193+0000","last_became_active":"2024-09-12T16:51:58.171526+0000","last_became_peered":"2024-09-12T16:51:58.171526+0000","last_unstale":"2024-09-12T16:56:28.133193+0000","last_undegraded":"2024-09-12T16:56:28.133193+0000","last_fullsized":"2024-09-12T16:56:28.133193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:28.133013+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:28.133013+0000","last_clean_scrub_stamp":"2024-09-12T16:56:28.133013+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:26.697952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:07.042238+0000","last_change":"2024-09-12T16:56:07.042238+0000","last_active":"2024-09-12T16:56:07.042238+0000","last_peered":"2024-09-12T16:56:07.042238+0000","last_clean":"2024-09-12T16:56:07.042238+0000","last_became_active":"2024-09-12T16:51:56.153086+0000","last_became_peered":"2024-09-12T16:51:56.153086+0000","last_unstale":"2024-09-12T16:56:07.042238+0000","last_undegraded":"2024-09-12T16:56:07.042238+0000","last_fullsized":"2024-09-12T16:56:07.042238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:07.042037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:07.042037+0000","last_clean_scrub_stamp":"2024-09-12T16:56:07.042037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:52.852652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.396791+0000","last_change":"2024-09-12T16:56:10.396647+0000","last_active":"2024-09-12T16:56:10.396791+0000","last_peered":"2024-09-12T16:56:10.396791+0000","last_clean":"2024-09-12T16:56:10.396791+0000","last_became_active":"2024-09-12T16:51:58.152960+0000","last_became_peered":"2024-09-12T16:51:58.152960+0000","last_unstale":"2024-09-12T16:56:10.396791+0000","last_undegraded":"2024-09-12T16:56:10.396791+0000","last_fullsized":"2024-09-12T16:56:10.396791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:10.396473+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:10.396473+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.396473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:10.833391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:54.440316+0000","last_change":"2024-09-12T16:55:54.440130+0000","last_active":"2024-09-12T16:55:54.440316+0000","last_peered":"2024-09-12T16:55:54.440316+0000","last_clean":"2024-09-12T16:55:54.440316+0000","last_became_active":"2024-09-12T16:51:56.168073+0000","last_became_peered":"2024-09-12T16:51:56.168073+0000","last_unstale":"2024-09-12T16:55:54.440316+0000","last_undegraded":"2024-09-12T16:55:54.440316+0000","last_fullsized":"2024-09-12T16:55:54.440316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:54.439958+0000","last_clean_scrub_stamp":"2024-09-12T16:55:54.439958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:13.647744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.375456+0000","last_change":"2024-09-12T16:56:09.375456+0000","last_active":"2024-09-12T16:56:09.375456+0000","last_peered":"2024-09-12T16:56:09.375456+0000","last_clean":"2024-09-12T16:56:09.375456+0000","last_became_active":"2024-09-12T16:52:35.040427+0000","last_became_peered":"2024-09-12T16:52:35.040427+0000","last_unstale":"2024-09-12T16:56:09.375456+0000","last_undegraded":"2024-09-12T16:56:09.375456+0000","last_fullsized":"2024-09-12T16:56:09.375456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-12T16:56:09.375291+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-12T16:56:09.375291+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.375291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:02.952981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.406473+0000","last_change":"2024-09-12T16:55:57.406202+0000","last_active":"2024-09-12T16:55:57.406473+0000","last_peered":"2024-09-12T16:55:57.406473+0000","last_clean":"2024-09-12T16:55:57.406473+0000","last_became_active":"2024-09-12T16:51:56.157632+0000","last_became_peered":"2024-09-12T16:51:56.157632+0000","last_unstale":"2024-09-12T16:55:57.406473+0000","last_undegraded":"2024-09-12T16:55:57.406473+0000","last_fullsized":"2024-09-12T16:55:57.406473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.405992+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.405992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:26.716714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.099350+0000","last_change":"2024-09-12T16:56:09.099205+0000","last_active":"2024-09-12T16:56:09.099350+0000","last_peered":"2024-09-12T16:56:09.099350+0000","last_clean":"2024-09-12T16:56:09.099350+0000","last_became_active":"2024-09-12T16:51:58.172732+0000","last_became_peered":"2024-09-12T16:51:58.172732+0000","last_unstale":"2024-09-12T16:56:09.099350+0000","last_undegraded":"2024-09-12T16:56:09.099350+0000","last_fullsized":"2024-09-12T16:56:09.099350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:09.099018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:09.099018+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.099018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:17.509989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.952554+0000","last_change":"2024-09-12T16:55:55.952358+0000","last_active":"2024-09-12T16:55:55.952554+0000","last_peered":"2024-09-12T16:55:55.952554+0000","last_clean":"2024-09-12T16:55:55.952554+0000","last_became_active":"2024-09-12T16:51:56.164312+0000","last_became_peered":"2024-09-12T16:51:56.164312+0000","last_unstale":"2024-09-12T16:55:55.952554+0000","last_undegraded":"2024-09-12T16:55:55.952554+0000","last_fullsized":"2024-09-12T16:55:55.952554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.952167+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.952167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:25.813446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.362007+0000","last_change":"2024-09-12T16:56:11.362007+0000","last_active":"2024-09-12T16:56:11.362007+0000","last_peered":"2024-09-12T16:56:11.362007+0000","last_clean":"2024-09-12T16:56:11.362007+0000","last_became_active":"2024-09-12T16:51:58.148626+0000","last_became_peered":"2024-09-12T16:51:58.148626+0000","last_unstale":"2024-09-12T16:56:11.362007+0000","last_undegraded":"2024-09-12T16:56:11.362007+0000","last_fullsized":"2024-09-12T16:56:11.362007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:11.361791+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:11.361791+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.361791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:50.554072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.987602+0000","last_change":"2024-09-12T16:55:57.987345+0000","last_active":"2024-09-12T16:55:57.987602+0000","last_peered":"2024-09-12T16:55:57.987602+0000","last_clean":"2024-09-12T16:55:57.987602+0000","last_became_active":"2024-09-12T16:51:56.150159+0000","last_became_peered":"2024-09-12T16:51:56.150159+0000","last_unstale":"2024-09-12T16:55:57.987602+0000","last_undegraded":"2024-09-12T16:55:57.987602+0000","last_fullsized":"2024-09-12T16:55:57.987602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:57.987068+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.987068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:06.950990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.106577+0000","last_change":"2024-09-12T16:56:08.106418+0000","last_active":"2024-09-12T16:56:08.106577+0000","last_peered":"2024-09-12T16:56:08.106577+0000","last_clean":"2024-09-12T16:56:08.106577+0000","last_became_active":"2024-09-12T16:51:58.155154+0000","last_became_peered":"2024-09-12T16:51:58.155154+0000","last_unstale":"2024-09-12T16:56:08.106577+0000","last_undegraded":"2024-09-12T16:56:08.106577+0000","last_fullsized":"2024-09-12T16:56:08.106577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:08.106230+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:08.106230+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.106230+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:35.973906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:55.433107+0000","last_change":"2024-09-12T16:55:55.432903+0000","last_active":"2024-09-12T16:55:55.433107+0000","last_peered":"2024-09-12T16:55:55.433107+0000","last_clean":"2024-09-12T16:55:55.433107+0000","last_became_active":"2024-09-12T16:51:56.157339+0000","last_became_peered":"2024-09-12T16:51:56.157339+0000","last_unstale":"2024-09-12T16:55:55.433107+0000","last_undegraded":"2024-09-12T16:55:55.433107+0000","last_fullsized":"2024-09-12T16:55:55.433107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:55.432712+0000","last_clean_scrub_stamp":"2024-09-12T16:55:55.432712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.091150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:14.194277+0000","last_change":"2024-09-12T16:56:14.194089+0000","last_active":"2024-09-12T16:56:14.194277+0000","last_peered":"2024-09-12T16:56:14.194277+0000","last_clean":"2024-09-12T16:56:14.194277+0000","last_became_active":"2024-09-12T16:51:58.159364+0000","last_became_peered":"2024-09-12T16:51:58.159364+0000","last_unstale":"2024-09-12T16:56:14.194277+0000","last_undegraded":"2024-09-12T16:56:14.194277+0000","last_fullsized":"2024-09-12T16:56:14.194277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T16:56:14.193905+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T16:56:14.193905+0000","last_clean_scrub_stamp":"2024-09-12T16:56:14.193905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:20.189176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:09.030089+0000","last_change":"2024-09-12T16:56:09.029934+0000","last_active":"2024-09-12T16:56:09.030089+0000","last_peered":"2024-09-12T16:56:09.030089+0000","last_clean":"2024-09-12T16:56:09.030089+0000","last_became_active":"2024-09-12T16:51:56.154291+0000","last_became_peered":"2024-09-12T16:51:56.154291+0000","last_unstale":"2024-09-12T16:56:09.030089+0000","last_undegraded":"2024-09-12T16:56:09.030089+0000","last_fullsized":"2024-09-12T16:56:09.030089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:09.029746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:09.029746+0000","last_clean_scrub_stamp":"2024-09-12T16:56:09.029746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:03.041324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:29.147120+0000","last_change":"2024-09-12T16:56:29.146980+0000","last_active":"2024-09-12T16:56:29.147120+0000","last_peered":"2024-09-12T16:56:29.147120+0000","last_clean":"2024-09-12T16:56:29.147120+0000","last_became_active":"2024-09-12T16:51:58.158955+0000","last_became_peered":"2024-09-12T16:51:58.158955+0000","last_unstale":"2024-09-12T16:56:29.147120+0000","last_undegraded":"2024-09-12T16:56:29.147120+0000","last_fullsized":"2024-09-12T16:56:29.147120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:29.146778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:29.146778+0000","last_clean_scrub_stamp":"2024-09-12T16:56:29.146778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:19.977310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:00.392408+0000","last_change":"2024-09-12T16:56:00.392236+0000","last_active":"2024-09-12T16:56:00.392408+0000","last_peered":"2024-09-12T16:56:00.392408+0000","last_clean":"2024-09-12T16:56:00.392408+0000","last_became_active":"2024-09-12T16:51:56.162711+0000","last_became_peered":"2024-09-12T16:51:56.162711+0000","last_unstale":"2024-09-12T16:56:00.392408+0000","last_undegraded":"2024-09-12T16:56:00.392408+0000","last_fullsized":"2024-09-12T16:56:00.392408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:00.392055+0000","last_clean_scrub_stamp":"2024-09-12T16:56:00.392055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:04.803837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.363927+0000","last_change":"2024-09-12T16:56:13.363788+0000","last_active":"2024-09-12T16:56:13.363927+0000","last_peered":"2024-09-12T16:56:13.363927+0000","last_clean":"2024-09-12T16:56:13.363927+0000","last_became_active":"2024-09-12T16:51:58.175829+0000","last_became_peered":"2024-09-12T16:51:58.175829+0000","last_unstale":"2024-09-12T16:56:13.363927+0000","last_undegraded":"2024-09-12T16:56:13.363927+0000","last_fullsized":"2024-09-12T16:56:13.363927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T16:56:13.363599+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T16:56:13.363599+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.363599+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:22.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:56.980599+0000","last_change":"2024-09-12T16:55:56.980434+0000","last_active":"2024-09-12T16:55:56.980599+0000","last_peered":"2024-09-12T16:55:56.980599+0000","last_clean":"2024-09-12T16:55:56.980599+0000","last_became_active":"2024-09-12T16:51:56.165979+0000","last_became_peered":"2024-09-12T16:51:56.165979+0000","last_unstale":"2024-09-12T16:55:56.980599+0000","last_undegraded":"2024-09-12T16:55:56.980599+0000","last_fullsized":"2024-09-12T16:55:56.980599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:56.980237+0000","last_clean_scrub_stamp":"2024-09-12T16:55:56.980237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:15.364632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:17.210898+0000","last_change":"2024-09-12T16:56:17.210631+0000","last_active":"2024-09-12T16:56:17.210898+0000","last_peered":"2024-09-12T16:56:17.210898+0000","last_clean":"2024-09-12T16:56:17.210898+0000","last_became_active":"2024-09-12T16:51:58.146144+0000","last_became_peered":"2024-09-12T16:51:58.146144+0000","last_unstale":"2024-09-12T16:56:17.210898+0000","last_undegraded":"2024-09-12T16:56:17.210898+0000","last_fullsized":"2024-09-12T16:56:17.210898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:17.210420+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:17.210420+0000","last_clean_scrub_stamp":"2024-09-12T16:56:17.210420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:27.115703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:57.999627+0000","last_change":"2024-09-12T16:55:57.999462+0000","last_active":"2024-09-12T16:55:57.999627+0000","last_peered":"2024-09-12T16:55:57.999627+0000","last_clean":"2024-09-12T16:55:57.999627+0000","last_became_active":"2024-09-12T16:51:56.158280+0000","last_became_peered":"2024-09-12T16:51:56.158280+0000","last_unstale":"2024-09-12T16:55:57.999627+0000","last_undegraded":"2024-09-12T16:55:57.999627+0000","last_fullsized":"2024-09-12T16:55:57.999627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:55:57.999280+0000","last_clean_scrub_stamp":"2024-09-12T16:55:57.999280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.958335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.119931+0000","last_change":"2024-09-12T16:56:12.119798+0000","last_active":"2024-09-12T16:56:12.119931+0000","last_peered":"2024-09-12T16:56:12.119931+0000","last_clean":"2024-09-12T16:56:12.119931+0000","last_became_active":"2024-09-12T16:51:58.171842+0000","last_became_peered":"2024-09-12T16:51:58.171842+0000","last_unstale":"2024-09-12T16:56:12.119931+0000","last_undegraded":"2024-09-12T16:56:12.119931+0000","last_fullsized":"2024-09-12T16:56:12.119931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:12.119628+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:12.119628+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.119628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.835640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:08.045599+0000","last_change":"2024-09-12T16:56:08.045457+0000","last_active":"2024-09-12T16:56:08.045599+0000","last_peered":"2024-09-12T16:56:08.045599+0000","last_clean":"2024-09-12T16:56:08.045599+0000","last_became_active":"2024-09-12T16:51:56.152533+0000","last_became_peered":"2024-09-12T16:51:56.152533+0000","last_unstale":"2024-09-12T16:56:08.045599+0000","last_undegraded":"2024-09-12T16:56:08.045599+0000","last_fullsized":"2024-09-12T16:56:08.045599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:08.045272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:08.045272+0000","last_clean_scrub_stamp":"2024-09-12T16:56:08.045272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.816254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.096674+0000","last_change":"2024-09-12T16:56:11.096441+0000","last_active":"2024-09-12T16:56:11.096674+0000","last_peered":"2024-09-12T16:56:11.096674+0000","last_clean":"2024-09-12T16:56:11.096674+0000","last_became_active":"2024-09-12T16:51:58.147279+0000","last_became_peered":"2024-09-12T16:51:58.147279+0000","last_unstale":"2024-09-12T16:56:11.096674+0000","last_undegraded":"2024-09-12T16:56:11.096674+0000","last_fullsized":"2024-09-12T16:56:11.096674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T16:56:11.096227+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T16:56:11.096227+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.096227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:02.873110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:10.073202+0000","last_change":"2024-09-12T16:56:10.073063+0000","last_active":"2024-09-12T16:56:10.073202+0000","last_peered":"2024-09-12T16:56:10.073202+0000","last_clean":"2024-09-12T16:56:10.073202+0000","last_became_active":"2024-09-12T16:51:56.166252+0000","last_became_peered":"2024-09-12T16:51:56.166252+0000","last_unstale":"2024-09-12T16:56:10.073202+0000","last_undegraded":"2024-09-12T16:56:10.073202+0000","last_fullsized":"2024-09-12T16:56:10.073202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:10.072860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:10.072860+0000","last_clean_scrub_stamp":"2024-09-12T16:56:10.072860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:55.441106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.911761+0000","last_change":"2024-09-12T16:56:13.911634+0000","last_active":"2024-09-12T16:56:13.911761+0000","last_peered":"2024-09-12T16:56:13.911761+0000","last_clean":"2024-09-12T16:56:13.911761+0000","last_became_active":"2024-09-12T16:52:35.028010+0000","last_became_peered":"2024-09-12T16:52:35.028010+0000","last_unstale":"2024-09-12T16:56:13.911761+0000","last_undegraded":"2024-09-12T16:56:13.911761+0000","last_fullsized":"2024-09-12T16:56:13.911761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T16:56:13.911459+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T16:56:13.911459+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.911459+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:23.988896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:55:59.983914+0000","last_change":"2024-09-12T16:55:59.983767+0000","last_active":"2024-09-12T16:55:59.983914+0000","last_peered":"2024-09-12T16:55:59.983914+0000","last_clean":"2024-09-12T16:55:59.983914+0000","last_became_active":"2024-09-12T16:51:56.149657+0000","last_became_peered":"2024-09-12T16:51:56.149657+0000","last_unstale":"2024-09-12T16:55:59.983914+0000","last_undegraded":"2024-09-12T16:55:59.983914+0000","last_fullsized":"2024-09-12T16:55:59.983914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:55:59.983590+0000","last_clean_scrub_stamp":"2024-09-12T16:55:59.983590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:23.882360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:13.157609+0000","last_change":"2024-09-12T16:56:13.157345+0000","last_active":"2024-09-12T16:56:13.157609+0000","last_peered":"2024-09-12T16:56:13.157609+0000","last_clean":"2024-09-12T16:56:13.157609+0000","last_became_active":"2024-09-12T16:51:58.154025+0000","last_became_peered":"2024-09-12T16:51:58.154025+0000","last_unstale":"2024-09-12T16:56:13.157609+0000","last_undegraded":"2024-09-12T16:56:13.157609+0000","last_fullsized":"2024-09-12T16:56:13.157609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:13.157069+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:13.157069+0000","last_clean_scrub_stamp":"2024-09-12T16:56:13.157069+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:40.173708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:11.064636+0000","last_change":"2024-09-12T16:56:11.064485+0000","last_active":"2024-09-12T16:56:11.064636+0000","last_peered":"2024-09-12T16:56:11.064636+0000","last_clean":"2024-09-12T16:56:11.064636+0000","last_became_active":"2024-09-12T16:51:56.168606+0000","last_became_peered":"2024-09-12T16:51:56.168606+0000","last_unstale":"2024-09-12T16:56:11.064636+0000","last_undegraded":"2024-09-12T16:56:11.064636+0000","last_fullsized":"2024-09-12T16:56:11.064636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:11.064306+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:11.064306+0000","last_clean_scrub_stamp":"2024-09-12T16:56:11.064306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:20.818102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:12.073760+0000","last_change":"2024-09-12T16:56:12.073587+0000","last_active":"2024-09-12T16:56:12.073760+0000","last_peered":"2024-09-12T16:56:12.073760+0000","last_clean":"2024-09-12T16:56:12.073760+0000","last_became_active":"2024-09-12T16:51:56.152851+0000","last_became_peered":"2024-09-12T16:51:56.152851+0000","last_unstale":"2024-09-12T16:56:12.073760+0000","last_undegraded":"2024-09-12T16:56:12.073760+0000","last_fullsized":"2024-09-12T16:56:12.073760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T16:56:12.073409+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T16:56:12.073409+0000","last_clean_scrub_stamp":"2024-09-12T16:56:12.073409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:11.864469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:15.309178+0000","last_change":"2024-09-12T16:56:15.309025+0000","last_active":"2024-09-12T16:56:15.309178+0000","last_peered":"2024-09-12T16:56:15.309178+0000","last_clean":"2024-09-12T16:56:15.309178+0000","last_became_active":"2024-09-12T16:51:58.163497+0000","last_became_peered":"2024-09-12T16:51:58.163497+0000","last_unstale":"2024-09-12T16:56:15.309178+0000","last_undegraded":"2024-09-12T16:56:15.309178+0000","last_fullsized":"2024-09-12T16:56:15.309178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T16:56:15.308840+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T16:56:15.308840+0000","last_clean_scrub_stamp":"2024-09-12T16:56:15.308840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:26.096395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:01.428035+0000","last_change":"2024-09-12T16:56:01.427883+0000","last_active":"2024-09-12T16:56:01.428035+0000","last_peered":"2024-09-12T16:56:01.428035+0000","last_clean":"2024-09-12T16:56:01.428035+0000","last_became_active":"2024-09-12T16:51:56.169485+0000","last_became_peered":"2024-09-12T16:51:56.169485+0000","last_unstale":"2024-09-12T16:56:01.428035+0000","last_undegraded":"2024-09-12T16:56:01.428035+0000","last_fullsized":"2024-09-12T16:56:01.428035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:56:01.427706+0000","last_clean_scrub_stamp":"2024-09-12T16:56:01.427706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:56.339223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T16:56:19.286850+0000","last_change":"2024-09-12T16:56:19.286721+0000","last_active":"2024-09-12T16:56:19.286850+0000","last_peered":"2024-09-12T16:56:19.286850+0000","last_clean":"2024-09-12T16:56:19.286850+0000","last_became_active":"2024-09-12T16:51:58.172903+0000","last_became_peered":"2024-09-12T16:51:58.172903+0000","last_unstale":"2024-09-12T16:56:19.286850+0000","last_undegraded":"2024-09-12T16:56:19.286850+0000","last_fullsized":"2024-09-12T16:56:19.286850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T16:56:19.286513+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T16:56:19.286513+0000","last_clean_scrub_stamp":"2024-09-12T16:56:19.286513+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:30.010412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":574,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640328,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640329,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":740498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673034,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":740621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44096,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327744,"statfs":{"total":96636764160,"available":96591609856,"internally_reserved":0,"allocated":442368,"data_stored":151866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:57:30.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T16:57:30.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f73309cd640 1 Processor -- start 2024-09-12T16:57:30.937 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f73309cd640 1 -- start start 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f73309cd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f732c09a690 0x7f732c134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f73309cd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732c09bd60 con 0x7f732c12f4b0 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f73309cd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 -- 0x7f732c12ffa0 con 0x7f732c09a690 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f732a59c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f732c12f4b0 0x7f732c12f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:39198/0 (socket says 172.21.15.122:39198) 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f732a59c640 1 -- 172.21.15.122:0/2775737661 learned_addr learned my addr 172.21.15.122:0/2775737661 (peer_addr_for_me v1:172.21.15.122:0/0) 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f7329d9b640 1 --2- 172.21.15.122:0/2775737661 >> v2:172.21.15.122:3300/0 conn(0x7f732c09a690 0x7f732c134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f732959a640 1 -- 172.21.15.122:0/2775737661 <== mon.0 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723984795 0 0) 0x7f732c09bd60 con 0x7f732c12f4b0 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f732959a640 1 -- 172.21.15.122:0/2775737661 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7318003530 con 0x7f732c12f4b0 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f7329d9b640 1 -- 172.21.15.122:0/2775737661 >> v1:172.21.15.122:6789/0 conn(0x7f732c12f4b0 legacy=0x7f732c12f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:30.938 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.935+0000 7f7329d9b640 1 -- 172.21.15.122:0/2775737661 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c09aea0 con 0x7f732c09a690 2024-09-12T16:57:30.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f7329d9b640 1 --2- 172.21.15.122:0/2775737661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c134710 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f731c009740 tx=0x7f731c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69216dd17edda724 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:30.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f732959a640 1 -- 172.21.15.122:0/2775737661 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731c0b0070 con 0x7f732c09a690 2024-09-12T16:57:30.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f732959a640 1 -- 172.21.15.122:0/2775737661 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731c0ab530 con 0x7f732c09a690 2024-09-12T16:57:30.940 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f732959a640 1 -- 172.21.15.122:0/2775737661 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731c0ab810 con 0x7f732c09a690 2024-09-12T16:57:30.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- 172.21.15.122:0/2775737661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 msgr2=0x7f732c134710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:30.943 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 --2- 172.21.15.122:0/2775737661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c134710 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f731c009740 tx=0x7f731c01c400 comp rx=0 tx=0).stop 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- 172.21.15.122:0/2775737661 shutdown_connections 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 --2- 172.21.15.122:0/2775737661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c134710 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- 172.21.15.122:0/2775737661 >> 172.21.15.122:0/2775737661 conn(0x7f732c0a0010 msgr2=0x7f732c0a0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- 172.21.15.122:0/2775737661 shutdown_connections 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- 172.21.15.122:0/2775737661 wait complete. 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 Processor -- start 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- start start 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c1271d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f732c137800 con 0x7f732c09a690 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f732a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c1271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:30.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f732a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c1271d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:38340/0 (socket says 172.21.15.122:38340) 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f732a59c640 1 -- 172.21.15.122:0/718790887 learned_addr learned my addr 172.21.15.122:0/718790887 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f732a59c640 1 -- 172.21.15.122:0/718790887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c128cb0 con 0x7f732c09a690 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f732a59c640 1 --2- 172.21.15.122:0/718790887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c1271d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f731400c450 tx=0x7f731400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f7322ffd640 1 -- 172.21.15.122:0/718790887 <== mon.0 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7314017070 con 0x7f732c09a690 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f7322ffd640 1 -- 172.21.15.122:0/718790887 <== mon.0 v2:172.21.15.122:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7314005ce0 con 0x7f732c09a690 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c073c90 con 0x7f732c09a690 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f7322ffd640 1 -- 172.21.15.122:0/718790887 <== mon.0 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7314007200 con 0x7f732c09a690 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c1298d0 con 0x7f732c09a690 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.939+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732c129280 con 0x7f732c09a690 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.943+0000 7f7322ffd640 1 -- 172.21.15.122:0/718790887 <== mon.0 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f731401a070 con 0x7f732c09a690 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.943+0000 7f7322ffd640 1 --2- 172.21.15.122:0/718790887 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f730c03b180 0x7f730c03d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T16:57:30.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.943+0000 7f7322ffd640 1 -- 172.21.15.122:0/718790887 <== mon.0 v2:172.21.15.122:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f731404eb60 con 0x7f732c09a690 2024-09-12T16:57:30.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.943+0000 7f7329d9b640 1 --2- 172.21.15.122:0/718790887 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f730c03b180 0x7f730c03d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T16:57:30.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.943+0000 7f7329d9b640 1 --2- 172.21.15.122:0/718790887 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f730c03b180 0x7f730c03d640 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f731c0ad000 tx=0x7f731c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T16:57:30.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:30.947+0000 7f7322ffd640 1 -- 172.21.15.122:0/718790887 <== mon.0 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7314012400 con 0x7f732c09a690 2024-09-12T16:57:31.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.115+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f732c068e50 con 0x7f732c09a690 2024-09-12T16:57:31.121 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.119+0000 7f7322ffd640 1 -- 172.21.15.122:0/718790887 <== mon.0 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f7314012780 con 0x7f732c09a690 2024-09-12T16:57:31.122 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.119+0000 7f7322ffd640 1 -- 172.21.15.122:0/718790887 <== mon.0 v2:172.21.15.122:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7314010b60 con 0x7f732c09a690 2024-09-12T16:57:31.123 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.119+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f730c03b180 msgr2=0x7f730c03d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.119+0000 7f73309cd640 1 --2- 172.21.15.122:0/718790887 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f730c03b180 0x7f730c03d640 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f731c0ad000 tx=0x7f731c008040 comp rx=0 tx=0).stop 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.119+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 msgr2=0x7f732c1271d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.119+0000 7f73309cd640 1 --2- 172.21.15.122:0/718790887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c1271d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f731400c450 tx=0x7f731400c910 comp rx=0 tx=0).stop 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.123+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 shutdown_connections 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.123+0000 7f73309cd640 1 --2- 172.21.15.122:0/718790887 >> [v2:172.21.15.151:6824/919571907,v1:172.21.15.151:6825/919571907] conn(0x7f730c03b180 0x7f730c03d640 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.123+0000 7f73309cd640 1 --2- 172.21.15.122:0/718790887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f732c09a690 0x7f732c1271d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.123+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 >> 172.21.15.122:0/718790887 conn(0x7f732c0a0010 msgr2=0x7f732c1330a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.123+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 shutdown_connections 2024-09-12T16:57:31.124 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-12T16:57:31.123+0000 7f73309cd640 1 -- 172.21.15.122:0/718790887 wait complete. 2024-09-12T16:57:31.139 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T16:57:31.139 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T16:57:31.140 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T16:57:31.140 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:57:31.233 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T16:57:31.233 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T16:57:31.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:57:31.318 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T16:57:31.318 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T16:57:31.318 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:57:31.409 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T16:57:31.409 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T16:57:31.410 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:57:31.504 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T16:57:31.504 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T16:57:31.504 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T16:57:31.504 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:57:31.535 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T16:57:31.535 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T16:57:31.535 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T16:57:31.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T16:57:31.559 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T16:57:31.559 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T16:57:31.559 DEBUG:teuthology.orchestra.run.smithi122:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-12T16:57:31.616 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi122.front.sepia.ceph.com 2024-09-12T16:57:31.616 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T16:57:31.844 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:57:31.844 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T16:57:32.037 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:57:32.038 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T16:57:32.234 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:57:32.234 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T16:57:32.421 INFO:tasks.ceph:Archiving mon data... 2024-09-12T16:57:32.423 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685/data/mon.a.tgz 2024-09-12T16:57:32.424 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-12T16:57:32.430 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.WXupUhIior 2024-09-12T16:57:32.430 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WXupUhIior 2024-09-12T16:57:32.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.WXupUhIior 2024-09-12T16:57:32.617 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.WXupUhIior is 287KB 2024-09-12T16:57:32.674 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.WXupUhIior 2024-09-12T16:57:32.679 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T16:57:32.680 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T16:57:32.725 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T16:57:32.785 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T16:57:32.791 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T16:57:32.791 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T16:57:32.793 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685/remote/smithi122/crash 2024-09-12T16:57:32.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T16:57:32.841 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685/remote/smithi151/crash 2024-09-12T16:57:32.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T16:57:32.855 INFO:tasks.ceph:Compressing logs... 2024-09-12T16:57:32.855 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T16:57:32.889 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T16:57:32.907 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24899.log 2024-09-12T16:57:32.908 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24639.log 2024-09-12T16:57:32.909 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22822.log 2024-09-12T16:57:32.909 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.24899.log.gz 2024-09-12T16:57:32.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25148.log 2024-09-12T16:57:32.910 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24639.log.gz 2024-09-12T16:57:32.910 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.22822.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T16:57:32.910 INFO:teuthology.orchestra.run.smithi122.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.22822.log.gz 2024-09-12T16:57:32.911 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25252.log 2024-09-12T16:57:32.911 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.0.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25148.log.gz 2024-09-12T16:57:32.911 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25304.log 2024-09-12T16:57:32.912 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25489.log 2024-09-12T16:57:32.912 INFO:teuthology.orchestra.run.smithi122.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.25252.log.gz 2024-09-12T16:57:32.912 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24587.log 2024-09-12T16:57:32.912 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25304.log.gz 2024-09-12T16:57:32.912 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24702.log 2024-09-12T16:57:32.912 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25489.log: /var/log/ceph/ceph-client.admin.24587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25174.log 85.9% 2024-09-12T16:57:32.912 INFO:teuthology.orchestra.run.smithi122.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25489.log.gz 2024-09-12T16:57:32.913 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24587.log.gz 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25096.log 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24702.log.gz 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24807.log 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25174.log.gz 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25435.log 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.25096.log.gz 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25356.log 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24807.log.gz 2024-09-12T16:57:32.915 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25435.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T16:57:32.916 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25356.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25435.log.gz 2024-09-12T16:57:32.916 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25382.log 2024-09-12T16:57:32.916 INFO:teuthology.orchestra.run.smithi122.stderr: 87.0%/var/log/ceph/ceph-mon.a.log: -- replaced with /var/log/ceph/ceph-client.admin.25356.log.gz 2024-09-12T16:57:32.916 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24613.log 2024-09-12T16:57:32.940 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24797.log 2024-09-12T16:57:32.941 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24613.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25382.log.gz 2024-09-12T16:57:32.941 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24613.log.gz 2024-09-12T16:57:32.941 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21503.log 2024-09-12T16:57:32.941 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25463.log 2024-09-12T16:57:32.941 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24797.log: /var/log/ceph/ceph.tmp-client.admin.21503.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph.tmp-client.admin.21503.log.gz -- 2024-09-12T16:57:32.941 INFO:teuthology.orchestra.run.smithi122.stderr: /var/log/ceph/ceph-client.admin.25330.log 2024-09-12T16:57:32.941 INFO:teuthology.orchestra.run.smithi122.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.24797.log.gz 2024-09-12T16:57:32.941 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24542.log/var/log/ceph/ceph-client.admin.25463.log: 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25330.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25463.log.gz 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22752.log 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25330.log.gz 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24806.log 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24542.log.gz 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.22752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24567.log 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.22752.log.gz 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25278.log 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24567.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24806.log.gz 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24479.log 2024-09-12T16:57:32.942 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.24567.log.gz 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24903.log 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24479.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25278.log.gz 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.24479.log.gz 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24699.log 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24517.log 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24903.log: /var/log/ceph/ceph-client.admin.24699.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.24699.log.gz 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24903.log.gz 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25055.log 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24517.log.gz 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25003.log 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr:gzip/var/log/ceph/ceph-client.admin.25055.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25567.log 2024-09-12T16:57:32.943 INFO:teuthology.orchestra.run.smithi122.stderr: 86.6%/var/log/ceph/ceph-client.admin.25003.log: -- replaced with /var/log/ceph/ceph-client.admin.25055.log.gz 2024-09-12T16:57:32.944 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25515.log 2024-09-12T16:57:32.944 INFO:teuthology.orchestra.run.smithi122.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25003.log.gz 2024-09-12T16:57:32.944 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T16:57:32.944 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25226.log 2024-09-12T16:57:32.944 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25567.log: /var/log/ceph/ceph-client.admin.25515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24697.log 2024-09-12T16:57:32.944 INFO:teuthology.orchestra.run.smithi122.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25567.log.gz 2024-09-12T16:57:32.944 INFO:teuthology.orchestra.run.smithi122.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25515.log.gz 2024-09-12T16:57:32.944 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25200.log 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24697.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25226.log.gz 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24697.log.gz 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24910.log 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25200.log: gzip/var/log/ceph/ceph.audit.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24911.log 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25200.log.gz 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24910.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24910.log.gz 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24799.log 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22863.log 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24911.log: /var/log/ceph/ceph-client.admin.24799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24703.log 2024-09-12T16:57:32.945 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24911.log.gz 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24799.log.gz 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.22863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25029.log 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.24703.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.22863.log.gz 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr:gzip 87.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.24703.log.gz 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr: -- /var/log/ceph/ceph-client.admin.24665.log 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25543.log 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25029.log: /var/log/ceph/ceph-client.admin.24665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25122.log 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24665.log.gz 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25029.log.gz 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25408.log 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25122.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25543.log.gz 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25122.log.gz 2024-09-12T16:57:32.946 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.25408.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25408.log.gz 2024-09-12T16:57:32.964 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85454.log 2024-09-12T16:57:32.964 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55984.log 2024-09-12T16:57:32.964 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.85454.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T16:57:32.964 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.55984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51854.log 2024-09-12T16:57:32.964 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41824.log 2024-09-12T16:57:32.964 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85454.log.gz 2024-09-12T16:57:32.964 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.51854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47134.log 2024-09-12T16:57:32.964 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.41824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77808.log 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.55984.log.gz 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.47134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43594.log 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51854.log.gz 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.77808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71914.log 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25092.log 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.43594.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.41824.log.gz 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77808.log.gz 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.71914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78976.log 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80734.log 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.25092.log.gz 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.47134.log.gz 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.78976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41234.log 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.80734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48904.log 2024-09-12T16:57:32.965 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.43594.log.gz 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.41234.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78976.log.gz 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71914.log.gz 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48314.log 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.48904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25044.log 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.48314.log: gzip 91.3% -5 -- replaced with /var/log/ceph/ceph-client.0.80734.log.gz --verbose 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr: -- /var/log/ceph/ceph-client.0.53624.log 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41234.log.gz 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63654.log 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68374.log 91.6% 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.48904.log.gz 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.53624.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25044.log.gz 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.63654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31210.log 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.68374.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48314.log.gz 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30620.log 2024-09-12T16:57:32.966 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.31210.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53624.log.gz 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86044.log 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60704.log 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.30620.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63654.log.gz 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.86044.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68374.log.gz 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56574.log 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64834.log 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.60704.log: /var/log/ceph/ceph-client.0.56574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29265.log 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.64834.log: 91.3% 91.7% -- replaced with /var/log/ceph/ceph-client.0.31210.log.gz 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35334.log 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.86044.log.gz 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29265.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30620.log.gz 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.56574.log.gz 2024-09-12T16:57:32.967 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.35334.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29265.log.gz 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59524.log 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60704.log.gz 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81324.log 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87224.log 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.59524.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35334.log.gz 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64834.log.gz 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.81324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46544.log 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.87224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82504.log 2024-09-12T16:57:32.968 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70734.log 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.46544.log: /var/log/ceph/ceph-client.0.82504.log: gzip 91.4% -5 -- replaced with /var/log/ceph/ceph-client.0.81324.log.gz --verbose 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr: -- /var/log/ceph/ceph-client.0.37104.log 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87224.log.gz 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.59524.log.gz 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.70734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34744.log 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82504.log.gz 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.37104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53034.log 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.46544.log.gz 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49494.log 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.34744.log: /var/log/ceph/ceph-client.0.53034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52444.log 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.70734.log.gz 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.37104.log.gz 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.49494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50084.log 2024-09-12T16:57:32.969 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.52444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34154.log 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34744.log.gz/var/log/ceph/ceph-client.0.50084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58344.log 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.53034.log.gz 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49494.log.gz 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.34154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74864.log 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.58344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61884.log 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52444.log.gz 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.74864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78392.log 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62474.log 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.61884.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.50084.log.gz 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34154.log.gz 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.78392.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58344.log.gz 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.78392.log.gz 2024-09-12T16:57:32.970 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74864.log.gz 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.62474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80144.log 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25068.log 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.80144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75454.log 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79560.log 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.61884.log.gz 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25068.log.gz 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.75454.log: 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62474.log.gz 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80144.log.gz 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75454.log.gz 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87814.log 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.79560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83684.log 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.79560.log.gz 2024-09-12T16:57:32.971 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.87814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29313.log 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54214.log 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.83684.log: /var/log/ceph/ceph-client.admin.29313.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29313.log.gz 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.54214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69554.log 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2%/var/log/ceph/ceph-osd.1.log: gzip -- replaced with /var/log/ceph/ceph-client.0.87814.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.39464.log 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.69554.log: gzip 91.3% -5 -- replaced with /var/log/ceph/ceph-client.0.83684.log.gz --verbose 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr: -- /var/log/ceph/ceph-client.0.88412.log 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.39464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66014.log 2024-09-12T16:57:32.972 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54214.log.gz 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.88412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83094.log 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6%/var/log/ceph/ceph-client.0.66014.log: -- replaced with /var/log/ceph/ceph-client.0.69554.log.gz 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.39464.log.gz 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70144.log 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.83094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73684.log 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.66014.log.gz 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42414.log 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.70144.log: /var/log/ceph/ceph-client.0.73684.log: 93.5% -- replaced with /var/log/ceph/ceph-client.0.88412.log.gz 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83094.log.gz 2024-09-12T16:57:32.973 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70144.log.gz 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.42414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51264.log 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40054.log 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73684.log.gz 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.51264.log: gzip 91.6% -5 -- replaced with /var/log/ceph/ceph-client.0.42414.log.gz --verbose 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr: -- /var/log/ceph/ceph-client.0.63064.log 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.40054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38874.log 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.63064.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.51264.log.gz 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60114.log 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40054.log.gz 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45954.log 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.38874.log: /var/log/ceph/ceph-client.0.60114.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.63064.log.gz 2024-09-12T16:57:32.974 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43004.log 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.45954.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.38874.log.gz 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60114.log.gz 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32390.log 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr:gzip 91.7% -- replaced with /var/log/ceph/ceph-client.0.45954.log.gz -5 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr: --verbose -- /var/log/ceph/ceph-client.admin.25020.log 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.43004.log: /var/log/ceph/ceph-client.0.32390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76044.log 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25020.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.25020.log.gz 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55394.log 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.76044.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43004.log.gz 2024-09-12T16:57:32.975 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.32390.log.gz 2024-09-12T16:57:32.976 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30030.log 2024-09-12T16:57:32.976 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61294.log 2024-09-12T16:57:32.976 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.55394.log: /var/log/ceph/ceph-client.0.30030.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55394.log.gz 2024-09-12T16:57:32.976 INFO:teuthology.orchestra.run.smithi151.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.76044.log.gz 2024-09-12T16:57:32.983 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81914.log 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.30030.log.gz 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.61294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76634.log 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.81914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57754.log 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.76634.log: 91.4% 91.6% -- replaced with /var/log/ceph/ceph-client.0.76634.log.gz 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.81914.log.gz 92.8% -- replaced with /var/log/ceph/ceph-client.0.61294.log.gz 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67194.log 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.57754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84274.log 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.67194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54804.log 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.84274.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57754.log.gz 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.67194.log.gz 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84274.log.gz 2024-09-12T16:57:32.984 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45364.log 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.54804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57164.log 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.45364.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.57164.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54804.log.gz 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45364.log.gz 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57164.log.gz 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71324.log 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67784.log 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.71324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50674.log 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.67784.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71324.log.gz 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67784.log.gz 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44184.log 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.50674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58934.log 2024-09-12T16:57:32.985 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.44184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29289.log 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.58934.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50674.log.gz 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44184.log.gz 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.58934.log.gz 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36514.log 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35924.log 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr: 87.4%/var/log/ceph/ceph-client.0.36514.log: -- replaced with /var/log/ceph/ceph-client.admin.29289.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.47724.log 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.35924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74274.log 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.47724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31800.log 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.36514.log.gz 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.74274.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.35924.log.gz 2024-09-12T16:57:32.986 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32980.log 2024-09-12T16:57:32.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.31800.log: 92.3% -- replaced with /var/log/ceph/ceph-client.0.47724.log.gz 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37694.log 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.32980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84864.log 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.37694.log: 90.6% 91.7% -- replaced with /var/log/ceph/ceph-client.0.31800.log.gz 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.32980.log.gz 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74274.log.gz 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72504.log 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.84864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77224.log 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.72504.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.37694.log.gz 2024-09-12T16:57:32.991 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33564.log 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.77224.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.77224.log.gz 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84864.log.gz 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29337.log 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.33564.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44774.log 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.72504.log.gz 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5/var/log/ceph/ceph-client.admin.29337.log: --verbose -- /var/log/ceph/ceph-client.0.65424.log 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr: 86.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68964.log 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29337.log.gz 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.44774.log: /var/log/ceph/ceph-client.0.65424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38284.log 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.33564.log.gz 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.68964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73094.log 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44774.log.gz/var/log/ceph/ceph-client.0.38284.log: 2024-09-12T16:57:32.992 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65424.log.gz 2024-09-12T16:57:32.995 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68964.log.gz 2024-09-12T16:57:32.996 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38284.log.gz 2024-09-12T16:57:32.996 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40644.log 2024-09-12T16:57:32.996 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66604.log 2024-09-12T16:57:32.996 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.73094.log: /var/log/ceph/ceph-client.0.40644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86634.log 2024-09-12T16:57:32.997 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.66604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29361.log 2024-09-12T16:57:32.997 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.86634.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.73094.log.gz 2024-09-12T16:57:32.997 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64244.log 2024-09-12T16:57:32.997 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40644.log.gz 2024-09-12T16:57:32.997 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29361.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.66604.log.gz 2024-09-12T16:57:32.997 INFO:teuthology.orchestra.run.smithi151.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29361.log.gz 2024-09-12T16:57:32.997 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86634.log.gz 2024-09-12T16:57:32.998 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.64244.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.64244.log.gz 2024-09-12T16:57:33.021 INFO:teuthology.orchestra.run.smithi151.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T16:57:33.115 INFO:teuthology.orchestra.run.smithi122.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T16:57:33.847 INFO:teuthology.orchestra.run.smithi151.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T16:57:33.914 INFO:teuthology.orchestra.run.smithi122.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T16:57:33.916 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-12T16:57:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m1.024s 2024-09-12T16:57:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m1.240s 2024-09-12T16:57:33.916 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m0.046s 2024-09-12T16:57:33.991 INFO:teuthology.orchestra.run.smithi151.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T16:57:33.996 INFO:teuthology.orchestra.run.smithi151.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T16:57:33.998 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-12T16:57:33.998 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m1.092s 2024-09-12T16:57:33.998 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m3.245s 2024-09-12T16:57:33.998 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.184s 2024-09-12T16:57:33.998 INFO:tasks.ceph:Archiving logs... 2024-09-12T16:57:33.998 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685/remote/smithi122/log 2024-09-12T16:57:33.999 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T16:57:34.232 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685/remote/smithi151/log 2024-09-12T16:57:34.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T16:57:34.744 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T16:57:34.755 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T16:57:34.755 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T16:57:34.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T16:57:34.815 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T16:57:34.829 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T16:57:34.829 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:57:34.832 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:57:34.843 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T16:57:34.843 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-09-12T16:57:34.843 INFO:teuthology.orchestra.run.smithi122.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.116 -1.461 0.894 2024-09-12T16:57:34.843 INFO:teuthology.orchestra.run.smithi122.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.081 -1.002 0.858 2024-09-12T16:57:34.843 INFO:teuthology.orchestra.run.smithi122.stdout:*hv03.front.sepi 74.6.168.72 3 u 35 64 377 0.111 -0.947 0.876 2024-09-12T16:57:34.843 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:57:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T16:57:34.845 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-12T16:57:34.845 INFO:teuthology.orchestra.run.smithi151.stdout:+hv01.front.sepi 67.205.162.81 3 u 25 64 377 0.080 -0.155 0.580 2024-09-12T16:57:34.846 INFO:teuthology.orchestra.run.smithi151.stdout:*hv02.front.sepi 63.231.80.2 3 u 35 64 377 0.096 -0.229 0.254 2024-09-12T16:57:34.846 INFO:teuthology.orchestra.run.smithi151.stdout:+hv03.front.sepi 74.6.168.72 3 u 31 64 377 0.091 -0.008 0.375 2024-09-12T16:57:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:57:34.847 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T16:57:34.856 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T16:57:34.857 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T16:57:34.865 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T16:57:34.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T16:57:34.883 INFO:teuthology.task.internal:Duration was 951.520936 seconds 2024-09-12T16:57:34.883 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T16:57:34.892 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T16:57:34.892 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T16:57:34.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T16:57:34.930 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T16:57:34.930 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-09-12T16:57:34.930 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T16:57:34.985 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-09-12T16:57:34.985 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T16:57:34.995 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T16:57:34.996 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T16:57:35.029 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T16:57:35.063 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T16:57:35.063 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T16:57:35.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T16:57:35.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T16:57:35.177 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T16:57:35.178 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T16:57:35.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T16:57:35.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T16:57:35.214 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:57:35.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:57:35.240 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-09-12T16:57:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-09-12T16:57:35.356 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:57:35.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:35.361 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T16:57:35.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:35.403 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T16:57:35.413 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T16:57:35.414 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685/remote/smithi122 2024-09-12T16:57:35.414 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T16:57:35.437 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902685/remote/smithi151 2024-09-12T16:57:35.437 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T16:57:35.470 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T16:57:35.471 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T16:57:35.477 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T16:57:35.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T16:57:35.522 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T16:57:35.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T16:57:35.533 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T16:57:35.534 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T16:57:35.536 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T16:57:35.540 INFO:teuthology.orchestra.run.smithi122.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 16:57 /home/ubuntu/cephtest 2024-09-12T16:57:35.559 INFO:teuthology.orchestra.run.smithi151.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 16:57 /home/ubuntu/cephtest 2024-09-12T16:57:35.560 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T16:57:35.577 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T16:57:35.607 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 951.5209357738495 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T16:57:35.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:57:35.701 INFO:teuthology.run:pass